Definitely replace, even if it looks like it is OK.
Tires don't have to be expensive. I have used Shinko and Kenda tires on two different bikes, both offer tires in sizes for our bikes in the $50 each range that are perfectly adequate for day-to-day riding and even the occasional trip down the winding road.