You have the dreaded "dead ahead detent". Bearings are trash. The forks should move smoothly left to right, stop to stop with NO detectable impedence.
as you ride, 95% is straight ahead, often slightly countersteering against the crown in the road. The bearings beat themselves into a spot right there. You may not feel it but it is there. As you transition into turns, or make small corrections you have to fight against that detent, into and out of the dents.
At the extreme, you may steer against the dent, then fall back into the dents, then steer out again, then relax back into the dents. All at a micro level but its happening. This sets up the beginning of an oscillation that could be annoyiing or severe.
With tapered bearings, they are SO much better, so much more surface area over which to spread the loads, that you'll never beat those dents into them again and your steering will become amazignly smooth.