In case anyone needs to do this in the future, here's how I took it off.
The bearing is indeed pressed on there, I doubt it would've come off by tapping the inner race with a flathead screwdriver.
Went to home depot and got a 1 1/4" piece of black pipe. The fat part of the countershaft on the outside of the bearing is 1.3", the pipe inner is 1.38", so made 4 cuts on the end of the pipe and hammered it gradually to shrink. Spot welded it, which seemed overkill at first but I was glad I did it because it took some hammering to move the bearing.
Bearing came off in one piece because I could now apply force evenly on the inner race. It was tight about half way through the shaft, then it let go.
Hope I can get it back on there after I freeze the shaft