Use a magnet to pull them up. There has to be a dowel or else it wouldn't work. You have the shaft partially removed, right? I mean, you're not trying to slide it off the shaft while the shaft still captured by the case?
Sent from my iPhone using Tapatalk