When I took mine out I butchered it by trying to put a screw into it. I thought I would just pull the thing out by the screw at that point. That didn't work, but it did give me something to grab on to with the needle nose pliers. I just pulled it out with the pliers after that.
Be careful not to damage the shaft while performing this gyration.