I think it may have backed off, or bearing is not seated.
Take it to a tool styore, buy 2 close fitting drill bits, put smooth end in reatainer. Then turn it carefully and clamp in a vise.. makes sure drills stay in..
Now turn the retainer like a steering wheel, or use a piece of 1x4 betwwen the drive lugs..