I'm a bit fuzzy on what's on the bike and what's not. Did the bolt break off and leave the housing somehow stuck to the bike? If the housing is off, does any of the bolt show? How about a picture?
I'm sure other folks will chime in with actual suggestions, but I can say from experience that drilling out an extractor can be a serious pain. They're made of hardened steel and don't like to be drilled.