I would remove it, if it got chewed up in the gearbox or one of the chains I would not want little rubber pieces in my oil that could possibly end up in a blockage and engine failure. If you get it out, you don't have to worry.... I wouldn't leave it in there. It most likely will end up in the sump, but I just wouldn't risk it myself...