It’s easy to think you’re all the way through the bushing when you’re not quite. As said earlier, a small cut in the swing arm isn’t serious, so be brave, cut all the way through!
Once you’re sure you are through, heat it till it’s almost glowing and then try to drive, with a big hammer, a small chisel in behind the bushing. It will then collapse in on itself, or you can cut it out piece by piece with the chisel.
Persevere, you’ll get there