If that flange hasn't broken off like mine did, see if you can break it off.
You should then be able to punch what's left into the inside of the tank & then tip it out through the cap hole. The worry will be that your new lining is now going to be flawed.
I'm debating just cutting the filter at its base and adding an inline filter.
A bit better than nothing, I suppose. But, keep in mind the fuel line is only fed by gravity pressure. Any air bubbles or circuitous routing can trap air bubbles in the line that will fight the fuel flow, particularly when the tank is low on fuel. (Air WILL get in there via design of the carb bowl fuel valve.)
Some have had difficulty meeting needs with the short and small area available in the fuel route. I recall one mention that a right angle type filter made the task less difficult.
I don't know of any inline filters that have the same metric sized nipples that are found on the tank and carbs. So, you will also have to invent a scheme to adapt different fuel line and different clamps to to the routing. Keeping screwdriver access to the clamps in the limited should be fun. Or, distroting the existing metric fuel line onto the inline filter chosen.
You also have to add a note to your routine maintenance schedule to clean or replace the filter periodically.