If they were hard to be removed, probably they were just glued into place as you have been directed.
I bought from Honda the whole carb kit for about 10 euro each. It includes the bowl gasket, idle screw o-ring, jets o-ring, the rubber plug etc.
Maybe I'm stating the obvious, but make sure you are inserting the o-ring in the right groove. The other one is for the bracket, that as you said, is pressed by the bowl.
Raul