It shouldn't be hard at all. If it is, you may want to consider new o-rings as it sounds like yours have hardened up substantially. They just press in snugly.
As Fred T said, using a bamboo skewer from the throat down is a good way to remove them.
There's a very helpful carb rebuild walk-through guide on the Yahoo CB400F user group for the CB400F carbs.