Everything went back together pretty easy.
Thanks MCRider for the recommendation on heating the swingarm.
I cleaned up the collar ends with 00 steel wool, and then rinsed with carb cleaner. I also lightly sanded the ID of the swing-arm with wet/dry sandpaper to clean-up some scratches I made when removing the old bushings.
I put both the new bushings and old collar in the freezer for about an hour. And then I "baked" the swing arm in the oven for 20 minutes at 170F - yes the wife was out of the house
I pulled the swingarm out of the oven, greased the ID, grabbed the new bushings out of the freezer, put a quick coat of grease on them as well, and they easily tapped in with light taps from a wood block. One of them did require more force after going half-way in, but I believe that was because of bump/score I made with the screwdriver when removing the old bushing (that I wasn't able to sand down all the way.)
Nice thing about heating up the swingarm, was once I got the new bushings in, they absorbed the heat from the swingarm and got pretty warm themselves. I then grabbed the old collar out of the freezer, generously applied grease, and it slid in with no problems (completely by hand).
Bolted everything back on - and so far so good. (I'll to a test rider later today.)
BTW, how does one measure swingarm play? I assume you have to unbolt the bottom of the shocks and loosen the chain. Even with just the swingarm on (no shocks or wheel) I couldn't really noticed any play (after putting the new bushings in). Not that it had any noticeable play before I replaced the bushings - I did this as more of a suspension tune-up measure.
I'm happy I did this maintenance, but all said, I'll be sending the next one to Hondaman as well.