Yup, it is under some decent spring pressure so be ready.
You'll need to get the front end well supported to do pull the caps so while you are at it (with the front end a little off the ground) move the bars back and forth from full lock left and right. Look for the bars to kind of fall into a notch or drag at the middle. This indicates worn steering bearings, which will cause a vibration.
If you do as proposed, and you feel the "detent" in the steering as you pass thru dead ahead, and I'll wager if youre bike has more than 10,000 miles on it you will, your bearings are shot. Obviously you can still ride it. But on a crowned road for example, the steering will want to fall into that detent, and you will steer out of it to keep going straight. All this happens on a very imperceptible level, but its happening. This back and forth can initiate a wobble and other weird feelings in the handling of the bike.
The stock balls and races steering bearing are not up to the beating. Most of us upgrade to tapered roler bearings at the first opportunity.
As to your fork cap question, if the bike's front end is unloaded, the cap nut will push up a slight amount once it is unthreaded, 1/2 inch or less. Just keep your hand on it and it will be fine. If you don't unload the front end that nut will shoot thru the ceiling. Or your face if that is encountered first.
So, move the bike into the yard, remove the drain bolts (one side at a time) and pump the forks. Have everyone stand back as the oil will squirt several feet to either side. If you've got help, you can do it indoors. Someone must be tasked with keeping a container at the drain plug while the other pumps the fork. Remember the oil will come out under pressure upon each pump. Roll back indoors, leave the drains out and something underneath to catch the drippings overnight.
Loosen the cap nuts a full turn, you'll want to do that while the bike is stable, then jack up the front end, remove them the rest of the way, and proceed with refilling.