All CB500/550 carb bodies from '71-76 are the same. The differences were in the jets, possibly needles, air screws, etc.
You should be fine swapping the parts around. Be sure to check/set the float height and bench sync the carbs while they're off the bike.