Luggage racks that I have, connect at the rear shock mount, the fender bolt, and either the grab bar, or the rear tail light. The grab bar is much preferred over the rear lamp mount, as the lamp mount transfers rack loads to the fender, which causes the fender to flex, and eventually bend then crack.
At least, that's been my experience with the Cb550s.
Cheers,