Do I understand you have not sync'd the carbs and you are complaining about idle issues?
You have 4 motors tied together with a common crank. You don't think that one cylinder has enough power to make the other 3 motors turn faster?
Have you checked the head pipe temps during "idle". Do you notice any one head pipe hotter than the others? Do you think that associated "hot" cylinder might be working harder than the rest?
If you have PD carbs, the #2 cylinder doesn't have a slide height adjuster. It will be your master reference. You will adjust each of the other slides in turn to match the vacuum indications on your 4 station manometer. You may have to interactively readjust your idle knob to lower your idle RPM.
If your slides are out of adjustment far enough. One cylinder may drive the idle speed beyond the idle knob setting, making it ineffective.
All the MC shops I'm aware of, have made vacuum syncing carb checks a routine part of the 3000 mile tune up procedure, among the other items to be performed.
Cheers,