A unit of measurement that I have seen bandied about in discussions on polishing is Surface Feet Per Minute. So, let's say you're turning at 700rpm with a 6 inch diameter disc. C = pi * D so the circumference is 3.14159 * 6 inches or about 18 inches or 1.5 feet per turn, times 700 rpm = 1050 SFPM.
Now go to an 8 inch disc turning at the same speed. C = pi * D, 3.14159 * 8 = 25 inches or so, around 2.1 feet, times 700rpm = about 1470 SFPM.
So, assuming your buffer is strong enough to turn at the same speed with the larger buff, the effect is higher surface speed where the part meets the buff. However, since there's more leverage on a larger wheel you'll get more slowdown once you offer the part to the buff.
If you go too high on the speed, the compound will tend to liquify and fling off the wheel, plus the part can overheat easily. Also more chance of the part getting snatched from your hand. However the higher SFPM can give more aggressive polishing action.
Personally I stick with the disc size that the buffer/grinder is rated for. Your mileage may vary.
mystic_1