I wouldn't think it as the opposite, as you state, rather it's probably more equal. But my answer would be horse power and torque. For example, take my bike, a CB350F, and compare it to it's 2 cylinder brother, the CB350G(one I've ridden). They actually perform quite similarly. And the specs are very close, horse power the same, top speed within a mile or two, 1/4 mile(from the magazine tests) very close.
I would disagree with your statement regarding smoothness. A 4 is going to be smoother than a twin. A V-twin may seem smoother than most inline twins. This is because these inline twins are mostly single crankpin design, and are 180 degrees apart, meaning that both cylinders rise and fall at the same time, but as one comes to the top of the stroke to compress, the other comes to the top to exhaust.