I've had 2 of these in recent years. The first one was a [dying] Dyna S ignition that was making weak spark. It caused the intake tract to be a little bit 'wet' from unburned fuel, and when warmed up it would hang about 2200 RPM until I quick-killed it with the Run-Off switch (off and back on real quick-like), then it would idle until the next time.
The second one was spookier: in the end it turned out to be the too-skinny O-rings on the mainjets, which came in the carb kits. They were letting fuel sneak past them each time the throttle was open enough to start the mainjet circuit (about 3500 RPM or so), after which it would hang at 2000-2500 RPM, wandering up and down. If left long enough, it would finally use up the wetness and the idle would drop (maybe 2 minutes of fast idle time). Since then, this has happened on a CB350 (similar mainjets).
The O-rings in the kits are 1.2x4mm, too skinny: they should be 1.4x3.9mm. This prevents them from blocking fuel: it sneaks past the O-rings, unmetered, and ends up in the venturi when it's not supposed to be there.