Your 650 is a DOHC motor, so it may be quite different from mine but I'll give you what I know.
Even when the carbs are running on a fresh rebuild and all adjustments have been done by the book, my bike is very picky until it is warmed up a little. I close the choke fully, start the bike, feather the choke until the bike idles at ~1500RPM for about a minute, then feather it down further to just above 1k. I'll ride off and fully open the choke maybe a mile down the road, if that.
But if I start the bike from cold and begin cracking the throttle right away it behaves like I've never maintained it. The 81-82 CB650s with CV carbs, at least, are not happy cold runners. They need to be warmed up some. I think a big reason is that the CV carbs rely 100% on healthy vacuum pressure, which relies 100% on both perfectly sealing valves and healthy piston rings. If you have worn rings and/or poorly seating valves, then those carbs simply do not behave as as optimally as they should. Synchronizing helps until the differences between cylinders is enough to outshine the sync screws. Hypothetically that's many many years and many many thousands of miles of riding, but everyone will be due for a top-end and carb rebuild eventually. Not saying yours is, but it isn't unheard of.
So, in short, make sure you do your maintenance. Sync your carbs and get their air/fuel mix just right. Then adjust idle off of that when the bike is at full operating temp.