Hey Mitch,
I'll give you my two cents since I have the same bike/carbs. I've had two sets of PD46A's now, the set that came on the bike and a set I picked up on eBay to learn how to take them apart and adjust them without screwing with a functioning motorcycle.
Interestingly enough, the set I purchased off of eBay had 42 pilots and a jet needle for a CB500 (which is a slightly richer needle)....Not sure which needle is in my installed carb bank; but I'll check in a month or so when I clean them up for the winter.
I changed out my stock pilot jets for 42s in my current installed carb bank (up from 38s) because the engine seems to like it a little better and it doesn't run so lean.
My only engine modification is a motogp werks 4-into-1 pipe, which is a pretty open pipe, that I'm running with the stock airbox and stock paper filter.
My jetting is 42 pilots, 95 main (up two from stock), and raised the needle clip from the 3rd clip from the top to the 2nd from the top, air screw turned out 1.5 turns, floats at 14.5mm. If it's helpful to anyone reading this later, I'm in Atlanta so at about 1,000 feet of elevation.
My bike runs perfect. Plug chops confirm I'm not lean or rich and the pulls hard at full-throttle with no flat spots...Based on this, your 105 mains sound really big for a regular 4-into-1 exhaust, even with pods, 6 sizes up from stock sounds like too big of a jump but I'm just speculating....I don't suppose you've looked at your spark plugs?