I remember fixing loose shifter drum pin plates on 400 and 350/4 bikes. They loved the constant shifting, but broke springs and loosened the screw that holds the round plate that holds the drum pins down. Symptoms were similar to what you're describing, so check that screw. Some of them did not get the little chink in them that kept them from working loose, or some worked loose anyway. Chink it down twice after you fix it, in any case.