As I tightened the valve cover, I heard a crack. It took me a bit to find it, but the crack was in the threads of the valve cover. It would not tighten down. I'm just happy nothing broke off and went down in the case.
So....I guess I'm in the market for some new tappet covers...