Alright so an update on this. I finally had enough of it and brought it to a local shop to see if they could find anything wrong. I can't believe I never noticed this being that I had the valves in and out of the head several times. But All of the exhaust valve guides are extremely worn. What they believe this causing is intermittent compression, which is why that doesn't show up in a compression tester.
I pulled the head off my other running motor and brought it to them so they could throw it on and see if actually runs. I have attached a video showing how bad the wear is on the guides, he hadn't pulled the intakes so not sure if they were this bad but its likely.