The hole that feeds gas to the diaphragm has a check valve in it and so does the hole on the exit side of the pump.
When the pump sucks gas in, the out put valve should shut. When the pump feeds gas out, the inlet valve should shut.
If you can push fluid both ways through either of those passages, you know why the pumps doesn't.
Cheers,