The compound might be some plumbers putty. It should be thoroughly cleaned out or it can get in the way of a good seal.
The piece can be removed by gently threading in a sheet metal screw, pulled out, and threads adequately cleaned before it is bled.
Yellow pipe tape can be used if needed, but if its cleaned well, it should seal.