If it doesn't taste right leave it alone.
One of the biggest mistakes people drinking moonshine or any liquor neat is how they take a breath. Take the swig, while it is in your mouth breathe in through your nose, swallow and exhale slowly through your mouth. It makes a big difference in how you will taste liquor in the future