There may be a crack or split in the brake drum. Remove the wheel, remove the brake assembly, clean the drum and examine the drum, with a magnefier if necesary. If it's cracked, that's your problem! Haven't heard of any fixes for it, other than replacement.
Bowhunter