At rest, fully charged, your battery should have at least 13.1v.
Measure the voltage at the following RPMs:
Rest
2,000
3,000
4,000
5,000
You should be seeing at least 13.4v by 3,000, and as much as 14.4v at 5,000. If not, what you are witnessing is not enough charge coming to the battery. It can also be indicative of a battery that is not "good" or poorly grounded. Does your battery NEG wire, run to the rear, upper bracket for the motor? And, does it connect directly to bare metal, or through paint/powder coat to the frame?
Trickle chargers only "maintain" batteries, they don't really fully charge them. To fully charge them, take your bike onto an open road, or highway, and run it above 5,000 RPMs for at least an hour. Upon returning home, test the voltage at the battery with engine and key off. Then, repeat that reading 2 hours later. If you don't have at least 13.1v, replace the battery.
If you have a standard lead acid battery, and ran it down to a very low charge, you may have evaporated some of the acid out. Sometimes, you can revitalize it, but I'd recommend replacing with a quality AGM type battery. Be sure it's at least a 12 Amp Hour rated battery.
These old Hondas don't produce any charge when idling, and virtually no extra charge below 3,000 RPMs. So if you are testing the bike in the garage, then you're draining the battery. Or, driving around town at low RPMs, especially with lights on, you've got a drain again.
See if some of that helps troubleshoot your woes. Take some pictures if you're unsure about what you have, or concerned about how you're wired up. Lots of folks here to help-