Yep, sounds like the regulator has crapped out, and the excess voltage has toasted the battery.
The starter is probably still good, but DON'T use it until you've sorted out the fried battery.
If the voltage is too low, then the current being drawn by the starter goes way up to compensate and that high current will kill your starter pretty soon.
So, step one, steal underpants. No wait, that's from South Park.
For real, step one, get a new regulator, step two, new battery, step three, RIDE!
-K