Have a look at this picture. It's the tensioner of my CB350 twin. I guess it goes without saying which is the new one...
The jockey wheel below is independent, while the wheel above forms a unit with the metal bracket. When I dismantled the engine I ordered both parts as a matter of fact. After all, they are just rubber wheels, and though the upper one seemed untouched I ordered it. I regret now, it costed 45 euros. Ouch!!
The jockey wheel was about 10 euros, much more affordable. The tensioner plunger presses on the metal bracket on the above wheel. The fact that it's untouched and the wheel below badly worn reassures my theory that the tension was not adjusted and the camchain was loose, therefore scraping the cylinder walls.
Raul