I have some brass rod that is the right size to make an O-ring sealed "plug" that looks like the end of the starter for the CB750 engines. I could make a double O-ring seal that you could bolt from the alternator side, pulling up against the engine case from the starter's cave side.
Is there enough interest to bother?