Welcome to the forums!
A quick search will turn up many previous threads on this subject, including what to do to plug up the hole left by the starter, but in all honesty, just removing the starter won't make a noticeable difference in weight. If you're doing other things to improve the performance of the bike or to save weight, then it can be one small step in the overall process, but won't do a whole lot by itself.