Even if you wanted to use it, 4 turns out is too many. Yes, turning it in until the head of the screw is so flush you can't turn it any more is to the off position. That may be good enough for you, you may want to try it.
And you may still have other problems as well, like the CS seal.
To plug it, remove the 17mm nut that the adjuster screw goes through. THe adjuster will come out with it. The adjuster that you can't see is actually a bit of an affair, there is a small plate that squishes a rubber plug. All that stuff comes out.
Run a bolt in that is long enough to cover the hole where the oil comes out. It is in the CS about centered in a spot about halfway under the sprocket. You can't see it unless you take the sprocket off. THe length of an "E" size spark plug is likely the length you need. I've heard that you can break the ceramic top off a spark plug and run that in to plug it. Use the tabbed lock washer to hold it there.
Others have removed the sprocket and threaded a bit of rubber, like an O Ring that has been cut, into the hole, that trick is on this site soemwhere, maybe search Tricks and Tips.