If you remove the adjuster, the A pad will continue to withdraw into the caliper from road bumps and such. After an extended period of riding you won't know how far the A pad has withdrawn. Then when you go to grab some brake you will have to squeeze the lever into the grip much further, maybe all the way, and then double pump the lever to finally get some brake.
This is a safety issue and i would highly recommend that you leave the adjuster screws in place and properly adjust them. The amount of the gap, provided by proper adjustment, about 6 thou i think, is all that you should have to overcome with lever travel, before you get braking force.