On my CB750, with euro bars, the tubes would hit at about 1 inch or less. This is more than enough to affect the handling, good or bad depending on what you are going for.
If you're trying to lower more for looks, you'll likely need to look hard at the bars, and maybe use clipons.