Ah, we all like to wax poetic about bikes, don't we?
I believe that *most* of the disdain around here about cafe bikes, aside from the generic trend of it being over done, comes from the majority of these things being turned into machines that are less capable than these bikes were originally, riddled with trendy-bullsh*t, for no other reason than vanity. On a well done bike, you rarely see someone hate on it because it was once stock.
People who build capable machines, and ride them like they were meant to be suffer the consequences of all the poorly done bikes out there. If there's more to your build than taking off the front fender and signals, putting on drop bars and a bump seat, then you'll probably get quite a bit of cred in the end.
There will always be the stock purists out there, but you're not starting with something that original, so it's probably a good platform for what you've got going, and it looks to me like you've got the experience to build something tasteful
My only advice is that if that tank is stock paint, and if it's in good shape, for the love of god, don't paint it.