The piece of aluminium you have is too thin for the brake stay, 6061T6 is a good grade of material to use, very similar is 6082T6 which I use here in South Africa. If you look at the Honda GP racer bikes of the 60's they all used aluminium brake stays. A better material to use would be a 7075 T6 grade, much stronger than mild steel.
If you look at modern superbikes a fair few of the components are now aluminium, trees, steering stems, calliper brackets, handlebars to name a few, on our old bikes these parts were in steel.
To get back to your question, I would use a piece of 7075T6 , 6mm thick for the brake arm.
Hope this helps.
Kevin