Was that torque on a thread in the aluminum?
Do you have a different figure for torque on a nut, onto a stud, threaded into the aluminum?
(I figure that would be just the shear strength of the aluminum threads. May or may not be different; could just avoid wear.)
Generally speaking, about 85% of the torque on a fastener goes to overcome friction, and the remainder goes to adding clamping force. Friction is split between friction between the nutface (or bolt face if tightening the bolt side), and thread friction.
Clamping force (pullout force), is determined by tightening torque, minus the nut face friction, and thread friction. Then you multiply by the pitch. This is a pretty long equation, so for zinc plated steel fasteners of common pitches, its often simplified to T=KFd(1-L/100). This is approximate, but its within the error factor of most torque wrenches for zinc plated steel.
For a great quality thread in soft aluminum, I would say 4NM for well lubricated threads. But given the quality of some of these tap jobs, I would say 3.5NM to be safe. A helicoil could probably go to 5NM. On my last pack, I did 3.5NM, which felt pretty close to the limit, the last 10 degrees didn't seem to be increasing in torque in the same linear fashion, which tends to make spidey senses tingle.
So the interface materials do matter, especially for dry threads. In this case, you would want to secure the stud with a threadlocker, and torque the nut itself.
At low torques, friction isn't as linear, and for materials like stainless, it can be "sticky". To make the calculations simpler, its best to lubricate the threads. A threadlocker serves as a basic lubricant at low torques (prior to cure).