I guess you're just misunderstanding the concept of the key. A modifier key is only modifying when you press something at the same time. So when you do alt-a, that's a modifier; when you just press and release, it does something else. Quite simple, I never had a problem with it.