Seems like RIAA finally won the fight; AllOfMp3 has shut down.
… but there is a new site called Mp3Sparks up and running. Mp3Sparks looks like a clone of AllOfMp3 and is owned by the same company. They claim to accept credit cards so it is possible to actually buy from them. That was a problem AllOfMp3 had at the end since none of the credit card ompanies wanted to do business with them.