The only way to prevent spam from destroying the hCard (or uploading vCards to the internet!) is by destroying spam first!
There is a second solution: Make GnuPG signing and encryption mandatory to successfully email people. This would reduce the amount of spam as it would be administratively more difficult to send spam, and it would be more processor intense to send lots and lots of emails.
