You need to check logs in Antispam module to know the reason. For now I suspect that when you are on the phone, then different IP is used, which is flagged is some spammers' database.