Google has launched a legal battle against a Chinese cybercrime network, Outsider Enterprise, which is accused of using its Gemini generative AI to automate scams. The group reportedly offers phishing-as-a-service and provides templates for creating fake websites that mimic major tech companies like Google and YouTube.

The scam campaign was so extensive that it resulted in over 2.5 million text messages being sent to Android users, with a significant spike of 55,000 messages within two weeks. Google has identified more than 9,000 fake websites linked to the network and tracked nearly 1 million URLs.

The criminal group used Gemini to create convincing phishing pages that tricked users into submitting personal data and banking details. Google worked with mobile carriers AT&T, Verizon and T-Mobile to block these messages, but its on-device scam detection feature in Google Messages also played a crucial role in reducing the success rate of phishing attempts.

The case highlights the ongoing challenge of combating AI-powered cybercrime, as both legitimate developers and malicious actors tap into advanced technologies. The race between innovation and security is never straightforward.