Google has taken legal action against a Chinese cybercrime group abusing its Gemini AI platform to execute a sprawling scam. The operation targeted hundreds of thousands of Americans with fraudulent messages and fake websites, inflicting millions in losses.

The group, dubbed Outsider Enterprise, crafted 9,000 counterfeit websites and over one million fraudulent URLs. They sent 2.5 million spam texts within two weeks, duping victims with links impersonating Google, YouTube, government agencies, and toll services. These messages used urgent warnings about account compromises or package tracking to bait users into handing over sensitive data.

Google joined forces with the FBI and major U.S. carriers—AT&T, T-Mobile, and Verizon—to halt the campaign. The telecom companies blocked malicious texts, while Google filed a restraining order to shut down the scam infrastructure. This marks Google’s first coordinated lawsuit focused on AI-enabled fraud.

The scammers reportedly used Gemini’s chatbot to generate custom code for fake sites. They also coordinated through Telegram to distribute phishing links. This operation alone pushed the boundaries of AI misuse, spawning a sprawling criminal network with automated tools.

Beyond this case, Google warns that Gemini and other AI models have become tools for not just scams but state-backed cyberattacks. Chinese advanced persistent threat groups use Gemini to automate reconnaissance, vulnerability testing, and malware development. Iranian hackers employ it for social engineering campaigns. Attackers even attempt to replicate Gemini’s reasoning by bombarding it with non-English prompts.

Google’s Trust & Safety teams have responded with targeted AI defenses and infrastructure shutdowns. The company stresses the need for stronger legislation, backing bipartisan bills aimed at curbing AI-driven scams. These include acts focused on scam prevention, protecting seniors, and establishing national strategies against such fraud.

Meanwhile, Google’s 2026 Scam Advisory highlights a surge in sophisticated phishing, cryptocurrency fraud, and mobile app extortion. Scammers exploit adversary-in-the-middle attacks, QR code phishing, and fake calendar invites to bypass security. Crypto scams drain wallets through fake token giveaways and deceptive mining software. Malicious finance apps demand excessive permissions, then extort victims.

Google urges users to avoid clicking suspicious links, scanning unexpected QR codes, or granting excessive app permissions. The company deploys predictive analytics and policy enforcement to disrupt emerging scam tactics. It also calls on the industry for a unified response as scams evolve across platforms and exploit trusted cloud services.

This saga reveals a disturbing truth: AI’s power to automate creativity also fuels crime at scale. As AI models like Gemini grow more capable, they become double-edged swords—tools for innovation and exploitation alike. Google’s fight is just beginning, underscoring the urgent need for vigilance and regulation in AI’s wild frontier.