Sapiens
Social phenomena

What is AI-generated misinformation?

Published June 1, 2026 · 4 min read

AI-GENERATED MISINFORMATIONA counterfeit you can't spot by eye.It copies the look of the real thing so well that surface inspection fails.REALAI FAKE?Same face, same voice, same message — the eye alone cannot tell the genuine from the fake.

Definition

Fake images, video, audio, or text auto-created by generative AI that can deceive people or damage a business.

At a glance

  • Spans deepfake video, cloned voices, fake photos, and convincing text, all now cheap and fast.
  • A direct fraud threat: in 2024, engineering firm Arup wired ~$25M after a video call with deepfaked executives.
  • People rarely catch it, spotting high-quality deepfakes only ~24.5% of the time.
  • U.S. AI-fraud losses are projected to climb from $12.3B in 2023 to $40B by 2027.

Why it is different now

Misinformation is false info that spreads; disinformation is the deliberate version[1]. The tool changed it. Generative AI now makes a realistic fake video, clones a voice from a short clip, or writes a flawless scam email in seconds, for almost nothing, so any fraudster can impersonate your CFO or fabricate news about you[4]. Deepfake files jumped from ~500,000 in 2023 toward 8 million in 2025[2].

How it hits a business

The costliest form is impersonation: scammers use deepfaked audio or video of a leader to order a wire or data, often live on a call[3]. Arup lost ~$25M; an energy firm sent ~$243,000 to a voice clone of its parent CEO[2]. AI also drives fake reviews, cloned sites, and tailored phishing.

How to protect yourself

Set a code word for urgent money requests. Treat urgency and secrecy as red flags. Detection software is unreliable, so use it only as backup[5].

Bottom line

You cannot win by looking harder, so build a verification habit and slow urgent requests until they prove out.

References

  1. Deepfakes and the crisis of knowing. UNESCO www.unesco.org
  2. Deepfake Statistics 2025: The Data Behind the AI Fraud Wave. DeepStrike deepstrike.io
  3. How to Navigate the New Frontier of Fraud in the Era of Generative AI. American Bar Association www.americanbar.org
  4. AI-Generated Media Drives Real-World Fraud, Identity Theft, and Business Compromise. Trend Micro newsroom.trendmicro.com
  5. Deepfake disruption: A cybersecurity-scale challenge and its far-reaching consequences. Deloitte www.deloitte.com

Comments

Questions, corrections, and links welcome. Be specific and civil.

  • Loading comments…