Weaponizing Trust: How Threat Actors Use GenAI and Deepfakes to Breach Digital Security

Date:

Before Article Content · 728×90
Advertise Here

Trending

- Advertisement -

On an April afternoon, Sarah was scrolling Instagram as she came across a familiar face. The video featured Peter Hargreaves the co-founder of UK’s biggest investment platform, Hargreaves Lansdown. The advert promoting Whatsapp communities for exclusive stock picks seemed lucrative. Within minutes, Sarah shared her number and became part of a Whatsapp group. An investment app recommended in the group was downloaded. She was happily walking the road to riches aided by a “mentor” who told her when to buy which stocks.

Treading cautiously, Sarah started investing small sums- just £50 at first. With the app showing decent profits, she added to her portfolio until she earned a tidy £300 in profits on a total investment of £2000 in a mere two weeks. Then came the moment of truth – Sarah couldn’t transfer the profits to her bank account. She continued to pay the supposed taxes, regulatory fees and withdrawal charges only to find her “mentor” vanish and the investment app stop working.

Boom, EVERYTHING was gone as if it never existed. Sarah lost about £4000 by believing a deepfake of Peter Hargreaves. If not for the well-known stock picker’s face, Sarah wouldn’t have fallen for an investment scam. She was just one among the possibly hundreds of victims. Cybersecurity firm Kaspersky in it’s blog noted that more than 600 advertisements featuring deepfakes of Peter Hargreaves were found on the Meta platform.

The deepfake phenomena

Deepfakes are fake digital media – audio, video and images that are generated using Artificial intelligence(AI). Deepfake fraudsters ride on credibility of real people often public figures to manipulate, cheat or mislead others into action. Generative AI is the technology that enables cybercriminals to create hyper-realistic images, videos or audio to trick people online.

Over the past few years, Gen-AI has been utilized by bad actors for a range of objectives right from crypto currency scams, investment frauds, election manipulation and social media misinformation campaigns. GenAI has also enabled deepfake pornography on a massive scale. GenAI tools like Nudify apps that instantly convert innocuous Instagram posts into outrageous nude pics have become a nightmare for female social media users. Social media is flush with a slew of deepfake porn posted online every minute. While deepfake porn harms reputation, deepfake frauds that inflict financial losses have become ubiquitous.

- Advertisement -

In an incident in Canada, attackers began running an ad in the name of BMO Belski. Most Canadians identify the abbreviation “BMO” as Bank of Montreal and Brian Belski as the famous investment strategist at BMO. By assuming BMO Belski as the official financial advice from the oldest bank in Canada, unsuspecting Canadian users invested, and lost money.

Deepfakes frauds in India

In India too, there has been a massive spike in deepfakes. Deepfake videos of Bollywood actress like Rashmika Mandana and Alia Bhatt introduced Indians to this phenomena a few years ago. Later, deepfakes became routine as everyone right from Aamir Khan to Ranveer Singh started running to the police demanding action on the fake content circulating online. Journalist Rajat Sharma was so tired of finding his own viral deepfakes recommending weight-loss treatment and diabetes medicine that he approached the court to stop it for once and for all. Member of Parliament Hema Malini expressed concern about deepfakes and raised it in Parliament. Nothing provided respite. It appeared that wealth couldn’t protect you from deepfakes. Business leaders like Warren Buffet and Tim Cook are deepfaked in crypto currency scams. Tech genius Elon Musk was among the most deepfaked men. Political power couldn’t protect you either. Deepfakes of US President Donald Trump and Indian PM Narendra Modi have become too common in social media.

It’s not the rich-and-famous alone who are bearing the brunt of GenAI. A deepfake account created by a jilted lover against Archita Phukan aka Babydoll Archi made international headlines last month. It became a social media sensation that humiliated an innocent woman by projecting her as a porn alongside Kendra Lust. In November last year, Bengaluru residents were duped of Rs. 95 lakhs by deepfake videos of Narayana Murthy and Mukesh Ambani. Last week, a Pune man lost Rs.43 lakhs to share trading fraud after believing a deepfake of Narayana and Sudha Murthy. The Indian government’s massive awareness campaign against deepfakery and digital arrest suggests that huge number of ordinary citizens are falling prey daily. The cases are likely underreported for fear of embarrassment.

The Gen-AI threat to digital trust

The growth of deepfake menace have created a corresponding increase in trust deficit in the digital world. Over 5.07 billion people, or 62.6% of the world’s population, use social media platforms for communication and information access. On 27 June 2025, Nature published a study that concluded “Following news on social media boosts knowledge, belief accuracy and trust.” The surge of deepfake content posted on social media without any inhibitions threatens the accuracy of information online and jeopardizes the trust in social media platforms.

- Advertisement -

If the next video call with your colleague can plausibly be a criminal disguised in deepfake or the next Instagram video of Virat Kohli promoting a product isn’t the “real Kohli”, users are constantly on edge unable to separate fact from GenAI fiction. A shocking detail: Deepfakes continued to circulate in Meta platforms i.e Facebook, Instagram and Whatsapp even when the public figure say Martin Wolf was enrolled in Meta’s new face recognition system designed to automatically detect and delete such content. It’s a sign that Big Tech’s like Meta and X haven’t quite figured out how to stop deepfake mess eroding faith in their platforms.

Installing deepfake detection tools at the system level is the only viable solution today. Deepfake awareness campaigns and AI detection capabilities should reach every nook and corner of the digital world. Until then, the likes of Rajat Sharma and Martin Wolf have no option but to continue crying hoarse that esoteric medicines and dubious investment schemes are being sold by their deepfake avatar. Your reality is at crosshairs as threat actors continue to weaponise GenAI and breach digital trust.

Stay ahead of the curve, every day.

A daily briefing covering news, interviews, and the trends driving the world forward. Curated for readers who want news, not noise.

We don’t spam! Read our privacy policy for more info.

- Advertisement -
Ankush Tiwari
Ankush Tiwari
Ankush Tiwari Founder and CEO of pi-labs

More Latest Stories

More Articles

StationPC PA100 Pro: The Next-Gen Portable NAS Storage Solution for On-the-Go Professionals

The next-generation PocketCloud (model: PA100 Pro) portable NAS from StationPC has officially been unveiled, following its launch on June 30, 2026. Positioned as a...

The Borderless Startup: FinStackk CGO Nithin Reddy on Simplifying Financial Operations for Global Founders

Speaking with TechGraph, Nithin Reddy, Co-founder & Chief Growth Officer at FinStackk, discussed how incorporating a business in the US has become increasingly accessible for global startups, while managing financial operations and regulatory compliance across fragmented systems continues to create operational complexity, and how...

The New Collateral in Lending Isn’t an Asset; It’s a Citizen’s Consent

Old habits die hard, and few habits in Indian finance have died harder than...

Why Do Most Enterprise AI Projects Never Make It Past the Pilot Stage?

Conceiving, developing, and implementing AI projects an optimum mix of creativity, dedication, and perseverance.

The Responsiveness Economy: DashLoc’s Sumit Singh on Redefining Customer Conversations with AI

Speaking with TechGraph, Sumit Singh, Co-Founder & CEO of DashLoc, discussed how businesses are...

How Generative AI Could Reshape Airline Distribution and Travel Retailing

Airline distribution is entering a new phase. For decades, the industry has relied on...

AI That Serves: Impact AI Foundry’s Arjun Balaji on Making Artificial Intelligence Accessible for Nonprofits

Speaking with TechGraph, Arjun Balaji, Co-Founder and Programme Director of Impact AI Foundry, discussed...

How AI Is Building India’s Next-Generation Emergency Mobility Infrastructure

Imagine this. A customer is stranded on the roadside due to a vehicle breakdown...

How Mixed-Use Ecosystems Will Shape the Next Decade of Urban India

India's urban growth story is entering a decisive phase. By 2036, nearly 600 million Indians are expected to live in urban centres, which are...

Human-in-the-Loop: Why AI in Education Still Needs the Professor

Generative AI is rapidly entering classrooms, boardrooms, and training programs. Yet a critical question...

Why Indian Men Are Quietly Moving Away From Fast Fashion

When a man opens his wardrobe, stares at a rail of clothes, and realises...

Simple Habits That Keep Your Car Running Longer

Keeping your car running longer doesn’t require expert-level knowledge—it comes down to building smart...

Why Indian Business Still Runs on Spreadsheets and WhatsApp for Treasury

India is home to one of the world's fastest-growing fintech ecosystems, projected to reach...

The New Age of Digital Assets: How Blockchain Is Redefining Financial Inclusion

Innovation is changing the nature of economic participation and making it more inclusive, especially with the development of blockchain technology. Blockchain technology introduces a...

The Efficiency Gap That Will Reshape Finance by 2030

Here is the number that should be keeping every CFO awake right now: 97% of finance teams have adopted AI. Yet 45% of financial leaders are still spending more than 60% of their time on manual tasks. That is not a technology problem. That...

The rise of tier-2 GCCs: How digital infrastructure is redefining India’s technology talent map

For the better part of two decades, India's Global Capability Centre (GCC) story was...

Nexchain AI Maps Its Final Path to Launch as $0.06 Token Presale Window Nears Its Close

Like a building project that moves from design to final inspections, the Nexchain AI...

Nexchain Rebuild Story Puts AI Layer 1 Development Back on the Crypto Presale Radar

Nexchain AI has brought its rebuild story back into focus as its AI Layer...

From IP to Global Leadership: Aum Ventures’ Chetan Mehta on India’s Next Deeptech Breakout Companies

Speaking with TechGraph, Chetan Mehta, Founding Partner at Aum Ventures, outlined why deeptech remains...

How Machine Learning Is Redefining Short-Term Borrowing for Tech-Savvy Consumers

Short-term lending has long relied on limited snapshots of a borrower’s history. That approach...

Why Players Buy LoL Boost and How the Process Works

If you’re researching why players buy lol boost, you’re usually trying to understand two...

India’s Air Crisis Needs a Deeptech Answer, Not a Consumer Gadget

Twenty years ago, an air conditioner in an Indian home was a luxury. Today...

India’s Cloud Cost Crisis: Why Startups Are Rethinking Their Tech Stack

Over the last ten years, startups in India have experienced an incredible boom driven...

Redrob AI Launches Professional AI Platform for India’s Workforce

In a bid to help students and professionals navigate an increasingly fragmented digital work...

Simple Habits That Keep Your Car Running Longer

Keeping your car running longer doesn’t require expert-level knowledge—it comes down to building smart...

“Budget should focus on reducing taxes on capital gains,” Says Abhishek Gupta of Hex N Bit

Speaking in the upcoming Union Budget 2021, Abhishek Gupta, Founder, and CEO, Hex N...

“China is a Global thief” Rep. Tom Rice on Uyghur Forced Labor Prevention Act

Speaking at the House on Uyghur Forced Labor Prevention Act, Rep. Tom Rice (R-SC)...

Nexchain Publishes New Roadmap as $0.06 Token Stage Continues

Nexchain has unveiled its updated development roadmap, providing the community with a clearer view...

Why Startups Are Turning to Virtual CFOs for Smarter Growth

​For a long time, finance leadership in startups followed a predictable path. Founders managed...

Why Indian Business Still Runs on Spreadsheets and WhatsApp for Treasury

India is home to one of the world's fastest-growing fintech ecosystems, projected to reach...

Key differences between a burner phone & prepaid phone

You may have heard both terms mentioned when it comes to protecting your identity....

Alphabet Discloses $2.14 Billion in Public Equity Holdings as of June 30

Alphabet Inc. disclosed $2.14 billion in equity securities held across 39 positions as of...

India to generate $100 bn from telephonic investments

India expects to attract $100 billion in investments in the telecom sector, a union...