Weaponizing Trust: How Threat Actors Use GenAI and Deepfakes to Breach Digital Security

Date:

Trending

- Advertisement -

On an April afternoon, Sarah was scrolling Instagram as she came across a familiar face. The video featured Peter Hargreaves the co-founder of UK’s biggest investment platform, Hargreaves Lansdown. The advert promoting Whatsapp communities for exclusive stock picks seemed lucrative. Within minutes, Sarah shared her number and became part of a Whatsapp group. An investment app recommended in the group was downloaded. She was happily walking the road to riches aided by a “mentor” who told her when to buy which stocks.

Treading cautiously, Sarah started investing small sums- just £50 at first. With the app showing decent profits, she added to her portfolio until she earned a tidy £300 in profits on a total investment of £2000 in a mere two weeks. Then came the moment of truth – Sarah couldn’t transfer the profits to her bank account. She continued to pay the supposed taxes, regulatory fees and withdrawal charges only to find her “mentor” vanish and the investment app stop working.

Boom, EVERYTHING was gone as if it never existed. Sarah lost about £4000 by believing a deepfake of Peter Hargreaves. If not for the well-known stock picker’s face, Sarah wouldn’t have fallen for an investment scam. She was just one among the possibly hundreds of victims. Cybersecurity firm Kaspersky in it’s blog noted that more than 600 advertisements featuring deepfakes of Peter Hargreaves were found on the Meta platform.

The deepfake phenomena

Deepfakes are fake digital media – audio, video and images that are generated using Artificial intelligence(AI). Deepfake fraudsters ride on credibility of real people often public figures to manipulate, cheat or mislead others into action. Generative AI is the technology that enables cybercriminals to create hyper-realistic images, videos or audio to trick people online.

Over the past few years, Gen-AI has been utilized by bad actors for a range of objectives right from crypto currency scams, investment frauds, election manipulation and social media misinformation campaigns. GenAI has also enabled deepfake pornography on a massive scale. GenAI tools like Nudify apps that instantly convert innocuous Instagram posts into outrageous nude pics have become a nightmare for female social media users. Social media is flush with a slew of deepfake porn posted online every minute. While deepfake porn harms reputation, deepfake frauds that inflict financial losses have become ubiquitous.

- Advertisement -

In an incident in Canada, attackers began running an ad in the name of BMO Belski. Most Canadians identify the abbreviation “BMO” as Bank of Montreal and Brian Belski as the famous investment strategist at BMO. By assuming BMO Belski as the official financial advice from the oldest bank in Canada, unsuspecting Canadian users invested, and lost money.

Deepfakes frauds in India

In India too, there has been a massive spike in deepfakes. Deepfake videos of Bollywood actress like Rashmika Mandana and Alia Bhatt introduced Indians to this phenomena a few years ago. Later, deepfakes became routine as everyone right from Aamir Khan to Ranveer Singh started running to the police demanding action on the fake content circulating online. Journalist Rajat Sharma was so tired of finding his own viral deepfakes recommending weight-loss treatment and diabetes medicine that he approached the court to stop it for once and for all. Member of Parliament Hema Malini expressed concern about deepfakes and raised it in Parliament. Nothing provided respite. It appeared that wealth couldn’t protect you from deepfakes. Business leaders like Warren Buffet and Tim Cook are deepfaked in crypto currency scams. Tech genius Elon Musk was among the most deepfaked men. Political power couldn’t protect you either. Deepfakes of US President Donald Trump and Indian PM Narendra Modi have become too common in social media.

It’s not the rich-and-famous alone who are bearing the brunt of GenAI. A deepfake account created by a jilted lover against Archita Phukan aka Babydoll Archi made international headlines last month. It became a social media sensation that humiliated an innocent woman by projecting her as a porn alongside Kendra Lust. In November last year, Bengaluru residents were duped of Rs. 95 lakhs by deepfake videos of Narayana Murthy and Mukesh Ambani. Last week, a Pune man lost Rs.43 lakhs to share trading fraud after believing a deepfake of Narayana and Sudha Murthy. The Indian government’s massive awareness campaign against deepfakery and digital arrest suggests that huge number of ordinary citizens are falling prey daily. The cases are likely underreported for fear of embarrassment.

The Gen-AI threat to digital trust

The growth of deepfake menace have created a corresponding increase in trust deficit in the digital world. Over 5.07 billion people, or 62.6% of the world’s population, use social media platforms for communication and information access. On 27 June 2025, Nature published a study that concluded “Following news on social media boosts knowledge, belief accuracy and trust.” The surge of deepfake content posted on social media without any inhibitions threatens the accuracy of information online and jeopardizes the trust in social media platforms.

- Advertisement -

If the next video call with your colleague can plausibly be a criminal disguised in deepfake or the next Instagram video of Virat Kohli promoting a product isn’t the “real Kohli”, users are constantly on edge unable to separate fact from GenAI fiction. A shocking detail: Deepfakes continued to circulate in Meta platforms i.e Facebook, Instagram and Whatsapp even when the public figure say Martin Wolf was enrolled in Meta’s new face recognition system designed to automatically detect and delete such content. It’s a sign that Big Tech’s like Meta and X haven’t quite figured out how to stop deepfake mess eroding faith in their platforms.

Installing deepfake detection tools at the system level is the only viable solution today. Deepfake awareness campaigns and AI detection capabilities should reach every nook and corner of the digital world. Until then, the likes of Rajat Sharma and Martin Wolf have no option but to continue crying hoarse that esoteric medicines and dubious investment schemes are being sold by their deepfake avatar. Your reality is at crosshairs as threat actors continue to weaponise GenAI and breach digital trust.

THE SNAPSHOTS

Sign up to get quick snaps of everyday happening, directly in your inbox.

We don’t spam! Read our privacy policy for more info.

- Advertisement -
Ankush Tiwari
Ankush Tiwari
Ankush Tiwari Founder and CEO of pi-labs

More Latest Stories

More Articles

How Air Can Become Urban India’s New Water Source

India's cities are running dry. Chennai nearly ran out of groundwater in 2019. Bengaluru's lakes are shrinking. Delhi's borewells are drawing from depths unimaginable...

The Human Algorithm: Why the Future of Digital Marketing Belongs to Empathetic Strategists

The modern marketing department is quieter than it used to be. The frantic tapping of copywriters racing against deadlines and the loud debates of creative directors have largely been replaced by the hum of servers processing natural language. Today, an enterprise can generate ten...

How AI is Rewriting the Economics of India’s $300 Bn IT Services Sector

When Microsoft CEO Satya Nadella recently disclosed that artificial intelligence now generates nearly 30...

Bounce House Rental vs Inflatable Slides: Which Option Delivers More Excitement?

Planning a family gathering or a children's party often involves finding the perfect entertainment...

How Hiring a Qualified Plumber Solves Major Household Issues

For many homeowners, maintaining a functional and safe home is a top priority. Plumbing...

Why India Must Own Its Education Intelligence Stack

India has rapidly digitised large parts of its education ecosystem over the last decade....

Why Micro Learning at 3 Minutes Works Better Than Lectures at 3 Hours

In the fast-moving world of digital education, there is one myth that continues to...

More Than Just a Scratch: The Importance of Windshield Care

Maintaining your vehicle’s windshield often appears as a seemingly minor task that can easily...

How Choosing A Licensed Plumber Ensures Quality Repairs

When it comes to maintaining a safe and comfortable home, the quality of plumbing repairs can significantly impact your daily life. From leaky faucets...

The world’s largest crypto market is building in the dark

India remains one of the few significant economies without a comprehensive crypto and stablecoin...

How Location Data Storage Technology is Making City Travel Smoother

India’s mobility ecosystem is undergoing a quiet but powerful transformation, driven not just by...

India Is Building Cities Without Building the Systems That Make Them Work

India is in the middle of the largest urban expansion in its history. By 2050,...

Why Cyber Resilience Is Replacing Cybersecurity as a Boardroom Priority

Traditionally, cybersecurity was hard-wired to be a technology concern that was only taken care...

Infrastructure 4.0: How AI & Predictive Analytics Are Transforming Real Estate

The new era of technology and innovation has changed operations in many industries. The integration of artificial intelligence in different industries is making processes...

The Rise of Integrated Solar Tech Ecosystems in India

India’s clean energy is all about building an ecosystem that is interconnected with various elements and goes beyond just installing solar panels at scale. Renewable energy generation, storage, digital intelligence, manufacturing, financing, and grid infrastructure work together within the said ecosystem in a coordinated...

Beyond Nvidia: The Hidden Winners of the AI Stock Rally

Nvidia stock (NASDAQ:NVDA) has returned roughly 1,200% since ChatGPT launched in late 2022. Most...

What PM Modi’s Appeal to Avoid Gold Buying Could Mean for India’s Jewellery Economy

When Prime Minister Narendra Modi recently urged citizens to avoid purchasing gold for a...

How Agentic AI Is Personalising the End to End Salon Experience

Walk into a salon today, and more often than not, the experience still depends...

From Black Box to Trusted AI: Why Defence Needs Constitutional AI Models

For decades, the defence and intelligence agencies have followed one non-negotiable rule: trust nothing...

Apple Reports $111.18 Billion Revenue in Q2 FY26, Net Profit Rises to $29.6 Bn

Apple Inc. (NASDAQ:APPL) has reported its financial results for the quarter ended March 28,...

Hermès vs MetaBirkin: The NFT Case That Redefined Ownership on Ethereum

The NFT boom of 2021 and early 2022 pushed digital assets into the mainstream,...

Bihar Police, Vehant Technologies Partners to Deploy Screening Systems Across 40 Courts

In a bid to enhance safety and security across court premises for judges, lawyers,...

Rethinking Hospital Security: TrioTree Technologies CEO Surjeet Thakur on Securing Fragmented Hospital IT Environments

In an interaction with TechGraph, Surjeet Thakur, Founder and CEO of TrioTree Technologies, outlined...

What the Next Phase of Growth Looks Like for Indian and Global E-commerce Players

For close to a decade, metrics for evaluating the growth of e-commerce included customer...

India Is Building Cities Without Building the Systems That Make Them Work

India is in the middle of the largest urban expansion in its history. By 2050,...

“Budget should focus on reducing taxes on capital gains,” Says Abhishek Gupta of Hex N Bit

Speaking in the upcoming Union Budget 2021, Abhishek Gupta, Founder, and CEO, Hex N...

“China is a Global thief” Rep. Tom Rice on Uyghur Forced Labor Prevention Act

Speaking at the House on Uyghur Forced Labor Prevention Act, Rep. Tom Rice (R-SC)...

Borade AI Founder Shiv Kumar Borade on Building an AI Growth Engine for Small Businesses

Speaking with TechGraph, Shiv Kumar Borade, Founder & CMD of Borade.AI, discussed how many...

When AI-Generated Documentation Hurts More Than Helps

AI-generated documentation has quickly become a selling point for modern SaaS and developer platforms,...

Why Cyber Resilience Is Replacing Cybersecurity as a Boardroom Priority

Traditionally, cybersecurity was hard-wired to be a technology concern that was only taken care...

Alphabet Discloses $2.14 Billion in Public Equity Holdings as of June 30

Alphabet Inc. disclosed $2.14 billion in equity securities held across 39 positions as of...

Gaming for Good: Boosting the Indian Gaming Community through Technology

The Indian gaming industry is transforming remarkably, driven by technological advancement and a growing...

India to generate $100 bn from telephonic investments

India expects to attract $100 billion in investments in the telecom sector, a union...