Weaponizing Trust: How Threat Actors Use GenAI and Deepfakes to Breach Digital Security

Date:

Trending

- Advertisement -

On an April afternoon, Sarah was scrolling Instagram as she came across a familiar face. The video featured Peter Hargreaves the co-founder of UK’s biggest investment platform, Hargreaves Lansdown. The advert promoting Whatsapp communities for exclusive stock picks seemed lucrative. Within minutes, Sarah shared her number and became part of a Whatsapp group. An investment app recommended in the group was downloaded. She was happily walking the road to riches aided by a “mentor” who told her when to buy which stocks.

Treading cautiously, Sarah started investing small sums- just £50 at first. With the app showing decent profits, she added to her portfolio until she earned a tidy £300 in profits on a total investment of £2000 in a mere two weeks. Then came the moment of truth – Sarah couldn’t transfer the profits to her bank account. She continued to pay the supposed taxes, regulatory fees and withdrawal charges only to find her “mentor” vanish and the investment app stop working.

- Advertisement -

Boom, EVERYTHING was gone as if it never existed. Sarah lost about £4000 by believing a deepfake of Peter Hargreaves. If not for the well-known stock picker’s face, Sarah wouldn’t have fallen for an investment scam. She was just one among the possibly hundreds of victims. Cybersecurity firm Kaspersky in it’s blog noted that more than 600 advertisements featuring deepfakes of Peter Hargreaves were found on the Meta platform.

- Advertisement -

The deepfake phenomena

Deepfakes are fake digital media – audio, video and images that are generated using Artificial intelligence(AI). Deepfake fraudsters ride on credibility of real people often public figures to manipulate, cheat or mislead others into action. Generative AI is the technology that enables cybercriminals to create hyper-realistic images, videos or audio to trick people online.

Over the past few years, Gen-AI has been utilized by bad actors for a range of objectives right from crypto currency scams, investment frauds, election manipulation and social media misinformation campaigns. GenAI has also enabled deepfake pornography on a massive scale. GenAI tools like Nudify apps that instantly convert innocuous Instagram posts into outrageous nude pics have become a nightmare for female social media users. Social media is flush with a slew of deepfake porn posted online every minute. While deepfake porn harms reputation, deepfake frauds that inflict financial losses have become ubiquitous.

- Advertisement -

In an incident in Canada, attackers began running an ad in the name of BMO Belski. Most Canadians identify the abbreviation “BMO” as Bank of Montreal and Brian Belski as the famous investment strategist at BMO. By assuming BMO Belski as the official financial advice from the oldest bank in Canada, unsuspecting Canadian users invested, and lost money.

Deepfakes frauds in India

In India too, there has been a massive spike in deepfakes. Deepfake videos of Bollywood actress like Rashmika Mandana and Alia Bhatt introduced Indians to this phenomena a few years ago. Later, deepfakes became routine as everyone right from Aamir Khan to Ranveer Singh started running to the police demanding action on the fake content circulating online. Journalist Rajat Sharma was so tired of finding his own viral deepfakes recommending weight-loss treatment and diabetes medicine that he approached the court to stop it for once and for all. Member of Parliament Hema Malini expressed concern about deepfakes and raised it in Parliament. Nothing provided respite. It appeared that wealth couldn’t protect you from deepfakes. Business leaders like Warren Buffet and Tim Cook are deepfaked in crypto currency scams. Tech genius Elon Musk was among the most deepfaked men. Political power couldn’t protect you either. Deepfakes of US President Donald Trump and Indian PM Narendra Modi have become too common in social media.

It’s not the rich-and-famous alone who are bearing the brunt of GenAI. A deepfake account created by a jilted lover against Archita Phukan aka Babydoll Archi made international headlines last month. It became a social media sensation that humiliated an innocent woman by projecting her as a porn alongside Kendra Lust. In November last year, Bengaluru residents were duped of Rs. 95 lakhs by deepfake videos of Narayana Murthy and Mukesh Ambani. Last week, a Pune man lost Rs.43 lakhs to share trading fraud after believing a deepfake of Narayana and Sudha Murthy. The Indian government’s massive awareness campaign against deepfakery and digital arrest suggests that huge number of ordinary citizens are falling prey daily. The cases are likely underreported for fear of embarrassment.

The Gen-AI threat to digital trust

The growth of deepfake menace have created a corresponding increase in trust deficit in the digital world. Over 5.07 billion people, or 62.6% of the world’s population, use social media platforms for communication and information access. On 27 June 2025, Nature published a study that concluded “Following news on social media boosts knowledge, belief accuracy and trust.” The surge of deepfake content posted on social media without any inhibitions threatens the accuracy of information online and jeopardizes the trust in social media platforms.

If the next video call with your colleague can plausibly be a criminal disguised in deepfake or the next Instagram video of Virat Kohli promoting a product isn’t the “real Kohli”, users are constantly on edge unable to separate fact from GenAI fiction. A shocking detail: Deepfakes continued to circulate in Meta platforms i.e Facebook, Instagram and Whatsapp even when the public figure say Martin Wolf was enrolled in Meta’s new face recognition system designed to automatically detect and delete such content. It’s a sign that Big Tech’s like Meta and X haven’t quite figured out how to stop deepfake mess eroding faith in their platforms.

Installing deepfake detection tools at the system level is the only viable solution today. Deepfake awareness campaigns and AI detection capabilities should reach every nook and corner of the digital world. Until then, the likes of Rajat Sharma and Martin Wolf have no option but to continue crying hoarse that esoteric medicines and dubious investment schemes are being sold by their deepfake avatar. Your reality is at crosshairs as threat actors continue to weaponise GenAI and breach digital trust.

THE SNAPSHOTS

Sign up to get quick snaps of everyday happening, directly in your inbox.

We don’t spam! Read our privacy policy for more info.

- Advertisement -
Ankush Tiwari
Ankush Tiwari
Ankush Tiwari Founder and CEO of pi-labs

More Latest Stories

More Articles

Mozark Snaps $40 Mn In Series B Round Led by IFC and RMB Capitalworks

Mozark, a Singapore-based company specializing in digital experience testing and measurement, has raised $40 million in a Series B round led by International Finance...

Role of Agentic AI in transforming the real estate landscape

The real estate industry involves a high-stakes ecosystem driven by shifting supply-demand dynamics, regulatory changes, and several other economic factors. Every stage from evaluating land to designing projects, projecting cash flows, managing construction, marketing properties, and supporting post-sales operations involves interdependent decisions that can...

How to Extend Vehicle Lifespan With Proper Maintenance

Extending the lifespan of your vehicle is not only cost-effective but also beneficial for...

Geospatial Intelligence Is Powering India’s Next Wave of Smart Infrastructure

Every day, nearly 500 families in India receive news that will change their lives...

From Browsing to Buying: How Multi-Modal AI Is Turning Discovery Into Decision-Making

The digital journey, starting from discovery to decision, has been notably discontinuous through time....

Nebius Gets Approval for 1.2 GW AI Factory Campus in Missouri

Nasdaq-listed AI company, Nebius (NBIS), said the Independence City Council has approved a Chapter...

Why India’s Next Cloud Boom Is Coming from Tier-2 Cities

Historically, the story of India's cloud adoption has been focused on the metro cities...

Is India Ready for a Smart Treasury? A Look at Adoption Barriers and Opportunities

Across India, businesses hold thousands of crores in current accounts that earn no interest....

Understanding Common Car Problems and How to Prevent Them

Keeping your vehicle in top condition requires more than just regular washing or occasional oil changes. Cars are complex machines with multiple systems that...

Fraud or Finance? How to Identify Trustworthy Digital Lending Platforms

Digital lending has changed how credit flows in India. According to the IBEF, fintech-led...

What Modern Enterprises Can Expect from CPaaS Platforms in 2026

Over the past two decades, enterprise communication technology has advanced rapidly. Yet the gap...

India’s Creator Economy Seeks Tax Clarity and Social Security Support in Budget 2026

As policymakers finalise Budget 2026, the creator economy stands at a crossroads between rapid...

How To Use Tech To Aid Your Financial Management

Financial management and tech actually go hand in hand really well, and it’s important...

O-1 Visa & Moving Beyond H-1B: Frederick Ng of Beyond Border on Fixing US Visa Bottlenecks for Startup Founders

Speaking with TechGraph, Frederick Ng, Co-founder of Beyond Border, discussed how many venture-backed founders often find themselves constrained by restrictive and poorly understood U.S....

Creator Commerce Platform Wishlink Secures $17.5 Mn in Series B round

India-based creator commerce platform Wishlink has raised $17.5 million in a Series B funding round led by Vertex Ventures Southeast Asia & India, with participation from existing investors Fundamentum and Elevation Capital. Wishlink plans use the fresh capital to expand its creator and brand network,...

Brazil and South Korea Sign Stragetic Deals Across Trade, Health & Tech

In a move aimed at strengthening economic and strategic ties, Brazilian President Luiz Inácio...

Amazon India Opens 1.1 Million Sq Ft Campus in Bengaluru

Amazon announced the opening of its second-largest office in Asia with the launch of...

How Drone and LiDAR Surveys are Redefining Railway and Highway Project Execution

India’s railway and highway networks rank among the largest and most transformative infrastructure systems...

How Union Budget 2026–27 Supports Small Logistics Players through TReDS and the SME Growth Fund

Union Budget 2026–27 marks a decisive shift in how India supports its small logistics...

Union Budget Focus on MSMEs: Why Efficient Warehousing Is the Missing Link

The Union Budget 2026–27 places Micro, Small, and Medium Enterprises (MSMEs) firmly at the...

Union Budget 2026: Solar & Clean Energy Industry Draws Mixed Reactions on Manufacturing, KUSUM Funding & Import Duty Exemptions

The solar and clean energy sector has welcomed Union Budget 2026–27 for its focus...

Union Budget 2026 Reactions: Tech Sector Welcomes AI Focus, Sees Cloud Tax Incentives as Boost To India’s Digital Growth

India’s Union Budget for 2026, presented on Feb 1 by Nirmala Sitharaman, further integrated...

Budget 2026: FM Nirmala Sitharaman Cuts Customs Duty on Personal Imports, Cancer Drugs Among 17 Medicines Exempted

India Union Budget 2026: The Indian government has reduced the customs duty rate on...

Why India’s Housing Affordability Crisis Needs Policy Attention in Budget 2026

In the past few years, real estate prices have risen steadily, especially in tier-one...

India’s Creator Economy Seeks Tax Clarity and Social Security Support in Budget 2026

As policymakers finalise Budget 2026, the creator economy stands at a crossroads between rapid...

B2B Logistics platform Mojro Draws $3Mn for IAN Alpha Fund & Others

Bengaluru-based B2B logistics platform Mojro has raised $3 million in a Series A funding...

Peak XV Partners Closes $1.3 Bn in Fresh Capital to Back Startups Across India and APAC

Peak XV Partners (formerly Sequoia Capital India & SEA) has closed $1.3 billion in...

LTM partners with the Indian Institute of Creative Technologies to strengthen creative technology skilling

LTM, a Larsen & Toubro Group company, and the Indian Institute of Creative Technologies...

Business Structure for Modern Entrepreneurs: What No One Explains Clearly

Modern entrepreneurs often obsess over product-market fit while neglecting the structural bones of their...

How To Use Tech To Aid Your Financial Management

Financial management and tech actually go hand in hand really well, and it’s important...

Budget 2026: FM Nirmala Sitharaman Cuts Customs Duty on Personal Imports, Cancer Drugs Among 17 Medicines Exempted

India Union Budget 2026: The Indian government has reduced the customs duty rate on...

Union Budget 2026: Nirmala Sitharaman Raises Capex to ₹12.2 Lakh Crore, Fiscal Deficit Projected at 4.3% for FY27

Union Budget 2026: Finance Minister Nirmala Sitharaman said the government has allocated ₹12.2 lakh...

Why India’s Housing Affordability Crisis Needs Policy Attention in Budget 2026

In the past few years, real estate prices have risen steadily, especially in tier-one...