spot_img

Weaponizing Trust: How Threat Actors Use GenAI and Deepfakes to Breach Digital Security

Date:

Trending

On an April afternoon, Sarah was scrolling Instagram as she came across a familiar face. The video featured Peter Hargreaves the co-founder of UK’s biggest investment platform, Hargreaves Lansdown. The advert promoting Whatsapp communities for exclusive stock picks seemed lucrative. Within minutes, Sarah shared her number and became part of a Whatsapp group. An investment app recommended in the group was downloaded. She was happily walking the road to riches aided by a “mentor” who told her when to buy which stocks.

- Advertisement -

Treading cautiously, Sarah started investing small sums- just £50 at first. With the app showing decent profits, she added to her portfolio until she earned a tidy £300 in profits on a total investment of £2000 in a mere two weeks. Then came the moment of truth – Sarah couldn’t transfer the profits to her bank account. She continued to pay the supposed taxes, regulatory fees and withdrawal charges only to find her “mentor” vanish and the investment app stop working.

Boom, EVERYTHING was gone as if it never existed. Sarah lost about £4000 by believing a deepfake of Peter Hargreaves. If not for the well-known stock picker’s face, Sarah wouldn’t have fallen for an investment scam. She was just one among the possibly hundreds of victims. Cybersecurity firm Kaspersky in it’s blog noted that more than 600 advertisements featuring deepfakes of Peter Hargreaves were found on the Meta platform.

- Advertisement -

The deepfake phenomena

Deepfakes are fake digital media – audio, video and images that are generated using Artificial intelligence(AI). Deepfake fraudsters ride on credibility of real people often public figures to manipulate, cheat or mislead others into action. Generative AI is the technology that enables cybercriminals to create hyper-realistic images, videos or audio to trick people online.

Over the past few years, Gen-AI has been utilized by bad actors for a range of objectives right from crypto currency scams, investment frauds, election manipulation and social media misinformation campaigns. GenAI has also enabled deepfake pornography on a massive scale. GenAI tools like Nudify apps that instantly convert innocuous Instagram posts into outrageous nude pics have become a nightmare for female social media users. Social media is flush with a slew of deepfake porn posted online every minute. While deepfake porn harms reputation, deepfake frauds that inflict financial losses have become ubiquitous.

- Advertisement -

In an incident in Canada, attackers began running an ad in the name of BMO Belski. Most Canadians identify the abbreviation “BMO” as Bank of Montreal and Brian Belski as the famous investment strategist at BMO. By assuming BMO Belski as the official financial advice from the oldest bank in Canada, unsuspecting Canadian users invested, and lost money.

Deepfakes frauds in India

In India too, there has been a massive spike in deepfakes. Deepfake videos of Bollywood actress like Rashmika Mandana and Alia Bhatt introduced Indians to this phenomena a few years ago. Later, deepfakes became routine as everyone right from Aamir Khan to Ranveer Singh started running to the police demanding action on the fake content circulating online. Journalist Rajat Sharma was so tired of finding his own viral deepfakes recommending weight-loss treatment and diabetes medicine that he approached the court to stop it for once and for all. Member of Parliament Hema Malini expressed concern about deepfakes and raised it in Parliament. Nothing provided respite. It appeared that wealth couldn’t protect you from deepfakes. Business leaders like Warren Buffet and Tim Cook are deepfaked in crypto currency scams. Tech genius Elon Musk was among the most deepfaked men. Political power couldn’t protect you either. Deepfakes of US President Donald Trump and Indian PM Narendra Modi have become too common in social media.

It’s not the rich-and-famous alone who are bearing the brunt of GenAI. A deepfake account created by a jilted lover against Archita Phukan aka Babydoll Archi made international headlines last month. It became a social media sensation that humiliated an innocent woman by projecting her as a porn alongside Kendra Lust. In November last year, Bengaluru residents were duped of Rs. 95 lakhs by deepfake videos of Narayana Murthy and Mukesh Ambani. Last week, a Pune man lost Rs.43 lakhs to share trading fraud after believing a deepfake of Narayana and Sudha Murthy. The Indian government’s massive awareness campaign against deepfakery and digital arrest suggests that huge number of ordinary citizens are falling prey daily. The cases are likely underreported for fear of embarrassment.

The Gen-AI threat to digital trust

The growth of deepfake menace have created a corresponding increase in trust deficit in the digital world. Over 5.07 billion people, or 62.6% of the world’s population, use social media platforms for communication and information access. On 27 June 2025, Nature published a study that concluded “Following news on social media boosts knowledge, belief accuracy and trust.” The surge of deepfake content posted on social media without any inhibitions threatens the accuracy of information online and jeopardizes the trust in social media platforms.

If the next video call with your colleague can plausibly be a criminal disguised in deepfake or the next Instagram video of Virat Kohli promoting a product isn’t the “real Kohli”, users are constantly on edge unable to separate fact from GenAI fiction. A shocking detail: Deepfakes continued to circulate in Meta platforms i.e Facebook, Instagram and Whatsapp even when the public figure say Martin Wolf was enrolled in Meta’s new face recognition system designed to automatically detect and delete such content. It’s a sign that Big Tech’s like Meta and X haven’t quite figured out how to stop deepfake mess eroding faith in their platforms.

Installing deepfake detection tools at the system level is the only viable solution today. Deepfake awareness campaigns and AI detection capabilities should reach every nook and corner of the digital world. Until then, the likes of Rajat Sharma and Martin Wolf have no option but to continue crying hoarse that esoteric medicines and dubious investment schemes are being sold by their deepfake avatar. Your reality is at crosshairs as threat actors continue to weaponise GenAI and breach digital trust.

THE SNAPSHOTS

Sign up to get quick snaps of everyday happening, directly in your inbox.

We don’t spam! Read our privacy policy for more info.

- Advertisement -

Support our independent journalism PayPal (Outside India) For PayU (For Indian Readers).

Ankush Tiwari
Ankush Tiwari
Ankush Tiwari Founder and CEO of pi-labs

More Latest Stories

More Articles

Meta Declares Quarterly Cash Dividend Of $0.525 Per Share

Facebook parent company, Meta Platforms Inc. (NASDAQ:META) said its board of directors has declared a quarterly cash dividend of $0.525 per share on its...

Lok Sabha: Government releases ₹68K crore under MGNREGS; wage payments routed via DBT

New Delhi, India: Union Agriculture Minister Shivraj Singh Chouhan said the government has released 68,393.67 crore rupees to states and Union Territories under the Mahatma Gandhi National Rural Employment Guarantee Scheme (MGNREGS) in the current financial year 2025-26. In a written reply in the Lok...

The Evolving Classroom: Venkateshwar International School’s Pooja Sharma on Changing Role of Schools in Delhi’s CBSE Ecosystem

Speaking with TechGraph, Pooja Sharma, Vice Principal of Venkateshwar International School (VIS), discussed how...

Digital Generics: How AI is Redefining the Future of Affordable Medicine

It was with pride that global headlines described India as the world's pharmacy, supplying...

Why NoSQL Databases Are the Future for Tech Startups

In today’s digital-first economy, tech startups continue to dominate the startup landscape. A startup...

Delhi IGI Airport Revamped Terminal 2 with Advanced Baggage screening systems

Delhi’s Indira Gandhi International Airport (IGI) has reopened its reconstructed Terminal 2, inaugurated by...

The Rise of the AI Agent Economy: How Voice AI Agents Are Becoming the New Frontline Workforce For Call Centers

The work inside a call center has always depended on two things: speed and...

The Road to Equality in Tech: Women In Cloud’s Chaitra Vedullapalli on Reshaping Opportunity for Women Entrepreneurs Globally

In an interview with TechGraph, Chaitra Vedullapalli, Co-Founder of Women In Cloud, discussed how...

Understanding What Makes Sunscreen Truly Effective

Many people pick a sunscreen merely based on its SPF, thus they think that a higher number means better protection. However, SPF is only...

How AI is Improving Risk Management Among Crypto Traders

Over the past few years, the role of Artificial Intelligence in almost every sector...

The AI Advantage: How Intelligent Learning Solutions Are Rewriting Workforce Productivity in 2025 and Beyond

In 2025, artificial intelligence is no longer a futuristic concept — it’s the invisible...

Bajaj Financial Securities Acquires Stake in Lemnisk from Early Investors

Bajaj Financial Securities has acquired stakes in Bengaluru-based customer data platform Lemnisk through a...

The Rise of Cyber Cartels: How the Dark Web Fuels Digital Extortion?

In 2025, cybercrime has evolved beyond individual hackers or little ransomware criminal gangs into...

AI Research Startup Redrob Draws $10 Mn In Series A Funding Led By Korea Investment Partners

AI research startup Redrob has secured $10 million in its Series A round led by Korea Investment Partners with KB Investment, Kiwoom Investment, Korea...

The Future Employability Equation: PrepInsta’s Manish Agarwal on How AI Is Reshaping Student Readiness for Hiring in India

Speaking with TechGraph, Manish Agarwal, Co-Founder of PrepInsta, discussed how the increasing adoption of AI-led assessments and automated hiring platforms is shifting campus recruitment away from reliance on pedigree and location toward a more merit-driven model that values consistency, analytical reasoning, and practical application...

Norovex Review: Inside the Trading Platform Gaining Momentum

The online trading industry has entered one of its most dynamic periods in years....

Why Zero Code Exposure Is the Future of Trust in AI

AI coding assistants have quickly become indispensable for developers, promising faster deployment, cleaner code,...

Trump Says He Will Sue BBC Over Edited Broadcast of Jan 6 Speech

US President Donald Trump has said he plans to take legal action against the...

Starbucks Baristas Rally in New York as Strike Over Pay and Staffing Extends Nationwide

Starbucks baristas rallied in New York City as part of an open-ended strike that...

Demystifying Private Equity Market: WWIPL MD Krishna Patwari on Expanding Retail Access to India’s Unlisted Ecosystem

Speaking with TechGraph, Krishna Patwari, Founder and Managing Director of Wealth Wisdom India Pvt....

The Aesthetic of Longevity: Aesthetica’s Tanisha Bansal Gokharu on Redefining Luxury Home Interiors

Speaking with TechGraph, Tanisha Bansal Gokharu, Founder and Principal Designer at Aesthetica, discussed how...

Empowering Creators: Studiobackdrops’ Archisman Misra on Making Professional Production Accessible Across India

Speaking with TechGraph, Archisman Misra, CEO and Founder of Studiobackdrops, discussed how India’s fast-growing...

Trade Gaia Emerges as a Key Player in Global Altcoin Trading

While Bitcoin continues to dominate headlines, the real growth in 2025 is coming from...

The Conversation Shift: Doceree CRO Thomas Shea on Making Healthcare Marketing More Relevant for Physicians

Speaking with TechGraph, Thomas Shea, Chief Revenue Officer (CRO) at Doceree, discussed how artificial...

Bajaj Financial Securities Acquires Stake in Lemnisk from Early Investors

Bajaj Financial Securities has acquired stakes in Bengaluru-based customer data platform Lemnisk through a...

Digit Life Insurance posts 31% rise in H1 FY26 revenue to ₹858 crore

India-based, Go Digit Life Insurance said its revenue for the first half of FY...

Debt Recovery Reinvented: Collectedge’s Ranjan Agarwal on Reshaping India’s Collections Ecosystem for Lenders

Speaking with TechGraph, Ranjan Agarwal, CEO and Co-Founder of Collectedge, discussed how India’s debt...

AI as a Growth Multiplier: How Smart Companies Accelerate Without Breaking

In today’s business environment, smart growth is just as important as any other form...

Beyond Price Points: Unix India’s Imran Kagalwala on Redefining Consumer Expectations in the Mobile Accessories Market

Speaking with TechGraph, Imran Kagalwala, Co-founder of Unix India, discussed how a crowded accessories...

The Rise of Cyber Cartels: How the Dark Web Fuels Digital Extortion?

In 2025, cybercrime has evolved beyond individual hackers or little ransomware criminal gangs into...

Trade Gaia Emerges as a Key Player in Global Altcoin Trading

While Bitcoin continues to dominate headlines, the real growth in 2025 is coming from...

How Fleet Maintenance Scheduling Supports Business Vehicle Performance

Managing a fleet of vehicles can be challenging for any business. From delivery vans...

The Conversation Shift: Doceree CRO Thomas Shea on Making Healthcare Marketing More Relevant for Physicians

Speaking with TechGraph, Thomas Shea, Chief Revenue Officer (CRO) at Doceree, discussed how artificial...