High quality image manipulation was once reserved for big Hollywood budgets. Now, anyone with a decent computer and a bit of tech know-how can use AI algorithms to blur the lines between reality and fiction. It’s the age of the deepfake.

Deepfake is a type of content that uses ‘deep learning’ tools to convincingly replace one person's likeness and/or voice with that of another in digital media. These tools are readily available online and becoming easier to use. The creative applications are endless, ranging from harmless to nefarious, and around 500,000 deepfakes (video or voice) were estimated to be shared on social media in 2023 – a staggering increase from the 2021 figure of 14,678.

The technology could simply let you insert your face into your favourite films, become a sporting hero or live out dreams of being a rockstar. Or, you could use someone else’s face – and the ethics start to get murkier.

When a parody TikTok account seemed to feature actor Robert Pattinson dancing and performing magic tricks, even friends of his thought it was really him. While these videos weren’t meant to cause any harm, they were made without Pattinson’s knowledge and he found the experience unsettling. Some AI-generated images have become unexpected viral hits: one of the Pope wearing a Balenciaga puffer jacket fooled many and brought significant public awareness to the practice last year. 

There’s potential for more serious misinformation and deception. When a fake photo of an explosion at the Pentagon rapidly spread across social media and investment websites, the S&P 500 briefly dropped 0.3%. Endorsements are no longer a sure bet either; ask the BBC and U.S. news anchors who purportedly promoted a nonexistent investment platform created by Elon Musk. 

Deepfake fraudsters can avoid detection by eagle-eyed members of the public through targeted schemes. Recently, in Hong Kong, a finance employee obeyed orders to transfer out US$25.6m after a video call with his CFO and several other staff members… who all turned out to be ‘clones’. And you thought mic blunders were bad enough on Zoom ($ZM).

Efforts are under way to make the digital landscape more secure, from automated detection systems to stricter laws against the creation and dissemination of AI-generated content. Embedding watermarks is something companies like Adobe ($ADBE), Microsoft ($MSFT) and Google ($GOOG) are working on. Meanwhile, Meta ($META) has delayed the release of its Voicebox speech generator, due to potential misuse.

However, the field is moving so fast that detecting and reducing the spread of deepfakes can feel like a cat and mouse game. And as approximately a quarter of the world’s population heads to voting booths this year, the impact of ‘fake news’ could be severe and long lasting. 

Revealing the truth later doesn’t always undo the damage, either. Case in point: last week a good old-fashioned human error led to Lyft ($LYFT) reporting a profit margin at 10 times its real value, which sent the stock price soaring. The mistake was quickly corrected, but its market value did not completely retreat. If first impressions last, we all need to pay extra attention to what we believe in.


Want more?

You know what to do

Insights, trends and company deep dives delivered straight to your inbox.

Stake logo
Over 7,000 5-star reviews
App Store logoGoogle Play logo

Subscribe to our free newsletters

By subscribing, you agree to our Privacy Policy.

Stakeshop Pty Ltd, trading as Stake, ACN 610105505, is an authorised representative (Authorised Representative No. 1241398) of Sanlam Private Wealth Pty Ltd (Australian Financial Services Licence No. 337927) ('Sanlam') and an authorised representative (Authorised Representative No. 1241398) of Airwallex Pty Ltd (Australian Financial Services Licence No. 487221) ('Airwallex'). Stake is not authorised by Airwallex under Airwallex’s AFSL to arrange for clients to be issued with securities as Airwallex is not authorised under its AFSL for this purpose. Stake is not authorised by Sanlam under Sanlam’s AFSL to arrange for clients to be issued with a non-cash payment facility as Sanlam is not authorised under its AFSL for this purpose. Stake SMSF Pty Ltd (‘Stake Super’) is not licensed to provide financial product advice under the Corporations Act. This specifically applies to any financial products which are established if you instruct Stake Super to set up a self managed super fund (‘SMSF’). When you sign up to Stake Super, you are contracting with Stake SMSF Pty Ltd who will assist in the establishment of a SMSF under a ‘no advice model’. You will also be referred to Stakeshop Pty Ltd to enable your trading account and bank account to be set up in order to use the Stake Website and/or App. Stakeshop Pty Ltd will also run marketing and promotions to you under. For more information about SMSFs, see our SMSF Risks page.The information on our website or our mobile application is not intended to be an inducement, offer or solicitation to anyone in any jurisdiction in which Stake is not regulated or able to market its services. At Stake and Stake Super, we’re focused on giving you a better investing experience but we don’t take into account your personal objectives, circumstances or financial needs. Any advice given by Stake is of a general nature only. As investments carry risk, before making any investment decision, please consider if it’s right for you and seek appropriate taxation and legal advice. Please view our Financial Services GuideTerms & ConditionsPrivacy Policy and Disclaimers  before deciding to invest on or use Stake or Stake Super. By using our website or service in any way, you agree to our Privacy Policy and Terms & Conditions. All financial products involve risk and you should ensure you understand the risks involved as certain financial products may not be suitable to everyone. Past performance of any product described on this website is not a reliable indication of future performance. Stake and Stake Super are registered trademarks in Australia.

Copyright © 2024 Stake. All rights reserved.