Responsible deepfakes

maio23

Some viral TikTok videos may soon show a new type of label: that it’s made by AI.

The ByteDance-owned app is developing a tool for content creators to disclose they used generative artificial intelligence in making their videos, according to a person with direct knowledge of the efforts. The move comes as people increasingly turn to AI-generated videos for creative expression, which has sparked copyright battles as well as concerns about misinformation.
https://www.theinformation.com/articles/tiktok-is-developing-ai-generated-video-disclosures-as-deepfakes-rise



dez22

A small academic and corporate team of researchers say they have created a way to preserve the biometric privacy of people whose faces are posted on social media.

And while that innovation is worthy of examination, so is a couple phrases that the team has developed for their facial anonymization: “a responsible use for deepfakes by design” and “My Face, My Choice.”

For most people, deepfakes exist because humans like to be fooled. For the rest, they exist to dominate a future when objective proof or truth no longer exist.

Two scientists from State University of New York, Binghamton, and another from Intel Labs say in a non-peer-reviewed paper that they recognize the identity and privacy dangers posed by face image scrapers like Clearview AI that harvest billions of faces for their own purposes and without permission.

The answer, they say, is qualitatively dissimilar deepfakes. That is, using deepfake algorithms to alter faces just enough that the faces cannot be facially recognized by software. The result is a facial image in a group photo that is true enough to the original (and free of AI weirdness) that anyone familiar with a person would quickly accept it as representative.

The researchers also have proposed metrics for doing this under which a deepfake (though, again, still recognizable by many humans) is randomly generated with a guaranteed dissimilarity.

https://www.biometricupdate.com/202212/a-proposal-for-responsible-deepfakes

IMAGENS

jan23

Deepfakes: faces created by AI now look more real than genuine photos

 https://uk.news.yahoo.com/deepfakes-faces-created-ai-now-122623469.html

dez22

AI image generation tech can now create life-wrecking deepfakes with ease

AI tech makes it trivial to generate harmful fake photos from a few social media pictures.

https://arstechnica.com/information-technology/2022/12/thanks-to-ai-its-probably-time-to-take-your-photos-off-the-internet/

dez22

At a glance, the above three images look just like me. Look closer and you might notice that my skin is too smooth, my clothes distorted in places — details that might be dismissed as an overdone Photoshop edit.

Thing is, I never posed for these pictures. Nor have I ever sported shoulder-length hair or a cowboy hat, for that matter. These images are entirely the product of artificial intelligence, utilizing a cutting-edge technology developed by Google scientists called DreamBooth.

Since its release in late August, DreamBooth has already advanced the field of AI art by leaps and bounds. In a nutshell, it gives AI the ability to study what individuals or objects look like, then synthesizes a “photorealistic” image of the subject in a completely new context.

https://www.thestar.com/business/technology/2022/12/01/these-ai-images-look-just-like-me-what-does-that-mean-for-the-future-of-deepfakes.html

Real time deepfakes (Ver Metaphysics)

set23

Scroll through the livestreaming videos at 4 a.m. on Taobao, China’s most popular e-commerce platform, and you’ll find it weirdly busy. While most people are fast asleep, there are still many diligent streamers presenting products to the cameras and offering discounts in the wee hours. 

But if you take a closer look, you may notice that many of these livestream influencers seem slightly robotic. The movement of their lips largely matches what they are saying, but there are always moments when it looks unnatural.

These streamers are not real: they are AI-generated clones of the real streamers. As technologies that create realistic avatars, voices, and movements get more sophisticated and affordable, the popularity of these deepfakes has exploded across China’s e-commerce streaming platforms. 

Today, livestreaming is the dominant marketing channel for traditional and digital brands in China. Influencers on Taobao, Douyin, Kuaishou, or other platforms can broker massive deals in a few hours. The top names can sell more than a billion dollars’ worth of goods in one night and gain royalty status just like big movie stars. But at the same time, training livestream hosts, retaining them, and figuring out the technical details of broadcasting comes with a significant cost for smaller brands. It’s much cheaper to automate the job.

https://www.technologyreview.com/2023/09/19/1079832/chinese-ecommerce-deepfakes-livestream-influencers-ai/

jun23

Generative deep learning models are able to create realistic audio

and video. This technology has been used to impersonate the

faces and voices of individuals. These “deepfakes” are being used to

spread misinformation, enable scams, perform fraud, and blackmail

the innocent. The technology continues to advance and today attackers

have the ability to generate deepfakes in real-time. This new

capability poses a significant threat to society as attackers begin

to exploit the technology in advances social engineering attacks.

In this paper, we discuss the implications of this emerging threat,

identify the challenges with preventing these attacks and suggest a

better direction for researching stronger defences.

Discussion Paper: The Threat of Real Time Deepfakes

Guy Frankovits, Yisroel Mirsky

guyfrank@post.bgu.ac.il,yisroel@bgu.ac.il

Ben-Gurion University

Department of Software and Information Systems Engineering

Beersheba, Israel

(Guardado)

mai23

Researchers say the technology for real-time deepfakes has been around for the better part of a decade. What's new is the range of tools available to make them.

"We know we're not prepared as a society" for this threat, said Andrew Gardner, vice president of research, innovation and AI at Gen. In particular, he said, there's nowhere to go if you're confronted with a potential deepfake scam and you need immediate help verifying it.

Real-time deepfakes have been used to scare grandparents into sending money to simulated relatives, win jobs at tech companies in a bid to gain inside information, influence voters, and siphon money from lonely men and women. Fraudsters can copy a recording of someone's voice that's been posted online, then use the captured audio to impersonate a victim's loved one; one 23-year-old man is accused of swindling grandparents in Newfoundland out of $200,000 in just three days by using this technique.

https://techxplore.com/news/2023-05-realtime-deepfakes-dangerous-threat.html

fev23

Joe Biden deepfake responds to questions in ‘real-time’ using AI

24 hours ago

Media and Comms Advisor Hamish MacLachlan-Lester says the deep-faked AI video of US President Joe Biden responding to a question with a realistic synthesised voice was done in “real-time”.

“In terms of that video, it’s not only that it’s just a deepfake, it is a real-time deepfake that is responding to a question,” Mr MacLachlan-Lester told Sky News host Cory Bernardi.

https://www.news.com.au/national/joe-biden-deepfake-responds-to-questions-in-realtime-using-ai/video/d43211a25719376cf22ef29553a296e5

 out22

When Berlin mayor Franziska Giffey took a call from Vitali Klitschko, the mayor of Kyiv, in June, the pair discussed several important issues, including the status of Ukrainian refugees in Germany. It was a perfectly normal conversation between politicians, given the circumstances. Except Klitschko wasn’t real.

Although the mayor could see the face of the former Boxer turned politician, and was talking to him in real-time, she was actually talking to an imposter. Deepfakes – technology which creates realistic renders of famous faces using artificial intelligence (AI) – are now sophisticated enough to work in real-time.

It’s not yet clear who the tricksters behind the incident were, nor what their intentions were, but the same group reportedly fooled the mayors of Vienna and Madrid using the same Klitschko deepfake.

Since deepfakes first emerged in 2017, a persistent worry has been that they could be used to meddle in politics and otherwise cause chaos. As with many things in recent times, those fears have been replaced with cold, hard reality. 

https://www.itpro.co.uk/security/369243/real-time-deepfakes-are-becoming-a-serious-threat

https://www.dw.com/en/vitali-klitschko-fake-tricks-berlin-mayor-in-video-call/a-62257289

https://www.youtube.com/watch?v=nboS2oevX5A

O fenómeno Metaphysic

set23

“Deep Tom Cruise changed everything,” Metaphysic CEO Tom Graham says over a video call from Porto, Portugal.

There had been plenty of other deepfakes before the AI-generated videos of the Mission Impossible star were released on TikTok in 2021. But the Cruise videos were different: The quality was higher, the subject more dazzling, and the reaction on the internet far more impressive. In no time at all, the videos had garnered many, many millions of views. But for Graham, who had previously co-founded the data analysis software company Heavy.AI, the most amazing thing wasn’t the deepfake per se—it was the videos’s creator, his friend Chris Umé. “I literally rang up Chris and his brother Kevin and asked: ‘Hey, what’s going on with this? How could you make it so realistic?'” says Graham. He saw a business opportunity, and one month later, they founded Metaphysic.

https://www.fastcompany.com/90956286/metaphysics-tom-graham-wants-to-arm-us-in-the-fight-against-deepfakes

mai23

https://www.forbes.com/sites/charliefink/2023/05/03/metaphysic-deep-fakes-ted/?sh=46f4e80160e6

ab23
Deepfakes mean we can’t trust videos and voices already | Metaphysic CEO at TED

https://venturebeat.com/business/why-we-wont-be-able-to-trust-videos-and-voices-soon-metaphysic-ceo-at-ted/

set22

Cowell described Metaphysic as “probably the most incredible, original act” he’d had on America’s Got Talent. Original? Perhaps not, given that it mimics real people. But incredible? It’s hard to argue with that.

http://webcache.googleusercontent.com/search?q=cache:KcRhZiHsJJoJ:https://www.telegraph.co.uk/tv/0/tom-cruise-americas-got-talent-deepfakes-future-entertainment/&hl=pt-PT&gl=pt&strip=1&vwsrc=0

https://www.telegraph.co.uk/tv/0/tom-cruise-americas-got-talent-deepfakes-future-entertainment/

set22 

a atuacao final

https://www.youtube.com/watch?v=5BQdw6t90XQ

https://www.youtube.com/watch?v=Jr8yEgu7sHU

set22

Deepfakes are stealing the show on ‘America’s Got Talent.’ Will they soon steal a lot more too?

Metaphysic is making money right now by creating deepfakes for Hollywood and the advertising industry. But it also has started a side project called Every Anyone that allows a person to upload a simple selfie and generate a realistic deepfake of themselves that is also linked to a non-fungible token (NFT). The idea, according to Graham, is that this will give people ownership over their own digital likenesses and provide them a means to control how they are used. (Because the deepfake—Graham and Ume prefer the term “hyper-real digital avatar”— is cryptographically written to an unalterable digital ledger, it will in theory provide a way for people to know they are interacting with you—or at least the authorized fake version of you—as opposed to some impostor pretending to be you.)

https://fortune.com/2022/09/06/deepfakes-americas-got-talent-metaphysic-fraud-metaverse/

 sete22

'Technology is not talent': Is MetaPhysic really the best 'AGT' act ever?

https://www.yahoo.com/entertainment/technology-is-not-talent-is-meta-physic-really-the-best-agt-act-ever-015829964.html

agos22

Simon Cowell Declares Controversial Deepfake Act the 'Best of the Season' on AGT

https://www.entrepreneur.com/article/434416

'AGT' judges Simon Cowell, Howie Mandel get 'deepfake' treatment by AI act Metaphysic: Watch here

https://eu.usatoday.com/story/entertainment/tv/2022/08/30/agt-simon-cowell-calls-ai-opera-best-act-metaphysic/7947094001/

Ready or not, mass video deepfakes are coming

A start-up’s appearance on primetime TV heralds a new era, backers say. Others warn we should stay in the current one.

https://www.washingtonpost.com/technology/2022/08/30/deep-fake-video-on-agt/

1º video

https://www.youtube.com/watch?v=mPU0WNUzsBo

Uso na publicidade

nov23

https://www.livemint.com/ai/artificial-intelligence/legislators-aim-to-help-celebrities-and-consumers-fight-deepfake-scam-ads-11699271032419.html

https://www.wsj.com/articles/legislators-aim-to-help-celebrities-and-consumers-fight-deepfake-scam-ads-8d490bc6?mod=business_lead_story

jul23

Elis Regina aparece cantando ao lado da filha Maria Rita em campanhafeita com inteligência artificial

https://g1.globo.com/economia/midia-e-marketing/noticia/2023/07/04/elis-regina-aparece-cantando-ao-lado-da-filha-maria-rita-em-campanha-da-volkswagen-feita-com-inteligencia-artificial.ghtml

https://www.youtube.com/watch?v=U1jPJ5FKEwg

https://www.youtube.com/watch?v=aMl54-kqphE

nov22

Researchers: Deepfakes will be in mainstream advertising in a decade

Synthetic advertising is well on its way, but will consumers be ok with these artificial yet real representations of reality?

https://www.cmo.com.au/article/703619/researchers-deepfakes-will-mainstream-advertising-decade/

VER: https://www.adnews.com.au/news/synthetic-advertising-is-coming

 (ver arquivo anterior; outras utilizações)    

agos22

Creative artificial intelligence technologies (e.g., deepfakes, generative adversarial networks) are enabling new ways of producing and editing the audio and visual content in advertising. These new tools highly automate extreme changes to—and the entire generation of—advertisements. Examples range from changing a model’s skin tone, age, or gender to swapping the entire body or voice of a model. This investigation finds that these creative tools may cause potentially dramatic changes in how advertisements are conceived, produced, edited, and targeted. This paper explores these changes, along with related ethical issues and areas of needed research.

http://www.journalofadvertisingresearch.com/content/early/2022/08/15/JAR-2022-017.abstract

Deepfakers

dez22

The user need only enter a simple text prompt and — hey presto! — out comes the picture. The most popular programs are Stable Diffusion and DALL-E — and both are now free of cost and available open access.

This points to troubling potential: these tools are a dream for a disinformation actor who need only to be able to imagine the 'evidence' they need to support their narrative, and then create it.

These technologies are already starting to penetrate social media and images are only the beginning.

Just recently in September, Meta released 'Make-A-Video' that enables users to create "brief, high-quality video clips" from a text prompt. Experts warn that synthetic video is even more troubling than synthetic images, given that today's social media landscape already favours fast and clipped videos, over text or images.

https://euobserver.com/digital-eu/156482

set22

Metaphisycs

https://dot.la/deepfake-tom-cruise-2657988402/particle-2

 jul22

Tom Cruise has been thriving, as Top Gun: Maverick is still breaking records for Paramount. And while the star finds success, Miles Fisher, who's become famous for his Cruise deepfakes is getting considerable buzz a well. Of course, going viral for his uncanny recreations of the actor has helped raise his profile. But as Fisher now tells it, fooling people into thinking he’s Cruise has proved to be a burden, even around A-listers like Leonardo DiCaprio. 

Miles Fisher definitely seems appreciative of the attention and work he's received, thanks to his resemblance to the Mission: Impossible star. However, whenever he's working with Hollywood titans, there's something that he just can't seem to shake. As Fisher explained:

https://www.cinemablend.com/movies/man-whos-the-face-behind-tom-cruise-deepfakes-talks-about-how-huge-of-a-burden-its-been-even-around-a-listers-like-leonardo-dicaprio

jul22

Few deepfakes are done well. "It's easy to make bad ones, but very difficult to make ones that are truly successful," he told Le Monde. Although there are several free tools available online, making this technology accessible to as many people as possible depends on several factors: "You need a very powerful machine, time, patience, but, above all, skills. "

https://worldcrunch.com/tech-science/slovakian-artist-ctrl-shift-face-king-of-deepfakes

Desenvolvimento da tecnologia (tecnológicas II)

jan24

In an age where deepfakes and AI-generated content are increasingly blurring the lines of reality, camera giants Nikon, Sony, and Canon have announced groundbreaking technology to combat the proliferation of sophisticated fakes. With the digital world experiencing an onslaught of deepfake scandals involving celebrities, politicians, even common people, these companies are stepping in with solutions that promise to maintain the integrity of digital imagery.

Digital Signatures: The New Frontier in Image Authentication

Nikon is leading the charge by introducing mirrorless cameras equipped with authentication technology tailored for photojournalists and other professionals. These cameras will produce images with tamper-resistant digital signatures, detailing crucial information like date, time, location, and the photographer’s identity. This move is a significant step in ensuring the credibility of professional photography in an era increasingly dominated by fake content.

https://www.news9live.com/technology/canon-nikon-sony-fight-ai-deepfakes-new-tech-2393242

+

https://factcheckhub.com/nikon-sony-and-canon-to-fight-deepfakes-with-latest-camera-technology/

nov23

Developers of artificial intelligence platforms could soon release technology that allows users to make images and videos that would be nearly indistinguishable from reality.

Companies such as OpenAI, the developer behind the popular ChatGPT platform, and other AI companies are nearing the release of tools that will allow the creation of widespread and realistic fake videos as early as next year, according to a report from Axios.

https://www.foxnews.com/us/deepfakes-indistinguishable-reality-2024-report-warns

maio23

Some viral TikTok videos may soon show a new type of label: that it’s made by AI.

The ByteDance-owned app is developing a tool for content creators to disclose they used generative artificial intelligence in making their videos, according to a person with direct knowledge of the efforts. The move comes as people increasingly turn to AI-generated videos for creative expression, which has sparked copyright battles as well as concerns about misinformation.
https://www.theinformation.com/articles/tiktok-is-developing-ai-generated-video-disclosures-as-deepfakes-rise

ab23
Deepfakes mean we can’t trust videos and voices already | Metaphysic CEO at TED

https://venturebeat.com/business/why-we-wont-be-able-to-trust-videos-and-voices-soon-metaphysic-ceo-at-ted/

jan23

About a third of the way into a New York Times piece about the prospects for regulating "deepfake" technology, a striking statement appears:

Some experts predict that as much as 90 percent of online content could be synthetically generated within a few years.

It's striking because it's frustrating: The sentence grabs your attention with a huge number (90 percent!), but it doesn't convey what the number means. For one thing, there's that weasel-phrase "as much as"—just how much wiggle room is that masking? And what counts as "online content"? The passages before and after this line are explicitly about deepfakes, but strictly speaking even bot spam is "synthetically generated." What precisely are we talking about here?

https://reason.com/2023/01/27/that-time-we-tried-to-make-sense-of-a-statistic-in-a-new-york-times-story-on-deepfakes/

jan23

Deepfakes: faces created by AI now look more real than genuine photos

 https://uk.news.yahoo.com/deepfakes-faces-created-ai-now-122623469.html

jan23

Eye contact between the presenter and the audience is important to sustain a personal connect. But when the presenter and the audience are divided by screens in a virtual world, this becomes a challenge. While reading from a script, video content creators often struggle to orient themselves towards the camera to ensure maximum engagement. To address the issue, NVIDIA Broadcast App - a free software for NVIDIA RTX and GeForce RTX GPU users - has brought an update that includes a deepfake eye contact functionality. Nvidia hails itself as a global leader in accelerated computing.

https://www.hindustantimes.com/technology/nvidia-deepfake-video-tool-helps-presenters-maintain-eye-contact-while-reading-script-101674368080824.html

jan23

Deep Fakes may replicate digital humans this year

https://itwire.com/business-it-news/security/deep-fakes-may-replicate-digital-humans-this-year.html

jan23
NVIDIA Broadcast can now deepfake your eyes

https://videocardz.com/newz/nvidia-broadcast-can-now-deepfake-your-eyes

jan23

That’s what a new tool from Do Not Pay promises. Do Not Pay is an organization that has previously automated all manner of things from fighting parking tickets to easily cancel unwanted subscriptions. In a video uploaded to Twitter on Wednesday, Do Not Pay founder Joshua Browder showed the tool calling Wells Fargo customer support, and using an AI-generated version of his own voice to overturn wire fees.

https://www.vice.com/en/article/pkg94v/deepfake-voice-do-not-pay-wells-fargo-refund

dez22

Google, research firm OpenAI, and AI vendor Stability AI have each developed a text-to-image image generator powerful enough that some observers are questioning whether in the future people will be able to trust the photographic record.

https://www.inverse.com/innovation/text-to-image-ai-deepfakes

dez22

AI image generation tech can now create life-wrecking deepfakes with ease

AI tech makes it trivial to generate harmful fake photos from a few social media pictures.

https://arstechnica.com/information-technology/2022/12/thanks-to-ai-its-probably-time-to-take-your-photos-off-the-internet/

out22

yesterday the U.S. Patent Office granted Apple a patent for just that: Deepfake creations or Synthetic creations. The patent is titled "Face Image Generation with Pose and Expression Control." Of course, it's not as sophisticated as the TV series or the Obama presentation at present, but it definitely illustrates how Apple thinks this could be a future photos manipulation feature and/or app for still photos and videos.  In fact, Apple already has the technology in place. More on that later. 

 

Apple's newly granted patent notes that their invention covers systems and methods that relate to the creation of synthetic images of human faces based on a reference image. The synthetic images can incorporate changes in facial expression and pose.

 

At inference time, a single reference image can generate an image that looks like the person (i.e., the subject) of the reference image, but shows the face of the subject according to an expression and/or pose that the system or method has not previously seen. Thus, the generated image is a simulated image that appears to depict the subject of the reference image, but it is not actually a real image.

https://www.patentlyapple.com/2022/10/apple-has-won-a-patent-for-the-creation-of-deepfakes-that-alter-the-facial-expression-and-pose-of-a-person-in-a-photo-or-vide.html

out22

Uma empresa de inteligência artificial usou técnicas de deepfake para permitir que "Steve Jobs" (ou uma versão digital dele) concedesse uma entrevista a um podcast. O objetivo da iniciativa foi revelar como é possível criar sons tão realísticos quanto as fotos e vídeos criados com as ferramentas modernas.

O podcast foi criado pela Play.ht, empresa especializada na criação de ferramentas de geração de texto para voz com IA. O material fictício traz o falecido fundador da Apple, Steve Jobs, sendo entrevistado pelo polêmico influenciador Joe Rogan — que teve110 episódios do podcast The Joe Rogan Experience excluídos recentemente, acusado de disseminar informações negacionistas sobre a pandemia de covid-19.

A voz de Jobs ainda parece meio estranha em alguns momentos, mas a IA consegue recriar as nuances da fala, o timbre e até o jeito de falar do ex-CEO da Maçã. A fala de Joe Rogan é mais realista, mas há muito mais materiais disponíveis atualmente do que de uma pessoa falecida há 11 anos.

Roteiro também foi criado por IA

Segundo a Play.ht, o roteiro foi totalmente criado pela inteligência, algo impressionante para um conteúdo sem intervenção humana. Aparentemente, a tecnologia é similar à usada em aplicativos de geração de vídeo e imagem a partir de roteiros, como o DALL-E

https://br.noticias.yahoo.com/deepfake-permite-que-steve-jobs-211200693.html

out22

SÓ NAO HA MAIS PORQUE A TECNICA AINDA NAO ESTA DESENVOLVIDA

Phishing works so well crims won't bother with deepfakes, says Sophos chap

People reveal passwords if you ask nicely, so AI panic is overblown

https://www.theregister.com/2022/10/17/phishing_beats_deepfakes/

out22

Creating Full Body Deepfakes by Combining Multiple NeRFs

https://www.unite.ai/creating-full-body-deepfakes-by-combining-multiple-nerfs/

ago22

A cybersecurity expert is puzzled by recent actions taken by a group of researchers working at the Samsung AI Centre in Moscow, saying their work might inevitably end up doing more harm than good.

In a research paper, they wrote that they have invented something called Mega Portraits, which is short for megapixel portraits, based on a concept called neural head avatars, which, they said, “offer a new fascinating way of creating virtual head models. They bypass the complexity of realistic physics-based modeling of human avatars by learning the shape and appearance directly from the videos of talking people.”

Lou Steinberg, the founder of CTM Insights, a New York City-based cybersecurity research lab and incubator, said intentionally edited images, also known as deepfakes, are a growing and troubling issue with possibilities that include editing a picture of someone to cause reputational/brand damage, often with AI tools that are becoming more capable.

https://www.itworldcanada.com/article/samsungs-handling-of-deepfakes-research-questioned/499236

jul22

Researchers Found A Way To Animate High Resolution Deepfakes From A Single Photo, And It's Unsettling

https://petapixel.com/2022/07/22/megaportraits-high-res-deepfakes-created-from-a-single-photo/

https://digg.com/video/high-resolution-deepfakes-from-a-single-photo-and-its-unsettling

jul22

Researchers from Samsung Labs have developed a way to create high-resolution avatars, or deepfakes, from a single still frame photo or even a painting.

https://petapixel.com/2022/07/22/megaportraits-high-res-deepfakes-created-from-a-single-photo/

 jun22

Parked near the LeRoy King Carousel next to the Moscone Center, the RV offered three interactive experiences. The first involved a voice analyzer that was programmed to ascertain the gender, language and approximate age of any speaker. The second let visitors test out a voice authentication API, and the third was an audio deepfake demonstration through which guests type out sentences and hear them read aloud by various celebrities and popular figures.

https://www.scmagazine.com/analysis/rsac/speaks-for-itself-demo-reveals-power-of-voice-authentication-and-perils-of-deepfakes

Crimes (fraudes, etc) II

fev24

Law enforcement agencies are scrambling to keep up with generative artificial intelligence, which experts say holds potential for disinformation and misuse — such as deepfake images showing people mouthing things they never said.

A company employee in the Chinese finance hub received “video conference calls from someone posing as senior officers of the company requesting to transfer money to designated bank accounts”, police told AFP.

https://hongkongfp.com/2024/02/05/multinational-loses-hk200-million-to-deepfake-video-conference-scam-hong-kong-police-say/

jan24

Vídeos adulterados de famosos estão sendo usados para promover uma suposta versão do jogo de celular Subway Surfers. A campanha é veiculada em redes sociais com postagens, algumas delas pagas, que prometem dinheiro fácil para quem usa o game, chamado de Subway Money.

As publicações usam imagens de famosos para criar deepfakes, técnica que usa inteligência artificial para fazer parecer que uma pessoa está falando outra coisa em uma gravação. A ideia é convencer as vítimas a pagarem pelo jogo, mas os vídeos são falsos.

Em busca de mais credibilidade, os vídeos têm demonstrações do que seria o Subway Money. Esses trechos se parecem muito com Subway Surfers, mas mostram uma área do que seria o valor a receber pelo jogador, algo que não existe no jogo oficial.

https://g1.globo.com/tecnologia/noticia/2024/01/14/subway-money-golpistas-criam-deepfakes-de-famosos-para-prometer-dinheiro-em-jogo-falso.ghtml

jan24

A pair of U.S. House of Representative members have introduced a bill intended to restrict unauthorized fraudulent digital replicas of people.

The bulk of the motivation behind the legislation, based on the wording of the bill, is the protection of actors, people of notoriety and girls and women defamed through fraudulent porn made with their face template.

Curiously, the very real threat of using deepfakes to defraud just about everyone else in the nation is not mentioned. Those risks are growing and could result in uncountable financial damages as organizations rely on voice and face biometrics for ID verification.

The representatives, María Elvira Salazar (R-Fla.) and Madeleine Dean (D-Penn.), do not mention the global singer/songwriter Taylor Swift in their press release, it cannot have escaped them that she’s been victimized, too.

https://www.biometricupdate.com/202401/us-lawmakers-attack-categories-of-deepfake-but-miss-everyday-fraud

jan24

A IA também tem um “lado negro” e, ao cair nas mãos erradas, pode dar origem a ameaças mais sofisticadas. As deepfakes não são uma novidade, mas, com a crescente popularidade da tecnologia, têm-se tornado mais prevalentes, levantando preocupações quanto à utilização em esquemas fraudulentos como este que circulou recentemente no YouTube e na rede social X (antigo Twitter).

O esquema inclui um vídeo manipulado por IA “protagonizado” por Anatoly Yakovenko, co-fundador da plataforma de blockchain Solana, que tem uma criptomoeda de mesmo nome, avança o website The Verge.

https://tek.sapo.pt/noticias/internet/artigos/novos-esquemas-de-fraude-com-criptomoedas-usam-deepfakes-para-enganar-internautas

dez23

BOSSIER PARISH, La. (WVUE) - A 32-year-old Louisiana man arrested on child pornography allegations is now the first in the state to face charges under a new law aimed at safeguarding individuals from the misuse of deepfake technology.

Deepfake technology uses artificial intelligence to create highly realistic photos and videos. Deepfakes are becoming more realistic, easier to access, and have added to an era of disinformation.

According to the Bossier Parish Sheriff’s Office, Rafael Valentine Jordan was arrested on Lylac Lane, less than half of a mile from Bellaire Elementary School in Bossier, on Nov. 17 and booked into jail on one count of juvenile pornography.

During the investigation, authorities say they discovered 436 images of child pornography created using deepfake technology. On Dec. 1, a second count of juvenile pornography was added, along with two counts of unlawful deepfake creation.

https://www.wafb.com/2023/12/27/bossier-man-jailed-child-porn-also-states-first-face-new-deepfake-law/

out23

The world's biggest YouTuber, MrBeast, and two BBC presenters have been used in deepfake videos to scam unsuspecting people online.

Deepfakes use artificial intelligence (AI) to make a video of someone by manipulating their face or body.

One such video appeared on TikTok this week, claiming to be MrBeast offering people new iPhones for $2 (£1.65).

Meanwhile, likenesses of BBC stars Matthew Amroliwala and Sally Bundock were used to promote a known scam.

https://www.bbc.com/news/technology-66993651

agos23

In first, Hong Kong police arrest 6 over finance scams involving deepfake technology

The case marks the first time police have made arrests related to the deepfake technology, where an image or recording is manipulated to misrepresent somebody.

https://hongkongfp.com/2023/08/25/in-first-hong-kong-police-arrest-6-over-finance-scams-involving-deepfake-technology/

jun23

The FBI is warning that scammers are using AI technology to create sexually explicit deepfake photos and videos of people in a bid to extort money from them, also known as “sextortion.”

The threat is particularly disturbing because it exploits the benign photos people post on their social media accounts, which are often public. Thanks to advancements in image- and video-editing software, a bad actor can take the same photos and use them to create AI-generated porn with the victim’s face.

“The FBI continues to receive reports from victims, including minor children and non-consenting adults, whose photos or videos were altered into explicit content,” the agency said(Opens in a new window)

 in the alert. “The photos or videos are then publicly circulated on social media or pornographic websites, for the purpose of harassing victims or sextortion schemes.”

https://www.pcmag.com/news/fbi-scammers-using-public-photos-videos-for-deepfake-extortion-schemes

mai23

A fraud in northern China that used sophisticated "deepfake" technology to convince a man to transfer money to a supposed friend has sparked concern about the potential of artificial intelligence (AI) techniques to aid financial crimes.

China has been tightening scrutiny of such technology and apps amid a rise in AI-driven fraud, mainly involving the manipulation of voice and facial data, and adopted new rules in January to legally protect victims

https://www.reuters.com/technology/deepfake-scam-china-fans-worries-over-ai-driven-fraud-2023-05-22/

mai23


Regula survey: a third of businesses hit by deepfake fraudMonday 1 May 2023 10:39 CET | News

Forensic devices and identity verification solutions provider Regula has issued a survey showcasing that AI-generated identity fraud like deepfakes affects a third of businesses.

The growing accessibility of AI technology for creating deepfakes makes the risks mount and pose a challenge for businesses and individuals alike, with 37% of organisations having experienced deepfake voice fraud, and 29% having fallen victim to deepfake videos.

https://thepaypers.com/digital-identity-security-online-fraud/regula-survey-a-third-of-businesses-hit-by-deepfake-fraud--1262408

ab23

A California judge has tentatively ordered Elon Musk to be interviewed under oath about whether he made certain statements regarding the capabilities of Tesla’s Autopilot features after the company questioned the authenticity of the remarks, claiming Musk is a “target for deep fakes”.

The ruling came in a lawsuit against Tesla, filed by the family of Walter Huang who was killed in a car crash in 2018.

Huang’s family argues Tesla’s partially automated driving software failed. The carmaker contends Huang was playing a video game on his phone before the crash and disregarded vehicle warnings.

https://www.theguardian.com/technology/2023/apr/27/elon-musks-statements-could-be-deepfakes-tesla-defence-lawyers-tell-court

ab23

Deepfake technology leaves “everyone exposed” to life-changing scams, experts have warned, after a German newspaper published an artificially-generated “interview” with Michael Schumacher.

The family of the former Formula 1 driver is reportedly planning to take legal action against outlet Die Aktuelle after it ran a front-page spread of an exclusive “interview” with him - that was entirely generated by AI.

https://www.express.co.uk/news/uk/1761048/michael-schumacher-ai-interview-deepfake

In Europe, an AI-generated “interview” with Formula 1 racing legend Michael Schumacher highlights the danger (Schumacher has not been seen in public since his brain injury in a skiing accident in December 2013.)

The Schumacher family will now take legal action against Die Actuelle, a German tabloid magazine that failed to mark the interview as an AI creation. The magazine fired the editor responsible, but the damage was already done — and out in public.

https://www.ravepubs.com/video-deepfakes-theres-a-new-sheriff-in-town/

jan23

In a recent case involving misusing deepfake technology, the New Taipei City District Court entered a judgment (111-Su-Zi No. 2500) against two Taiwanese YouTubers (“Defendants”) on December 8, 2022, finding them liable for damaging other’s reputation, likeness, and sexual autonomy by misappropriating other’s digital facial images through deepfake technology, and subsequently presenting them in porn materials edited and created by the Defendants.

According to the judgment, the Defendants downloaded vast amount of digital images of the targeted influencers on the internet, modified the downloaded images by deepfake image synthesis, applied the modified images to Defendants’ porn materials and then provided such modified porn materials to their paid members.  Based on the records, the Defendants earned up to NT$13 millions from July of 2020 to October of 2021.

https://www.lexology.com/library/detail.aspx?g=81916986-c2de-45b3-9573-2ae522488d0a

jan23

A set of hackers managed to impersonate Binance chief communications officer (CCO) Patrick Hillmann in a series of video calls with several representatives of cryptocurrency projects. The attackers used what Hillman described as an AI hologram, a deepfake of his image for this objective, and managed to fool some representatives of these projects, making them think Hillmann was helping them get listed on the exchange.

https://www.inferse.com/387080/hackers-used-deepfake-of-binance-cco-to-perform-exchange-bitcoin-news/

dez22

 In several recent high-profile trials, defendants have sought to cast doubt on the reliability of video evidence by suggesting that artificial intelligence may have surreptitiously altered the videos.

These challenges are the most notable examples yet of defendants leveraging the growing prevalence in society of AI-manipulated media — often called deepfakes — to question evidence that, until recently, many thought was nearly unassailable.

There are two central concerns about deepfakes in the courtroom. First, as manipulated media becomes more realistic and harder to detect, the risk increases of falsified evidence finding its way into the record and causing an unjust result.

Second, the mere existence of deepfakes makes it more likely the opposing party will challenge the integrity of evidence, even when they have a questionable basis for doing so. This phenomenon, when individuals play upon the existence of deepfakes to challenge the authenticity of genuine media by claiming it is forged, has become known as the "liar's dividend," a term coined by law professors Bobby Chesney and Danielle Citron.[1]

https://www.wilmerhale.com/en/insights/publications/20221221-the-other-side-says-your-evidence-is-a-deepfake-now-what

dez22

Entre a crise econômica e tecnologias avançadas chegando às mãos dos criminosos, uma das principais apostas do cibercrime para 2023 está no uso de deep fakes para aplicação de golpes com criptomoedas. É o que aponta um alerta da empresa de segurança McAfee, que colocou esta como a principal tendência para o ano novo, principalmente diante de usuários e investidores cada vez mais vulneráveis.

https://br.financas.yahoo.com/noticias/deep-fakes-devem-tornar-fraudes-170000075.html?guccounter=1&guce_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&guce_referrer_sig=AQAAAE4xP9kO2tigeGtjBkv14JWX_w8I-KMzGpdUd4vlBy_9tTLrRrWzqYOUUsMWYjYGVfqSByoBV9J4aNOP2ZLxwQglNVW1kVlIgni-TQMHUgMi6DUKm0XSaZg4VM3xUnwFHCA2MrW2fB1wrWBrnfIn7kv0HfB47uL1CdUv5AU35JUg

dez22

Golpistas utilizaram a técnica deepfake para acessar apps bancários em celulares e furtar mais de R$ 700 mil de clientes de bancos em Campo Grande, segundo a polícia. Para especialistas na área digital, o novo golpe é "sofisticado" e faz com que os usuários de bancos online redobrem a atenção. Segundo investigação da Delegacia Especializada em Repressão a Roubos a Banco, Assaltos e Sequestros (Garras), os hackers estudavam as vítimas nas redes sociais, colhiam imagens e criavam novas imagens digitais por meio de algoritmos. https://g1.globo.com/ms/mato-grosso-do-sul/noticia/2022/12/15/golpistas-usam-tecnica-de-deepfake-para-acessar-aplicativos-de-bancos-e-furtar-especialista-da-dicas-de-protecao.ghtml

dez22

AI image generation tech can now create life-wrecking deepfakes with ease

AI tech makes it trivial to generate harmful fake photos from a few social media pictures.

https://arstechnica.com/information-technology/2022/12/thanks-to-ai-its-probably-time-to-take-your-photos-off-the-internet/

dez22

deepfake phishing
Why deepfake phishing is a disaster waiting to happen
https://venturebeat.com/security/deepfake-phishing/

nov22

Sam Bankman-Fried deepfake attempts to scam investors impacted by FTX

A faked video the FTX founder created by scammers has circulated on Twitter with users poking fun at its poor production quality.

https://cointelegraph.com/news/sam-bankman-fried-deepfake-attempts-to-scam-investors-impacted-by-ftx

out22

New research from New York University adds to the growing indications that we may soon have to take the deepfake equivalent of a ‘drunk test’ in order to authenticate ourselves, before commencing a sensitive video call – such as a work-related videoconference, or any other sensitive scenario that may attract fraudsters using real-time deepfake streaming software.

https://www.unite.ai/gotcha-a-captcha-system-for-live-deepfakes/

out22

SÓ NAO HA MAIS PORQUE A TECNICA AINDA NAO ESTA DESENVOLVIDA

Phishing works so well crims won't bother with deepfakes, says Sophos chap

People reveal passwords if you ask nicely, so AI panic is overblown

https://www.theregister.com/2022/10/17/phishing_beats_deepfakes/

set22 [HOMEM VITIMA DE CHANTAGEM PORN)

It seems that scammers are now becoming bolder, even using technology to steal information and blackmail their victims. Unfortunately, a Singaporean man was the latest victim of such a scam, all because he had answered a phone call from the United Kingdom.

https://goodyfeed.com/man-deepfaked-porn-video-blackmailed/

set22

Audio deepfakes potentially pose an even greater threat, because people often communicate verbally without video – for example, via phone calls, radio and voice recordings. These voice-only communications greatly expand the possibilities for attackers to use deepfakes.

To detect audio deepfakes, we and our research colleagues at the University of Florida have developed a technique that measures the acoustic and fluid dynamic differences between voice samples created organically by human speakers and those generated synthetically by computers.

https://theconversation.com/deepfake-audio-has-a-tell-researchers-use-fluid-dynamics-to-spot-artificial-imposter-voices-189104

ag22

Scammers have created a deepfake of the CEO of crypto exchange firm Binance in online meetings to fool clients, the exec has claimed.

Chief communications officer of Binance Patrick Hillmann revealed in a blog post that the scammers used news interviews and TV appearances over the years to create a “deepfake of him to be used maliciously”.

“Other than the 15 pounds that I gained during Covid being noticeably absent, this deepfake was refined enough to fool several highly intelligent crypto community members,” he said.

https://www.digit.fyi/deepfake-tech-creates-ai-hologram-of-binance-exec/

ag22

Rick McElroy, the cybersecurity strategist at VMware, said that cybercriminals are now incorporating deepfakes into their attack methods to avoid security controls. 

Two out of three respondents in VMware's report saw malicious deepfakes used as part of an attack. It is a 13% increase from 2021, with email as the top delivery method. 

McElroy added that the new goal of bad actors and hackers is to use deepfake technology to compromise organizations and gain access to their environment. They can do this by duping employees into thinking they are dealing with real people. 

https://www.techtimes.com/articles/279444/20220821/deepfake-technology-2022-protect-business-attacks.htm

jun22

Companies hiring for an open IT position might need to do more than scrutinize how prospective employees react to the question “What is your worst quality?” If the prospective hire sneezes or coughs without moving their lips, their worst quality might be that they’re not actually real. The FBI wrote to its Internet Crime Complaint Center Tuesday that it has received multiple complaints of people using stolen information and deepfaked video and voice to apply to remote tech jobs. https://gizmodo.com/deepfakes-remote-work-job-applications-fbi-1849118604 

jun22

Education

6 JUN 2022 1:56 PM AEST

AI and deepfakes present new risks for internet relationships

People looking for genuine relationships via the internet will need to become a lot more savvy about new technologies which expose them to romance fraud at an “entirely new level of risk”, warns QUT internet fraud researcher Associate Professor Cassandra Cross.

• Romance scams amped up with entirely synthetic profiles using deepfake tech
• Deepfake detection tools are limited
• A revised prevention campaign is needed to alert people to this type of deception
• In 2020 alone, Australians lost $131M to romance fraudsters

https://www.miragenews.com/ai-and-deepfakes-present-new-risks-for-internet-795150/

 Maio22
THE THREAT THAT DEEPFAKES POSE TO SCIENCE JOURNALS

https://mindmatters.ai/2022/05/the-threat-that-deepfakes-pose-to-science-journals/