Large tech platforms including TikTok, X and Facebook will soon have to identify AI-generated content in order to protect the upcoming European election from disinformation.
"We know that this electoral period that's opening up in the European Union is going to be targeted either via hybrid attacks or foreign interference of all kinds," Internal Market Commissioner Thierry Breton told European lawmakers in Strasbourg on Wednesday. "We can't have half-baked measures."
The social media platform X, formerly known as Twitter, has blocked searches of pop superstar Taylor Swift after explicit, artificial intelligence (AI) generated images went viral on social media, an executive confirmed Sunday.
As of Sunday night, searches of “Taylor Swift” on the social media platform showed the error message, “Something went wrong. Try reloading.”
Popular search engines like Google and Bing are making it easy to surface nonconsensual deepfake pornography by placing it at the top of search results, NBC News reported Thursday.
These controversial deepfakes superimpose faces of real women, often celebrities, onto the bodies of adult entertainers to make them appear to be engaging in real sex. Thanks in part to advances in generative AI, there is now a burgeoning black market for deepfake porn that could be discovered through a Google search, NBC News previously reported.
NBC News uncovered the problem by turning off safe search, then combining the names of 36 female celebrities with obvious search terms like "deepfakes," "deepfake porn," and "fake nudes." Bing generated links to deepfake videos in top results 35 times, while Google did so 34 times. Bing also surfaced "fake nude photos of former teen Disney Channel female actors" using images where actors appear to be underaged.
Facebook’s Tolerance for Audio Deepfakes Is Absurd
In the world of misinformation, fake audio can have a more sinister effect than video — especially during a tumultuous election year.
https://www.bloomberg.com/opinion/articles/2024-01-09/elections-2024-facebook-should-ban-audio-deepfake-clips-of-trump-and-others?embedded-checkout=true
YouTube is updating its cyberbullying and harassment policies and will no longer allow content that “realistically simulates” minors and other victims of crimes narrating their deaths or the violence they experienced.
The update appears to take aim at a genre of content in true crime circles that creates disturbing AI-powered depictions of victims — including children — that then describe the violence against them. Some of the videos use AI-generated, childlike voices to describe gruesome violence that occurred in high-profile cases. Families of victims depicted in the videos have called the content “disgusting.”
YouTube’s policy update will result in a strike that removes the content from a channel and also temporarily limits what a user can do on the platform. A first strike, for example, limits users from uploading videos for a week, among other things. If the policy is violated again within 90 days, penalties increase, with the eventual possibility of having the entire channel removed.
Platforms including YouTube have in recent months unveiled AI-driven creation tools, and along with them new policies around synthetic content that could confuse users. TikTok, for one, now requires creators to label AI-generated content as such. And YouTube itself announced a strict policy around AI voice clones of musicians — with another set of looser rules for everyone else.
https://www.theverge.com/2024/1/8/24030107/youtube-ai-deepfakes-true-crime-victims-minors
X-rated celebrity deepfakes are in heavy circulation online, as artificial intelligence and advanced technology blur the lines between real images and doctored content.
Despite Twitter’s policies against misleading media and non-consensual nudity, digitally altered imagery of popular TikTok creators and celebrities has cropped up on the platform, according to an NBC report.
Twitter searches for TikTok creators Addison Rae Easterling, Charli D’Amelio and Bella Poarch revealed sexually explicit deepfakes — manipulated videos or images where a person’s face is superimposed on someone else’s body.
Some viral TikTok videos may soon show a new type of label: that it’s made by AI.
The ByteDance-owned app is developing a tool for content creators to disclose they used generative artificial intelligence in making their videos, according to a person with direct knowledge of the efforts. The move comes as people increasingly turn to AI-generated videos for creative expression, which has sparked copyright battles as well as concerns about misinformation.
https://www.theinformation.com/articles/tiktok-is-developing-ai-generated-video-disclosures-as-deepfakes-rise
As the prospect of a US TikTok ban continues to grow, the video app has refreshed its content moderation policies. The rules on what content can be posted and promoted are largely unchanged but include new restrictions on sharing AI deepfakes, which have become increasingly popular on the app in recent months.
The bulk of these moderation policies (or “Community Guidelines,” in TikTok’s parlance) is unchanged and unsurprising. There’s no graphic violence allowed, no hate speech, and no overtly sexual content, with gradated rules for the latter based on the subject’s age. One newly expanded section, though, covers “synthetic and manipulated media” — aka AI deepfakes, which have become increasingly popular on the app in recent months.
Mark-Zuckerberg-owned Facebook and Instagram scrambled to remove hundreds of video clips touting an app that creates AI-generated deepfake videos of Hollywood stars in sexually suggestive poses.
One ad that circulated on social media shows a deepfake of “Harry Potter” heroine Emma Watson gazing sensually into the camera while kneeling to the floor just moments before it appears she is about to perform a sex act.
The ad then displays the name of the app, FaceMega, which touts itself as a tool for creating “deepfake face swap videos.”
Hundreds of sexual deepfake ads using Emma Watson’s face ran on Facebook and Instagram in the last two days
Even a brief unintentional glimpse at those sorts of images “will be removed and will result in an enforcement,” the company writes. And if you intentionally promote, create, or share deepfake porn, that’s grounds for an instaban: doing that “can result in an indefinite suspension on the first offense.”
The company isn’t doing this on a whim — as BuzzFeed News and NBC News reported last month, Twitch recently had its own deepfake scandal. On January 30th, Twitch streamer Brandon “Atrioc” Ewing left a browser window open on stream that reportedly showed the faces of popular female Twitch streamers, including Pokimane, QTCinderella, and Maya Higa, “grafted onto the bodies of naked women,” as BuzzFeed tells it. In a tearful apology stream, Atrioc admitted he visited a deepfake site out of “morbid curiosity” about the images. “I just clicked a fucking link at 2AM, and the morals didn’t catch up to me,” he said while promising never to do anything like that again.
https://www.theverge.com/2023/3/7/23629634/twitch-deepfake-porn-ncei-ban-enforcement-atrioc-pokima-ne
Ultra sexualised images of Billie Eilish likened to “deepfake pornography” went viral on TikTok and were amplified by the app’s algorithm.
A photo gallery video featuring the singer’s face on sexually exaggerated bodies was seen by 11 million people in four days before being removed for violating TikTok’s community guidelines around sexual harassment.
https://www.vice.com/en/article/m7gnya/billie-eilish-tiktok-ai-art
Nas últimas semanas, os usuários do TikTok compartilharam uma captura de tela falsa de uma história inexistente da CNN, alegando que as mudanças climáticas são sazonais. Um vídeo foi editado para sugerir que a secretária de imprensa da Casa Branca, Karine Jean-Pierre, ignorou uma pergunta do repórter da Fox News, Peter Doocy.
Outro vídeo, de 2021, ressurgiu há alguns meses com o áudio alterado para que a vice-presidente Kamala Harris parecesse dizer que praticamente todas as pessoas hospitalizadas com Covid-19 foram vacinadas. (Ela disse “não vacinadas”.)
https://oglobo.globo.com/economia/tecnologia/noticia/2022/11/tiktok-pode-virar-porta-de-entrada-para-videos-manipulados-e-fake-news-dizem-especialistas.ghtml
tiktok
Worries Grow That TikTok Is New Home for Manipulated Video and Photos
Misleading edits, fake news stories and deepfake images of politicians are starting to warp reality on the popular video platform.
Tech companies have spent years trying new tools to spot manipulations such as deepfakes. During the 2020 election season, TikTok, Facebook, Twitter and YouTube vowed to remove or label harmful manipulated content.
A 2019 California law made it illegal to create or share deceptive deepfakes of politicians within 60 days of an election, inspired in part by videos that year that were distorted to make Speaker Nancy Pelosi appear drunk.
TikTok said in a statement that it had removed videos, found by The New York Times, that breached its policies, which prohibit digital forgeries “that mislead users by distorting the truth of events and cause significant harm to the subject of the video, other persons or society.”
“TikTok is a place for authentic and entertaining content, which is why we prohibit and remove harmful misinformation, including synthetic or manipulated media, that is designed to mislead our community,” said Ben Rathe, a TikTok spokesman.
But misinformation experts said individual examples were difficult to moderate and almost besides the point. Extended exposure to manipulated media can intensify polarization and whittle down viewers’ ability and willingness to distinguish truth from fiction.
Misinformation has become a problem on the platform ahead of the midterms. In recent days, researchers from SumOfUs, a corporate accountability advocacy group, tested TikTok’s algorithm by creating an account and searching for and watching 20 widely viewed videos that sowed doubt about the election system. Within an hour, the algorithm had switched from serving neutral content to pushing more election disinformation, polarizing content, far-right extremism, QAnon conspiracy theories and false Covid-19 narratives, the researchers found.
TikTok said it had removed content, cited by the report, that violated its guidelines and would update its system to catch the search terms used to find the videos.
“Platforms like TikTok in particular, but really all of these social media feeds, are all about getting you through stuff quickly — they’re designed to be this fire hose barrage of content, and that’s a recipe for eliminating nuance,” said Halsey Burgund, a creative technologist in residence at the M.I.T. Open Documentary Lab. “The vestiges of these quick, quick, quick emotional reactions just sit inside our brains and build up, and it’s kind of terrifying.”
https://www.nytimes.com/2022/11/04/technology/tiktok-deepfakes-disinformation.html
One of the world’s most popular social media platforms, TikTok, is now hosted to a steady stream of deepfake videos. Deep fake is a type of artificial intelligence used to create convincing images, audio, and video hoaxes. Deepfake videos use AI tools to convincingly replace a person’s face or voice with somebody else’s, allowing the synthesized media to be used playfully or to spread misinformation maliciously.
Deepfakes are videos in which a subject’s face or body has been digitally altered to make them look like someone, usually a famous person. Deepfake videos are often used for harmless purposes like memes, social media filters, or face-swap apps. But deepfakes can also be used maliciously to spread misinformation, create fake news, or launch revenge videos. Recently, a deceptively convincing viral video on TikTok featuring what looked like actor Tom Cruise. Those videos may have seemed real, but they were actually made with deepfake technology.
https://www.analyticsinsight.net/tiktokers-vs-deepfakes-the-misinformation-battle-never-settles/
Scholars and political observers have raised concerns over public opinion maneuvering on social media in Southeast Asia as three countries in the region – the Philippines, Malaysia and Indonesia, are gearing up for elections.
Propagandists’ strategic maneuvering of public opinion on social media remains a dangerous threat to democracy in Southeast Asia. Over the years, strategic use of cybertroopers in Southeast Asian countries has been prominent, especially during the election periods.
.The study makes use of situational crime prevention framework for analyzing online community reactions to the banning of deepfake pornographic content from Reddit. Findings: Analysis indicates that Reddit users voiced several shortcomings that are currently present in Reddit’s platform management approach. In particular, users emphasized issues related to the lack of a consistent and transparent approach to community rule enforcement, as users believed the rule changes to be sudden and poorly reasoned. The general reactionary nature of Reddit’s approach to moderating community-harming actions also was a point of emphasis, alongside the platform’s continued rigid stance on freedom of expression, even with regard to illegal and demeaning content. Regarding Reddit and the new rules on involuntary pornography and the sexualization of minors, enforcement of sitewide policy appears contingent on external influences, such as attention from mainstream media or financial matters, rather than stemming from an inherent stance on decreasing community-harming activities. https://www.emerald.com/insight/content/doi/10.1108/S2050-206020210000020008/full/html
It’s difficult to say if 2022 is the year Big Tech will finally be hit with significant new rules, but a series of regulatory and legal threats launched in 2021 will provoke major battles. In the United States, the Federal Trade Commission’s anti-trust lawsuit against Facebook represents a genuine threat to the social media giant, though a court has already dismissed the case once. More lawsuits and a federal investigation — and maybe even finally new laws — are possible in the wake of the damning whistleblower leaks showing Facebook executives knew its sites could cause harm. Some critics say the firm’s major push into realizing the metaverse — a virtual reality version of the internet — is an effort to change the subject after years of criticism. Apple dodged a bullet in 2021 when a US federal court said Fornite maker Epic Games failed to show the iPhone giant held an illegal monopoly, but the firm was still ordered to loosen control over its App Store. Both sides have appealed. New regulations may come sooner in the EU as it pushes through new laws, such as the Digital Services Act which would create much stricter oversight of harmful and illegal content on platforms like Facebook. https://www.macaubusiness.com/tech-2022-trends-meatless-meat-web-3-0-big-tech-battles/
CONTRADITORIO??? Live, from your smartphone! It’s you and your friends in a personalized sketch-comedy show, brought to you by Snapchat. The new 10-episode Snap original series “The Me and You Show” taps into Snapchat’s Cameos — a feature that uses a kind of deepfake technology to insert someone’s face into a scene. Using Cameos, the show makes you the lead actor in comedy skits alongside one of your best friends by uploading a couple of selfies. https://variety.com/2021/digital/news/snapchat-me-and-you-show-sketch-comedy-deepfake-1235073852/ (incluído na aula de 9/12/21)
O Facebook revelou um novo projeto que, aproveitando a tecnologia de IA da empresa, é capaz de imitar a escrita de uma pessoa bastando ter apenas uma palavra como base de estudo. Este sistema analisa a escrita do utilizador, e é capaz de converter qualquer outro texto que se pretenda para uma grafia similar.
Apelidado de TextStyleBrush, este novo sistema é capaz de reconhecer por IA o estilo de escrita de cada utilizador, bastante ter uma palavra como estudo. Feito isso, o sistema é capaz de replicar qualquer texto que se pretenda dentro dessa grafia, criando resultados verdadeiramente surpreendentes.
Basicamente, podemos considerar esta tecnologia como um “deepfake” para escrita – o que pode ser visto como algo bom ou mau. O sistema não necessita de ficar limitado apenas a um estilo de escrita, é capaz também de reproduzir fontes.
Por exemplo, se possui um texto numa determinada fonte que pretenda aplicar noutro conteúdo, o TextStyleBrush é capaz de recriar a mesma – até se esta fonte for algo digital, e não propriamente uma escrita manual.
Mas não está claro quão bom pode ser o trabalho de reforço das políticas das redes sociais quando o volume de deepfakes disparar. E se, digamos, um estudante disser uma piada má numa deepfake com a imagem do seu professor de matemática — e o director não se aperceber que o vídeo é falso? Todas as empresas dizem que vão continuar a avaliar as suas abordagens.
Uma ideia: as redes sociais podiam reforçar a protecção ao tornarem como prática a identificação automática dos deepfakes com marcas — as tais marcas de água escondidas — ainda que não seja imediatamente óbvio que os vídeos possam ser prejudiciais. O Facebook e a Google têm investido em tecnologia para as identificar.
https://www.publico.pt/2021/03/26/p3/noticia/qualquer-pessoa-iphone-deepfake-nao-prontos-vai-acontecer-1956134
CRITICAS AS REDES SOCIAIS
Hany Farid, a professor at the Univeristy of California, Berkeley, warned lawmakers that the major technology platforms like Facebook and Google need to play a role in addressing deepfakes, but the tech companies have been slow to address the problem. "You have to understand here that we are fighting against business interests," Farid said. "In the last six months, the language coming out of the technology sector is encouraging, but I don't know there's a lot of action yet." "I can help with the technology problem, but I don't know what I can do with the policy problem when you say you aren't arbiters are the truth," Farid said. "They have to start getting serious about how their platforms are being weaponized to great effect and disrupting elections, inciting violence and sowing civil unrest." LINK (incluído na aula de 9/12/21)
------------------------------------AULA de dez20---------
Farid defende iniciativas de educação sobre os perigos dos deep fakes, para que os usuários entendam como nem tudo o que enxergam pode ser real, e de que forma discursos desse tipo podem florescer em um ambiente de polarização. O especialista também volta seus olhos às redes sociais e plataformas online, que considera responsáveis pelo atual clima de animosidade. Ele faz uma proposta de regulamentação sobre o alcance dos discursos veiculados e pede que isso não se confunda com censura, uma vez que não se trata de trabalhar o que é dito, e sim, como isso é amplificado e chega aos ouvidos do público, com informações mentirosas e dados manipulados sendo veiculados ao lado da verdade e, agora, também dos deep fakes.“As plataformas não são neutras. Elas usam algoritmos para exibir conteúdo de acordo com a preferência dos usuários e isso acaba contribuindo para a polarização, uma vez só vemos o que o sistema julga ser conveniente”, completa Farid. Ele sugere medidas oficiais de responsabilidade corporativa também no que toca o funcionamento das plataformas e alerta que o tempo urge. Quanto mais o relógio corre, mais desfavorável a situação e mais perdida se torna a batalha. https://canaltech.com.br/inteligencia-artificial/sociedade-pode-estar-perdendo-a-guerra-contra-os-deep-fakes-alerta-professor-172775/
Facebook and Twitter said on Tuesday that they’ve removed a network of accounts that were promoting a fake news outlet, which was staffed by fictitious journalists with AI-generated headshots. According to Facebook, the network was linked to Russia‘s most notorious troll farm: the Internet Research Agency (IRA). The company says the network primarily sought to amplify a purportedly independent left-wing news site called PeaceData that was run by fake editors. https://thenextweb.com/neural/2020/09/02/russias-most-notorious-troll-farm-reportedly-used-deepfakes-to-push-a-fake-news-outlet-on-facebook/
Political groups which create websites designed to look like news outlets will no longer get the same treatment as independent media on Facebook, the social network said Tuesday. Facebook said the rise of political sites masquerading as news outlets prompted a change in policy, and that these won't be included as part of its Facebook News. These partisan sites may remain on the platform but will no longer get a "news exemption" for their ads and will be "held to the same standard as political entities on Facebook," according to a statement from the California giant. https://today.rtl.lu/news/business-and-tech/a/1563326.html
Assim, o Facebook lançou o chamado “red team” ("time vermelho", em tradução literal), voltado somente para tentar burlar o sistema e antecipar estas ações e encontrar brechas para filtros tanto no Instagram quanto no próprio Facebook. A companhia está trabalhando com uma empresa MITRE Corporation, que levanta vulnerabilidades em IAs. Ela é voltada para descobrir falhas como filtros ou modos de criar uma imagem para enganar um sistema de IA, fazendo-o categorizar uma arma como se fosse um helicóptero, por exemplo. A reportagem da Wired conversou com o líder do red team no Facebook, Cristian Canton, e mostrou outros exemplos que vão desde tornar uma foto invisível para detecção, até colocar recursos em banco de dados para dificultar o treinamento de inteligências artificiais https://canaltech.com.br/inteligencia-artificial/facebook-cria-time-interno-para-burlar-seus-proprios-sistemas-de-ia-168806/
How Facebook plans to handle a deepfake posted by Trump
Facebook and Twitter differ in their approaches. https://www.dailydot.com/debug/deepfake-twitter-biden-trump-facebook/
6. What are companies doing?
Facebook removes dozens of accounts and pages each month for what it calls “coordinated inauthentic behavior,” including on its Instagram platform. One Russia-directed network yanked in March was targeting the U.S., while two of eight pulled in April originated in the U.S. and also focused domestically. Facebook has expanded a fact-checking program aimed at labeling fake news, but refused to subject political advertising to such scrutiny on free speech grounds. “People should be able to hear from those who wish to lead them, warts and all,” the company said. It did implement stronger verification rules for political advertisers, including requiring proof that they have a domestic address to place ads in the U.S. It also has closed hundreds of accounts and has begun removing (or labeling) deepfakes and other “deceptively altered or fabricated” media. Facebook has said that it will remove deepfake videos intended to mislead, but not those edited in traditional ways. https://www.washingtonpost.com/business/how-disinformation-has-morphed-for-the-2020-election/2020/05/14/72910b40-95ca-11ea-87a3-22d324235636_story.html
Google, along with the University of California at Berkeley, has recently published a paper that makes a claim that best forensic classifiers (trained AI that distinguishes between real and synthetic) are prone to adversarial attacks. This follows a past work of researchers from the University of California at San Diego, who proved that it is possible to bypass a fake video detector by simply injecting information into each frame and synthesizing videos using existing AI generation methods. https://analyticsindiamag.com/researchers-dug-deeper-into-deepfake-to-uncover-can-of-worms/
What makes detection even more difficult is social media, which disseminates content - fake or real - in seconds. Those intent on deceiving can inject fake content onto social media platforms instantly. Even successful debunking would likely be too late to stop the fake content from spreading, and cognitive dissonance and bias would more greatly influence consumers' decisions. https://www.weforum.org/agenda/2020/03/how-to-make-better-decisions-in-the-deepfake-era/
17/11/2019 BOM PARA O TWITTER? Twitter’s
crackdown on deepfakes could insure the company’s survival (LINK)
Mar20When the microblogging platform Twitter applied its “manipulated media” tag for the first time on 8 March 2020, it was on an edited video of a speech by former Vice President Joe Biden. The tag informs netizens when a photo or video has been “significantly altered or fabricated,” a more focused approach at targeting disputed visual-based content. While certainly a step forward, tackling the challenges of disinformation on social media remains an uphill battle. https://intpolicydigest.org/2020/03/20/tagging-manipulated-media-in-a-polarized-world/
FB: https://www.thestreet.com/video/facebook-deepfake-ban
No comments:
Post a Comment