MacDirectory magazine is the premiere creative lifestyle magazine for Apple enthusiasts featuring interviews, in-depth tech reviews, Apple news, insights, latest Apple patents, apps, market analysis, entertainment and more.
Issue link: https://digital.macdirectory.com/i/1515807
A.I. and 23andMe Follow Ups By SecureMac.com AI Experiment Reveals People Struggle to Distinguish Humans from Bots in Online Conversations In a surprising experiment conducted by AI21, a competitor to OpenAI, participants engaged in two-minute conversations with online strangers, attempting to discern whether they were interacting with a human or an AI bot. The game, titled “Human or Not,” utilized AI bots based on leading large language models (LLMs) such as OpenAI’s GPT-4 and AI21 Labs’ Jurassic-2. VentureBeat reports that the results of the experiment were eye-opening. Participants successfully identified fellow humans 73% of the time, but when interacting with bots, their accuracy dropped to just 60%. The game, which has been live for over seven months, continues to attract participants, and over a million conversations have been analyzed. Interestingly, the experiment revealed that certain expectations, such as flawless sentence structure and responses, did not reliably indicate whether the interlocutor was human or artificial. Participants often assumed that bots wouldn’t make typos, grammar mistakes, or use slang, but the LLMs were trained to incorporate these human-like characteristics. After a month of the experiment and millions of conversations, researchers found that 32% of participants couldn’t distinguish between human and AI interactions. Amos Meron, the creator of the game and creative product lead at AI21 Labs, emphasized that the primary purpose of the experiment is to educate people about the capabilities of AI in conversational settings. Meron noted that the real danger lies in people being unaware of the technology, especially as AI-powered bots become increasingly sophisticated. He emphasized the need for awareness to prevent misuse of such technology by bad actors, influencers, scam artists, or anyone with ill intentions. As concerns grow about the potential misuse of AI technology, especially in the context of upcoming elections, Meron suggests that discussions about the impact and implications of AI should become more prevalent. With the projection that, by the end of 2023, many products could possess advanced AI capabilities, the experiment aims to prompt necessary conversations about the evolving landscape of online interactions and the need for public awareness.