May 2023 Summaries

AI21 Labs recently concluded the largest Turing Test experiment in history, with over 15 million conversations conducted by more than two million participants worldwide. The social Turing game "Human or Not?" allowed users to chat for two minutes with either an AI bot or a fellow human and then guess their counterpart's identity. Main insights from the experiment include that 68% of people guessed correctly, with humans being easier to identify than bots. France had the highest percentage of correct guesses at 71.3%, while India had the lowest at 63.5%. Strategies for identifying AI bots included looking for spelling and grammatical errors, asking personal questions, and testing current events knowledge.