AI's Next Frontier: Mining Human Emotion from Improv Actors

Key Takeaways

• AI companies are hiring improv actors to improve AI's ability to understand and replicate human emotions.
• Handshake AI, a data provider for OpenAI and others, is actively seeking performers for paid collaborative projects.
• The goal is to create more realistic and human-sounding AI voice interactions.
• Concerns are rising about the potential for AI to displace human creative roles.
• Some performers view this as an opportunity, while others express concerns about the ethical implications and long-term effects on the entertainment industry.

The quest to imbue artificial intelligence with genuine-sounding emotion has led AI companies to an unexpected source: the world of improv comedy. Companies like Handshake AI are actively recruiting actors and improvisers to participate in paid projects designed to train AI models on the complexities of human emotional expression. This initiative reflects a broader trend within the AI industry to refine the ability of AI systems to engage in more natural and believable interactions.

Handshake AI's job posting specifically targets individuals with backgrounds in acting, improv, sketch comedy, or theater. The company seeks individuals who can demonstrate emotional awareness, express emotions authentically, and adapt their emotional responses in a way that feels human. These performers will be paired with others to improvise scenes based on light prompts, essentially testing the limits of large language models' understanding of human emotion and tone.

The rise of multimodal AI models, capable of generating images, videos, and voice interactions, fuels this demand for emotionally intelligent AI. Companies like OpenAI, with its advanced voice mode in ChatGPT, and xAI, with voice chat in Grok, are investing heavily in creating AI that can communicate in a way that mimics human conversation. By training AI on the nuanced performances of improv actors, these companies hope to create AI systems that are more engaging, relatable, and ultimately, more useful.

However, this trend raises ethical questions and sparks debate within the creative community. While some performers view this as a unique opportunity to contribute to the development of AI, others express concerns about the potential for AI to eventually replace human actors and performers. Reddit forums dedicated to improv comedy have seen lively discussions about the Handshake AI job posting, with some users labeling it as "dystopian" and expressing fears about the future of live entertainment.

The job description emphasizes the flexibility and part-time nature of the work, with an average pay of $74 per hour. However, reports suggest that the starting pay can decrease quickly once participants are onboarded, and the availability of tasks can be unpredictable. This raises concerns about the long-term sustainability and fairness of these AI training projects.

Despite the potential downsides, some remain optimistic about the future of human creativity. They predict a resurgence of live comedy and other forms of in-person entertainment as people seek genuine, unscripted experiences that cannot be replicated by AI.

Why it matters

The effort to train AI on human emotion highlights the ongoing evolution of AI technology and its increasing integration into various aspects of our lives. While the potential benefits of emotionally intelligent AI are significant, it is crucial to address the ethical implications and potential impact on human creative professions. The debate surrounding this trend underscores the need for a broader conversation about the future of work in the age of AI and the importance of ensuring that AI development benefits both technology and society as a whole.