OpenAI launches an advanced voice mode on September 24, 2024, marking a significant development in conversational AI technology. This update was revealed in a screenshot shared by a user on X (formerly Twitter). According to the attached blog post, the voice feature will initially be available only to a select group of users through a limited alpha release.
Although long-term ChatGPT Plus subscribers and participants of previous beta tests, such as SearchGPT, are more likely to be chosen, access will be determined by several criteria. The company has stated that not all users will receive the voice mode at launch.
OpenAI’s GPT-40, launched at its Spring Update event, already showcased impressive multimodal capabilities, including text, vision, and audio functionalities. Demos of real-time translation, code assistance, tutoring, poetry, and singing drew widespread attention. However, despite these advancements, the highly anticipated voice feature was not part of that release.
A few months ago, when OpenAI CEO Sam Altman was asked about the voice update, he humorously responded, “How about a couple of weeks of gratitude for magic intelligence in the sky, and then you can have more toys soon?”
Competitive Landscape Heats Up
As competition intensifies, OpenAI launches an advanced voice mode to capture the growing demand for voice capabilities. While OpenAI has been preparing to launch Advanced Voice Mode, the competition in the AI space has grown significantly. Kyutai, a French non-profit AI research lab, introduced Moshi, a multimodal AI model capable of real-time conversation with users. This model is similar to OpenAI’s intended vision for its upcoming voice feature.
At the same time, Hume AI launched EVI 2, a foundational voice-to-voice AI model. Available in beta, EVI 2 promises more natural, human-like conversations. It can engage in fluent, fast-paced interactions, adapting its tone and style based on user preferences. EVI 2 includes multilingual capabilities and is trained to maintain specific personalities and voices for users, preventing voice cloning to ensure privacy and security. One of EVI 2’s standout features is its experimental voice modulation system, which lets developers customize voices by adjusting elements like gender, pitch, and nasality.
Meanwhile, Amazon has teamed up with AI safety startup Anthropic to enhance the conversational capabilities of its virtual assistant, Alexa.
Google has also stepped up its game, releasing Astra, an AI agent from the Gemini model family. Astra’s advanced multimodal processing enables it to interpret and respond to text, audio, video, and visual inputs simultaneously, offering a versatile AI solution.
The Competitive Edge: Is OpenAI Behind?
With its innovative features, OpenAI launches an advanced voice mode, promising a more natural user experience. While OpenAI has been working on its voice features, other companies have already made significant strides. For example, Hume AI’s EVI 2 has introduced a highly customizable voice-to-voice model, designed to simulate more human-like interactions. With its ability to adjust voice characteristics such as pitch, nasality, and gender, EVI 2 offers developers flexibility that OpenAI has yet to demonstrate. This kind of voice customization could be key in industries like entertainment, customer service, and education.
Furthermore, Kyutai’s Moshi and Google’s Astra have already entered the real-time conversational AI space, offering similar voice capabilities that OpenAI’s users are still waiting for. The competitive landscape shows that OpenAI might be playing catch-up in the voice AI space. While the company’s reputation and previous success with GPT-40 are in its favor, the rapid development by competitors suggests that the market won’t wait. If OpenAI doesn’t make its voice mode widely accessible soon, its delayed entry could reduce its impact, particularly when companies like Amazon are partnering with Anthropic to enhance their voice assistants.
As OpenAI’s voice mode launch approaches, it enters a competitive landscape where various tech companies are striving to make AI more conversational, interactive, and human-like. With several new features in development, the race to dominate the voice AI market is heating up.
Also Read: Godfather of AI Warns About OpenAI’s New Model and Its Potential Risks.
