I Made a Podcast with an AI Cohost
Notebook LM VS OpenAI Realtime API
I just made a podcast with an AI cohost — using the new OpenAI Realtime API
I’ll explain how I made it and how you might want to use the OpenAI realtime API for your podcast or applications — in this article.
If you don’t have a paid Medium account, you can read for free here
👉 Sign up to our free 5-Day email course to grow 🚀 and earn💲in the AI age
What is the OpenAI Realtime API?
OpenAI just launched another huge update — a realtime API for voice.
Why is this a big deal?
You can now create applications that are voice-to-voice.
You can create voice applications and communicate with them as if you are speaking to a real person.
I just tried the realtime voice API on the OpenAI playground — and will show you how to do it.
Before you would need to transcribe your voice — get the assistant to interpret the meaning, and then respond as a voice.
This is way too slow for real-time voice applications — such as podcasts
According to OpenAI:
With the new Realtime API, you can now create low-latency speech-to-speech experiences — think ChatGPT’s Advanced Voice, but for your own app, using the six preset voices already supported in the API. Until now, building voice into apps required stitching together multiple models, causing latency or unnatural interactions.
The new realtime voice API does all of this as a single API — allowing for almost real-time voice interactions.
How to try the Realtime API?
2. Plug in a microphone and talk with the Realtime API in the playground. You can interact with the AI voice assistant in real time.
Click the “Start Session” button
How to Make a Podcast using the Realtime API?
I just used a screen recording software. There are many free ones to try.
Just start talking and record the tab of your conversation with the realtime assistant API — in the OpenAI playground.
Make sure to include your microphone audio as well as the browser audio to record your AI cohost.
Tips for using the OpenAI Realtime API
I made a simple podcast and pretended to be a host of a show about AI.
I used the realtime API assistant as my cohost.
Here are some tips to improve your results.
Adjust the settings to your needs. You can decide how quickly the AI Assistant responds and also adjust a system prompt, voice style, and other variables to get a different result.
I just used the default settings in my example.
But I did add a function — which will be the next tip.
2. Add functions to give your AI voice assistant more power.
By default, the reatime API doesn’t allow you to search the web. So I clicked the add function button and used the AI helper to create a tool to allow the voice assistant to search the web.
The amazing thing is, I just explained it and didn’t need any code!
My Prompt:
Add a search the web ability to the AI assistant that allows the assistant to search the web while speaking.
I can see why they don’t have this in by default because it adds a delay.
But as a cohost for my podcast, one of the interesting functions I wanted to try was to get the AI to search the web during our conversations.
It did add a 15 second delay when I asked the AI Assistant to search the web about NotebookLM.
But I cut this delay out in the recording before publishing.
But the rest of the audio I didn’t cut at all — so you can see how seamless the voice interactions of the realtime API are.
I did try other web searches such as real-time weather updates, and these were much quicker — so it depends on the search, but since this is an API you could make a program that accounts for this delay.
Admittedly, the AI cohost sounded a bit robotic compared to NotebookLM generated AI podcasts.
But I did this podcast with the default settings and recorded the whole podcast within two minutes of playing around with it.
This is the first version so I’m really excited to how it progresses.
My brother and I just started a podcast about AI and marketing in the Age of AI and I’ll experiment with adding another AI cohost in the future using this.
You can check out our AI podcast here.
My other Channels:
👉 Sign up to our free 5-Day email course to grow 🚀 and earn💲in the AI age
You can also sign up for my newsletter on how to use AI to earn more money.
Check out our YouTube Channel
Follow us at our website: AI Growth Guys
This Article was originally posted on Addison Best Medium.com