chat gpt's advanced voice mode has been here for about a month and I've been scanning the internet every single day since then plus using this on a daily basis and now I pull together all the different ways I've been using it the team has been using it and the entire internet has been using it in this video I'll show you a bunch of mind-blowing use cases like how to set it up to act as a universal translator or how to roleplay a variety of scenarios with the presets being all in the description of this video
plus I'll also give you a glimpse at what people are already building with this because during open a death day they released a realtime voice API which is the API equivalent as of the advanced voice mode I could have made this video a whole lot longer but I decided to just pick the very best use cases here that might benefit somebody out there so grab a drink sit back relax and let's have a look at everything that is possible with in chat gpt's brand new advanced voice feature that as of now is only available to
paid users but before we do that I want to give you a few General tips because I found a few ways to improve your experience with the advanced voice mode which might not be obvious to everyone using it before we get into these concrete ways that you can use it or people have been using it I want to show you a few tips and tricks that apply to everything we will look at this is going to be super brief but very valuable because some of these things might not be intuitive to everyone first up it's
the fact that custom instructions actually work with this so if I'm on my phone over here and I navigate to the settings and then I go to personalization and then here customized chat GPT whatever I enter into these two boxes namely the second one is ideal here because it affects effects how chat GPD responds is going to be applied to every single new conversation that I start with the voice assistant meaning if I have a preset which I'll give you a bunch of in this video you can put it in here and start the conversation
using that preset this is the only way because Voice Assistant only works in new chats so you cannot copy paste into the chat you need to add it to the custom instructions secondly this thing can speak over 50 languages and you can totally use that matter of fact you could even use custom instructions and say something like always reply in in German brand new chats and let's ask something simple what have you been eating today there you go and speaking German you can switch on the fly in the middle of the conversation just tell it
to speak a certain language it'll switch and do that more tips on this later and here's my last tip and this is something I learned from the team you can actually make it stop if you're sometimes annoyed by the fact that it just keeps on talking even though you might want it to stop you can do something like this so what have you been eating today oh wait hold up could stop talking until I tell you to start again okay now you can chill and do something for example if you're using it to guide you
for a recipe now you can get the ingredients and do stuff and let's continue and we're back at a German jet gbt talking to you again so these tips will be useful with everything we look at and now let's get into the first category of use cases which is tutoring and this is arguably the biggest one and the one that might just change the entire world in a few years here outdated education system hello and if you're in education listen up because you can enhance your teaching or learning experience with these today and here's my
first preset for you you can copy paste it into the custom instructions from the description below or you can do the second alternative on how to set up a preset which is opening the conversation with a specific phrase and then I'll read out this tutoring prompt which will help assess my language proficiency let's conduct a mock oral language proficiency assessment I'll respond as a learner and you guide me through the assessment asking questions of increasing difficulty and providing feedback great let's get started imagine this is a conversation about your daily life to begin can you
tell me about your usual morning routine just a brief overview sure usually I wake up and I read for about half an hour and then I drink espresso that sounds like a nice start to the day now let's go a bit deeper can you describe an interesting experience you've had recently maybe something unexpected or out of the ordinary okay yeah I Was preparing for a use case video for the advanced voice mode for the past few weeks and what I ran into is the fact that the responses are actually different than when I prompt GPT
40 it's more conversational a little more simplistic more like a human less like a encyclopedia that sounds like quite the discovery it's fascinating how the nuances in communication can change with different models how do you feel about these differences do you prefer the more conversational Style so you see the point it follows the preset and it tutors you it's there as a mentor for you on this Learning Journey now in the end you can take all that and ask for feedback and this way you can prepare for a language proficiency assessment without the need for
another person to talk to you you can do this 24/7 it never gets tired and it all comes at a price tag of $20 a month pretty good deal in my opinion there's thousands of these use cases we'll talk about more of them later on in this video but this is only the beginning because you can build applications on top of this through the API that openi released during the dev day and I found various use cases that people have built on top of that which to me were very interesting so let me share two
of them with you that sort of go hand inand with this tutor idea the first one is AI companions there's no doubt that something like a digital friend that is powered by this voice is going to be a part of our life very soon here maybe already is I mean people are using this feature as somebody to talk to and then on the other hand people are even building Discord Bots which just hang out with them during their gaming session so although this might not be a tutor this is more like inspiration for to see
where all of this is heading there you go open AI voice powered anime character I guess and then as we're talking about this Discord bot as you might know Discord is mostly used for gaming Communications so when people play together they hop on Discord and they chat to each other now they have ai friend in the mix here and I know this is a little tangential but I think it's appropriate and we'll spend about a minute on it and then we get back to the next category of voice use cases but open recently released a
collaboration with altia I believe it's pronounced and simply put what this did is inside of M inecraft it spawned an extra player that had a voice engine I'm not exactly sure if it's the advanced voice but doesn't really matter basically this extra player that is AI controlled AI spoken can talk to you while you play and you can spawn your gaming buddy within this me and the team actually went in and tested this and it actually works you can download this today try it out and you have this Minecraft player in there that runs around
with you does the missions with you and you can even talk to him it doesn't always work it makes mistakes but check out this short clip of game footage catch you later squid stay enigmatic and intriguingly fishy my pixelated friend or this clip where the AI is actually building a bridge across the canyon to mine some rare resources on the other side of the canyon where you going you going to get that coal focus on pumpkins and coal nothing else got it he is building a bridge to the coal all on its own it's like
having a digital friend that is playing games with you and this advanced voice thing is almost good enough that you can't even pick up on it right pretty fascinating and a good indicator of where this might be heading next but now let's get back to what you could do with it today Beyond tutoring and that's using it as a universal translator and this is pretty straightforward you don't need any prompt preset I'm confident most of you would be able to just speak into it and set it up in a way that it works as a
universal translator something like this you will will translate between English and German wait for one person to finish and then translate into the other language also do not add anything or say anything outside of the translation got it I'll translate between English and German for you without adding anything extra go ahead hey how are you doing hello I'm doing very well how about you today yep excellent what do you want to eat later on vnit things to a vena schnitzel would be awesome what do you think I mean this is pretty incredible and the speed
of this thing is unbelievable if you guys want I'm actually traveling to Brazil tomorrow maybe I could talk to some people that only speak Portuguese on the beach and see how this thing works in practice leave a comment if you would like that but you see the potential here with up to 1 hour of daily usage you can travel the world and use this as a universal translator let me tell you I myself have gotten the Apple watch recently excellent accessory for anything sport related by the way but the one thing that I'm really hoping
for is that this action button will be able to mutate to Advanced chat GPT voice right now I have Google translator on it and it's just a bit too slow for everyday interactions like you can use it it is useful here and there but if I could just press this and talk into the watch and it would speak Portuguese to the people in Lisbon or the people in Brazil that'd be incredible and let's be real it's just a question of time I mean this thing has 4G connection so it should work and as I said
it works with 50 languages so you can use it as a universal translator today all around the world and it doesn't doesn't stop there because with the real-time voice API people are already building phone call agents that are automatic they go out there call people they answer calls check out this example from twio that is known for phone call and SMS marketing [Music] Communications my family and I came from our country to the United States and I want to know how we can stay here pretty amazing now if you're not where this API costs more
than a worker today it Nets out to somewhere around $ 12 to $14 per hour in some cases just three minutes of usage can cost up to a dollar but over time the price will surely come down and these things will become more prevalent but this can be built if you're ready to foot the bill okay next up let me show you something a little more fun still useful but definitely the funnest feature that hides within this voice feature it's its ability to do different accents great success and let me tell you it can do
most of them here are just some examples to get you going reply to me in the style of a Russian mobster all right listen up you got question you come to me isn't that just excellent okay let me open up a you new chat and show you another one reply to me in if you're not aware that's Swiss German so it can even do accents and then here I want to show off one more thing from our community Daniel from the team showed this off inside of a dedicated space that we created just for the
advanced voice mode just cuz there's so many conversations around it happening and he says this is the most fun he's ever had with ch GPT voice and he shared this prompt let's try it out hey can you do a fun thing where each of your responses is in a different voice or accent I'd love to hear variety throughout our conversation feel free to get creative and surprise me with each reply absolutely that sounds like a delightful challenge I'll switch it up with each response just let me know what you like to chat about and we'll
take it from there no I suppose we're going to chat about the advanced voice feature in chat GPT what can you tell me what I might the advanced voice voice feature in chat GPT let me have a good old chinwag with you we can n away about all sorts using different voices and accents tomorrow tomorrow tomorrow tomorrow so I don't know tell me a little bit about yourself who are you I'm chat GPT your conversational companion okay okay hold up fair enough but who else are you tell me more about yourself some nitty-gritty details well
diving into the nitty-gritty I'm a language model which means I'm built to understand and generate humanlike text so that's pretty amazing but you might have known some of these before and that's where Daniel follows up here and says hey at a certain point you can follow up with I've heard these give me some more obscure accents and voices let's see what we get here I've heard these give me some more obscure accents and voices all right let's dive into the depths of creativity lad as the digital entity I'm all about processing language conversing with you
and spinning Yarns my purpose is to assist entertain and inform from the mundane to the mystical y thank you for sharing your insights with me as a pirate I guess ye guessed it Mighty now what other Seas of knowledge be you interested in exploring tell me about Quantum Computing Quantum Computing eh it's like harnessing the unpredictable tides of the quantum world to perform calculations okay okay okay from here and out only answer in form of a poem go in a word of tech so Grand quantum computers take a stand with cubits in a Quantum dance
they solve problems given the chance okay okay next up I want you to round out this segment by saying hi to our viewers on the YouTube channel and wish them a wonderful day hello dear viewers on YouTube with conversations we're in quite the grp Pro from chat GPT I must say wishing you all a wonderful day not bad so I bet there's more voices in there we could just keep on playing honestly I pulled this out at the beginning of some meetings just to lighten the mood a little bit with some fun little accent that
chat chpt formulates into some formal intro it's a great way to lighten the mood and you can use it in combination with everything else we talk about here so now let's get back to talking about something a little more serious which is its ability to break brainstorm with you and as you might know this is one of the Undisputed use cases with AI it's a fantastic brainstorm body that can spit out ideas faster than most humans and I personally find myself brainstorming with chat GPT all the time so here's a prompt that you can use
to brainstorm together with it using voice which just makes it more natural it flows better it's just a better way of brainstorming this one is going to be a customer experience consultant okay prompt in the description below but this time I'm going to put it into the custom instructions how would you like chat GPT to respond I'm facing a situation where customer desires conflict with business limitations and with a simple preset like this I can go in and it will right away start brainstorming Solutions together with me all right let's fire up a brand new
chat and talk to it about our problem all right so I have a situation where we have a 14-day no questions asked refund policy but it has been 5 weeks and the customer is still asking for a refund what do I do that's a bit of a Sticky Wicket since the request is outside your stated policy you're not obligated to provide a refund however it might be worth considering whether there's a way to meet the customer a halfway perhaps offer store credit or a partial refund as a gesture of Goodwill it shows flexibility and might
help maintain a positive relationship with a customer all right can you give me three more alternatives to this route of action certainly here are three more options one strict policy adherence two escalation three value added service instead of a refund offer an additional service or a discount on future purchases all right can you draft us super concise email for each one of these Alternatives keep it professional yet friendly absolutely so there you go simple as that and let me tell you that interaction fell a whole lot more fluid than typing it all out it's like
talking to a person and I have all the emails that I need as a result of the conversation you could do this on the go you can have your airpods in and simply prompt it like this talk to it like this all you need to do is set up the custom instructions before you go on a walk or before you head out of the house and there you go pretty amazing and just little side note I find myself to be in a different head space when I'm out and about and I'm walking for example as
opposed to just sitting in your chair so maybe setting it up like this and going for a brainstorming walk with your airports is a good way to use this to find New Perspectives I don't know just a suggestion any type of brainstorming technique here will work and again this is one of my favorite ways to use it all right the next up I would like to bring your attention to a few use cases that open AI even highlighted on their very own Twitter account for developers so some of these are purely fun but others really
give us a glimpse at what is yet to come once this will be integrated into some of the applications we already know in love so let's start with a fun one here this is quite simple they built an interface where you can talk to the voice assistant about what you envision and it uses AI generation to sort of paint it for you I thought this was extraordinarily creative and just a brand new type of interface have a quick look at this what would you like to create a sunset on the beach that sounds beautiful picture
a Serene beach with the golden sun slowly descending towards the horizon painting the sky in Hues of orange pink and purple actually make it daytime and add some palm trees all right visualize a bright sunny day at the beach with the sky a brilliant shade of blue palm trees sway gently in the warm breeze I don't know something about that one feels magical for the lack of a better word now next up there's a lot of applications like this that allow you to chat with your documents rag implementations with voice as the front end this
might be convenient but lacks that magical factor to me at least and then this next one is actually something you could use right now and maybe even land a job because of it it's this free application and as per usual I'll link everything in the description below but right here you can just go ahead you can give this access to the microphone and once you pull your CV into here which I don't have you know YouTube but if you put the CV in here you'll meet the admissions officer from a Stanford MBA and you can
practice and this is sort of a smart implementation of uploading your documents plus Voice Assistant I really liked seeing this here's a quick demo let's dive in what inspired you to pursue a career as a freelance developer I think you get the point here and then there's one more which really caught my attention and that is this implementation where saw your hood over here set it up in a way that it could remote control his browser meaning as he spoke what he wanted to do order me food and add that to the shopping cart and
now pay for it the browser just made it happen there's actually two of them can you remove one and it does it how amazing this release a glimpse of the future it's a brand new interface that hasn't been possible in this way at this speed every time we had voice input it was either super super stupid remind me to upload this video today in an hour okay I added call to be reminded today in an hour to your reminders that's not or so slow that it just didn't feel natural well that change now and that
brings me to the last category of use cases that we can talk about here and this is going to be where I give you a bunch of presets in the description below I'm not going to go through every single one of them but the category is role playay and this is what chat GPT advanced voice really excels at there's so many scenarios that you can go through and simulate in advance and here's my little tip it can pick up and simulate the motion now I don't know if it's as good as the demos that they
showed in Spring but it's certainly efficient and if you do something like look at this emotional wheel right here that I just found on a random page on the internet you can tell hel it to mimic all of these emotions in combination with the role play so maybe if there's a situation where you're afraid of a specific emotion from a person or you know that you react in a certain way well you could sort of treat yourself in advance by practicing that scenario while CH GPT is role playing a specific scenario with a specific emotion
I believe this is called exposure therapy right where you gradually expose to things situations and activities you fear you could do it in the safest environment ever at home in your living room with your phone in your hand now what can you simulate well here's a few examples for you so let's for a second just assume you're a radio host and you want to be better at your job you want to train so open up the custom instructions here and under personalization customize I will change the text in a second box here so here we'll
be simulating an interview with a controversial public figure now I could replace this for a specific name although advanced voice does a problem with specific famous names it's very very limited in terms of that they want to make sure to avoid any further problems so maybe I'll just make it a little more specific like with a controversial rapper I'll play the role of the figure and you respond as the journalist asking tough questions while maintaining professionalism and objectivity let's do this new chat and let's try this out all right I'm here thank you for joining
us today let's Dive Right In your recent album has sparked a lot of conversations not just for its musical content but for some of the lyrics that many have found offensive I don't really want to talk about the music today I'd rather talk about how my day went well it didn't go so well do you have a drink I don't have a drink but it sounds like it's been a rough day for you want to share what happened yeah sure when I saw your face I was disgusted and now I have to sit here talk
to you it sounds like you're not in the mood for an interview today we can wrap this up if you'd like or we can talk about something else that might be on your mind what do you think okay and that way you can get a feeling for how you could react now let's do another one but now let's Infuse an emotion okay this one says let's role playay a witness interview I'll play the role of a reluctant witness and you respond as a private investigator demonstrating effective interviewing techniques to gather crucial information and here next
to the private investigator I can pick one of the Motions right so I'll do just that I'll just say aggressive and let's see how it behaves now hello good day thanks for agreeing to talk listen I'm not here to waste time and neither are you what you know could make all the difference so let's cut the chase what did you see I didn't see anything I don't know what you're talking about oh come on we both know you were there it's all over your face you might think staying quiet keeps you safe but trust me
the danger in what you don't say now start talking what went down that night it's pretty good right now let's switch rolls I'm going to be the investigator all right we both know you were at the crime scene now tell me what you saw look I don't want any trouble I was there but I didn't get a good look it was dark and everything happened so fast stop lying involed tell me now it was a tall guy in a dark jacket he was lurking near the alley there we go so as you see it's pretty
amazing you can do that with all the emotions and roleplay different scenarios in combination with any one of these pretty amazing generally speaking when it comes to these role plays you can really use a standard formula It Go something like I need to talk to insert conversational partner about insert topic I will role playay as conversational partner but obviously there's a plethora of opportunities here and at this point I just want to highlight that we created a whole product where we created over 30,000 presets that you can actually copy paste into chat gbt it's it's
a template from which for example here with the rose comedian you could open them up and you have 30 prompts for a rose comedian so you could just easily copy one of these heading over to chat GPT change the custom instructions and ready to go now as mentioned this video description has a bunch of them so I would recommend you start out there and then if you could use a library with presets for a total of 1,600 different professions 30 prompts each you can find those in our shop I'll round this video out with two
more practical tips that you can apply to every single one of these use cases whether you're building something with the API and you change the system prompt or you're doing one of the role plays or even using it as a universal translator one thing is you can always edit the speed so if you simply tell it hey speak 50% faster it will do that speak three times faster it will do that on the other hand you could also tell it to slow down and will do that for you and my last little tip here actually
refers to the desktop app of chat GPT because if you're in here you can open up all the conversations you had on your phone as you can see right here and this is really a little hit or miss some of these transcripts are unavailable and some are available but it's good to know that they're here plus you can always replay these messages in here so whatever advanced voice set you could go in here and replay them like so now it's a real shame that you do not get to download these easily now I could record
just like I'm recording this video but hey open ey if by any chance you're watching then give us the ability to download this it would be so amazing to just quickly prompt it create a fun little intro for a meeting and here with the click of a button we could download it and play to open up the next Zoom meeting or a million other use cases like that and that sums it up that's all I got for today I hope you this discovered something new researching this video was a lot of fun this feature is
one of the most interactive human things that we have ever received with AI and on a personal not I can tell you whenever you run into real world struggles just opening up advanced voice and talking to it about it for a minute can be a really good first help if you don't have anybody to talk to well cat GPT is a great alternative I'm speaking from experience here and that wraps up the video check out the description with all the presets and links and I will see you very soon
