Building Voice ChatBots with chatbotbuilder.ai, WhatsApp, and 11 Labs Integration | July 2023

chat Bots have been around for a very long time the reason people have not loved chat bots in the past is because they've been dumb they've gotten better very very slowly until now this year 2023 is the first year where you could actually have a gangster chat by which this is a money maker guys what is going on everyone Ryan here WhatsApp is finally here guys I know that since day one we've had a lot of folks ask about WhatsApp I'm personally most excited for 11 labs and that's what I'm going to show you right

now we're going to get right to it you'll need an API key for this go get one at 11 Labs website and they give you free credits I think you get um like 30 000 credits you get so this is how easy we've made this is going to blow your mind after you enter your API key from 11 Labs head over to your flow section and click add 11 labs click the block remember we've already got open AI connected for you so there's no need to grab a key for all you early adopters now when

August first hits we no longer will be providing this same access these early adopters are getting the best deal on a chatbot platform period because of all the things that we offer at scale this is made for agencies this is made for forward-thinking people to create AI systems the early adopter deal is kind of crazy but um the standard deal that we offer will still beat all of the other platforms out there so let's add content here and we're going to generate a message using open AI so we're going to click actions and we are

going to click open AI we're already working on integrating our next large language model folks I hope to be the first platform real platform that is offering this language out of the box so you can choose between open AI or you could choose to use llama when we get access to Bard and Claude guess what you're gonna have access to assistant for the Hilton Head Island chamber and let's give the assistant some instructions a helpful assistant for the Hilton Head Island Chamber of Commerce you are going to respond to all the messages you get anyone

can do that easy all right so let's do remember the conversations we'll keep this on and we're going to save this answer let's call this um AI output so what's happening here guys is we are calling the API of open AI for you we're making the API call very easy so we're telling the chat about what we wanted to do who we want it to be I think that's so let's give it a name your name is Kimberly continue so now we've got text generated the next thing that we typically do is show that text

that we saved in this custom field called AI output once this text that gets generated from this information from openai is returned it's returned and saved here so what we'll do is We'll add some text here just to show you how this works we'll have our custom field AI output show up so what will happen now the flow will start the text will be generated by open AIS API sent back to you saving your custom field and then you're going to display that text in the next step now here's where 11 Labs comes in choose

11 Labs you will only see this if you add in your API key in the settings section in Integrations but then click 11 labs and now we can click on the action itself the element here the input text is what is going to be spoken so first we generated the text with open AI then we've send that text as a custom field right the custom field AI output this will be the text that 11 Labs use it to generate the speech follow me so far making this easy peasy next depending on your account will be

dependent upon what voices you had to select from so you've got all these different voices and some I've made many I just had already by default when I created the account there's one that is called Valley Girl um so we're going to choose that one because I think that's going to be funny The Next Step here is a level Labs does its thing and it's going to take that information run its magic and then send us back the file so we've got to save that file into a custom field we're going to add a new

one let's just call this um 11 Labs output we got the open AI output here we're telling 11 labs to take this text and use this voice and say what you create into this custom field continue so we're almost done last step add content one more time so what element do you think we're going to use for the audio that is going to be a file and here we have audio and you're going to laugh when you see how easy this is for that custom field that we made here for 11 laps we're just going

to display it right here you don't want to click the block but where it says insert link now we've got a place to add that link and guess what we're going to do add the custom field baby that easy now we're done pop this real quick publish I think we should be straight there so what we've got is let's rename this let's call um generate and send audio save publish let's add one more thing let's run over a new block we're going to hit add content let's click actions and let's click open AI one more

time we're going to click this top drop down and we're going to generate an image create a beautiful realistic image of the emotion derived from the current conversation that involves the last text input and we're going to save this as a new custom field AI image that basically means make a picture that's relevant save it save so let's click on the image block and again we've got that sneaky little insert link there click on that bad boy open up your custom fields bam AI image this is going to be our new default so I'm going

to label this it's really good to be in a good habit of labeling your blocks and your flows so that you can refer to them later easily What's Happening Here is we're going to make this a default reply so when we message our bot the default reply is going to hit and it's going to first generate the text based on my last text input of the user this text is going to 11 labs and whatever voice we've told it to use it's going to use that voice and generate the speech and it's going to play

that speech next immediately after that we're going to have another API call to open Ai and based on this interaction here we're going to get an image generated let's do this get the link we've only connected to web chat for now so Ctrl V opens up the web chat alright so bam do you all see this do y'all see this hello there I'm Kimberly your helpful assistant from Hilton Head Island Chamber of Commerce how may I assist you today Chamber of Commerce help me I assist you today the thing that I'm we need to do

if we're going to make this our default reply we need to go to our settings and we're going to click on Integrations and we're going to turn off the default reply here because that's going to override and then what we're going to do General default reply just switch that to 11 Labs default save so what is the nicest beach on the island it should take just a second boom and look and look I'll do my best best can I assist you with today oh humble and deserving individual that is freaking hilarious to me but you

know what we're gonna just take it up another notch let's change that voice this is only for educational purposes in the name of Education you are Donald J Trump respond like Trump who is Grumpy I'm just gonna like double down on it hey what is your name now it's taking the text and it's generating it into audio I don't have time for this nonsense boom so we asked the question give me some life advice grumpy Trump what did he say to us listen I've got better things to do than play along with your little game

what's your question anyway so you see how it's listening to my prompt there and guys I hope you enjoyed this I'm always here to help you and so is the rest of our team and our chatbot if you haven't tested our chat by yet you're missing out I'm gonna do that right now but anyways thanks for watching guys y'all have a great day and um be on the lookout for the next video soon peace