How to Create Custom Audio Summaries of ANYTHING (That Sound Exactly Like You)

all right welcome to another AI workflow tutorial I always enjoy doing these as this is as concrete and practical as it gets usually on this channel we talk about specific releases and tools that come out but today we'll be combining a multitude of these tools to achieve something a bit greater a custom notebook LM with your very own voice I mean sort of notebook LM has these podcast Ty conversations here it's just one speaker but it's fully custom so you can change the prompts in the background you can change the voices you can change the

style you can change the workflow it's set up to auto automatically fetch the files and create these summaries rather than notebook LM where you have to work manually with it it might not be exactly like notebook LM but as close as we could get and it's fully customizable and almost free depending on which components you pick here of course if you want the highest quality it'll cost a little bit so essentially what happens here is you go from a meeting summary to a custom audio file that sounds exactly like you in both tone and style

and the voice instead of me just explaining this to you let me show you the resulting audio file and then let's get into the step by step of how to set this up and do it yourself all right so this is the resulting audio file it's a recap of a tea meeting that we hold on a weekly basis anybody that misses it can listen to this instead of reading the transcript or ly summary hey team welcome back this is eigor with the recap of the AIA weekly team meeting from October 28th 2024 okay let's get

into it Ruka brought up the need for standardized PowerPoint templates for events with consistent branding Matias supported the importance of color consistency but noted that structures can vary I confirmed that we have templates on notion and suggested we collaborate on a new one okay isn't this cool I just want to note this voice is pulled from my newu can use videos so extracted all the transcript and customize the style of gp40 with a fine tune we'll talk more about that soon to sound just like me in the YouTube videos hey team just to summarize topic

four of our meeting Matias reported back on the success of our no code ethics talk and riplet agents events so as you can see this is pretty damn good and the very last thing before we get into this I just want to say a big thank you to make for collaborating with us on this project it's something that we were actually using within the company and when they reached out to collaborate we're like awesome this is a great opportunity to show in great detail what's possible with their product all right with that being said let's

get into this and we'll begin with a little checklist that I prepared for you on what you will need to make this happen first up you will need a Dropbox account that's how we buildt this automation you can certainly customize it to work with Google Drive one drive or any other file storage system you're using but we wanted to switch it up the last make tutorial on YouTube we did was with notion this one is going to happen inside of Dropbox next up you need account with make and here you can sign up for free

with the link in the description deson below to give this a shot you don't need to pay to actually try how this automation works and to set it up if you're going to be using it regularly you might want to upgrade to the $10 plan as I have done on this account here next up you need the blueprints that we prepared for this video you can freely download this inside of our public Google drive folder also linked below and simply import this entire automation into make making it really simple to get up and running with

this hey there editing eigor here we tested the result of this video with somebody who had no experience in Automation and it turns out it might be a bit too complex for somebody just getting into it for that reason we're actually adding a second file that will make it way simpler for you so the original workflow is hey you need a Google Gemini meeting recording file export it to markdown bring it into the Dropbox and then have the automation move it through the workflow and you get a resulting audio file but if you don't have

a Gemini meeting file you would need to either custom prompt it in a way for it to change or you would need to change the format of your document differently that's a bit cumbersome and that's why we created the second automation which includes the custom prompt that changes the formatting for you so you're not compromising any of the quality because to me that seems really important that hey it starts with a formal intro it starts with the date it starts with a structure you wanted to have so it sounds more professional so you were not

compromising all of that but we gave you a second blueprint that will automatically change any summary you might have into this exact format that works with the automation all right I hope that makes sense and let's get back back into the more advanced tutorial just be aware that there's a second file now in the description that is more beginner friendly I would recommend you start out with that one if you don't have extensive experience with this stuff all right and there's two more items on my checklist one of them is 11 Labs account with a

custom voice created in there you don't have to create a custom voice hey team welcome back this is eigor with the recap of the AIA weekly team meeting but it certainly adds to this project we'll talk about that in a second and then lastly you will need a fine-tuned model inside of open ai's platform in this case we find you in the GPT 40 model on my own transcripts again more details on that in a second here okay so let's go through this checklist one by one and let's exactly show you what goes into these

points and what it costs so first up Dropbox I created a brand new account here just logged in with my Google email address and on the onboarding screen you can skip the paid plan and if you do that you get signed up for free account with 2 gbt of storage that you can now use for this automation excellent that's Dropbox right there secondly same thing for make you can just sign up with the link in the description below for a free account once you have your free account as I mentioned you will also want to

get the blueprints that we prepared for you simply go to the link in the description and then download it to your local machine we'll be using that in a second here okay two more items left on the checklist one of them is 11 Labs custom voice here you can sign up for free but this won't allow you to create a custom voice if you want to do the best version of this and you want your custom voice I would recommend the Creator plan that comes in at $22 a month although you can do it on

a starter plan there The Voice just won't be as high quality but essentially this allows you to upload a recording of your own voice how you speak and then usually within 24 hours they will come back to you and then they will create the highest quality voice clone that is available on the market right now I think right now this is the consensus opinion that 11 laps is just the best at this this is a thing that I won't be going through step by step here because it's really simple once you're on the paid plan

you just head on over to voices say add new voice and here under professional voice clone you can upload a 30 minute audio file or longer of your voice and then they create it I'll give you a tiptoe one of the best things you can can do is take some recording when you weren't purposefully talking just to record so if you ever were on a podcast episode or inside of a meeting or you held some sort of lecture that's a really good voice recording to take just make sure nobody else is speaking in there you

will want to manually edit out all the parts where other people are not speaking honestly you need to do this manually no automatic software is good enough to really catch everything and this file needs to be perfect then you upload it here and it creates a replica of your very own voice that you can then use in our make scenario here okay and last on our checklist probably most excitingly you need a fine tune and fine tuning is something we talked about before on the channel but it's something that most people Overlook and if you

ever wondered how to get the very best custom style out of a llm like gbt 40 well this is the way and no matter how you prompt these models inside of chat GPT or foodo API it doesn't matter what you put in there it doesn't matter how detailed your instructions are it doesn't matter how many examples of your writing or speaking you provide a fine tune will always be the depth of the style replication that happens here now this is not a video just about fine tuning but trust me on this if you want to

replicate your style fine tuning is the way and it is quite simple by now all you need to do is you need to go to platform. open.com log in with your openai account that can be a completely free one and then you will want a few dollars in your account $5 should suffice to find you in a GPT 40 model on your own writing so just make sure under billing you add some credits here and then you want to head on over to dashboard finetuning and up here under create all you do is select the

base model here and what you want to do is GPT 40 not mini not 3.5 40 this works the best especially for something a bit more in-depth like the summaries that we're working with here if you're in a budget or just want to play around with this I would recommend mini as that is the cheapest and then once you're here all you need to do is give it its training data and this is where really a lot of the magic with fine tuning is hidden everything else you can keep as default but right now I'll

put up a screenshot of the training data that we have used for my very own fine tune here this is a bit of an in-depth workflow and inside of our community we're even developing an entire course on fine tuning because there is so many options here but basically what we did here for this case is we pulled every transcript from the news you can use video that we have done for over a year now on this channel every single Friday then we compiled a big table of all those transcripts in different fields and paired them

with input values as you can see here you can totally steal this formatting and adjust this to some of your own recordings again you will need some transcripts of you speaking so you can run some AI up to transcribe your next meetings and from there you can pull out the way you speak a transcript of you speaking or you can put in your own writing too if you have some it's just important that it comes in as this format and then what you can do you can upload this Excel file to this free tool novel.com

toolsfine Tunes Link in the description below also this is completely free and as you upload this it will turn your Excel file with all the examples into this Json L format that I showed you which you can then upload into here and as you upload this file and hit create at the bottom it will take a few minutes minutes to train a brand new model like these right here and then you can link that model inside of the automation to use a custom version of gbt 40 together with the custom voice from 11 Labs pulling

files from the Dropbox folder and all of that happening automatically and that's a checklist that's all you need to prepare for this once you prepared the items on the checklist we can move on to bringing it all together inside of the make Automation and as we created this blueprint for you you can simply create a new scenario like so inside of your account and all you want to do is go to the bottom here click the free dots and say import blueprint I'll simply choose a file and here on my desktop I have the meaning

summary blueprint where I just click open and check this out if I just hit save it Imports this entire automation for me and now all the work here that is left is linking your various accounts that we prepared in the checklist step to this Automation and this thing can run in the background indefinitely as long as you have made credits in your account so let's start with the Dropbox stab as we need to do one more thing for this to work you need a bit of a file structure here and I'll do this by creating

a few folders the main one will be Igor's custom meeting summarizer and inside of that I will create one that is called to-do one that is called in progress and a third one that is called completed summaries with this structure literally all that is left now is linking all of it up inside of this automation so I'll go to my first step say create connection as I haven't linked the Dropbox account here and then as I'm logged in Dropbox in my account already I simply have to allow this and the connection has been set up

inside of here I just have to navigate to the fold folder where the meeting summary files will be placed well and that is the eigor custom meeting summarizer folder that we just set up and then inside of that we want the to-do folder if I ever Place something in a to-do folder the step that watches files inside of that folder will automatically start this entire automation next step we pick our connection again continue and then as you can see a lot of these other steps will be preset by default I just click okay here this

is fine again I will not be going into every intricate detail of this Automation and how to customize it I'm just showing you how to set this blue blueprint and this automation flow up for yourself okay next Dropbox step again add the connection alloud this and this we have to do one thing which is set up the in progress folder as this moves the file from to-do to in progress so I'll go to eager's custom meeting summarizer and then here I'll pick the in progress folder excellent this entire next row is something specific to Google

meet summaries with their Gemini AI that we use so all of these steps pretty much take apart the format that this meeting file comes in for our automation to work work even more reliably but if you're just coming in with a generic summary you could just delete this entire row and directly link the Dropbox notes to this chat gbt note down here I just left this here because this is exactly how we use it and how you get the highest quality results which is what this is about if you want to delete a part of

this workflow you can if you want to change 11 labs to something that's free but lower quality you can if you want to change Dropbox to another file system that you might be using you can but this is how we use it and this is the highest quality that we manage to achieve from it so again this takes apart the summary that comes directly from Google's Gemini Google meet summarizer that you can see on the screen right now it always comes in this predefined format and this basically identifies the pattern and gives us the ability

to work with this file in a bit more detail than just throwing a big paragraph at it and then CP having to figure out what's going on in there one pro tip would be you could totally prompt your llm or your summarization step before this to export it into exactly the file format of this Google Gemini summary that I will also put into the Google drive folder so you can see what that looks like now look I understand that your summaries might not be coming in this format but this really works for us and we

found this to be the highest quality workflow so what I'll also do I'll give you a prompt inside of the Google drive folder that you can use to summarize in a way that will produce this exact outcome every time and those summaries will work extremely well with this but again it's not mandatory you could just give it a paragraph of text that's a summary it's just an extra step to make this as high quality as possible which is the goal of this video I mean notebook LM is so good that's why people love it and

we did what we could to get as close as possible here here as I mentioned if you want to simplify things you can always do that okay so that is this rle and then in the next rle we will be going through the various cat GPT steps but for this will have to set up a connection I'll add a new one here I'll just call this finetune model and here I will paste the API key that I created here in my open AI platform by saying create new secret key and then once you create it

you simply copy it over here to API key and say save and then here what you'll want to customize is the model name right this is my own fine tune and you don't have my API key so this won't work for you you need to head on over to the playground and then take the model name up here by the way this is a different openi account so this won't exactly match up but you want to put in that model name into this field everything else is set up the prompt is set up we connected

it via our API key to our own account but you need to link your custom model that you trained on your own data for this to work so yeah I've done that here I'll click okay you don't have to do anything in this step in the next open AI step again I just want to pick my fine-tuned model connection again make sure the model is correctly f build in here there's one more thing that you probably should customize in here which is the prompt here here I gave it some context on me I'm Igor Pani

the founder of the adventage community so you probably want to change this first sentence to fit your own context so cat GPT recognizes you from the meeting summaries right I run these meetings and that's why I want the summarizer to summarize this as me eigor it has my accustom 11 Labs voice now also chat GP knows what's up here cool you can skip this tool step in the open eye step again we want to pick the fine-tuned model make sure that the right model is in here again and again this is the same prompt you

might want to change this out to your very own context here just a quick side note on why multiple steps well these different steps process different parts of the meeting summary and we just like this format of it first saying hello to the team and then stating what the date is taking exactly the date that we extracted with this little step producing something that's really custom as opposed to just a generic meeting summary it as you heard in the recording in the beginning it greets the people and it states the date and then it goes

into the points just these little touches that go go a long way if you're more advanced you can go into customizing this but if you just want to copy what I'm doing here no need to change anything else in there we can skip the tool step and then we're almost done here on the last row 11 Labs is quite simple you just create a connection I'll just call this my 11 Labs connection and then all you want to do here is head on over to the 11lbs account go to API Keys say create an API

key demo key one I'll delete this one after this video and here you can just copy this to the clipboard paste it in here and voila we connect our 11 Labs account in which the custom voice that we trained will show up look at that professional eor dii Advantage this is the custom voice and how I named it inside of the 11 Labs account when training and again everything else is set up you can see it pulls in the transcription from the last step here already and 11 turbo V2 from our testing is the best

voice that you want to use here ha we're so close to being done and this actually working so last thing I need to do is connect these last three Dropbox steps so I'll just pick my connection here and then here I just have to pick a folder I'll go to the meeting summarizer folder and I want to navigate to the completed summaries as we're at the end here now we want to generate this new voice file from 11 laabs inside of completed summaries that's where the results go I click okay and then the last two

steps will be the same deal I just pick my connection navigate to my custom meeting summarizer folder and completed summaries hit okay again this saves the transcript in case you don't need that you can delete the step and then again same thing I need to pick my folder path go to eagor custom eating summarizer completed summaries and then this last step moves the initial file that we sent from in progress to complet it and that's it I'm not saying this is super simple but I believe that everybody can do this it's just bringing together a

lot of these tools that we talk about here on this channel all right so now what I could do is one of two things I could set this up to run every 15 minutes ah there's a little error here and it wants me to save this I apparently didn't click okay here at the bottom so now that I did that I think we should be okay so now all I have to do is click save here at the bottom now this scenario this automation is saved inside of my make account and I can set this

up to run every 15 minutes like so and now every 15 minutes it will check if there's a new file inside of the folder and run this Automation and as you can see now all I need to do is drag and drop this meeting summary file that I automatically get from the AI inside of Google meets into this Dropbox folder like so and now inside of the scenario I just run this once and we get the custom summary in my tone style and my real voice well 11 Labs voice all generated automatically here we go

hello everyone top G here welcome to the recap of the AIA week team meeting for October 28th 2024 let's get started here's a quick summary of what happened at last week's event Matias shared his positive impressions of the presentation noting the speaker's good vocabulary isn't that amazing now you could imagine that there's a lot of customizability here you could change the voices you could change the file system you could change the prompting you could do something different than summarizing meetings with this I mean really this is a automated way to turn text documents into audio

files that sound just like you and I think that's the coolest part about this automation there's there's a lot of opportunities here and on the make platform It's relatively simple and approachable to customize these things I'm not saying it takes no effort at all I'm just saying it's doable and as approachable as it gets and that's why I like make that's why I like teaching with make so again a big thank you to make for partnering with us on this video I know this was a bit more advanced than we usually cover here on the

channel but I'm sure a few people are going to get a lot of value out of this and just to around things out I would like to say if you have any questions probably the best place to ask them is the public area of the community this is completely free you can ask the questions here nevertheless I would encourage everybody to give this a shot and to try this out with this video you have everything you need to put this into practice yourself all the links are in the description below and with that being said

I hope you have a wonderful day and I'll see you soon