[Music] hi welcome to another video so recently mitrol launched the minrol model and before that they launched the pixol and mrr small models but with that model mitrol actually launched a free tier of the API which I glanced over in the mrr small video I did but recently I was checking that API at what I found is just amazing I think I'll be ditching Gemini flash for this let me explain it to you first so metrol had posted a blog post when they launched the mistol small and pixol models and that blog post had a
part saying the serverless platform to tune and build with mistal models as API end points now offers a free tier enabling developers to get started with experimentation evaluation and prototyping at no cost which means that they have basically added a free tiar to their API I didn't go into depth at that time because I couldn't find proper documentation for it or you could say that I didn't believe what I was seeing at that time and just thought that the limit it was showing me was only applicable if I had a paid plan but boy I
was wrong so metrol has two different sets of apis there's one set of apis that is just for the cestal model and there's one set of apis that gives you access to almost all the mistal models now the cestal API is fully free yes like it's fully free you can use it almost as much as you want because it doesn't have any kind of rate limits and I tried using it and I didn't get any errors some forums did say that it has 30 requests per minute and 2,000 requests per day but I wasn't able
to even hit that limit and even if it has that limit then it is better than Gemini Flash and since cestal is focused on coding it works almost like Gemini Flash and in most cases it is better in ater benchmarks they both perform similarly so there's no performance left on the table but it's not just limited to that either because it also has another API that gives you access to almost all of their models including mistol large which performs significantly better than Gemini flash for sure and not just that because you get one request per
second which is completely usable and you get about 1 billion tokens per month for free so this is all also a great option for sure Cod straw could be good if you just want very reliable stuff because it doesn't have a token limit while the mistol large API could be used when you need to get better results than Cod strol although I think at least I can get away with the mistol large API because the token limit is so high that I probably won't reach that limit anyway so that's good but there's one downside to
this the downside is that they will use the data sent by you to train their models although they say that they will anonymize the data and then use it so that's good but Gemini also says the same so this is not an issue for me but it may be for you so make sure you keep it in mind now we'll be configuring it with both ader and Klein I wasn't able to configure it with Klein easily but I have work around for it and it works fine so we can use it with both you can
also use it with any application you have that supports the open AI compatible API because it uses the open AI API schema it worked fine with ader but had some issues with Klein which I was able to fix so let's get started with AER first and then we'll go through the client setup because that's complex anyway first of all just go to the mistl API platform and get signed up once that's done you'll be asked to select a plan just select the experiment option and it will get started and you'll see these options now just
go to the API Keys option here and create an API key here this API key will be used when you use any mraw model like mistol large pixol or anything once you have that just keep it in a safe place because we'll need it later apart from this we'll also need the codral API key because I'll also be telling you how you can use it as well so just go over here and get an API key from here as well and keep it in a safe place too now first of all because we'll be using
it with ader just go to the terminal and make sure that you install and upgrade it as well to do either of them just run the PIP install upgrade AER chat command and it will get updated if you already have it or if you don't have it then it will get installed now to use it with the general mistol models you'll need to First add your mistol API key to the environment by using this command and writing the API key here once that's done we can start using it to use it you'll just need to
start AER with metrol as the provider and the model name you want to use you can refer to the model names from the mstr API site generally you'd like to use the best model which is the mrr large model so let's just run it with that once you do that it will get started and you can ask it to do anything let's ask it to make a simple pingpong game okay it's doing that now let's wait a [Music] bit and it's now done if we run it then you can see that it works fine so
this is just amazing apart from this if you want to use it with cestal just add the environment variable for cestal API key and enter the respective API key once done just run it with Cod estral model like this now you can ask it to do anything let's ask it to make a simple to-do app using HTML CSS and JS let's send it it's doing that now and if we wait a bit [Music] you'll see that it's now done so this is pretty good if we run it you can see that this works pretty well
so this is also pretty good now AER is configured and it works pretty well but we also need to configure Klein and get it working as well so first of all download or update the client extension now technically you can just go to the client settings and select the open AI compatible option configure the mistal API base URL and use that but it doesn't work for some reason I think this is because the object that metrol API returns has some more stuff than the General open AI API and that's what makes the issue but I
found a workaround so to use Klein with mistol or Cod estol API we'll need to use L LM it's like a proxy server that changes non-open AI compatible apis to open AI compatible ones so to do that just install it with the PIP install Li LM command once you do that it will get installed after that just export your mstr API key as well like you do for ader now we'll need to run the light LM server with a model so you can run it quite easy easily with this command it's similar to theer command
because it also uses light llm in the back end so it's similar anyway just start the light Alm with the model you want to use once it has started you'll see the port that it has started on generally it would be on Port 4000 now once that's done you can just go to Klein and in the open AI compatible option just add the base URL of the light Alm server and in the API key enter anything and in the model name just enter the model name once done save it now we can start using it
I'll ask it to make a simple mind sweeper game okay it's doing that now let's wait a bit [Music] and it's now done so this worked pretty well if we preview it then you can see that this works kind of great as well so that's super cool furthermore if you want to use it with cestal then just export the cestal API key and run the light Alm server once you do that it will also start working with Cod pestal so that's super cool as well I think this mol configuration is something really good I might
just be replacing Gemini with metrol because if we see theer benchmarks then you can see that cotrol is basically similar to Gemini Flash and in my usage it has been better in most cases as well apart from this Mist large is even better than those and really usable so I can just keep switching based on what I'm doing and everything one thing that it lacks is the vision capability although you can change the model to pixal and use it for vision stuff it doesn't work well in coding so I'll recommend using the Gemini models if
you wish to use images in your prompts as well plus Gemini is also faster so that's one thing to consider as well I mean it's always good to have more options than fewer I'll be using it a lot going forward overall it's pretty cool anyway let me know your thoughts in the comments if you liked this video consider donating to my Channel Through the super thanks option below or you can also consider becoming a member by clicking the join button also give this video a thumbs up and subscribe to my channel I'll see you in
the next video till then bye [Music]
