so here's a huge update flux tools what is flux tools you might ask well black forest labs in paint out paint control net you name it so in the first example here we have change only what you need all samples were made with flux fill and flux phille is their in paint and outp paint model and it's not a third party model it's actually from Black Forest Labs we can see here they have painted on top of this guy here and changes a jacket into well another jacket but jeans jacket and here they're changing burgers and beers into coffee and beers and looking at this I mean you can barely see that it's in painted yes there's a slight line up here but it's actually not exactly following the mask because then it would bulge a little bit uh so I say it's more following the line of the sea well no probably it's the background it's the it's the lines in the background that got me fooled so I wouldn't say that I can see the mask at all uh in this example maybe if I zoom in and change the levels a bit but let's not do that now that's cheating well is it Anyway so apart from the in paint and out paint model we have control Nets so these are official control Nets we have depth depth is one of the most used control Nets together with canny but first let's look at some of the depth Ms and we can see it's a actually a surprisingly good depth model I'm not sure about what kind of strength they were using to get from the pre- cler to the to the the actual image here because as you can see we lost kind of the glasses in this image but you know if it was like a strength you know 0. 8 0. 9 whatever details like that tend to disappear so I wouldn't be too worried about that same with this one all the details here that you can see like M9 Leica whatever they're gone here so that just means they probably use or or tune down the strength of a little bit when they're generating this now you're going to have to test yourself if you feel that these results are chicked or not I mean obviously they are Cherry Picked but so far from Black Forest Labs we have been getting some really really good stuff we mentioned canny and canny are these pre-processed image where you can see all the lines so cany is one of the most popular control Nets what what's interesting with this one um I don't I don't know if this is uh prepared for the web but I've never seeing a cany like this we actually see the background image or the actual image so it feels like they just took the pre-processed image slapped it on top of the previous just to to make it look a little bit better for the web because I mean you're not keeping the color values here anyway well I mean you could if you're lower D noising strength that's for another video I'm going to create videos specifically on the in paint model I'm going to get create like one video for that that and probably one video video where we have the depth and cany in uh the same video we'll see you'll get I get that up in a couple of days or or later we'll see then we have remake your work so all samples here were made with something called flux Redux so they're changing from the image to the left here to the image on the right so from a photo realistic style here to kind of a illustration style so this seems uh more like an IP adapter kind of thing if if you're used to that here we're changing the Frog to another frog but it looks similar and the same with the rooms here they look similarish so my best bet this is very similar to an IP adapter so I'm going to check out what they're writing about this but uh so far it's looking pretty good so it says FX fill state of the art in paint and out paint Redux uh generate V variations of your images mix in text prompts or more images to give them a fresh look or change them completely yeah I mean I would say IP adapter if I'm wrong let me know in the comments depth and canny we know what those are control net we love control Nets who doesn't love control Nets if you don't love control Nets well you haven't been watching my videos for very long and this was released uh yesterday and it say today well it's released yesterday but it was WR yesterday anyway today we're excited to release FX from tools a suet of models designed to add control and stability to our base text image model flux one oh uh and if you're wondering can you get this locally yes you can it is available for Open Access with the flux one Dev model uh and also through the API with the flux one pro model right so most of you watching are going to be using this with the flux Dev and all some of these I've already seen are available like in fp8 and I think there's even lower us for some of these as well so most of you should be able to run it somehow if you are able to run any version of flux so again flux fill depth cany Redux this release reinforce our dual commitment delivering Cutting Edge open weight models for the research Community yes while offering best-in-class capabilities through our API so yes the pro is only available through the API but honestly I mean the dev is pretty good I use the dev uh it's amazing you should use the dev too so let's see we had some of the examples here we saw this one they say that uh the Imp painting capabilities that surpass existent tools like ideogram and popular open source variants such as alimama creatives flux control and in painting it allows for seamless edits that integrate naturally with existing images and looking at the results that we well we saw them previously I would say so far pretty good here's an example of the out painting so this is the image and then we're out painting we're adding stuff on the outside so now we have this picture of a face and let's see if can we find the line M I don't think so let's zoom in here H I think I'm just making that up no there's no line so they conduct benchmarks if you want to Lear more there's a link here these links are going to be in the description you can also just Google black forest LS flux tools oh you you're not seeing my my fingers but they're doing like this on a keyboard the results show that flux one fill outperforms all other competing methods I mean obviously whenever you see something like this they're just posting when there's on top right and I mean I get it who you know everyone's doing that uh with that said flux is one of the best models out there flux Dev 1040 flux Pro 1094 so I mean they all similarish uh the big outlier here is SD 1.
5 in painting which is still very good in painting to this day I kid you not SD 1. 5 in painting is super fast like super super super fast and it's surprisingly good I mean you can't fix like hands and feet and stuff like that um but you can work with it professionally because it's very good obviously there are caveats and those can be fixed by using flux now where you can get it full model weights available on hugging face uh comy has support for this from day one which is cool so you can use it in comy can you use it in automatic 11 11 no you can't because someone stopped updating automatic 1111 I don't know what's going on are we going to see an update this year or the next year who knows most people that like automatic 1111 are probably using Forge now or have can of transition into using comfy and automatic 111 I don't know I'm using mostly Forge and comfy I'm also going to take a a deeper dive into swarm because that's nice as well to be able to to get the files here you need to log in you need to agree and everything and then you can download the files so it's going to be uh flux fi Dev safe tensors that's a huge one 24 GB but I think some of the control net models had luras here's again these are the control Nets and they St how they stack up to other stuff uh we don't have okay here we have SD 1. 5 control Nets uh I mean 1.
5 control Nets are probably the best control that's out there surpassing even sdxl so it would be very cool to see that flux are would be outperforming SD 1. 5 but I'm going to take a deep dive into that in the coming days so let's check here full weights lower weights so the full weights are going to be 24 GB and the Laura is going to be 1. 24 GB so that's a huge difference so that's good to know I mean if you can handle the big one go for the big one and then the Redux or what's probably the IP adapter uh and they actually say Redux is an adapter for all flux one based models for image variation generation given an input image flux one Redux can reproduce the image with slight variation allowing to refine a given image and here we have an input and one two three outputs they're all looking similarish it's not the same image it's not the same cup it's not the same butter it's not the same bread but it's simp ilar and that is very powerful for a lot of use cases here we can see some of the prompts used on this input input input input uh fine glass sculpture on a shelf a simple 3D model I wouldn't say this is a 3D per se I mean you get some polygon trees here this one uh anyway actual duck on desk epic anime art flying through clouds so I would say it performs and same with this one we have an input photo photo we have flat Vector simple material art what is material art I have no idea I know what Vector is a large hand puppet with brown fur in the forest pen and ink sketch black and white this is actually surprisingly hard to do with uh some of the models out there right now I mean yes obviously you can do it but could be harder than you think detail anime artwork and again I mean Benchmark it's going to be best here obviously uh oh they have a Redux chel I'm not using the chel too much so can't comment on that but they say they outperforming as they want 1.
5 and SD XL and cool here in this one SD 1. 5 is outperforming XL and just you know third party support and extensions for 1.