most AI tools that you will find on GitHub are useless for your projects in this video I will teach you some secrets to find the ones that actually work as a software engineer who creates AI projects for a living I use these strategies to find projects and tools that I Implement myself or that I just learned from so here on the getup search portal we're going to get started by trying to find a project that allows us to inject our own documentation into an AI system to do this let's start with a query like how
can I use my own documents in Ai and if I search for this unfortunately it seems like we actually only get one result and this even seems to be IR relevant result about hand detection so this is the first pitfl that you want to avoid don't write full sentences but instead use keywords in our case why don't we just use the keywords document and AI if we search for it like this we get over 5,000 results in fact that's maybe a bit too much I cannot go through all these repots myself right and this is
where advanced search filters come in I will teach you right now how you can pin down the high quality repositories from this huge list first of all we want to make sure that the repositories have been updated recently you can see here that there is an document AI repository that was last updated in May of 2023 if you're familiar with the AI domain at all you will know that that's basically prehistoric right we want to make sure that the repos have been updated recently to do that we go back to our search and we type
the following we say pushed we add a colon and then we say that we want to make sure that this repository was updated at least once in December so 2024 month of December the first day if we search for rebos like this we actually only have 440 results left I mean that's still too many but we're getting this right so now that we know that all of these repositories are active how about we make sure that they are popular enough we are going to use this Stars filter for this I want to tell you that
stars don't indicate the quality of a repository per se but they do indicate that the community has approved of them and that they're probably being used in a couple of important projects I do want to strike a balance here and actually only look at repositories that have at least 100 Stars this way I don't get rid of all of the rep repositories that are up and coming but just don't have a lot of community uh reception yet but I do make sure that repositories that are very obscure and irrelevant are removed from my search query
so I'm going to go ahead and filter on that and now you can see that we only have 21 repositories left so we're getting there however it is important to note that just because code is on GitHub it doesn't mean that you can actually use this code for your own project projects it depends on the license of the code so I always make sure to look for two license types myself the MIT license and the Apache License 2.0 these two license types allow me to reuse the code for even commercial purposes and build on top
of it if I filter repositories for these two license types we actually only have 11 repositories left so we are really getting there but I'm going to do one extra filter personally I like to use Python for AI projects so I want to make sure that the repositories are written in Python this is why I'm going to add a language filter and make sure that all of the results are written in Python doing this leaves us with just six repositories and that's great because we can obviously just go through those manually to find the project
that we want to use starting from the bottom bottom dis case we actually have this haste at core Integrations repo which seems to add some packages to some kind of other program we have extract thinker which needs to be a document intelligence library for llms we even have a project here which is not just about the document injection but is a w private chat interface it's maybe a bit too much for now and we have a repository here that's a bit domain specific because this is about scientific documents I'm trying to find something more general
purpose so we will skip that one as well actually the repository that I'm looking for is one that I've explored before it's called Doling and Doling is a repository that allows you to get any documents ready for Gen this repository is one that's at the top of our list because we are sorting by best match and it's got a bunch of stars it's been updated it's in Python it's basically everything that we want So based on this let's go ahead and explore that repository we already know it's relevant that it's vetted by the community and
that it's up to dat because this repository is so popular we can be pretty certain that the readme will contain all the details that we need and indeed doc link contains a pretty big read me that has a lot of information information like the python version that it supports in this case multiple the amount of downloads that it has per month it seems pretty pretty popular and this specific repository even has a related paper so that's pretty cool and if we look at the features this allows us to read popular document formats and Export it
to any of these formats with embeddings for our AI systems that sounds like exactly what I want so next time we'll actually dive into docking and turn any document into AI ready data if you want to get better at using AI projects and see this video then follow me here on YouTube and I'll see you then