I've tested chat gpt's deep research and it's terrifyingly good okay let's check it out so on the 2nd of February open AI introduced deep research and it tells you blah blah blah what it does um how to use it we'll go through that but how it works deep research was trained using end to-end reinforcement it goes backtracking reacting to realtime information where necessary and it's doing really really well with AI test this one's really funny to me because it's Humanity's last exam if you go here this is the sort of questions they asked like this
one here is a representation of Roman inscription originally it's terrifyingly hard um and so I don't know why I'm saying terrifyingly I'm terrified um you've got this one Classics ecology look at this computer science let G be a graph an edge indicator of G these are incredibly tough questions but you can see that it's actually doing really well 26.6% accuracy as opposed to you know like what's the best one before that 13 which was the uh open AI 03 mini so it is getting so so smart but I wanted to know can it do its
smarts for research and Academia let's check it out and uh yeah it's it's so so very good all right so I just want to set the kind of the scene for you this is what chat GPT used to look like so here I've got a simple prompt I am writing a literature review and I'd like for you to conduct a literature review on opv devices use peer reviewed literature and adhere to academic standards of writing so its response is kind of you know what we've expected from chat GPT and it's pretty good you know like
this is what we were used to um It's relatively short it's got all of the like little tals like in conclusion um in terms of references references are there but you know this has got Wikipedia M how many has it got it's got like one two three 4 like five or six references you can click on the sources here and see them so uh yeah you know you can kind of see that it's done its best but it's not really doing great so I want to know how much better is deep research compared to that
so when you first sort of like go to chat GPT you've now got a new button which is not there at the moment if I refresh the page ah there it is I paid that hard-earned internet money to get this button deep research and so you put in your prompt prompt prompt prompt prompt prompt and then you click this deep research this button cost me $200 us to use but but uh I think it's rolling out to sort of like plus users and premium users and institutional users later so you don't maybe have to pay
$200 when you're watching this video but at the moment that's how much it costs but I'm willing to take the monetary sacrifice for you so let's have a look what happens so you put it in there and then you click go so this is what I asked it um I'm writing a literature review it's exactly the same prompt as before and this is sort of like that first little step that was a little bit interesting it said I'd be happy to conduct a literature review oh thank you very much deep research um to tailor the
research effectively could you please clarify the following and it's got scope time frame key topics preferred sources format so I copied and pasted those questions into the uh message uh box I was going to swallow and burp at the same time that's interesting isn't it and so here we've got scope I wanted materials efficiency improvements key topics I want it from like the past 5 years um and preferred sources prioritize best in information I didn't say literature um format structure the literature review into themes such as materials and then we've got length I want 10,000
words I'm going big I'm going big with this one I was wanted to push it to its limits and then it says here I will conduct a comprehensive literature review I was oh thanks very much for keeping me informed of your progress mate and then it says I will Noti as fire you once done and so it went away and it was doing all this stuff it took uh in this case 10 minutes and it found 40 sources and I'm absolutely sort of like Blown Away by what it found and also how it sort of
like characterized the information and put it into an easyto read format and this is what it's all about this output here introduction opv devices solar cells blah blah blah and like it starts well it's really sort of in detail we've got materials um if you scroll down you know we got subsections material stability morphology control history of opv Technology development um and uh this best performing opv devices so these things or I told it like I wanted you to do these things it didn't put history first which is what I would kind of expect it
to know to do but uh nonetheless it followed my sort of instructions to the to the key followed my instructions to the whatever very accurately um and so if you want to provide some sort of structure for your literature review just make sure you sort of like set that structure right before you get it to go off and do its things so it's structured how I asked it and you got all of these different references so if you click here the next web startup so this is not peer-reviewed literature but it is a like um
you know online articles but it does link to where they're actually sort of like talking about the thing that they're using the reference for which I really like um and then we can go back to this one we've also got research gate so we've got real peer reviewed references in there um I feel like it could have done a little bit better with selecting you know for academic St standards but nonetheless you know you can go through this yourself and make sort of like sense of the Articles which ones to use which ones not to
use but it is still in there look it's read all of this and it knows it's getting it from this bit of information here and that's what I really like so in terms of its output in terms of its depth in terms of the references it gives you I cannot fault it really this is the best AI literature review from chat GPT that I have ever ever seen and uh it's only going to get better if you're entering a new field if you're entering a new sort of like project doing one of these up front
will save you hours and hours and hours of writing researching anything you can do now online where you want deep research this can do for you and I think that's going to really really upset some people in Academia because it's now got easier than ever to get expert information sort of like referenced well in just 10 minutes that took me during my PhD days of researching reading synthesizing information now it's just done for you so in terms of you know creating a literature review creating a review paper you can now get all of that information
in a fraction of the time that you used to just incredible um I'll go through my limitations in a minute I I I think like there are some things that for an academic purpose this doesn't do too well but Let's test something else do you like my new t-shirt by the way sewed that up this weekend it's nice bright lovely M love it fits well custom made all right then so the next thing that I want to do was write an introduction to a peer-reviewed paper so not a literature review where you go out and
find loads of everything it's a very sort of like sort of condensed uh literature sort of search over a very specific topic for a peer-reviewed paper we're talking through 300 words Max for something like this so I gave it this prompt write me an introduction section to a peer-reviewed paper about solar concentration mirrors that was one of my projects as well um and advancements in the past 5 years it's going to be at the beginning of a paper that shows environmental stability of mirrors with various adhesion layers to a glass substrate and once again it
comes back to me and says what do you want actually to know mate and I'm like I want to know this so it wanted to know the type of solar concentration it knows to ask these questions what what H that's insane what okay that's the better intonation for that and it like what all right so now we've got the type of solar concentration mirrors being studied so I was doing Helia stats the primary environmental stressors being examined I could answer that any specific adhesion layers and the intended Focus so I sort of like copied and
paste that in and then sort of said type a solar concentration mirors with the Helia stat uh primary environmental stresses being examined with temperature fluctuation and mechanical we so all of this stuff you know it knows to ask and it's now sort of like using that to go and research and do its deep research this took 4 minutes it found 24 sources if you click here it will take you through all of the stuff that it did which is just incredible so you can go through and uh you know see what thinking it did really
and uh yeah it's just a really really great way of uh starting your research these days H oh I'm I'm jealous I'm jealous of you for being able to use this now if you've got $200 at the moment it will be cheaper in the future I think um and then 24 sources you can click here and you can get your sources oh nice look at that you can export those sources I think you would have to go and yeah sort of like put them in manually somewhere we'll talk about limitations in a minute but they're
at least all there for you and the output let's get rid of that Bon and the output here is okay it's not I actually asked for it I don't think it knows what the beginning of a peer-reviewed paper really looks like but that's fine um it gave me too much but I'd much rather have too much than too little at this point so it's got the 24 um references so I could use those and then I actually asked it make it shorter and suitable for the introduction paper of a peer-reviewed article I meant intr introduction
part but it understood um about 300 words and this is then what I could use at the begin of a peer-reviewed paper um in the introduction section it didn't actually give me any references for this bit but I can use the references that it gave me before so I think that's okay it's not ideal that it didn't put the references in here but in terms of output Helio stat mirrors play a pivotal role in concentrate uh concentrating Solar Power Systems by reflecting blah blah blah one king development is it's just perfect it oh God I'm
having a breakdown oh this is better than I would write as a first draft this is better than most people would write this is better than my supervisors could write as a first draft and I'm happy for you all those hours I wasted oh now with technology it's just so easy all right this is good this is this is good good this is POS positive positive for you sad for past Andy um but yes it does this so so so very well and uh you know for 200 bucks if your supervisor is paying for it
at the moment I don't know why you wouldn't get this for your lab because it will really really accelerate all of the writing that you're going to do and all of the important writing that furthers careers is going to get easier and easier but there are some limitations all right the limitations I can see for an academic purpose let's take this literature for example um you cannot actually uh output the cited sources in a way that you would want to use them it doesn't output it in like latc for example so you can put it
into overleaf it doesn't uh export it into like bib Tech it doesn't export it to zoto that is where I think you know specific companies will be able to swoop in at the moment and be like here's the out put and also we've done all the referencing for you as well something like thesis AI is great because you can export it out to um overleaf and then you got complete control over all of the referencing just like you had written the paper that's where this kind of like struggles um and also just in terms of
I think some of the word choices you know it just sounds still a little bit a little bit AI but overall in terms of how great this output is how referenced it is how you could probably just use this as it is I think the journals are going to have to be updating their um submission guidelines and their AI guidelines because this is just so easy to do now that people will be doing this and they'll be fighting a losing battle if they try to stop people just doing this you know clearly you need to
go through and you need to read it and you need to check it and you need to make sure it's not hallucinating that's going to take far less time than going through through all of the literature and coming up with your own kind of like uh you know group of themes and that sort of stuff it's all done for you this is the future of research if it will only sort of like you know perfect those last little things like being able to export the references to a reference manager being able to copy and paste
it across to word over leaf or something like that I think this will just be I mean I I hesitantly use this in real life I think it's a Game Changer if you like this video go check out this one where I talk about the 10 ways that notebook LM can make Academia easy and dare I say it fun go check it out
