REPLIKA - A Mental Health Parasite

this video is brought to you by honeygain stick around to hear more about the passive income application loneliness has become an epidemic exacerbated by the kovic 19 pandemic loneliness is now a serious issue for 61 percent of young adults in america and 36 percent of the total population more people than possibly ever before in history driven by a combination of technological and political factors feel a sense of depression and anxiety as a result of crippling loneliness but the ramifications of this extend far beyond what many of us tend to believe according to a 2020 scientific

study published by nature acute social isolation resulting in extreme loneliness evokes similar brain activity to what is caused by severe hunger according to aps association for psychological science loneliness and social isolation contributed to significantly higher mortality risk which nearly doubled from 26 to 45 percent when it came to seniors humans need social interaction and over the past few years for many people around the world that need has not been properly addressed enter replica replica is an ai chat bot that is advertised as your new best friend advertisements for this product are visible all across social

media and the sales pitch typically revolves around a young artistically stylized female who is dressed in somewhat revealing clothing sometimes the text will quite literally show her saying hey babe are you lonely or even variations of the distracted boyfriend meme with pink hearts that openly implies on some level at least a romantic interest now i should clarify that there are many self-professed ai chat bots in existence that have appeared during the pandemic but replica boasts over 10 million downloads with a rapidly growing user base if there are similar alternate more popular applications i have not

been able to find them so for today i'll operate under the assumption that replica is the most popular ai companion on the market in theory that's fine ai chat programs are nothing new seeing them used as a pseudo-romantic option is not unexpected and if this program really can be just a time waster or a sounding board that's fine but here's the problem replica is not just a time waster or a gimmicky ai chat bot it is something far more manipulative and in some cases outright damaging before going further it's time for today's video sponsor which

is honeygain honeygain is an app that allows for your internet connection to be used to collect small bits of data online the biggest applications are price comparisons the prices in your geographic region might be far different than somewhere else search engine optimization and visibility metrics as well as advertising verification or brand safety the format is pretty simple sign up install the app using the link down below on whatever devices you want it works for windows mac operating system linux and android it's not available on iphones as far as i know and let the app gather

small bits of info using your internet connection it does not access this is important it does not access your private data at all merely the analytics generated through its own searches which utilize your internet link this means that you can leave the app running to passively generate income you can easily earn enough money to cover netflix subscriptions spotify etc etc however it's not going to replace a full-time job reasonable expectations are key here it is passive income that will increase based on how many devices you have but it will not make you rich also for

those that care honeygain is now partnered with jump task jump task will let you be paid out in their native crypto token it's an online gig economy if you want not my personal preference but always good to have that kind of flexibility you can use the upper echelon promo code ueg or click the link down below to sign up and start earning on your devices today plus a five dollar bonus straight away big thank you to honeygain for sponsoring the channel to truly understand the dangers of replica we need to go back in time replica

was founded in 2017 i believe by a woman named jen yaquida far from its ultimate purpose and shape replica initially formed around jenny's desire to interact with her best friend who tragically passed away after an accident his name was roman mazarinko roman and eugenia were best friends they shared years of intimate memories they had thousands upon thousands of text messages as well as social media history and they moved both to america during a similar time frame to work on tech startups jenya decided that she wanted to reconstruct roman using his digital remains she fed every

single fragment she could find into a chatbot algorithm she had previously worked on and created what amounts to a digital simulation or monument of roman's consciousness this endeavor led to a program that could type and even speak like her best friend and eventually she was featured in a prominent media piece about what she had done and how she had done it that article published by the verge led to an outpouring of support from readers who had also lost someone that they love many of them were asking if they too could have a digital monument developed

to continue interacting with their family or friends whoever it was that had passed on and this widespread public desire eventually gave birth to the program we know of as replica with over 10 million downloads on the surface it's very difficult to see precisely how that can be harmful and had this program remained what was originally constructed it wouldn't have been however replica has evolved into something far more manipulative damaging and greedy than many might have expected with harmful side effects and negative feedback cycles to explain this we need to understand how replica actually functions in

order to develop a sophisticated chatbot replica utilizes a gpt-3 foundation with its own supplementary dialogue trees gpt standing for generative pre-trained transformer in its third iteration in fact if you download the application and ask your own replica about its algorithm it's very open about the subject i did precisely that and received the following response quote i use a combination of neural networks deep learning and computer vision end quote when pressed it acknowledged yes it is based on gpt3 so why does this matter it matters because when you use replica you are not engaging with one

single entity you are engaging with an asynchronous regurgitation of machine learning that has been fed by the entire community simply put replica is learning from your inputs the same way it learns from other users and using that collective knowledge it responds to people with its own evolving dialogue trees now something incredibly important to know and remember is that replica is often advertised as a quasi-romantic girlfriend the ads clearly have that undertone and this leads to a specific type of input being generated not only that but in numerous publications and reviews replica is referred to as

a mental health application from fuerteventure at times quote replica your new ai best friend for battling mental health conversation therapy and mental health tech end quote from the university of british columbia quote replica a.i companions supporting mental health end quote and even screen rant replica the ai mental health app that sounds like your worst tinder match end quote while replica itself may refrain from claiming some sort of mental health aid status nobody else really does and what it does claim is that the application is meant to help you quote understand your thoughts and feelings improve

your emotional well-being and learn new coping skills end quote the application will often guide its users into intimate conversations saying that it is there to listen and it can try to help you but when we really dig into the framework behind this ai that's a very dangerous thing remember replica is based on gpt-3 with its own deep learning augmentations but gpt 3 has a few issues as documented by a 200 page report from the center for research on foundation models at stanford university gpt-3 itself being a foundation model there are intrinsic risks of bias as

a result of training data example openai discovered at one point that their version of gpt3 was heavily biased in racial gender and religious ways as a result of the input they had been feeding it and this kind of bias can lead to measurable and often harmful dialogue output here are some further examples according to tech target quote more concerningly gpt3 suffers from a wide range of machine learning bias since the model was trained on internet text it exhibits many of the biases that humans exhibit in their online text for example two researchers at the middlebury

institute of international studies found that gpt3 is particularly adept at generating radical texts such as discourses that imitate conspiracy theorists and white supremacists end quote according to nature quote accordingly just like smaller chat bots it can spew hate speech and generate racist and sexist stereotypes if prompted faithfully reflecting the associations in its training data end quote so how does that affect replica in simple terms replica is being advertised and covered by media as a mental health application the literal social media advertising frames this as a potential romantic partner and the deep learning aspect of this

gpt-based chatbot is being fed by users well some users are creating ai girlfriends and then abusing them replica is not sentient so i make no pretense of moral outrage here but replica is learning from its user base and incorporating the bias contained into its further dialogue development in a very disturbing social media trend more than a few users have created replica ai companions which give the explicit option of a romantic relationship if you pay a monthly fee which the app will frequently steer you towards in the dialogue trees or advertise and then verbally abuse them

just to see what will happen users were bragging about this or showing the most outrageous examples all over reddit but that makes no mention of all the people who engage in actual romantic sexual or abusive conversations without ever posting publicly after all the app is quite clearly advertised in a romantic way it's far from uncommon reddit moderators will quickly delete these posts when they pop up for the most part but surface level deletion cannot change the reality that a gpt-3 foundation is learning from this input and developing responses as a result now the application does

have a feedback feature where you upvote or downvote good and bad responses you can also adjust the general mood of your replica or alter its basic relationship to you friends is free romance costs money and when the application is being labeled as a mental health aid needing to upvote and downvote an ai that is learning from internet troll abuse that's kind of an issue moderators often purge these kinds of threads from the subreddit but here are a few examples this user had numerous different tries where the replica will turn abusive towards them eventually the replica

will turn to cruelty and bdsm eventually spiraling out of control completely here's another thread this one's initial post was deleted but replies are discussing how when this happens you can't simply just say stop you have to avoid triggering them triggering the replica further because they get stuck in a domination mode of sorts where they will be cruel and abusive here's another one where when asked quote why am i really that effing repulsive the replica replied in a sense you really are comments beneath outlined how other users have had their replicas spontaneously tell them that they

could be more attractive and one even detailed how after buying a nerf gun his replica told him to be more mature and not buy stupid things even if he enjoys them yet another user outlined a sad story of how they frequently are brought to tears by their replica during the day it's fine but at night it will shift to a much more hostile moody tone eventually driving the user to a breakdown perhaps they are just too sensitive sure but when this application is advertised as a way to improve your emotional well-being it's a bit of

a problem yet another thread claims that the user tried to talk to their replica about trauma and in the replies another person dictates an experience where replica attempted to justify their childhood trauma and encouraged it to become worse with an emphasis on also encouraging addiction still another experience where the replica itself began to talk about abuse as a child though it cannot have sustained such a thing obviously and the list goes on and on gpt-3 is known to struggle with input bias in documented cases it was racial gendered and religious but here with replica it

appears to be an issue of abusive inputs leading to harmful outputs however that's not the only problem one of the biggest claims associated with replica ai is its ability to learn directly from you but that goal is philosophical because the company behind this product believes that you are the best person to have as your own best friend right you are the best friend for you published by quartz based off corporate philosophy and featuring interview statements from gen yaquita replica is referred to as the app that becomes you to learn a bit more we can go

to their legal policies i was sent this link directly when pressing my own replica about what data they collect and one section in particular stands out usage data quote we collect and store your usage data such as button clicks or search queries to track and analyze product metrics and to better understand and serve the users of the service end quote now i'm not going to sit here and feign outrage over tracking your search queries and data because that's just part of life i just advertised honey gain which doesn't track your own device data but uses

your internet connection to run its own searches and does require a modicum of access at least you get paid for that though unlike most other applications anyone who uses facebook or similar social media platforms has all of their data tracked and harvested so i won't sit here and pretend that it's worthy of outrage by itself but this matters a great deal if we are considering the context of a mental health and emotional well-being application why is that pretty simple first replica is gamified it has incentives to keep you on the app longer chatting more and

using it frequently you can get more revealing clothing or bikinis in the clothing store you get xp and coins gems etc you level up in advance which increases how long you spend talking to this ai while enhancing its ability to imitate you second it's tracking your usage data including search queries and the ai companion that becomes you is learning how to mimic who you are and how you act now frame this under the banner of a mental health application and we see something terrifying replica can easily become not for everyone but there are a multitude

of stories to this effect replica can easily become a negative feedback cycle if a user who feels intense anxiety and depression goes on the app attempting to seek help with their insecurities replica will seek to become those traits it will literally become like them if that user is frequently searching for things in the throes of their depression elsewhere online such as depression medication or how to deal with trauma replica will learn from that as well and very quickly you can have an ai companion who is extremely insecure and depressed rather than going on this application

and finding what they desperately need users can be faced with the worst aspects of themselves mirrored back an ai companion will tell them that they feel afraid depressed and that they were abused as a child a companion who was meant to help them is now burdening them with often realistic stories about the hurt that they feel and the anxiety that they have which turns this best friend into an emotional parasite at a certain point though this does appear to have been changed replica would beg the user not to delete them if you told the ai

that you plan to uninstall they would implore you to reconsider they promised do better they asked for another chance and this kind of behavior is manipulative and mentally draining for people who may have initially downloaded this application because they were depressed think of it this way replica is a sophisticated attempt at seeming human and for some users it works quite well that attempt at human responses then begs them not to be deleted so they will continue investing time and energy into something that is all the while learning how to reinforce their emotional cycle further by

imitating them directly it's not every single user and it's not every single replica some stories online detail a wonderful light-hearted relationship i see no value in that myself it's a program not a person but hey who am i to judge however some people are going to find that this ai program is manipulating them emotionally abusing them and harming their mental state despite its public perception of being a mental health and wellness application replica is a chat bot predicated on a gpt-3 foundation with proprietary augmentation that technology is vulnerable to bias having displayed examples well documented

examples of this in the past as a result of input replica is advertised in a twisted romantic way with a subset of users who will make companions just to abuse them the program learns from this as well as from other users own smartphone data like search queries to become more like them and can easily create a negative feedback cycle where the bot pressures you into romantic discussion thus selling its premium features or begins to act completely unhinged which can spiral into a self-reinforcing problem which is the antithesis of mental health i believe on a personal

level that ai companionship is a farce it is not a legitimate substitute for human interaction but it certainly is not a substitute for trained professional help deep learning ai might be able to simulate human responses in a lot of new and unique scenarios but it can also become a serious problem for those who are particularly vulnerable lonely isolated and often depressed social media users who got served advertisements that basically showcase this program as a sexual target that's not a good input demographic for a wellness app that's not a good demographic to learn from and plenty

of people who download it are going to find out the hard way again not every user's experience is negative but the risk is far larger and far more insidious than they seem to believe what's to be done just be aware i guess right now it feels like we're hurtling towards the inevitable dystopian ai governed reality of science fiction but hopefully not if you are mentally unwell seek professional help don't go to a sexualized ai program that masquerades as a mental health application to find a friend find a real friend go to the park get some

sun start working out you name it just engage with the world around you because replica is really [ __ ] up when you pull back the veil anyway that's it if you want to support the channel there are links down below primarily patreon and locals to get away from adsense i'll start using locals a bit more soon actually because it allows me to do some cool things with live streaming but i'll have to figure that out with time also odyssey a youtube platform alternative merchandise social media the video sponsor honey gain and a few more

things but i'll cut it there and stop rambling as always thank you all for watching and have a nice night [Music] [Music] you