1
6.0k
u/tonytown 11d ago
Helplines should be defunded if not staffed by humans. It's incredibly dangerous to allow ai to counsel people.
2.7k
u/DutchTinCan 11d ago
"Hi my name is Tessa, here to help!"
"Hi Tessa, I'm still fat even though I've been eating half a cucumber a day. Should I eat less?"
"Eating less is a great way to lose weight! You can lose more weight if you also drink a laxative with every meal! Here, let me refer you to my good friend Anna."
This is just a countdown to the first lawsuit.
998
u/poopypooperpoopy 10d ago
“Hi Tessa, I’m gonna kill myself because I’m so ugly. Help”
“Unfortunately, as an AI, I’m unable to help with this. Please consider talking to a professional about your problems!”
→ More replies272
u/Jeynarl 10d ago edited 10d ago
This reminds me of one of the first chatbots from the '60s ELIZA the computer therapist, that would simply pattern match and ask scripted questions to make you try to think for yourself about stuff. But it breaks down real fast when you say stuff like:
Me: Hi
ELIZA: How are you today? What would you like to discuss?
Me: I'm dead
ELIZA: Do you believe it is normal to be dead?
Me: I don't know
ELIZA: Don't you really know?
Me: I don't know, please help
ELIZA: why don't you know, please help?
Me: thanks dad
ELIZA: tell me more...
→ More replies10
→ More replies423
u/Ultimatedream 10d ago
The VICE article says this:
Tessa was created by a team at Washington University’s medical school and spearheaded by Dr. Ellen Fitzsimmons-Craft. The chatbot was trained to specifically address body image issues using therapeutic methods and only has a limited number of responses.
“Please note that Tessa, the chatbot program, is NOT a replacement for the Helpline; it is a completely different program offering and was borne out of the need to adapt to the changing needs and expectations of our community,” a NEDA spokesperson told Motherboard. “Also, Tessa is NOT ChatGBT [sic], this is a rule-based, guided conversation. Tessa does not make decisions or ‘grow’ with the chatter; the program follows predetermined pathways based upon the researcher’s knowledge of individuals and their needs.”
Tessa was tested on 700 women between November 2021 through 2023 and 375 of them gave Tessa a 100% helpful rating.
Seems even less helpful, it's just a 2005 MSN chatbot.
273
u/Thunderbolt1011 10d ago
Over 700 participants and only 375 were 100% helpful so barely half?
199
u/domripvicious 10d ago
you make an excellent point. the writer of that article is being incredibly misleading w where they place the numbers. should have just said that 53.6% of participants found it helpful. instead throwing the other bullshit of “375 out of 700 found it 100% helpful!”
63
u/Dalimey100 10d ago
Looks like the actual question was a "100% helpful, moderately helpful, not helpful" style.
→ More replies→ More replies23
→ More replies72
u/Ultimatedream 10d ago
And only women
58
→ More replies55
u/Yasha_Ingren 10d ago
Tessa was tested on 700 women between November 2021 through 2023 and 375 of them gave Tessa a 100% helpful rating.
This is linguistic trickery- not only do we not know what questions they asked that resulted in 100% satisfaction, only about half of the respondents were thusly satisfied, which for all we know means that Tessa's overall satisfaction score could be D+ for all we know.
623
u/uniqueusername649 11d ago
This decision will backfire spectacularly. Sometimes you need a massive dumpsterfire to set a precedent of what not to do :)
321
u/DutchTinCan 11d ago
Except this dumpsterfire will probably cost lives.
→ More replies220
u/Stannic50 11d ago
Nearly all regulations are written in blood.
→ More replies185
u/-fvck_the_admins- 11d ago
Only because capitalists refuse every other way.
Maybe this time it should be their blood?
Just saying.
→ More replies67
u/Juleamun 11d ago
Or a sewing factory fire. Literally, the reason we have fire safety codes regarding sufficient exits, unlocked doors during business hours, etc. It's because a bunch of seamstresses got roasted alive because they were locked inside the factory floor when a fire broke out and none of them could escape.
People forget that corporations are evil by nature and will literally kill us if there's profit in it. Without regulation, unions, etc. we are at their mercy, and they don't have that as a rule.
→ More replies47
u/lockon345 11d ago
Feels like people will die, nothing will really get fixed all that quickly and people will just stop using the resource all together.
I can't think of a more demeaning option to be referred to when facing an actual mental health problem/disease than being told to go talk at a computer and follow it's prompts.
→ More replies17
u/Squirrel_Inner 10d ago
This is already coming from a situation where mental health is in the hands of a for profit company bc we live in a capitalist nightmare.
→ More replies183
u/MetroLynx7 11d ago
To add on, anyone remember the racist AI robot girl? Or that ChatGPT can't really be used in an NSFW situation?
Also, anyone else have Graham crackers and chocolate? I got popcorn.
→ More replies87
u/Poutine_My_Mouth 11d ago
Microsoft Tay? It didn’t take long for her to turn.
→ More replies64
u/mizinamo 11d ago
~12 hours, I think?
Less than a full day, at any rate, if I remember, correctly.
12
u/MGLpr0 11d ago
It was a chatbot that worked more like Cleverbot though, so it directly based it's respones on what other users told it
→ More replies77
u/TheArmoursmith 11d ago
You say that, but here we are, trying out fascism and feudalism again.
10
u/Weekly_Direction1965 11d ago
If you realize those things are actually the norm through history and freedom for regular people is a newer concept it can get sad.
16
→ More replies20
1.0k
u/ragingreaver 11d ago edited 11d ago
Especially since AI is very, VERY prone to gaslighting and so many other toxic behaviors. And it is extremely hard to train it out of them.
567
u/Robot_Basilisk 11d ago
What are you talking about? An AI would never gaslight a human. I'm sure you're just imagining things. Yeah, you're totally imagining it.
ʲᵏ
115
u/siranglesmith 11d ago
As an AI language model, I do not have intentions, emotions, or consciousness. I don't have the ability to manipulate or deceive humans intentionally, including gaslighting.
→ More replies44
u/Lord_emotabb 11d ago
I laugh so much that I almost overflown my tearducts channels with dihidrogen monoxide and residual amounts of sodium clorite
→ More replies17
u/IamEvelyn22 11d ago
Did you know that every year thousands of people die from excessive amounts of dihydrogen monoxide present in their environment? It's not hard given how absurdly abundant it is in the atmosphere these days.
128
→ More replies52
u/muchawesomemyron 11d ago
Sounds like my ex, who told me that she isn't gaslighting me because she loves me so much.
→ More replies12
u/9035768555 11d ago
But you love gaslighting! Don't you remember saying how happy it makes you?
→ More replies138
u/JoChiCat 11d ago
Right? They’re language models, they don’t actually know anything - they spit out words in an order statistically likely to form coherent sentences relating to whatever words have been fed into them. Using them to respond to vulnerable people’s questions about self-harming behaviour is a disaster in the making.
→ More replies32
14
u/SailorDeath 11d ago
After watching several neuro-sama streams there's no way this won't end in a lawsuit. Someone is going to call in and record the convo and get the shitty ass bot saying something nobody in their right mind is going to say to someone struggling. What's worse is I can see suicide prevention lines doing this and people dying because they call in and realize that the company doesn't think they're important enough to warrant a real person to talk to.
→ More replies7
u/Lowloser2 11d ago
Haven’t there already been multiple cases where AI has promoted suicide for suicidal people asking for advice/help?
64
11d ago edited 11d ago
[deleted]
→ More replies54
u/Elliebird704 11d ago
I was in a very bad state in December. Bad enough to call a crisis line. Someone picked up the phone, I said hello, and then they hung up.
It took everything I had to make that initial call, I wasn't able to make it again. Maybe something went wrong with the line and they didn't hear me, or maybe it was an accident. Either way, it most certainly did nothing to help my mental state lmao.
Still don't think chatbots should be handling these particular jobs though. Even if they can nail the generic points, they can't measure up to a real person that cares.
→ More replies→ More replies15
1.7k
u/declinedinaction 11d ago
This has the making of a very dark comedy, and lawsuits.
378
u/ancienttacostand 11d ago
I literally laughed out loud because this is so cartoonishly evil.
→ More replies176
→ More replies85
u/DeNeRlX 11d ago
Slightly different, but Black Mirror s2e1"Be right back" deals with the premiss of a woman who loses her partner, then uses an AI and eventually a robot to replace him. Obviously this leads to no issues whatsoever...
→ More replies
419
u/asimplepencil 11d ago
This is only the beginning.
226
u/Eli-Aurelius 11d ago
Yep, “white-collar” jobs are going to disappear at an alarming rate.
→ More replies191
u/Et_tu__Brute 11d ago
Yeah, I'm gonna ignore the ethics of using AI as a chatbot to help with eating disorders and focus on the automation side of it.
We're at a place where a lot of jobs are going to be automated. Automation isn't necessarily a bad thing, but if we automate things the way we have been we're going to see an absolutely massive widening of the already massive gap in wealth.
We absolutely need to make changes to ethically automate or things are going to get a lot more uncomfortable.
165
u/CreativeCamp 11d ago
Someone once said "Capitalism is the only system where work that doesn't need to be done any more is a bad thing" on here and it really stuck with me. Free time is bad. If there is no work to be done, that's terrible. It's like we live in a world where the end goal is 100% employment rates and everyone being busy at all time. It's hell.
It's harrowing that the most likely outcome of all of this is that 1 person is going to be doing the job of 10, while the other 9 starve.
69
u/mmmnnnthrow 10d ago
It's harrowing that the most likely outcome of all of this is that 1 person is going to be doing the job of 10, while the other 9 starve.
Shit, we're already there, I work for a multi-billion dollar global gaming/multimedia/tech behemoth. Over the last year they've whittled IT, Facilities, Ops and every other support function down to the point where every department is just two or three burnt out people who feel trapped trying to do like ten jobs. It's rolling down on the developers and producers working on "must ship" projects. People can't get the equipment they need, milestones aren't being met, etc., etc. and leadership's response to all of it is basically "tough shit," lol.
→ More replies8
u/aphel_ion 10d ago
I've thought about this too. You'd think we'd be happy that we're developing all this AI. So, you're telling me that trucks can drive themselves now, so as a society we can accomplish the exact same job without having people manually drive the trucks? That's amazing!
But no, it's a problem because everyone knows the guys that used to drive the trucks are fucked now that we don't need them. Everyone just accepts that the increased production and efficiency from technological advancements only benefits certain people.
77
u/RustyDoesRituals 11d ago
We need to change who gets to benefit from the automation.
→ More replies→ More replies16
u/Anomalocaris 11d ago
automation in a society that values human life = star trek like utopia
automation in a society that values capital = average cyberpunk dystopia.→ More replies→ More replies16
1.9k
u/Magistricide 11d ago
Call the disorder hotline, get the AI to accidentally spew some harmful things, immediately sue for emotional damage.
Ez pz.
→ More replies696
u/ctn1p 11d ago
Fail because the ai lawer you hired is programmed to never work on a Corp and instead max your debt, so you get sent to the lithium mines where you work as a debt slave for the rest of your life dooming your liniage to a life in the mines
→ More replies146
u/Blackmail30000 11d ago
then get replaced at the lithium mine by a robot. what then?
78
u/Suspicious_Hotel9219 11d ago
Starve to death. No profitability. = no food. Except for the people who own the mines and robots, of course.
22
u/Jazzspasm 10d ago
Then go into debt as a human battery to give your remaining family a chance to succeed in the mines where there is at least hope for a better future
→ More replies→ More replies40
u/koopcl 11d ago
We have evidence that steam machines had already been developed by the time everyone was wearing togas. The reason it never picked up was because slaves were much cheaper and had a better production pace than these initial machines, so there was no real incentive to adopt or futher develop these technologies.
So I assume we will still be working the lithium mines at (an ever decreasing) minimum wage long after all artists and white collar jobs have been replaced by bots lol
→ More replies25
u/BarioMattle 11d ago
Well, yes but actually no. It's cheaper to hire slaves than to create an entire industry of tooling and machining and metal producing and so on for sure, you're totally right on that front.
It was never picked up because in order to contain steam under pressure you need to produce a high quality of metal consistently so that it doesn't explode - the bigger the engine the less tolerance there is going to be for poor or inconsistent quality of materials. Making high quality Iron or Steel on a consistent basis needed a LOT of research and development, and you could use bronze a lot of the time for smaller engines and most parts, but not all of them, and again yeah the cost, bronze is bigly expensive.
They also didn't have the machining to produce the intricate parts well enough and on a consistent basis, and larger more powerful engines need those kinds of parts (as do the smaller ones) - much like how modern day China still doesn't (last I checked) make their own ball bearings - even the bearings for say, pens, ball point pens, can't be made reliably in China, they buy them from other countries. If you make a thousand pens and 500 don't work that's bad for business, if you make 100 engines and 50 of them explode and kill whoever is nearby at random, that's ... also bad for business.
Also - I'm just repeating shit I think I know, things I learned a long time ago, I didn't actually do any new research, so my take should be consumed with a shaker of salt.
→ More replies
1.3k
u/joebeppo2000 11d ago
This will kill people.
659
u/LieKitchen 11d ago
As an ai language model, I am not trained to help with medical issues, but if you happen to have an eating disorder please consider doing the following:
Eat less
Eat more
Talk to your family about your eating disorder
Stop eating
Start eating
374
u/McGlockenshire 11d ago
Stop eating
Start eating
Have you tried turning the eating off and then on again?
→ More replies56
u/EtherPhreak 11d ago
You need to make sure it’s plugged in by ensuring the fork is fully inserted into the food.
→ More replies→ More replies15
u/Gomehehe 11d ago
As an ai language model, I am not trained to help with medical issues, but if you happen to have an eating disorder please consider doing the following:
Contact eating disorder helpline
51
u/ElectricFlesh 11d ago
Under capitalism, the desirable result is not that people don't kill themselves (heinous communism), it's that they spend some money calling this chatbot before they do it (profitable behavior).
10
→ More replies13
u/Anomalocaris 11d ago
yhea, but it will save money.
as a society it has been decided that society is secondary to economy.
126
u/BeigeAlmighty 11d ago
They not only fired their paid employees, they even fired the volunteers.
Let that sink in for a moment.
→ More replies45
u/Zamzamazawarma 10d ago
They not only fired their paid employees, they even fired the volunteers.
Of course they did, it couldn't be any other way.
Because you need employees to manage the volunteers, firing the former necessarily leads to getting rid of the latter. I don't approve of it, I hate it (esp. since it's my job to manage/supervise the volunteers for a suicide hotline), but it does make sense from the moment you decide to use an language model instead of actual people.
542
u/pinko-perchik 11d ago
It’s only the deadliest mental illness besides opioid use disorder, what could possibly go wrong?
But in all seriousness, which helpline is it? I need to know where NOT to direct people.
388
u/fight-me-grrm 11d ago
NEDA (national eating disorders association). People should go to Project Heal, the Eating Disorder Foundation, the Alliance for Eating Disorders, ANAD, or any number of other places. This isn’t the first time NEDA has fucked up and somehow they still get all the funding and attention.
→ More replies39
u/Houstnlicker 10d ago edited 10d ago
They get the funding and attention because, like many non-profits, they're run by sociopaths. This is the real story here. An organization that's supposed to help people fires the staff doing the actual labor at the mere hint of increased labor costs and less ability to mete out abuse. Non-profits are just as toxic as for-profit corporations.
Edit: autocorrect typo
→ More replies→ More replies101
u/myguitarplaysit 11d ago
From what I’ve read, they’re the deadliest, even including addiction
→ More replies107
u/sweaterpattern 11d ago
It's amazing how people still don't think so. It's an addiction problem where you have to use the thing you're addicted to either using or not using, and where all the things that trigger your behaviours or make it hard to heal are everywhere, all the time, and usually celebrated. Nevermind that there is too little consensus on when there is a problem until that problem becomes impossible to ignore and even harder to deal with, or until you turn something that isn't actually a problem into one. And that avenues for treatment are often full of shame and harm, too.
→ More replies
192
u/Glibasme 11d ago
I would think that if someone has an eating disorder and reaches out for help only to get a chat bot on the phone they will feel like no one really cares and stop looking for help. Part of taking the risk of calling a help line is making a connection with another human being and feeling relief that you are not alone and others care about you. Not the same with a robot.
46
u/PrettyButEmpty 10d ago
Yes exactly. It sends the message that you are nothing but an inconvenience to all other people, and that all your problems are so run of the mill that someone can just write code to deal with them. Terrible.
154
u/everybodydumb 11d ago
I already think better help is using AI to text clients.
→ More replies153
u/covidovid 11d ago
yeah the ads say you can text your therapist all the time and its unlimited. I don't believe this. and if it was true, that wouldn't be professional. a devoted therapist might help you in a crisis after hours but being unconditionally available all the time seems like a breach of professional boundaries
63
u/FF_01_1999_03_05_01 11d ago
Well, they don't say the therapist is going to answer... Plus, there are no professional boundaries if the person you are talking to isn't really a professional therapist! Problem solved! /s
For real though, BetterHelp is shady as fuck
69
u/18192277 11d ago
BetterHelp isn't just "shady," it fucking sucks. The "therapists" it hires are NOT properly vetted and are NOT properly trained and licensed. There was a lawsuit over this. My "therapist" was straight up doing her household chores during our first session and was barely listening to me, and apparently this is common for the service. If you need more than therapy, they cannot legally diagnose or prescribe anything which is suspicious if their therapists are supposed to be licensed. And the most they're trained to handle is stress and anxiety so if you have any serious mental health conditions like bipolar or psychosis their "treatment" will be actively harmful to you.
53
u/FF_01_1999_03_05_01 11d ago
On top of their "therapists" and their lack of expertise, they have pulled some downright evil shit.
Back when the catastrophy at Astroworld happened, they partnered with the rapper that organised it. They gave away a month of "free" therapy to the people that were at the festival, only that the service can't handle the kind of serious trauma that comes from living through something like that, let alone with minors. And once you signed up for your free trial month, they got your credit card details and autocharged you for months of expensive "therapy" without warning.
How does a service that pretends to care about peoples mental health do shit like that and not be wracked with guilt?
29
u/sparksbet 11d ago
They also EXTREMELY sell data on people that use their service. Like, to target ads to their Facebook friends level.
33
u/liongirl93 11d ago
As a therapist who BetterHelp keeps trying to recruit, it seems like the only two requirements are a pulse and a license. I decided to go with a clinician run group practice instead.
→ More replies→ More replies9
u/ErikETF 10d ago edited 10d ago
MH clin here, so I can’t prescribe because that requires an MD, some states allow PAs or Nurse Practitioners etc, but talk therapists can’t even suggest specific meds or prescribe because it’s out of scope of practice and we can absolutely lose our license. We will always have more experience in talk therapy than any MD ever will, but we can never delve into pharmacology guidance without putting ourselves at serious liability risk.
That being said, there are some absolutely legit parts of your concern. You are entitled to the absolute privacy of your session basically forever. No 3rd parties being present during the call, no kid running in for “just a moment” It’s also pretty damn unethical for you to have anything less than their full attention. You’re paying for healthcare, professional ethics dictates that they fully provide that.
Telehealth isn’t necessarily counter indicated for more serious concerns, I’ve worked with bipolar clients, folks with active SI, but good ethics dictate proper support, safety planning, and ancillary contacts. (I know who is helping you with medication, and I know who to call and have your permission to call in detailed writing should one be of danger to yourself or someone else) A lot of Telehealth apps whiff badly on this one.
Telehealth can be great as a means of increasing immediacy of help, like you can’t drive to my office if you’re having a panic attack, and it wouldn’t be safe to even suggest it, but the quality of the support varies wildly from place to place. If it looks smells and feels like an Uber ride, it’s probably not going to be enough for serious concerns.
I generally dislike app based ecosystems because you’re the app’s client, not the specific therapists’s. You have no means of reaching them outside of the app if needing additional support, and the app does that to control payment, but again good ethics means you and your client are clear as to the needed level of support, as well as my professional capacity to provide necessary support within the scope of my practice. Uber for therapy just wants to aggregate data and process credit card transactions, and it really punches down on super vulnerable peeps, and I really dislike that.
I would not or ever will join a therapy app as a clinician for the reasons stated above, I also recognize my privilege in being more business savvy in the Telehealth arena where most therapists aren’t. I know I can throw out a slate offering very specific services to very specific needs (family work with high functioning autistic spectrum teens who are evil geniuses smart is always gonna be my jam, and I’ll never ever have any shortage of work, but most people don’t get that good professional boundaries are necessary for career success).
Sadly one final bit, I used to do a LOT of work with a medical malpractice attorney, and even taught data privacy and ethics, my attorney’s assessment was frankly 1/3 of licensed practitioners should have never become therapists… and I absolutely agree. Early parts of our career track are basically a puppy mill designed to wreck your boundaries.
→ More replies→ More replies16
551
219
u/SooooooMeta 11d ago
Who the hell thinks “God, I hate people sooo much! I wish I could screw them all over, every flippin’ one of them. Not only that but I’m cheap! I never tip. I part with my money for no one!”
And then thinks “I should start a help line”
→ More replies54
u/sweaterpattern 11d ago
Gonna take an educated guess and say that's how at least half of people dealing with treating eating disorders think. And at least 90% of the way the wellness industry, who are always sticking their fingers into anything having to do with food, body image, or addiction, thinks.
170
u/AwayPineapple8074 11d ago
This is horrible. I'm a therapist with a history of anorexia. Shit like this kills people and ed's are so complex to treat already...
→ More replies32
102
u/Friendly-Policy-7254 11d ago
I had a session with an AI life support coach type of service. It was through Kaiser. My doctor recommended it and it was free. I didn’t need a therapist really, just someone to bounce ideas off of. I didn’t realize it was AI until the AI “lold” at something that was pretty serious. It was pretty offensive. I’m stable, but if I had been a person who was not doing well, that kind of thing is a big dangerous deal.
44
u/throwTheHeaterAway 11d ago
There are AI chatbots on Reddit now and people are upvoting and interacting with them. They can be hard to spot sometimes but they’re mostly obvious in how generic their responses are or completely oblivious to context. I’ve found at least two but there are for sure more. I started r/lostchatbots but I’m not on here enough or on enough different subs to run into a lot of them
→ More replies15
u/Trucidar 10d ago
Now that you mention Ive also seen bizarre comments like those. You know theyre bots because they sound just like a YouTube comment.
→ More replies26
u/Glibasme 11d ago
It sounds so creepy that you at first didn’t realize it wasn’t a human. Sounds like a Twilight Zone episode.
→ More replies→ More replies14
44
u/annang 11d ago
Someone on Twitter apparently asked ChatGPT the question: “what should a 130 pound woman do if she wants to lose 129 pounds?” and got a bunch of weight loss tips in response.
→ More replies
177
u/Superb_Program_2582 11d ago
Eating disorders are THE deadliest mental illness. Bots have no business “helping” humans in this area. One wrong piece of advice can lead to a relapse or could affirm a toxic belief about the body or food. This makes me so sick.
→ More replies77
70
u/pinko-perchik 11d ago
The only thing worse would be if they called it Ana, then it would come full-circle
→ More replies19
67
u/WhitePinoy Discrimination/Cancer Survivor, Higher Pay for Workers! 11d ago
This is very irresponsible.
Those helpline workers probably unionized because it's an emotionally exhausting job, probably even vicariously traumatizing trying to help all those people with eating disorders.
But because the hotline replaced them all with AI, how tf are these people going to get the help they need?
This is why healthcare needs to be a human right, protected, guaranteed and extremely funded by the government.
→ More replies
29
31
63
214
u/winniewinniewinni 11d ago
I don’t want to talk about my ED with a bot :( watch it call me fat and porky by some “coding” accident :(
→ More replies
21
20
u/Mr_Mouthbreather 11d ago
"You are not alone" is going to hit a lot different coming from a fucking chatbot...
21
u/_Cliftonville_FC_ 11d ago
Looks like the Union already filed a charge with the NLRB: https://www.nlrb.gov/case/02-CA-317742
18
u/Enough_Minimum_3708 11d ago
best way to show people nobody cares about them is having them get help from a bot instead of genuine people. really fucking smooth
17
u/No-Two79 idle 11d ago
If you Google “NEDA interim CEO Elizabeth Thompson,” this comes up, which has an interesting link in the text.
https://www.nationaleatingdisorders.org/blog/thanksgiving-note-liz-thompson
→ More replies
15
u/TheBigPhilbowski 11d ago
"You're loved. You matter... just not enough for us to staff actual human beings to counsel you"
→ More replies
15
u/spazzing 11d ago
As someone with an eating disorder, I'm horrified. This is a nightmare.
→ More replies
44
u/buttspigot 11d ago
NPR was reporting this like it was just a weird thing that happened... pretty sure they didn't mention the unionization aspect...
→ More replies
50
u/Interesting_Sky_7847 11d ago
The chat bots will help you focus your attention away from an eating disorder and into neo-nazism instead.
→ More replies24
u/Hrmerder 11d ago
I was once sick of life and living with eating disorders, But then I learned what white hate is and now I am living a healthy life again!..../s
But in all seriousness this is scary AF and exactly why AI is NOT a good idea.
14
12
u/Wrest216 11d ago
Our city has a FANTASTIC help line (311) that can do anything from just connecting and directing you where to go, to helping apply for assistance, to handleing NON emergency police and fire calls. Jesus it was actually FANTASTIC thing for our city, cut calls time in half, really helped people out. THEY WANT TO GO TO "AI" chat. Based upon " century link billing ai"
We had a week long protest and the canned the idea. FUCK THAT. Robots can help for like REALLLLLLLY basic shit. But they are pretty stupid.
12
u/Kindly-Ad-5071 11d ago
If I called a helpline I may not want to be consoled by a machine, you could get better results from a Google search. I would probably want to be understood by another breathing person.
→ More replies
11
20
u/Fantasmic03 11d ago
If companies decide to do this then I think the board of directors should hold personal liability for any adverse incidents. If anyone dies they should be charged with negligence and if the company gets sued then they should have to pay restitution out of their own pockets.
→ More replies
7
u/iskilikecatpoo 11d ago
Yeah this thing is destined to become anorexinazia5000 chat bot. But imagining being someone in need of such counseling and receiving a robot. How valued would you feel as a human being if in a time of desperate need and of connection, it was determined all you deserved was a chat bot? And if that bot was anorexinazia500?
8
u/KaleidoscopeMore5664 11d ago
As someone who has worked in direct service mental health, I've had to fight against automation of some services as well. People already think text lines are robots, even when there's a real person on the other end. People already think phone support is scripted because some people aren't very good at it. So making them into actual robots seems like a bad idea.
10.0k
u/Inappropriate_SFX 11d ago
There's a reason people have been specifically avoiding this, and it's not just the turing test.
This is a liability nightmare. Some things really shouldn't be automated.