"you cannot use our services for: provision of tailored advice that requires a license, such as legal or medical advice, without appropriate involvement by a licensed professional"
So, they didn't add any handrails, filters, or blocks to the software. This is just boilerplate "consult your doctor too!" to cover their ass.
There is no way for them to even remotely verify if you are "without appropriate involvement by a licensed professional" in the room, so to a rebellious outlaw, these prohibitions might as well not exist.
GPT saved me yesterday. It helped me identify and verify a rare three-way undocumented medicine interaction that was causing anguish. The interaction was hypomagnesia and serious arrhythmia caused by a combination of berberine, famotidine, and vonoprazan. This was despite magnesium supplementation.
Two months ago it helped me accurately identify a gastrointestinal diverticulitis-type issue, find the right medication for it (metronidazole), which fixed the issue for good. It also guided me on identifying the cause, and also on pausing and restoring fiber intake appropriately.
Granted, it is very easy for people to make serious mistakes in using LLMs, but granted how many mistakes doctors make, it is better to take some self-responsibility first. The road to making a useful diagnosis can be windy, but with sufficient exploration, GPT will get you there.
The bad idea is to live and die in ignorance. The good idea is to use GPT to find ideas and references that one can then verify. If it were up to the medical establishment, they would block the public from accessing medical research altogether, and they already do this by paywalling much research.
OpenAI already blocked public access to custom GPTs that gave medical advice. I had multiple such custom GPTs get blocked from their previously functional shared access.
While you are correct, the question now becomes whether the disclaimer can ever be removed.
If the AI isn’t smart enough to replace a licensed expert even given unlimited access to everything a doctor would learn in medical, where is the value in the AI?
Plenty of other automation supports licensed experts without replacing them and has value, so if even AI supports licensed efforts but can never replace them, it could still have value in that application.
> But this isn’t what was advertised by the AI companies themselves. They’ve been telling us AGI is imminent.
Other than OpenAI, I don’t think that’s actually true of what the companies have been advertising.
But, in any case, things can have value and still fall short of what those with a financial interest in the public overestimating the imminent significance of an industry promote. The claim here was about what was necessary for AI to have value, not what was necessary to meet the picture that the most enthusiastic, biased proponents were painting. Those are very different questions, and, if you don’t like moving goalposts, you shouldn’t move them from the former to the latter.
When I originally said “where’s the value in the AI?” in my first comment the implied situation relates to how vastly more expensive it is than traditional SaaS to deliver.
AI is undoubtedly useful, but at its current infrastructure cost it’s not going to be worth selling unless it can actually put people out of work so that enterprise customers are motivated to spend salary-level money on it. That’s the only way to make the numbers black with the kind of deficits the industry has.
Making existing employees 5-20% more productive isn’t enough. You can already get that kind of improvement for very cheap. That’s the kind of improvement you get by buying your employees catered lunch or a SaaS license for a CRUD app.
My company is paying less money for AI subscriptions per seat than some pretty low impact tools like password managers.
You’d think that CoPilot might charge us $100 instead of $10 if they really thought it was that valuable.
Unless the following excludes (which it shouldn’t) personal use vs batch one:
Empower people. People should be able to make decisions about their lives and their communities. So we don’t allow our services to be used to manipulate or deceive people, to interfere with their exercise of human rights, to exploit people’s vulnerabilities, or to interfere with their ability to get an education or access critical services, including any use for:
…
automation of high-stakes decisions in sensitive areas without human review:
You can still ask questions for medical advice. You just need to phrase the question more like a hypothetical one instead of making it obvious that you are asking for yourself.
"You can't believe how smart and capable this thing is, ready to take over and run the world"
(Not suitable for any particular purpose - Use at your own risk - See warnings - User is responsible for safe operation...)
(Pan from home robot clumsily depositing clean dishes into an empty dishwasher to a man in VR goggles in next room making all the motions of placing objects in a box)
Check all services you wish to subscribe ($1000 per service per month):
- Put laundry in washing machine
- Microwave mac & cheese dinner
- Change and feed baby
- Get granny to toilet
- Fix Windows software update error on PC
- Reboot wifi router to restore internet connection
Standard cop-out that software companies always try to include. They disclaim any warranty of merchantibility and fitness for a particular purpose. So if you try to claim that the software doesn't do what it's supposed to do, they take no responsibility for that.
HN Headline is categorically false.
"you cannot use our services for: provision of tailored advice that requires a license, such as legal or medical advice, without appropriate involvement by a licensed professional"
So, they didn't add any handrails, filters, or blocks to the software. This is just boilerplate "consult your doctor too!" to cover their ass.
Did the headline get changed? It 100% matches what you're calling out: "OpenAI updates terms to forbid usage..."
They didn't forbid it.
Does "US law forbids driving without a seatbelt" mean the same as "US law forbids driving"?
It hasn’t been changed
Doesn’t prohibit brainstorming what to ask your doctor, or which professional consultation to prioritize.
Does prohibit, for illustration, LLM-powered surgical device.
Everything else is “gray area”?
Prohibits in the "I'm a sign, not a cop" sense.
There is no way for them to even remotely verify if you are "without appropriate involvement by a licensed professional" in the room, so to a rebellious outlaw, these prohibitions might as well not exist.
> brainstorming what to ask your doctor
Generally a bad idea. If you want to be a doctor, go to medical school.
I don’t want to be a doctor, I just want to fix what ails me. You don’t need an MD to research symptoms.
GPT saved me yesterday. It helped me identify and verify a rare three-way undocumented medicine interaction that was causing anguish. The interaction was hypomagnesia and serious arrhythmia caused by a combination of berberine, famotidine, and vonoprazan. This was despite magnesium supplementation.
Two months ago it helped me accurately identify a gastrointestinal diverticulitis-type issue, find the right medication for it (metronidazole), which fixed the issue for good. It also guided me on identifying the cause, and also on pausing and restoring fiber intake appropriately.
Granted, it is very easy for people to make serious mistakes in using LLMs, but granted how many mistakes doctors make, it is better to take some self-responsibility first. The road to making a useful diagnosis can be windy, but with sufficient exploration, GPT will get you there.
The bad idea is to live and die in ignorance. The good idea is to use GPT to find ideas and references that one can then verify. If it were up to the medical establishment, they would block the public from accessing medical research altogether, and they already do this by paywalling much research.
OpenAI already blocked public access to custom GPTs that gave medical advice. I had multiple such custom GPTs get blocked from their previously functional shared access.
While you are correct, the question now becomes whether the disclaimer can ever be removed.
If the AI isn’t smart enough to replace a licensed expert even given unlimited access to everything a doctor would learn in medical, where is the value in the AI?
Plenty of other automation supports licensed experts without replacing them and has value, so if even AI supports licensed efforts but can never replace them, it could still have value in that application.
But this isn’t what was advertised by the AI companies themselves. They’ve been telling us AGI is imminent.
Now we are moving the goalposts to “it’ll be a nice tool to use like SaaS software.”
> But this isn’t what was advertised by the AI companies themselves. They’ve been telling us AGI is imminent.
Other than OpenAI, I don’t think that’s actually true of what the companies have been advertising.
But, in any case, things can have value and still fall short of what those with a financial interest in the public overestimating the imminent significance of an industry promote. The claim here was about what was necessary for AI to have value, not what was necessary to meet the picture that the most enthusiastic, biased proponents were painting. Those are very different questions, and, if you don’t like moving goalposts, you shouldn’t move them from the former to the latter.
When I originally said “where’s the value in the AI?” in my first comment the implied situation relates to how vastly more expensive it is than traditional SaaS to deliver.
AI is undoubtedly useful, but at its current infrastructure cost it’s not going to be worth selling unless it can actually put people out of work so that enterprise customers are motivated to spend salary-level money on it. That’s the only way to make the numbers black with the kind of deficits the industry has.
Making existing employees 5-20% more productive isn’t enough. You can already get that kind of improvement for very cheap. That’s the kind of improvement you get by buying your employees catered lunch or a SaaS license for a CRUD app.
My company is paying less money for AI subscriptions per seat than some pretty low impact tools like password managers.
You’d think that CoPilot might charge us $100 instead of $10 if they really thought it was that valuable.
There’s no goalpost being moved on my end.
Why is this flagged? This is pretty significant actually.
So stories like this are no longer possible? https://news.ycombinator.com/item?id=45734582
Unless the following excludes (which it shouldn’t) personal use vs batch one:
Empower people. People should be able to make decisions about their lives and their communities. So we don’t allow our services to be used to manipulate or deceive people, to interfere with their exercise of human rights, to exploit people’s vulnerabilities, or to interfere with their ability to get an education or access critical services, including any use for:
…
automation of high-stakes decisions in sensitive areas without human review:
- critical infrastructure
- education
- housing
- employment
- financial activities and credit insurance
- legal ===
- medical ===
- essential government services
- product safety components
- national security
- migration
- law enforcement
You can still ask questions for medical advice. You just need to phrase the question more like a hypothetical one instead of making it obvious that you are asking for yourself.
Wouldn’t this affect many prominent startups? Why wouldn’t they move to a competitor? Is OpenAI assuming to just be for consumers?
What stops others to do the same (if they haven’t already)?
It’s a safe bet: we don’t allow you to ask for medical advice so we are not liable if you do and drink mercury or what have you based on our advice.
Haha! What a joke
"You can't believe how smart and capable this thing is, ready to take over and run the world"
(Not suitable for any particular purpose - Use at your own risk - See warnings - User is responsible for safe operation...)
(Pan from home robot clumsily depositing clean dishes into an empty dishwasher to a man in VR goggles in next room making all the motions of placing objects in a box)
Check all services you wish to subscribe ($1000 per service per month): - Put laundry in washing machine - Microwave mac & cheese dinner - Change and feed baby - Get granny to toilet - Fix Windows software update error on PC - Reboot wifi router to restore internet connection
Standard cop-out that software companies always try to include. They disclaim any warranty of merchantibility and fitness for a particular purpose. So if you try to claim that the software doesn't do what it's supposed to do, they take no responsibility for that.