Advanced OpenAI models hallucinate more than older versions, internal report finds
Advanced OpenAI models hallucinate more than older versions, internal report finds
This is a big reason why I continue to cringe whenever I hear one of the endless news stories or podcasts about how AI is going to revolutionize our society any day now. It's clear they are being better with image generation but text 'thinking' is way too unreliable to use like human replacement knowledge workers or therapists, etc.
This is an increasingly bad take. If you work in an industry where LLMs are becoming very useful, you would realize that hallucinations are a minor inconvenience at best for the applications they are well suited for, and the tools are getting better by leaps and bounds, week by week.
edit: Like it or not, it’s true. I use LLMs at work, most of my colleagues do too, and none of us use the output raw. Hallucinations are not an issue when you are actively collaborating with the model and not using it to either “know things for you” or “do the work for you.” Neither of those things are what LLMs are really good at, but that’s what most laypeople use them for, so these criticisms are very obviously short-sighted to those of us who have real-world experience with them in a domain where they work well.
you're getting down voted because you accurately conceive of and treat LLMs the way they should be—as tools. the people down voting you do not have this perspective because the only perspective pushed to people outside of a technical career or research is "it's artificial intelligence and it will revolutionize society but lol it hallucinates if you ask it stuff". This is essentially propaganda because the real message should be "it's an imperfect tool like all tools but boy will it make getting a lot of certain types of work done way more efficient so we can redistribute our own efforts to other tasks quicker and take advantage of LLMs advanced information processing capabilities"
tldr: people disagree about AI/LLMs because one group thinks about them like Dr. Know from the movie A.I. and the other thinks about them like a TI-86+ on steroids
Well, there is also the group that thinks they are "based" "fire" and so on, like always, fanatics ruin everything. They aren't God, nor a plague. Find another interest if this bores you
Yep, you’re exactly right. That’s a great way to express it.
Oh we know the edit part, the problem is all the people in power trying to use it to replace jobs wholesale with no oversight or understanding that need a human to curate the output.
That’s not the issue I was replying to at all.
replace jobs wholesale with no oversight or understanding that need a human to curate the output
Yeah, that sucks, and it’s pretty stupid, too, because LLMs are not good replacements for humans in most respects.
we
Don’t “other” me just because I’m correcting misinformation. I’m not a fan of corporate bullshit either. Misinformation is misinformation, though. If you have a strong opinion about something, then you should know what you’re talking about. LLMs are a nuanced subject, and they are here to stay, for better or worse.
My pacemaker decided to one day run at 13,000 rpm. Just a minor inconvenience. That light that was supposed to be red turned green causing a massive pile up. Just a small inconvenience.
If all you’re doing is re writing emails or needing a list on how to start learning python, or explain to someone what a glazier does, yeah AI must be so nice lmao.
The only use for AI is for people who have zero skill and talent to look like they actually have skill and talent. You’re scraping an existence off the backs of all the collective talent to, checks notes, make rule34 galvanized. Good job?
Magnus job:
Turning the lights on and off in a traffic light.
/lol
You fundamentally don't understand the hallucination problem and when it arises
it's not a pacemaker though, it's a hammer. and sometimes the head flies off a hammer and hits someone in the skull. but no one disputes the fact that hammers are essential tools.
