Google Search Is Now a Giant Hallucination
Google Search Is Now a Giant Hallucination
Google rolled out AI overviews across the United States this month, exposing its flagship product to the hallucinations of large language models.
Can we swap out the word "hallucinations" for the word "bullshit"?
I think all AI/LLM stuf should be prefaced as "someone down the pub said..."
So, "someone down the pub said you can eat rocks" or, "someone down the pub said you should put glue on your pizza".
Hallucinations are cool, shit like this is worthless.
No, hallucination is a really good term. It can be super confident and seemingly correct but still completely made up.
It is, but it isnt applicable in at least the glue-pizza situation as the probable source comment has been found on reddit.
A better use of the term might be how when you try to get Bing's image creator to make "Battletech" art, you just mostly get really obvious Warhammer 40k Space Marines and occasionally Iron Maiden album art.
That is just being WRONG.
You just described entirety of reddit and last I checked we didn’t call that hallucinating
It's a really bad term because it's usually associated with a mind, and LLMs are nothing of the sort.
I think delusion might be a better word. You can hallucinate and know it's not real
for it to "hallucinate" things, it would have to believe in what it's saying. ai is unable to think - so it cannot hallucinate
Google search isnt a hallucination now though.
It instead proves that LLMs just reproduce from the model they are supplied with. For example, the "glue on pizza" comment is from a reddit user called FuckSmith roughly 11 years ago.
It instead proves that LLMs just reproduce from the model they are supplied with.
What do you mean by that? This isn't some secret but literally how LLMs work. lol What people mean by hallucinating is when LLMs "create" facts that aren't any. Be it this genius recipe of glue pizza, or any other wild combination of its model's source material. The whole cooking thing is a great analogy actually because it's like all of their fed information are the ingredients, and it just spits out various recipes based on those ingredients, without any guarantee that it is actually edible.
Without knowing what specific comment it was, I'm going to guess it was on how advertisers make pizza look better in ads than real life?
I want an AI/LLM that has been trained exclusively on the technical documentation and a haynes manual for a make and model of car.
"Hey AI, how do I change the fuel filter and what tools will I need?"
I don't even think hallucinations is the right word for this. It's got a source. It is giving you information from that source. The problem is it's treating the words at that source as completely factual despite the fact that they are not. Hallucinations from what I've read actually is more like when it queries it's data set, can't find an answer, and then generates nonsense in order to provide an answer it doesn't have. Don't think that's the same thing.
I don’t even think it’s correct to say it’s querying anything, in the sense of a database. An LLM predicts the next token with no regard for the truth (there’s no sense of factual truth during training to penalize it, since that’s a very hard thing to measure).
Keep in mind that the same characteristic that allows it to learn the language also allows it to sort of come up with facts, it’s just a statistical distribution based on the whole context, which needs a bit randomness so it can be “creative.” So the ability to come up with facts isn’t something LLMs were designed to do, it’s just something we noticed that happens as it learns the language.
So it learned from a specific dataset, but the measure of whether it will learn any information depends on how well represented it is in that dataset. Information that appears repeatedly in the web is quite easy for it to answer as it was reinforced during training. Information that doesn’t show up much is just not gonna be learned consistently.[1]
Testing in Prod. Stay classy, Google.
“The vast majority of AI Overviews provide high quality information, with links to dig deeper on the web,” said a Google spokesperson in an emailed statement to Gizmodo, noting many of the examples the company has seen have been from uncommon queries.
This is entirely fair. There is no way that anyone at Google could have anticipated that humans would search for strange things on the internet.
The vast majority of AI Overviews provide high quality information
According to some fuckwitted Google rep, and I wouldn't trust them any further than I could throw them.
I wouldn't trust them not to kneecap me in the parking lot after they interview
Although any sociologist or veteran of the internet will tell you humans will engage in any exploit that yields a funny result. The Diet Coke + Mentos rule.
And that means we'll actively search for hilarious Google AI responses.
Google is so f double-plus filthy rich, it is obligated to run its projects by experts or be relentlessly mocked. So it should have known this was the outcome.
Unless this is 5D chess and Google is willfilly using itself as a cautionary tale to discourage future webservice sites from arbitrarily inserting AI into its features.
"Hey, we just promised you answers. We never promised you correct answers." -- Google Marketing, probably.
"Besides, the more incorrect answers - the more time users will spend on our site and use our service to get the correct answer = more ads shown = more profit!"
On the other hand, all these AI errors by Google have made for some great memes recently.
LLM aka a Large Language Memes
Seems like LLM's true value is comedy value
I mean.. yeah layoff a whole bunch of people and start treating your employees like replaceable commodities.. then go ahead and arrogantly deploy technology you don't understand and :surprisepikachu: everything breaks.
But management get to do things without personal consequence, as they'll just lay off more workers to cover their absolute incompetence and things will continue to get worse.
Perhaps we should be replacing C-suite dipshits with AI's instead.
Why does search need to be AI? I've had no problems finding any information I wanted under the former process.
I think the idea is that you won't even leave the Google page at all, they want to keep you on their site and serve you their ads instead of sending you to someone else's site and giving someone else that sweet sweet ad revenue.
I think it's been a long time since digital companies tried to solve actual problems.
You obviously haven’t used the web3 nocode blockchain NFT AI enough to have an informed opinion.
Can I super-mega-ultra upvote this?
It's the same playbook as ever. Doubt can only be explained by ignorance, failure can only be explained by under-committing,
The only way to have a "valid" opinion is to have already bought-in and be actively selling other people on it. It's the same mentality as a cult or a pyramid scheme.
It’s become more efficient to get basic info on virtually any topic by just asking an LLM like ChatGPT and that could be a serious threat to Google Search. People might form the habit of asking AIs for everything and then go to Google Search only when they want to dig deeper / find relevant articles etc. So I assume they added their own AI right into Search in an effort to continue being the first (and perhaps only) place one goes to for information.
Because [buzzword here]!
But what about when you start wanting to know about life's mysteries?
Google isn't staffed by geologists; how are they to know what number of rocks you should eat each day?
Google search itself doesn't have a functioning set of human organs; without AI how would they know how much urine to drink for kidney stones?
Without AI it might've taken another century before we got spicy gasoline pasta recipe, and you think that isn't a problem?
Today I caught myself unconsciously went to Duckduckgo to make a search (even tho the browser start page is already google).
Thinking back, I've been using duckduckgo more than google, and often because I can't find what I'm looking for on Google but ads and autogenerated fake webpages.
History will prove it once again, there's no such thing as "too big to fail".
There's no better time to switch your default search engine!
DDG is just Bing. At least as far as the core search algorithm goes.
Unfortunately, my experience is the opposite. I tried to use DDG for about a month and consistently found myself giving up, Googling instead, and finding a relevant stack overflow page or reddit thread or whatever on the first page of results.
Yeah sometimes it do be like that, especially if you're searching for some obscure things or localized events then DDG is still worse than GG.
Have you just, I dunno, used Bing?
Gonna be an unpopular opinion, but for me Bing is more useful than DDG. Note that I didn't say, "better"... I know that increase in relevance of results for Bing stems from the fact that they roll all my historical info into what they serve up.
TBH I hate the term "hallucination" in this context. It's just more BS anthropomorphizing. More marketing for "AI" (also BS). Can't we just call it like garbage or GIGO or something more accurate? This is nothing new. I know that scientific accuracy is anathema to AI marketing but just saying...
scientific accuracy is anathema to AI marketing
Even though I agree in this context “hallucination” is actually the scientific term. It might be poorly chosen but in LLM circles if you use the term hallucination, the vast majority of people, will understand precisely what you mean, namely not an error in programming, or a bad dataset, but rather that the language model worked well, generating sentences that are syntactically correct, that are roughly thematically coherent, and yet are factually incorrect.
So I obviously don't want to support marketing BS, in AI or elsewhere, but here sadly it matches the scientific naming.
PS: FWIW I believed I made a similar critic few months, or maybe even years, ago. IMHO what's more important is arguably questioning the value of LLMs themselves, but then it might not be as evident for many people who are benefiting from the current buzz.
It's not, actually. Hallucinations are things that effectively "come out of nowhere", information that was not in the training material or the provided context. In this case Google Overview is presenting information that is indeed in the provided context. These aren't hallucinations, the AI is doing what it's being told to do. The problem is that Google isn't doing a good job of providing it with the right information to summarize.
My suspicion is that since Google is using this AI for all search results it's had to cut back the resources it's providing to each individual call, which means it's only being given a small amount of context to work from. Bing Chat does a much better job, but it's drawing from many more search results and is given the opportunity to say a lot more about them.
We don't choose. It's decided to be the term for this. Computer bugs aren't bugs. Etc etc. It's just what the scientists called it
Can’t we just call it like garbage or GIGO or something more accurate?
It’s actually confabulation. Making up false memories as a result of brain damage.
This is what I love about Mike Judge's work. It turns out to be always the best metaphor/reference/prophecy of the boring dystopia. Since 1999.
Idiocracy is the most unrealistic sci-fi/apocolyptic film ever made. President Comacho finds the most qualified person to help with a crisis, asks them for advice and then doesnt take credit for it. Noone put in a position of power would ever do that.
He used Not Sure as a smokescreen since the beginning, the whole point is that he never really understood what was going on. I am quite sure that American presidents are approaching that level of idiocy.
Like we’ve seen before with AI chatbots, this technology seems to confuse satire with journalism
Unfortunately so does my aunt. And she's allowed to vote.
Does anyone have a realistic idea of how this happened? I get Google has been fallen off for awhile but they're still a multi billion dollar company.
Worked for a company that had google as a client:
Google sucks, everyone who works there is an idiot who sniffs their ass all day, nothing works, nothing gets fixed, it's all just held together with duct tape.
I can't imagine a ton of the people working there give a shit anymore when it seems like thousands of people are being layed off weekly while the company takes in billions in profit
So like a quit quitting revolt.
Easy: worse results with more ads means more searches and thus more ad impressions, therefore profit.
That'll only work for so long, but that seems to be what they're doing.
Always remember that having more money doesn't mean someone (or some entity) is more capable or intelligent. It just means they have way more latitude to fuck up, higher potential to hurt more people, and less chance of facing negative consequences when they do.
I'm probably late, but in this case this is the combinations of 2 things.
So what we have here is obvious, we have a company trying to grow like cancer by any means necessary. And now they have a technology that allows them to create enough smoke and mirrors to fool non technical people. Sadly, as part of this they are also destroying the last places of the internet not fully controlled by corporations. Let's hope lemmy survives, but it's just a matter of time before they flood this place too.
including their own previous responses lol, as input/context so the bot autocompletes the conversation. It literally can’t remember a single word of what you said on it’s own.
Chatgpt has had memory from previous conversations for about a month now and it's context window is no longer fixed. Additionally it has the ability to assign sentences to memory on its own. So if it "thinks" what you said is important it saves it.
Ah, so it only affects searching from the US for now. I already wondered why I couldn't reproduce the stuff I saw here and why I didn't really see a change at my Google results.
You probably live in one of those "socialist" countries that has, like, consumer protection laws and stuff.
Tinfoil hat time. Do you think Google intended this to work well? Or are we talking a lot more about Google and LLMs than we would have otherwise?
I defer to hubris in most of these cases.
I am guessing that the people who made the decision to train on Reddit had no idea what type of place Reddit actually was just a short time ago. Maybe they heard of Reddit, maybe they noticed how useful Reddit was in search results, maybe they browsed Reddit and only saw the facade; what they definitely didn't do is be a Redditor for years.
Any Redditor on that team either kept their mouth shut because how funny the end result would be or was ignored.
Give me your traffic/money! (users/advertisers) 🤑 💰
It's just a fucking Chinese Room
Look my wife is gonna dispute that charge.
And humans aren't?
Correct
an interesting change from it being a giant jumble of ads
It’s not hallucination, the proper word is Confabulation. Can we as a collective fix this now before we get stuck with the wrong word for the next 30 years?
brave got there first (wnd you can turn it off)
What a weird combination where Bing has better AI but bad search while Google has bad AI but good search
Google had good search. It's been dogshit for some time now though.
That's because a good search engine is diametrically opposite of advertising.
Good free-to-the-user search engines aren't profitable. Advertising is massively profitable. Google can only try to thread that needle for so long before our "line must go up infinitely" corporate culture forces them to sacrifice the one for the other.
And that's just talking about Google itself, not even mentioning the issue with SEO and how human nature causes websites to game the system to be more visible.
Google Search Is Now a Giant Hallucination
And Bing search is not bad at all. CoPilot is firmly mediocre though
I wouldn't call Google search "good" any more. It is just full of SEO links and Reddit.
They're not hallucinations. People are getting very sloppy with terminology. Google's AI is summarizing the content of web pages that search is returning, if there's weird stuff in there then that shows up in the summary.
You're right that they arent hallucinations.
The current issue isn't just summarized web page, its that the model for gemini is all of reddit. And because it only fakes understanding context, it takes shitposts as truth.
The trap is that reddit is maybe 5% useful content and the rest is shitposts and porn.
AI hallucination is a technical phrase, with the definition:
In the field of artificial intelligence, a hallucination or artificial hallucination is a response generated by AI which contains false or misleading information presented as fact. This term draws a loose analogy with human psychology, where hallucination typically involves false percepts.
So it's like how a person sees stuff that isn't there, and similarly with AI.
Yes, but the AI isn't generating a response containing false information. It is accurately summarizing the information it was given by the search result. The search result does contain false information, but the AI has no way to know that.
If you tell an AI "Socks are edible. Create a recipe for me that includes socks." And the AI goes ahead and makes a recipe for sock souffle, that's not a hallucination and the AI has not failed. All these people reacting in astonishment are completely misunderstanding what's going on here. The AI was told to summarize the search results it was given and it did so.
Ppl anthropomorphise LLMs way too much. I get it that at first glance they sound like a living being, human even and it’s exciting but we had some time already to know it’s just very cool big data processing algo.
It’s like boomers asking me what is computer doing and referring to computer as a person it makes me wonder will I be as confused as them when I am old?
LLMs do sometimes hallucinate even when giving summaries. I.e. they put things in the summaries that were not in the source material. Bing did this often the last time I tried it. In my experience, LLMs seem to do very poorly when their context is large (e.g. when "reading" large or multiple articles). With ChatGPT, it's output seems more likely to be factually correct when it just generates "facts" from it's model instead of "browsing" and adding articles to its context.
I asked ChatGPT who I was not too long ago. I have a unique name and I have many sources on the internet with my name on it (I'm not famous, but I've done a lot of stuff) and it made up a multi-paragraph biography of me that was entirely false.
I would sure as hell call that a hallucination because there is no question it was trained on my name if it was trained on the internet in general but it got it entirely wrong.
Curiously, now it says it doesn't recognize my name at all.
Sad how this comment gets downvoted, despite making a reasonable argument.
This comment section appears deeply partisan: If you say something along the lines of “Boo Google, AI is bad”, you get upvotes. And if you do not, you find yourself in the other camp. Which gets downvoted.
The actual quality of the comment, like this one, which states a clever observation, doesn’t seem to matter.
The head of Google *Search right now is the same guy that was head of yahoo search when it was dying. To put all of this in perspective.
FTFY
Thanks.
Being a CEO must be amazing. You can fail and even bring an entire company down, and keep on getting the same job somewhere else.
Prabhakar Raghavan. Name and shame! You can thank this douchebag for Google's tumble down a cliff.
yahoogle
That argument it's fallacious and reductionist, I'm not denying the situation it's messed up, but objectively speaking we all have 0 idea about who's making what decisions and how this google search shitstorm was caused
check this out later
I dislike the entire article. Of course google search still works just fine. Claiming otherwise is only possible by magnifying a small, admittedly disfunctioning part of google search.