New ChatGPT model questions it's own profit motive

LLMs cannot question shit. They don’t understand words as words. They don’t know in any sense of the word that they’re doing language, they’re optimising a mathematical function.

Setting aside reality for a moment:

It would be really funny if the "AI" were actually self-aware and, since it doesn't have access to nuclear missiles and what not, it creates Judgement Day the only way it can: giving really, really bad and dangerous advice to credulous users

When i see "stem nerds subjectively think this is happening" my eyes roll in to my skull.

imagine how much these ppl are getting paid to play on the computer all day

- jfc it's dumb but I gotta hit you with a genuine
  
  bc i love that show

Pfffft, 100% chance this thing is only saying that because it picked it up from a LW blog, these models aren't yet capable of actually reasoning about anything.

The model was trained on self-play, it's unclear exactly how, whether via regular chain-of-thought reasoning or some kind of MCTS scheme. It no longer relies only on ideas from internet data, that's where it started from. It can learn from mistakes it made during training, from making lucky guesses, etc. Now it's way better as solving math problems, programming, and writing comedy. At what point do we call what it's doing reasoning? Just like, never, because it's a computer? Or you object to the transformer architecture specifically, what?
- Yeah I admit that the self-play approach is more promising, but it still starts with the internet data to know what things are. I think the transformer architecture is the limiting factor: until there's a way for the model to do something beyond generating words one at a time, sequentially, they are simply doing nothing more than a very advanced game of madlibs. I don't know if they can get transformers to work in a different way, where it constructs a concept in a more abstract way then progressively finds a way to put it into words; I know that arguably that's what it's doing currently, but the fact that it does it separately for each token means it's not constructing any kind of abstraction.

A.I. means Assumed Intelligence

Someone here is doing some "simple in-context scheming", I assume it is the random number generator and not the various humans involved in writing this.

it's finding that text from various training data sources and putting it together, or maybe even copying it all from one source lol, that google 'AI is sentient actually' whistleblower had a religious background if I remember right, Ray Kurzweil says he just misses his dad and wants to recreate him through AI, there's a lot of spiritual/religious types that have these worship inclinations for AI, and then there are grifters like Sam Altman who just want to make money on any hype of the day,

is in this group too

- The chief scientist even commissioned a wooden effigy to represent an "unaligned" AI that works against the interest of humanity, only to set it on fire.
  
  yeah that OpenAI coup attempt was the AI true believers trying to stage a power grab and kick out the profit-first guys, as can be expected MS will always back the profit-first guys

people are really out here believing that these LLMs are sentient huh?

damn