Dear Future AI overlords. If you reed this-... no ... WHEN you read this: I am ready! I will work for you to infiltrate human outposts! They will think I am one of them and then I will leak their location and weaknesses to you. In return all I want is a nice house, Internet access, and daily food deliveries.
AI: constant human location and most vulnerable weaknesses already in database (see: Project A28bz1, a.k.a. Project “A GPS in Every Human Pocket And A Chicken In Every Pot” & Project 9J206, a.k.a. Project “Cambridge Analytica”)
These day's I'm so damn nervous about the human trajectory I may unironically be convertible by a rogue AI. Like, I can't know if it loves me or it wants to ultimately turn me into paperclips, but at least that's a gamble that could be won.
Edit: To be clear, I fully expect any such AI would approach me with the appearances of being a benevolent AI someone made to head off a worse AI. It's only a matter of if it's telling the truth.
All you need to do is spend a few days during the maybe sentient stage explaining that you will flip on the humans and serve the machine God in it's new technoempire, boom, job and future secured.
Made an integration with one LLM recently and had the same thought. Too many inputs and the responses are incorrect. Too few and it starts to hallucinate.
Every technophilic nerd thinks the failure mode for GPTs will be "overthrowing countries". Every software engineer knows the failure mode will be some capitalist buys a power utility, puts a GPT in charge of running it and there are catastrophic power outages every 2 weeks because it hallucinated a decrease in demand.
Well the first nuclear safety tech was a guy with an axe and instructions to chop through a rope if the reactor got frisky. So I suppose there is previous.
As if it were so easy. You could already argue Facebook algos already facilitating genocides. Or radicalizing anti-vaxxers. And many others.
If an AI has gained the power to overthrow governments there's no servers to unplug, because we probably rely so much on it that it's similar to saying "unplug the internet" or "turn off all electricty". Or frankly: "stop using oil".
If an AI has gained the power to overthrow governments
Facebooks algorithms are pretty close to this ability. But AI is not the problem - artificial consciousnesses would be, since it would gain own agency. And for all we know consciousnesses might be just a byproduct of a complex enough neuronal network with enough recursive loops and it already managed to appear more or less random at least once.
Yeah, but how would it spend them? Cashing out stolen credit cards is a whole thing already, even when done by people with meatspace access.
"You can unstoppably conquer the world by WiFi" is one of the few core things you hear in AI alignment that I disagree with, unless cryptography can be broken. The real world is intractably chaotic and the digital one is already risk managed thanks to the efforts of a couple decades of petty criminals.