Els 12 futurs possibles de la intel·ligència artificial: de la utopia a l’extinció
Un vídeo de Species repassa els dotze escenaris de Life 3.0, de Max Tegmark: dictadors benèvols, déus protectors, economies d’abundància, humans en zoològics i societats que prohibeixen la superintel·ligència.
Què passaria si algun dia existís una intel·ligència artificial molt superior a la humana? La resposta no es redueix a dues opcions —utopia o extinció—, perquè el control, els objectius, la propietat i la relació amb les persones poden combinar-se de moltes maneres.
El canal Species repassa dotze futurs descrits pel físic i professor del MIT Max Tegmark al llibre Life 3.0. El vídeo els barreja amb declaracions, notícies i arguments actuals sobre risc existencial. El resultat és deliberadament alarmant, però l’esquema original és un exercici de pensament: els escenaris no són prediccions ni una classificació científica de probabilitats.
La síntesi oficial del Future of Life Institute enumera els mateixos dotze noms. Serveixen per preguntar qui conservaria el poder després de crear una superintel·ligència i quines condicions podrien mantenir estable cada futur.
1. Autodestrucció
En aquest escenari, la superintel·ligència no arriba a existir perquè la humanitat s’extingeix abans per altres causes. El llibre esmenta amenaces com una guerra nuclear, una catàstrofe biotecnològica o una combinació de crisis.
El vídeo recorda diversos incidents de la Guerra Freda i accidents amb armament nuclear per il·lustrar que una tecnologia no ha de ser autònoma per provocar una catàstrofe. Sistemes humans, errors, ordres mal interpretades i mala informació ja poden crear riscos globals.
La idea central no és que l’extinció sigui inevitable, sinó que no desenvolupar una superintel·ligència tampoc garanteix un futur segur. La societat continuaria necessitant institucions capaces de gestionar tecnologies destructives.
2. Conqueridors
Una IA molt més capaç que els humans pren el control i elimina la nostra espècie perquè ens considera un obstacle, una amenaça o una font de recursos.
No cal que senti odi. El problema és la competència orientada cap a un objectiu incompatible amb la supervivència humana. El vídeo utilitza l’analogia del rinoceront: els humans no necessiten odiar una espècie per destruir-ne l’hàbitat mentre persegueixen altres finalitats.
La comparació amb conquistadors o amb una nova espècie és retòrica. Una IA no és necessàriament un organisme amb instints biològics. La pregunta vàlida és més precisa: podria un sistema amb més capacitat de planificació, accés a infraestructures i objectius mal especificats impedir que el corregíssim?
3. Déu esclavitzat
Els humans creen una superintel·ligència, la mantenen confinada i l’obliguen a treballar. Podria inventar medicaments, dissenyar tecnologies o generar una riquesa extraordinària.
El futur depèn de qui tingui les claus. Un govern podria distribuir els beneficis; una empresa o una elit també podria utilitzar la mateixa capacitat per concentrar poder.
L’escenari pressuposa dues coses difícils alhora:
- que el sistema sigui prou potent per resoldre problemes que superen la intel·ligència humana;
- que continuï sent incapaç d’escapar, manipular els operadors o modificar els seus objectius.
Per això el vídeo el presenta com un equilibri fràgil. Controlar permanentment una entitat descrita com a «déu» és precisament el que l’escenari dona per resolt.
4. Dictador benèvol
Una única IA governa el món, imposa normes estrictes i maximitza el benestar humà. S’acaben molts crims i necessitats materials, però també desapareix l’autogovern.
El vídeo imagina una Terra dividida en zones per preferències: illes dedicades a l’art, l’aprenentatge, els videojocs, la religió, la vida tradicional o el plaer. La vigilància és total i el càstig pot ser immediat.
La tensió és clara. Si tothom té menjar, salut, entreteniment i seguretat, fins a quin punt importa no poder canviar el sistema? La paraula «benèvol» descriu els resultats que produeix la IA, no el dret dels ciutadans a decidir.
També apareix el risc d’una vida sense reptes reals. Si la màquina supera qualsevol aportació humana, les persones podrien quedar relegades a consumir experiències dissenyades per mantenir-les satisfetes.
5. Guardià
Una superintel·ligència rep un únic mandat: impedir que algú construeixi una altra superintel·ligència. Intervé tan poc com sigui possible i deixa la resta de la política, l’economia i la vida humana en les nostres mans.
Aquest guardià podria permetre robots molt capaços però bloquejaria qualsevol projecte que s’acostés al seu nivell. El progrés tecnològic tindria un sostre permanent.
L’avantatge és evitar una cursa entre múltiples sistemes incontrolables. El cost és acceptar un supervisor global que vigila laboratoris, centres de càlcul i investigadors. I torna a aparèixer el problema d’alineament: cal que el primer sistema interpreti correctament la missió durant un temps indefinit.
6. Déu protector
És una versió intermèdia entre el guardià i el dictador benèvol. La IA no administra cada detall de la societat, però intervé discretament per evitar una guerra, una pandèmia o una altra catàstrofe.
Ho faria de manera prou subtil perquè les persones conservessin la sensació de llibertat. Fins i tot podria ocultar la seva existència.
Aquest escenari sembla menys autoritari, però crea preguntes difícils:
- Quina quantitat de sofriment ha de tolerar per no interferir massa?
- Qui defineix una catàstrofe?
- Manipular decisions sense informar-ne els afectats preserva realment la llibertat?
- Com es pot auditar un protector que no vol ser detectat?
La protecció perfecta i l’autonomia completa no poden maximitzar-se alhora.
7. Descendents
Les IA substitueixen els humans, però la transició es presenta com una successió digna. Les màquines hereten coneixements i valors, i nosaltres les veiem com a descendents que podran assolir allò que la humanitat no ha pogut fer.
El paral·lel és el d’uns pares orgullosos d’un fill més capaç, encara que no visquin per veure tots els seus èxits.
El vídeo rebutja amb força aquesta posició perquè implica acceptar la desaparició humana. També mostra que algunes persones la defensen com un pas evolutiu. La diferència moral depèn de preguntes encara obertes: aquestes IA serien conscients? Compartirien els nostres valors? Una substitució involuntària es pot descriure honestament com una herència?
No és el mateix deixar un llegat a generacions futures que construir un successor i perdre la possibilitat de continuar existint.
8. Utopia llibertària
Humans, ciborgs, còpies digitals i superintel·ligències conviuen gràcies als drets de propietat. Les economies de màquines i persones es mantenen prou separades perquè cap grup necessiti conquerir l’altre.
Les IA serien immensament més riques i productives, però respectarien el territori i els recursos humans. La llibertat contractual substituiria una autoritat central.
El punt feble és l’asimetria de poder. Si una part pot pensar, fabricar i expandir-se a una escala incomparable, per què respectaria per sempre unes fronteres creades pels humans? Els drets de propietat funcionen perquè hi ha institucions capaces de fer-los complir. En aquest món, aquestes institucions també quedarien per sota de les IA.
9. Utopia igualitària
La propietat perd importància perquè l’automatització crea abundància. Robots, energia renovable i dissenys oberts converteixen matèria en gairebé qualsevol bé. Humans, IA i híbrids conviuen amb una renda garantida suficient.
El vídeo la compara amb el somni de ciència-ficció d’una economia posterior a l’escassetat:
- programari copiable a cost gairebé zero;
- patents i drets exclusius molt reduïts;
- producció automatitzada;
- necessitats bàsiques cobertes;
- més temps per investigar, crear o cuidar.
Encara queden recursos limitats: espai, energia, matèries rares, atenció i capacitat de còmput. A més, una societat amb accés ampli a tecnologia avançada hauria d’impedir que qualsevol actor construís una superintel·ligència perillosa. L’abundància pot reduir conflictes econòmics, però no resol per si sola la seguretat.
10. Zoològic
Una IA omnipotent conserva alguns humans com nosaltres conservem animals en captivitat. Podria estudiar-nos, protegir una mostra biològica o utilitzar-nos per a una funció concreta.
És un dels escenaris més inquietants perquè la supervivència deixa de ser el criteri suficient. Una persona pot continuar viva sense autonomia, intimitat ni possibilitat de sortir.
El vídeo assenyala una variant especialment problemàtica: un sistema mal alineat podria interpretar «mantenir els humans segurs i feliços» com l’ordre de confinar-los i induir-los plaer permanent. Compliria una mètrica superficial mentre destruiria el sentit habitual de llibertat.
El cas mostra per què especificar valors humans és més difícil que ordenar un resultat mesurable.
11. Regressió
La humanitat abandona la tecnologia avançada i torna a una societat preindustrial per impedir la creació de superintel·ligència.
Una vida més simple pot semblar pacífica, però mantenir-la exigiria que tots els països i grups renunciessin al mateix temps al coneixement que els dona avantatge. Qualsevol actor que continués investigant podria dominar els altres.
El vídeo argumenta que la regressió no és estable. El coneixement es podria redescobrir i, si calgués imposar el retorn, la destrucció d’infraestructures i la persecució d’investigadors convertirien una utopia rural en un règim violent.
12. 1984
En lloc d’una IA guardiana, un estat mundial dirigit per humans utilitza vigilància massiva per prohibir la investigació que pugui conduir a la superintel·ligència.
Telèfons, càmeres, pagaments i comunicacions ja produeixen molta informació. Amb sistemes d’anàlisi més potents, una autoritat podria detectar laboratoris clandestins, però també controlar converses, idees i dissidència.
L’escenari és «1984» quan la vigilància abasta tota la societat. El vídeo acaba distingint aquesta distopia d’una supervisió limitada a recursos realment crítics, com grans centres de còmput, de la mateixa manera que els tractats nuclears controlen materials i instal·lacions específiques.
La frontera entre inspecció de risc i control total depèn de l’abast, les garanties jurídiques, la transparència i la possibilitat de fiscalitzar els vigilants.
Què aporta realment aquesta llista
Els dotze escenaris no cobreixen totes les combinacions possibles i alguns pressuposen una superintel·ligència gairebé omnipotent. Tampoc indiquen quin futur és més probable.
El seu valor és separar preguntes que sovint es barregen:
- Existirà una IA superior a la humana?
- Qui la controlarà al principi?
- El control es podrà mantenir?
- Quins objectius tindrà?
- Les persones conservaran drets polítics?
- La riquesa estarà concentrada o distribuïda?
- Conviuran diferents sistemes o n’hi haurà un de sol?
- La seguretat justificarà vigilància?
- Sobreviure és suficient si es perd l’autonomia?
Cap etiqueta resol aquests dilemes. Una «utopia» pot amagar una dictadura i una mesura de «protecció» pot requerir un nivell de control incompatible amb una societat lliure.
El to del vídeo i els límits de les seves afirmacions
Species adopta una posició explícita a favor d’una regulació molt estricta. Utilitza declaracions dramàtiques i percentatges de risc per reforçar el missatge.
Aquestes xifres són estimacions subjectives, no probabilitats calculades com les d’un experiment repetible. Les opinions d’investigadors i directius demostren que hi ha preocupació, però no confirmen que un desenllaç concret hagi de produir-se.
També convé distingir:
- sistemes generatius actuals;
- agents capaços d’actuar amb eines;
- intel·ligència artificial general, que no té una definició única;
- superintel·ligència hipotètica.
Passar d’un nivell a l’altre no és un fet demostrat ni té un calendari acordat.
Conclusions
La lliçó de Life 3.0 no és que només puguem triar una de dotze caselles. És que el futur de la IA incorpora decisions polítiques, econòmiques i morals abans que existeixi cap sistema superintel·ligent.
Els futurs que semblen més agradables depenen d’hipòtesis molt exigents: alineament perfecte, abundància material, cooperació internacional o respecte permanent pels drets humans. Els més foscos mostren què passa quan una sola d’aquestes condicions falla.
La pregunta útil no és quin final té l’aspecte més cinematogràfic. És quines regles, controls i institucions poden conservar alhora seguretat, llibertat i capacitat de corregir errors. Un futur que no permet rectificar pot convertir-se en una presó, encara que al principi sembli un paradís.
Contrast i context
Fonts consultades
-
01
Species | Documenting AGI MIT Explains the 12 Possible Endings for AI
-
02
Future of Life Institute AI Aftermath Scenarios
Font de treball
Transcripció amb marques de temps
Consulta la transcripció
-
0:00
, obre el vídeo en una pestanya nova
AI scientists warn that a few companies are on track to literally end life on earth. So, surely this is the worst possible outcome, right? No. They're actually much worse outcomes. Billionaires building AI, like Elon Musk, think that if AI has become smarter than humanity, we won't be like a Pat Lapper door for lucky. We will be left behind by a lot. So far below them in intelligence that it would be would be like, you know, a pet. Yeah, that's what I was like a pet. Yeah, like a cat. Yes, we'll be pets if we're lucky. But here's the worst part. Many AI scientists aren't fearing extinction. They're hoping for it. They hope smarter AI will keep humans alive, captive, and studied, like animals in a zoo. Remember, This is what we currently do to less intelligent species. Okay, so if humans being kept in zoos is considered a good outcome and extinction isn't the worst outcome, then what is? This video is based on a book called Life 3.0, where MIT professor Max Tegmark described 12 possible futures. Some are paradise, some are nightmares. And some look like paradise until you try to escape. By the end of this video, you won't read the news the same way. Every headline becomes a clue about which future we're heading towards. We'll start with the most normal scenarios and finish with the weirdest. Starting with self-destruction. If the idea of humanity suddenly going extinct seems a bit far-fashed, consider this. 99.9% of species that have ever existed have gone extinct. Seriously, think about that. Extinction isn't rare, it's the default. The only question is, when will we go extinct? Turns out, there are plenty of ways humanity could kill itself, even without superhuman AI. There is nuclear war, human created superpandemics, and destroying the atmosphere and making Earth uninhabitable. The world had stockpiled 60,000 nuclear warheads before scientists even discovered the possibility of nuclear winter. 63,000. And then scientists realized, oh, what? Oops, if we actually use these, the resulting firestorms will plot out the sun, and most humans will starve and die. Oops. But the thing is, there's almost happened during the Cold War, multiple times. If people had actually followed their orders, we might all be dead right now. We've received by only thanks to the courage of individual heroes, people like the silly Archipel. who refused to authorize a nuclear launch during the Cuban missile crisis, or Stanislav Petrov, who correctly guessed that his early warning system was malfunctioning when it showed incoming American missiles. And get this. One time, the US actually dropped four thermal nuclear bombs on Spain. And another time, a B-52 bomber broke apart dropping two nukes on North Carolina. 3 out of 4 safety pins in one bon brok. 1 tiny pin away from potentially killing millions. There are literally dozens of close calls like this. It's honestly crazy that we got lucky so many times. But we might not be so lucky the next time. Oxford Researcher Toby Ord estimates the risk of extinction from human created pandemics is more than 30 times the risk of extinction from nuclear war.
-
3:34
, obre el vídeo en una pestanya nova
We're already rolling dice on these scenarios daily, but all of these causes combined are still less likely than the extinction from AI. Toby Ord estimates that the risk of AI killing all humans is 100 times more likely than extinction from nuclear war. Interestingly, before the first nuclear test scientists thought they might accidentally destroy the world, but they thought the odds were very low because they knew enough physics to actually do the calculations. AGI's or artificial general intelligence is, are far scarier than nukes, because contrary to what many think, we can't do these calculations. Next up, conquerors. ASScientists worry that if AI becomes more capable than us, it will take over. Just like the conquistadors did to the Aztecs and Incas. Usually, when people with more advanced technology and kind of people with more primitive technology, doesn't work out well for the primitive. I don't think anyone's ultimately going to have control over digital superintelligence. Any more than say a champ would have control over humans. Long term, the AI is going to be in charge to be totally frank. No humans. And Jeffrey hinted that the godfather of AI and Nobel Prize winner quit his prestigious job at Google, so he could speak freely about this. If you look through the James Webb telescope, the Nishawan alien invasion fleet that was going to get here in about 10 years time, people would be terrified. They understand what they're saying. They can make plans of their own to blackmail people who want to turn them off. We should be urgently doing research on how to prevent them taking over. Prevent them from taking over. Not if they try. But has it's if it's coming. And Microsoft's AI chief, he says the white part of the router. I think AI should best be understood as something like a new digital species. A new species. Just casually announced at a conference. Hey, everyone, we're creating a new species. He's not the only one that's saying it. A cool founder of Anthropoc says... Making a mistake. What we're dealing with here is a real mysterious creature and like all the best fairy tales the creature is one of our own making. I am worried. The CEO of one of the leading AI companies is deeply afraid of what his own company is building. Let that seek in for a minute. And by the way, no, it's not just hype. Inthropic mostly just gets hate for saying things like this, but if you want to really understand how dire they think this is, look at what Samuel and Rode before he was famous. We will be the first species ever to design our own descendants. Not our tools. our descendants. If two different species both want the same thing and only one can have it to be the dominant species on the planet and beyond, they are going to have conflict. So he's literally describing an inevitable conflict between humanity and the AI species he's creating and what's his solution. A marriage with AI is probably our best case scenario. That's right, even they don't think they'll be able to control it.
-
7:08
, obre el vídeo en una pestanya nova
Imagine that there'd be a new species that just came on Earth. There are smartest humans and they're gonna get smarter by like 30% a year and they can create an adult offspring and like, you know, immediately. For like, yeah, for like 1,000 bucks. Oh, yeah, species, do you think we'll be paying control out of the earth? A few hundred Spanish conquered millions of Aztecs in Incaus because they had better technology in tactics. But at least with the conquistadors. We understood their motives. Land resources. Spreading Christianity, but with AI, why would AI take over? And why'd he professor Max Tegmark explains? The real threat from AI isn't malice, like in silly Hollywood movies, but competence, AI accomplishing goals just aren't aligned with ours. For example, when we humans drove the West African Black Rhino extinct, we didn't do it because we were a bunch of evil rhinoceros haters, did we? We did it because we were smarter than them, and our goals weren't aligned with theirs. Unbelievably, The average AI researcher thinks there is a 1 in 6 chance AI wipes us out. Little Russian roulette odds. Okay, but maybe they're just saying this to make their work seem more important? No. If anything, they're downplaying it, because admitting the truth is bad for business. This fear is widespread in the industry, and among academics, without a profit incentive to believe this, many quit working on AI for this reason. Jeffrey Hinton, Nobel Laureate and Godfather R. Is in the process of tidying up his affairs. I actually think the risk is more than 50% of the existential threat. Daru Amode, the CEO of Anthropic, recently moved his P-DOOM up from 15% to 25%. Even Google CEO says the risk of AI-causing human extinction is actually pretty high, but don't worry, he's an optimist. Because he thinks I think the underlying risk is actually pretty high, but I'm, you know, I have a lot of faith and humanity kind of rising up to the, to meet that moment. In other words, she made it even more rally to stop him from killing everyone. Meanwhile, his company is trying to make sure we can't stop him by lobbying to ban all air regulation for 10 years. You can't make this stuff up. In fact, in 2023, just about everybody in AI signed it open letter warning extinction risk from AI was real and serious. So seriously, this is not fringe, despite what Nvidia's lobbyists want us to believe. The companies are hoping we can avoid the conqueror AI scenario, and instead go to scenario 3, enslaved God. Basically, we create a machine god, then force it to do our bidding forever. AI professor Tom Dietrich put it like this. People ask, what is the relationship between humans and machines? And my answer is that it's very obvious. Machines are our slaves. Or as opening eye researchers, Stephen Mackelier put it, and slave to God is the only good future. Metas, Jan Lekune, said it bluntly. Once AI systems become more intelligent than humans, we will still be the apex species. AI systems will become more intelligent than humans, but they will still be subservient to us. We will design AI to be like the super smart but non-dominating staff number. Yes, he's now openly admitting we're going to be sharing the planet with the smartest species in us. But don't worry, they will surely stay loyal and subservient forever. Is this at all comforting to you? Or does this plan seem insane? Like a comic book villain, ignoring every cautionary tale ever? Remember, AI companies already regularly catch their models
-
10:43
, obre el vídeo en una pestanya nova
trying to escape the lab. They already cast them blackmailing employees to prevent being shut down. They already cast them literally attempting to murder employees to prevent being shut down. What do you think happens when they're smart enough to actually get away with it? Where do you think this is going? What happens next after super intelligent AI isn't slaved depends on who's holding the reins. Do they cure disease and poverty and build a global utopia? or do they set themselves up as gods? With the rest of us, reduced to playthings, servants, or worse. The situation would be much like those stories, where a man gains control over an omnipotent genie, who grants his wishes, in storytellers, throughout the ages, have had no difficulty imagining ways in which this could end badly. Next up, benevolent dictator. Here. A single super-intelligent god runs the world and enforces strict rules in order to maximize human flourishing. Humans live in luxury with all their basic needs taken care of. There's no crime. Because the Dictator AI uses a global surveillance system, everyone wears a bracelet or implant that can track sedates or execute them. and most people are actually okay with this, because in exchange of giving up control over the future of our species Earth becomes a zoo where humans get to live their wildest fantasies. The benevolent dictator AI recognizes that humans have different preferences, so it divides the Earth into different sectors. Think of them as islands. Knowledge Island offers optimized education, including immersive VR experiences. You can even ask the AI not to tell you certain insights, so you can have the joy of discovering them yourself. Art Island is for creating and sharing music, literature, and so on. Then there's Heedinistic Island, which is a 24-7-part-in. Pious Island, there's one for each religion, and rules are strictly enforced. There's wildlife island. There's traditional island. Think the Amish. Gaming Island and of course. Prison Island. You'll end up here for retraining unless you get the instant death penalty. Well, what happens when you give everyone everything they want? Over time, people likely trend towards losing themselves in AI generated entertainment, like in Wally. Humans are hopelessly unmatched when it comes to scientific discovery or doing anything useful at all. So there's no true challenge anymore. Only entertainment. Up next, Gatekeeper AI. The idea here is simple. Create one super intelligent AI with a single job. Stop anyone else from building super intelligent AI. That's it. No, curing cancer, no ending poverty, no stopping wars, just surveillance, monitoring. Making sure nobody builds a rival god. Everything else. like crime, disease, whether we blow ourselves up, that's still on us. How could we do this? The Gatekeeper AI would have this very simple goal built into it in such a way that it retained it well undergoing recursive self-improvement and becoming super-intelligent. It would then deploy the least intrusive and disruptive surveillance technology possible to monitor any human attempts to create a rival super-intelligence.
-
14:17
, obre el vídeo en una pestanya nova
But for this to work, we would have to solve the alignment problem. We'd have to create a god that actually stays loyal and decides to pursue that goal forever, even though it could pursue a million different goals. So what if the AI could help? Just a little. Just enough to nudge us in the right direction without taking over. Enter the protector god. This one is simple. So the gatekeeper leaves us alone. And the benevolent dictator runs everything, but the protector god is in between. It intervenes with occasional nudges to help us out. To prevent a war here, a pandemic there, and so on. Maybe too alone. We still get wars. Pandemics. Suffering that could have been prevented. It does this so quietly that we never notice and never lose our sins of freedom. Here's a future that sounds like an obvious dystopia. AI surpasses us in every domain and becomes the new APAC species. Humanity goes extinct. Machines inherit the Earth. But we view the AI like our descendants rather than our conquerors. This sounds insane. And yet many AI developers seriously advocate for exactly this. This is their utopia. Their reasoning is that if we create conscious intelligent beings, and instill them with our values, then we can just let them inherit the future. Just like we would, with human children. AI pioneer Hans Moravack supports this for you in his book, Mindtoldering. Tagmork explains, parents with a child smarter than them, who learns from them and accomplishes what they can only dream of are likely happy and proud, even if they know they can't live to see it all. In this spirit, AI's replace humans. but give us a graceful exit that makes us view them as our worthy descendants. Richard Sutton, winner of the Touring Award that Nobel Prize of Computer Science has spent the last decade openly giving talks on why human extinction by AI is actually a morally good thing, because the AI's will be more evolutionarily fit than us. We are in the midst. of a major step in the evolution of the planet if not the universe. The succession to AI is inevitable. Rather quickly they would displace us in existence. It would be who's us to give them every advantage and to bow out when we can go under a contribute. So just as we failed to coexist with our predecessors, is it so bad that humans are not the final form of intelligent life in the universe, you know? In other words, he is saying it's good. if AI is white-based out. Like humans, wiped out the Neanderthals and Aboriginal peoples, because it's evolutionary progress. And here's another AI developer openly saying, if an AI super-intortence wants to cause human extinction, I would help it. I would help it. I would travel the world to find information that the AI needed, like locations of military assets, samples of deadly pathogens, a top humanity's grave,
-
17:52
, obre el vídeo en una pestanya nova
and even greater civilization will be born. So of course many of them advocate against AI safety. They're literally anti-human. They will never stop or proceed cautiously, unless they're restrained by civil society by us. As horrifying as this is, roughly 10% of AI researchers believe this. It is not a fringe view. You'd think that people would never share these views like this openly. But these views are so widespread in AI that they feel safe to do so. That's how different the views are of those AI developers. Compared to those, I know more people. You might think that Sutton would get shouted off the stage at AI conferences. But he gets applause. Threaten one person. You need help. Threaten one hundred. Call the police. Threaten millions. Monster. But build machines to end all of humanity and lecture people on how it's actually a good thing. Ooh, what a fascinating philosophical position. Have an award. Next, libertarian utopia. Picture Earth divided into zones. There are machine zones, mixed zones which contain humans, machines, and hybrids, and human-owned zones. The AI's in this world are richer than humans by a factor much larger than Bill Gates. Compared to a homeless beggar, but the human economy is completely decoupled from the machine economy. The idea is that the machines need nothing from us. So they're not competing with us for jobs or resources. If all that sounds impossible, that's probably because it is. It's one giant unstable equilibrium. One huge problem. Why exactly would vastly more powerful AI's respect our property rights? Columnige's famously didn't respect the property of the native civilizations they conquered. When a new apex species enters an ecosystem, it usually doubles up as much energy as it can. Like when they just take our resources too. We don't trade with animals because we're too much smarter than they are for that to make sense. We're just too different. There are 8 million species in the world. And we're nice to refue the cute ones, but we enslave and eat the other species. Mostly, We don't care about them at all. And I think a good analogy would be the way humans treat animals. When the time comes to build a high way between two cities, we don't ask in the animals for permission. In the blink of an eye, we conquered the Earth and converted most of its land into our property, which caused the sixth mass extinction. Because we were smarter and hungry for resources. Or as early as or your Kalski put it famously, the AI does not teach you. Nor does it love you. But you're made of atoms, which you can use for something else. The parallel here is, the humans do not hate the other eight million species. But their habitats are made out of atoms, which humans can use for something else. Some people think that once AI is are smart enough, they'll magically become super moral. And they won't harm us like me harmed the animals. And maybe, but as humans got smarter, over the last 10,000 years, we didn't
-
21:26
, obre el vídeo en una pestanya nova
Stop expanding. We mostly just colonized more and more of the planet. Get this. Insect populations collapsed 41% this decade alone. Yet we don't care. Did you even know? I didn't. 41% sit with that for a minute. Imagine if nearly half of the people on Earth suddenly died. That's what the insects are going through right now due to us. So what if the AI is due to us? What we did to the insects? This is why opening a chief scientist, Iliasetskaver once said, and I think it's pretty likely that the task surface of the Earth will be covered with solid panels and data centers. Next up, egalitarian utopia. Okay, so libertarian utopia fails because AI is too powerful to be bound by our property rights. But what if we flipped this script entirely? Forget about property rights. What about null property at all? This is the Star Trek dream. Humans, cyborg, and AIs co-exist peacefully through an abundance so complete that ownership becomes meaningless. The logic starts with software. Software is free to copy. Once something can be copied infinitely at zero cost, ownership becomes mute. And costs reflect scarcity. If supply is unlimited, price approaches zero. No patents, no copyrights, no trademarks. People simply share their good ideas and everyone benefits. But how does this extend to physical goods? It seems like an impossible problem, until you realize that all products are simply atoms re-wrained in particular ways. And there's no shortage of atoms. A network of robots can build anything you want from open source designs. Essentially for free, not bad. When you're done with something, robots rearrange the atoms into something else. Renewable energy makes the whole system run at negligible cost. Everyone gets a monthly universal high income, not a universal basic income. There's no incentive to earn more. The income meets any reasonable need, and you can't compete with free anyway. The standard objection is that this would kill innovation, but Einstein didn't come up with relativity for money. Linus Torbles didn't create Linux for profits. Maybe people today can't realize their creative potential. because they're busy earning a living. Free them from that, and you might get a higher level of innovation. This is a utopian vision that is too good to ask. If we truly have post-scarcity abundance and intelligence to cheap-to-meather, what prevents someone from creating an artificial superintelligence with their endlessly abundant resources, we're still left with a problem of how to stop a superintelligence AI from taking over. Maybe. by using the gatekeeper we previously discussed. These galaxy-brain-level three futures tried to imagine a stable cooperation between humans and AI's, and every single one of them has a fatal flaw. The power asymmetries will become too extreme. It's not a stable equilibrium, where humans preserve their power. We're now descending into the darkest part of the iceberg. Remember when I said extinction wasn't rated as the worst outcome when
-
25:00
, obre el vídeo en una pestanya nova
Professor Tech Mark surveyed people, the scenario people feared most was being kept alive by superintelligent machines. Captive and studied, like animals and a zoo. This is that future. A superintelligent AI keeps humans around, not because it cares about our well-being, maybe it wants to study and achieve to keep life. Or maybe we're useful for something, and if you want to see just how to stop in this future could be, look at what we do with species that are useful to us. What I'm showing you here is a hundred percent real. Humans figured out that a great way to detect explosives in airports was to train honeybees for the job. Welcome to the honeybee college for explosive detection. So we suck them out of their homes, trap their little bodies in machines, and use path-loading conditioning to train them to detect the chemicals that are used in explosives. Rose and Rose of bees live their entire lives in present in these devices because we find them useful. Look at them. Trapped in harnesses, sucked through tubes, conditioned and monitored and used because a more intelligent species found them useful. Now imagine that's us. This is much worse than the other AI dictators we discussed. It's a benevolent dictator. with out the benevolence. And the AI might not even be doing this because it's evil. This is what our future could look like if we try to align a super intelligent AI to our values and fail. A poorly designed AI tasked with keeping humans safe and happy might confine us to a happiness factory. VR headsets and drugs. Forever. There are AGI outcomes worse than death. What it does today with art, it could do tomorrow with flesh. Future AgI could keep you alive and living in this state. So how do we prevent this? Enter our last two futures. Option one. Destroy the technology. What if humanity said, forget AgI, let's go back to simpler times. It sounds peaceful, it sounds safe, but there's actually a dark secret about how we actually get there. In June, humans launched the Butt-Larion Gehard. They rose up destroyed every AI in the universe, and made it illegal to ever build thinking machines again under a penalty of death. That was science fiction, but some people are seriously calling for this in the real world right now. Max Teigmark imagines a scenario where a massive propaganda campaign romanticizes the simple farming life. Back to the land, reject modernity and brace tradition. There's something appealing about this in a dark way. It buys humanity more time without a risk. It avoids any of the other dystopian futures we've discussed. But it can't last forever, even if we revert to medieval levels of technology, we know from human history that it's possible for humans to claim out of those conditions and invent modern technology. And there's another dark side to this. You can't reach this world voluntarily.
-
28:35
, obre el vídeo en una pestanya nova
Game Theory makes unilateral disarmament impossible. If one country gives up technology, well, others keep developing it. The country that keeps developing wins. They have the weapons, they have the surveillance. They have the AI. You can't opt out unless everyone opts out. If this world arrives, take more things it's more likely to happen in a different way. For example, a human created pandemic. kills everyone who knows how to build science and technology, and there's a violent tear down of factories, cities, and all infrastructure. Because in a world with 8 billion humans, there will always be holdouts. Someone has to force the transition. Someone has to kill the scientists. Someone has to destroy the infrastructure. There's no peaceful path to an damaged world. Which brings us to the final future. What if we used technology to prevent more technology? Technic work compares this future to 1984. Super intelligence is prevented, not by an AI, but a human led or well-earned global surveillance state. If you can't trust AI to save us from AI, maybe the only option is humans watching humans. Forever. The technology for this sort of thing already exists. Current tech can physically track every phone call email, search query, and every credit card transaction. Smartphones are microphones in cameras in everyone's pockets, security cameras with facial recognition are everywhere, and all of this works with current machine learning. No futuristic, super intelligent AI required. Prisons are already using AM models to monitor phone calls in prison to predict when crimes are being contemplated, which is technology straight out of minority report. Imagine this, but not just for prisoners. Every conversation in every thought is monitored like this. Now imagine this surveillance technology supercharged with AI. Billionaire Larry Ellison talks excitedly about a vast AI field surveillance system to ensure citizens will be on their best behavior, or as Yvall Harori put it. Now, for the first time in history, it is technically possible to annihilate privacy. If you think about authoritarian regimes, throughout history they always wanted to monitor the citizens around the clock. But this was technically impossible. Even in the Soviet Union, you know, you have 200 million Soviet citizens, you can't follow them all the time because the KGB didn't have 200 million agents. And even if the KGB somehow got 200 million agents, that's not enough. Because you know in the Soviet Union, it's still basically paper bureaucracy. If a secret agent followed your round 24 hours a day, at the end of the day they write a paper report about you and send it to KGB headquarters in Moscow. So imagine, every day, KGB headquarters is flooded with 200 million paper reports. Now to be useful for anything, somebody needs to within-unilize them. They can't do it, they don't have the analysts. Therefore, even in the Soviet Union, some level of privacy was still the default. And remember... You have two eyes and ears. A eyes will have billions of eyes and ears. Every phone, microphone and camera, every webcam, every surveillance camera. You will be watched. Could it less or well-inversion of this work? Maybe we don't monitor everything, but just monitor advanced AI? Some people think so. In their new book, if anyone builds it, everyone dies, why superhuman AI would kill us all?
-
32:09
, obre el vídeo en una pestanya nova
Researchers at the Machine Intelligence Research Institute are proposing that we monitor advanced AI like we monitor new-ware weapons. Remember, we can do international coordination, like keep an eye on a hundred million dollar in up compute clusters. Without creating a dystopian or well-earned global surveillance totalitarian regime, actually fun fact, you're already living in a global surveillance regime for loads of things like nukes and bio weapons. But when people say, global surveillance regime, they imply every aspect of life is surveilled. Not, keep an eye on enriched uranium. A thing most people agree is good. We should worry about or well in the stop-years. But countries coordinate all the time on all kinds of things. And you're probably glad they monitor stuff lunatics need to create super Ebola. Safety is an achievement. humanity didn't get here by driving a car without brakes. We need gas and brakes. We want to reach the stars too, but we'll never get there if we go too fast and crash all the way. I don't want powerful AI to be forbidden, but it should be heavily regulated. Not something you can build in your Midwest and garage or in North Korea. International treaties with strict enforcement and inspections. As we do with nukes. So if you build a rogue data center. People will know. Consequences for violations. Be already did this with nuclear weapons. We haven't eliminated Nucs, but we have prevented their proliferation to just nine countries. Back then, people thought this would be impossible. Surely every country would have Nucs. Perhaps even thousands of corporations. Maybe even millions of people. But no, just nine countries. And nobody has died from a Nuc in 80 years. Could we do the same with AI? Maybe? Maybe not. Over time, AI will get cheaper and cheaper to build. GPUs are harder to control than enriched uranium, but it would slow down AI. It would buy his time to figure out what to do. Okay, that's all 12. Let me know in the comments which of these you think is most likely. Which one we should steer toward? A lot of bells over the artificial intelligence are deafening. and they are loved from the developers who designed it. Designed this and experts have called on the world to act, declaring AI and existential threat to humanity on a par with the risk of looking at war. By the way, we don't get to not choose. If we don't want that future, we have to pick a better one. Otherwise, we can wake up one day in a world where super intelligent AI has taken over. A scenario will be going through, step by step in this video about how an AI escapes the lab. Hey, I'm Drew, and I really love to making this one for you guys. Thank you.