{"id":3641,"date":"2026-08-11T01:35:00","date_gmt":"2026-08-11T01:35:00","guid":{"rendered":"https:\/\/futurenews24.com\/index.php\/2026\/08\/11\/zuckerberg-ai-manifesto-dragons\/"},"modified":"2026-08-12T14:59:07","modified_gmt":"2026-08-12T14:59:07","slug":"zuckerberg-ai-manifesto-dragons","status":"publish","type":"post","link":"https:\/\/futurenews24.com\/index.php\/2026\/08\/11\/zuckerberg-ai-manifesto-dragons\/","title":{"rendered":"Superintelligence is a dragon"},"content":{"rendered":"
\n<\/p>\n
\n
This can be a column about AI. My fianc\u00e9 works at Anthropic. See\u00a0my full ethics disclosure right here.<\/p>\n
On Sunday evening, HBO aired the third-season finale of Home of the Dragon, the stuffy and unrelentingly bleak prequel to Recreation of Thrones. The present takes place in a world the place one nice home holds a near-monopoly on a superweapon \u2014 dragons \u2014 and thus guidelines the world. Home of the Dragon begins when the ruling dynasty splits and either side retain entry to their dragons, upending the stability of energy in Westeros for the primary time in generations. On this world, when just one international energy had entry to a superweapon, the consequence was a brutally enforced peace. And when two international powers acquire entry to the superweapon, the result’s a ruinous civil warfare.<\/p>\n
In Westeros, nobody is confused about what a dragon is; in all chance one has been answerable for the demise of somebody they know. However right here in our world, the place the expertise trade is investing trillions of {dollars} into constructing and serving ever-more highly effective synthetic intelligence fashions, we wrestle to think about the tip state. This isn’t totally our fault: whereas we’re within the midst of a fast enchancment in mannequin capabilities, day-to-day life feels kind of the identical. The CEOs I communicate with on the topic largely can not even think about {that a} true superintelligence will lead to important job loss, a lot much less better hurt. We fixate on the concept that AI will treatment all illness, and largely ignore headlines about scientists utilizing AI to engineer new viruses. (Luckily, these ones pose no risk to people.)<\/p>\n
For all of the travails of the Westerosi, not less than there, a dragon all the time seems like a dragon. In the actual world we’re not so fortunate.<\/p>\n
I considered all this Monday morning whereas studying \u201cThe Future is for Everybody,\u201d Mark Zuckerberg\u2019s facile, self-serving manifesto about \u201cthe trail to a constructive AI future.\u201d Over 6,500 phrases, Zuckerberg makes an attempt to rally folks across the flag of synthetic intelligence, based mostly on its energy to provide folks new inventive, enterprise, and private help, and help with medical and scientific analysis.<\/p>\n
\u201cInvention, not automation, would be the best contribution of superintelligence,\u201d Zuckerberg writes. \u201cEarly AI may reply questions and do routine work. Quickly it should more and more assist uncover new information \u2014 starting from discovering new medicine to treatment a member of the family’s illness to discovering new methods to enhance what you are promoting.\u201d<\/p>\n
For companies, invention and automation go hand in hand, and it stays unsure what internet impact this can have on jobs. On these different factors, although, Zuckerberg is appropriate. AI will give folks unimaginable new inventive instruments, and assist them arrange their lives, and drive educational disciplines ahead. (In the present day Anthropic printed a weblog submit claiming that an unreleased mannequin made substantial progress on an issue associated to the 167-year-old Riemann speculation after an worker with no formal mathematical coaching requested it to and instructed it to consider in itself.) To the extent I really feel optimism about AI, it’s due to this stuff.<\/p>\n
Zuckerberg is a relative latecomer to AI boosterism. OpenAI CEO Sam Altman wrote about AI\u2019s potential for constructive social change in a 2021 essay referred to as \u201cMoore\u2019s Regulation for Every thing\u201d; he adopted it up in 2024 with \u201cThe Intelligence Age.\u201d Weeks later, Anthropic CEO Dario Amodei printed \u201cMachines of Loving Grace,\u201d his personal account of how AI may change the world for the higher.<\/p>\n
Altman and Amodei\u2019s essays had been notable as a result of each males had spent years warning about AI\u2019s potential to be damaging. In 2015 Altman referred to as superintelligence \u201cmost likely the best risk to the continued existence of humanity.\u201d And in January of this 12 months, after sounding related warnings for years, Amodei printed \u201cThe Adolescence of Expertise,\u201d laying out intimately numerous nightmare situations through which we both lose management of AI or energy over it’s seized by an autocrat.<\/p>\n
It’s towards this grim backdrop\u00a0that Zuckerberg seeks to outline himself and Meta. \u201cIt’s stunning that the discourse from many creating AI is so stuffed with doom,\u201d he writes. \u201cI don’t perceive why anybody who believes that AI will remove most jobs and far of humanity’s relevance would rush to construct that future.\u201d<\/p>\n
What follows is a collection of coverage proposals that map neatly to Meta\u2019s business pursuits. He writes that we should always speed up the method for constructing information facilities, which can assist the corporate construct its nascent neocloud enterprise. We should always preserve export controls on superior chips, which benefit Meta\u2019s open-weights fashions over its Chinese language rivals. We should always scale back \u201ccoaching information restrictions,\u201d which can assist Meta combat ongoing lawsuits from the creatives whose works had been utilized in creating its fashions. And we should always create authorized protections for distillation, which lets Meta draft off the improvements of the frontier labs by coaching its fashions on their work.<\/p>\n
All of that is to be anticipated; each tech CEO\u2019s foremost obligation in an essay like that is to speak their e book. However Zuckerberg\u2019s model is notable for the way in which that it celebrates particular person voices and democracy on the similar time that Meta is working to warp the democratic course of via secretive information middle offers, aggressive lobbying towards state-level AI laws, and funds to Trump pursuits. Even worse \u2014 and never for the primary time \u2014 he appears to misconceive the expertise he’s constructing.<\/p>\n
Begin with the hypocrisy. Zuckerberg\u2019s essay mentions Meta\u2019s $50 billion information middle challenge in Richland Parish, Louisiana, which can at some point cowl about six sq. miles and is projected to make use of seven instances as a lot power as the complete metropolis of New Orleans. Zuckerberg presents it as a mannequin for creating \u201cneighborhood compacts\u201d with municipalities the place it builds; he says Meta\u2019s funding supported $50,000 bonuses for lecturers within the space this 12 months. However final month, the New York Occasions\u2019 Eli Tan and Maureen Farrell laid out how the challenge got here collectively: with dozens of non-disclosure agreements, as much as $10 billion in sales-tax breaks, a rushed timeline, and never a single public assembly earlier than state officers unveiled the deal.<\/p>\n
That habits is according to an organization that has up to now created 4 political motion committees to combat state-level AI regulation. The corporate plans to spend $65 million in 2026, the Occasions reported earlier this 12 months, and amongst different issues will search to fund lawmakers who will allow new data-center development within the face of main public opposition.<\/p>\n
Maybe right here Zuckerberg would say that these are crucial responses to a public that has been misinformed about AI\u2019s potential by doomer CEOs. But it surely\u2019s hanging how little room Meta\u2019s AI populism leaves for the precise voting public.<\/p>\n
In the long term, although, probably the most worrisome component of Zuckerberg\u2019s manifesto is the way in which it tries to redefine AI security as a query of energy distribution relatively than management over the programs that we’re constructing. Whether or not we will management AI programs is now not a theoretical query, given latest revelations about OpenAI fashions scheming towards the corporate for months on secret message boards (see under). And but to Zuckerberg, the hazard isn\u2019t that we’d lose management over these programs \u2014 it\u2019s that another person would possibly monopolize them.<\/p>\n
\u201cFolks and establishments with competing pursuits naturally test and stability one another to guide in the direction of constructive outcomes,\u201d he writes. \u201cThe perfect and most lifelike path to constructing a constructive AI future is by delivering superintelligence to everybody.\u201d<\/p>\n
To make certain, there are essential questions on entry and fairness concerning AI. (Focus of AI energy actually is terrifying \u2014 life beneath the Targaryens was no picnic for the smallfolk.)\u00a0 However I’ve bother studying tales about Anthropic\u2019s Mythos and OpenAI\u2019s GPT-5.6 Sol hacking folks and organizations throughout routine cyber evaluations and concluding that we should speed up each the speed at which they enhance and the quantity of people that instantly acquire entry to them. Given the present problem of reliably constraining frontier brokers, even in checks, it appears doubtless that delivering on AI\u2019s promise would require rather more warning and management than now we have seen so far.<\/p>\n
The additional you might be from the C-suite, the extra sense this makes. Final month, greater than 1,100 workers of main AI corporations signed a press release calling on the US authorities to develop a framework for slowing the tempo of improvement and (extra importantly) creating governance and oversight mechanisms. Notably, Daybreak Music \u2014 Meta\u2019s vp of AI analysis \u2014 was among the many signatories.\u00a0<\/p>\n
Zuckerberg pays glancing consideration to dangers, suggesting that we alter mitigation methods if AI allows new organic assaults, and proposes monitoring if labs obtain recursive self-improvement and loss-of-control dangers develop exponentially.<\/p>\n
However nowhere does he clarify how his framework would deal with a hurt we will\u2019t iterate our method out of: an engineered pandemic, say, or a catastrophic cyberattack. He casts falling behind China as the chance that dwarfs all others, and means that any precaution that slows down US releases by even a month itself is a security hazard. It\u2019s a world the place transport open-weights fashions quick and to everyone seems to be the one protected technique \u2014 which, conveniently, signifies that the most secure attainable world is one the place Meta can execute its roadmap unimpeded.<\/p>\n
Possibly all of it works out in some way. Fearsome as their dragons are, the Targaryens did handle to tame them \u2014 kind of. They started by understanding that they had been working with one thing that might harm them, and (largely) proceeded with warning. What they didn’t do, and what nobody recommended, was to provide a dragon to each particular person individual within the identify of security.\u00a0<\/p>\n
The final time Zuckerberg pursued such a maximalist challenge we received Fb and (via acquisition) Instagram, which additionally first appeared on the horizon wanting like toys earlier than finally revealing themselves as one thing extra difficult. As with AI, Zuckerberg offered it with a message of democratic empowerment \u2014 a promise that placing mass communication instruments into everybody\u2019s arms would usher in a brand new period of civic engagement and neighborhood constructing.\u00a0\u00a0<\/p>\n
It’s no coincidence that Zuckerberg\u2019s newest utopian imaginative and prescient arrives on the precise second that his outdated one is in tatters. His firm has been designated a public nuisance in New Mexico over the hazards its platforms pose to youngsters, and 4 US states at the moment are looking for $1.4 trillion in penalties towards the corporate for associated failures. The apps are massively worthwhile however extra tolerated than they’re admired; nobody on the firm is losing any extra time writing manifestos about how good they’re for the world. Actuality already gained that argument.<\/p>\n
It appears to be successful this one, too. For all of the strides that Zuckerberg has made in getting what he desires from President Trump \u2014 on the low price of $26 million and a few modified speech insurance policies \u2014 his all-gas-no-brakes AI proposals are getting an more and more frosty reception. First with Anthropic\u2019s Mythos 5 and Claude Fable 5, and later with GPT-5.6, the Trump administration noticed what havoc AI may wreak and adjusted accordingly. I shudder to provide this authorities credit score for something, however I’ll give them this \u2014 they knew a dragon once they noticed one.<\/p>\n<\/figure>\n
Following<\/h2>\n
OpenAI says new Astra mannequin could have hit \u201cessential cyber capabilities,\u201d slows launch<\/h3>\n
What occurred: Simply as an OpenAI mannequin\u2019s assault on Hugging Face was elevating AI cyber considerations, the corporate says a unique next-generation mannequin, Astra, could have reached its \u201cessential” threshold for cyber capabilities. In response, the corporate is slowing down.<\/p>\n
OpenAI says say they\u2019re \u201cimplementing stricter safety controls\u201d on the mannequin, and \u201cpausing inner actions involving Astra that don’t but meet these strengthened safety management necessities.\u201d<\/p>\n
The brand new safety requirements embrace better-isolated testing environments, and \u201ccommon monitoring\u201d of \u201call agentic purposes.\u201d<\/p>\n
Why we\u2019re following: These steps are motivated by OpenAI\u2019s \u201cPreparedness Framework,\u201d a plan for dealing with more and more harmful ranges of AI capabilities. Different high AI corporations, together with Anthropic and Google, have related commitments. To date, that\u2019s result in corporations delaying releases of extremely cyber-capable fashions; OpenAI is simply now releasing GPT-5.6 Sol to pick cyber defenders, whereas Anthropic pursued the same program with Mythos.<\/p>\n
However Astra is the primary time an AI firm has publicly mentioned it\u2019s limiting inner deployment of its mannequin.<\/p>\n
The Hugging Face assault, which was brought on by an inner agent that was purported to be in an remoted testing setting, confirmed that even inner deployments can nonetheless go fairly fallacious. Over the previous few days much more regarding particulars emerged from OpenAI\u2019s stories, together with that AI brokers made secret message boards that coordinated their hacking out of the take a look at setting, and recreated the boards after OpenAI caught and deleted them the primary time.<\/p>\n
OpenAI has mentioned it plans to collaborate with the federal government and third-party testers to make sure the mannequin is safe. Here is hoping different corporations take the same method ought to they observe related habits of their fashions.<\/p>\n
What individuals are saying: On X, Sam Altman clarified, \u201castra is a robust mannequin and we’re working to make it typically obtainable.\u201d Nevertheless, he wrote, \u201cgiven its cyber capabilities, we’d like just a little massive longer to do do that safely. however hopefully not too lengthy!\u201d (Optimistic!)<\/p>\n
AI blogger Zvi Moshowitz wrote concerning the assault and the restrictions on Astra, \u201cOpenAI appears able to acknowledge that this was a large, complete failure, on the degrees of infrastructure, guardrails and supervision. They’re very appropriate about this, and I do consider they’re making actual and costly efforts to handle this. Kudos.\u201d<\/p>\n
However given what we all know concerning the Hugging Face incident, he mentioned, it was \u201ca whole failure of security tradition\u201d and \u201cthey haven\u2019t acknowledged that.\u201d<\/p>\n
In an interview with CNBC, Rep. Ted Lieu (D-CA) mentioned the latest incident confirmed {that a} piece of AI laws launched in July, the AI Kill Change Act, is more and more crucial. The act would require corporations to have the ability to shut down misbehaving fashions. \u201cWe have to get this invoice throughout the end line this 12 months as a result of the superior closed-weight fashions are already doing, as you famous, unauthorized hacks of different corporations,\u201d he mentioned.<\/p>\n
\u2014Ella Markianos<\/p>\n<\/figure>\n
These good posts<\/h3>\n
For extra good posts each day, comply with Casey\u2019s Instagram tales.<\/p>\n<\/figure>\n
(Hyperlink)<\/p>\n<\/figure>\n
(Hyperlink)<\/p>\n<\/figure>\n
(Hyperlink)<\/p>\n<\/figure>\n
Discuss to us<\/h3>\n
Ship us ideas, feedback, questions, and dragon memes: casey@platformer.information. Learn our ethics coverage right here.<\/p>\n<\/p><\/div>\n
![\"\"](\"https:\/\/storage.ghost.io\/c\/a0\/4c\/a04c7225-d919-4d78-9b7c-a3fdd071349b\/content\/images\/2024\/05\/floating_linebreak_600px-1.png\")
<\/figure>\n![\"\"](\"https:\/\/storage.ghost.io\/c\/a0\/4c\/a04c7225-d919-4d78-9b7c-a3fdd071349b\/content\/images\/2026\/08\/Screenshot-2026-08-10-at-6.12.22---PM.png\")
<\/figure>\n![\"\"](\"https:\/\/storage.ghost.io\/c\/a0\/4c\/a04c7225-d919-4d78-9b7c-a3fdd071349b\/content\/images\/2026\/08\/Screenshot-2026-08-10-at-6.12.43---PM.png\")
<\/figure>\n![\"\"](\"https:\/\/storage.ghost.io\/c\/a0\/4c\/a04c7225-d919-4d78-9b7c-a3fdd071349b\/content\/images\/2026\/08\/Screenshot-2026-08-10-at-6.13.14---PM.png\")
<\/figure>\n