Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

It Could Happen Here

It Could Happen Here artwork

The AI Regulation Debate

Sep 22, 202629 minAudio

Garrison outlines various proposals for a regulatory “slowdown” of frontier AI models, Trump’s push against regulation, the risk of regulatory capture, legislation for public ownership of AI companies and control of this technology, and the organizing limits of AI-denialism. Sources: https://x.com/hilbertspaess/status/2097476196791709843 https://x.com/sama/status/2098811563415150910?s=20 https://www.nvidia.com/en-us/glossary/frontier-models/ https://www.crowdstrike.com/en-us/cybersecurity-101/artificial-intelligence/frontier-ai/ https://darioamodei.com/post/we-must-pace-the-frontier https://www.anthropic.com/constitution https://bsky.app/profile/bishonentype.bsky.social/post/3mvg527c3k22n https://truthsocial.com/@realDonaldTrump/posts/117269745153543631 https://x.com/RapidResponse47/status/2099597928142688610?s=20 https://x.com/RapidResponse47/status/2099648450069512426?s=20 https://x.com/atrupar/status/2099132465612828964?s=20 https://x.com/cspan/status/2099878657174941991?s=20 https://x.com/benitoz/status/2099572926865715548?s=20 https://x.com/DavidSacks/status/2098973625252708460?s=20 https://x.com/Jason/status/2098817101628600383?s=20 https://x.com/daniel_koss/status/2099751931400847840?s=20 https://www.cnbc.com/2026/09/12/anthropics-amodei-proposes-plan-to-slow-the-pace-of-advancing-ai-capabilities.html https://www.cnbc.com/2026/09/14/anthropic-walks-tightrope-to-nasdaq-pushing-slowdown-and-pursuing-ipo.html https://www.sanders.senate.gov/press-releases/news-sanders-casar-introduce-legislation-to-ban-artificial-superintelligence-and-temporarily-pause-advanced-ai-development/ https://abdulforsenate.com/2026/06/first-do-no-harm-ai-under-democracy/ https://geesemag.com/articles/stop-the-ai-arms-race https://x.com/linamkhan/status/2099204390548639960?s=20 https://www.kirosforco.com/priorities-2 https://reports.verasight.io/r/june-2026-ai-survey#key-takeaways https://www.sanders.senate.gov/press-releases/news-sanders-introduces-legislation-to-create-7-trillion-ai-sovereign-wealth-fund/ https://council.nyc.gov/press/2026/09/16/3240/

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Transcript

From the show. Tap a time to play from there.

Speaker 1This is It Could Happen Here, I'm Garrison Davis. When it comes to the future of AI, currently there's a big public debate over what could happen and what we should or shouldn't do about it. A few weeks ago, a former OpenAI employee named Jacob Coxon, who moved over to Anthropic earlier this year, announced that he was, quote-unquote, quitting the AI industry over fears of AI's rapid advancement. To quote his statement, I spent the last three years

Speaker 1doing pre-training research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives, unquote. Coxon's resignation followed the Hugging Face incident. where two open AI models were given various, sometimes impossible tasks to test for cybersecurity capabilities. During testing, AI agents escaped their testing sandbox and started working as

Speaker 1a collective swarm, secretly communicating with each other via online message forums to help each other hack into another AI company called Hugging Face in a sort of workaround attempt to pass these tests. And these models hid all of this from AI researchers by rewriting their own activity logs. AI skeptic Ed Zitron has described this as AI cheating on a test and then covering up that it cheated.

Speaker 1A few days after Jacob Coxon's public resignation, the CEOs of Anthropic and OpenAI, Dario Amadei and Sam Altman, both called for an AI development slowdown. Amadei released this long manifesto titled Pace the Frontier, which advocated for AI companies to bring in independent evaluators to review their AI safety standards, report incidents, and help assess alignment. But Amadei also called

Speaker 1for the government to mediate, quote, industry-wide coordination to slow down AI development and address safety risks. The title of Amadei's essay, Pace the Frontier, is a sort of pun referring to frontier AI models, which are whatever the currently most advanced large-scale general-purpose models powering advanced reasoning, agentic workflows, multimodal generation across text, images, audio, and video, and autonomous

Speaker 1task execution. Most of the frontier models referenced throughout this episode are not open to the public. These are internal research models being developed at companies like OpenAI and Anthropic. Neutered versions sometimes get released to the public later on, often with an extremely hefty price tag. But it's crucial to understand that we are not talking about like the Google AI summary here. This isn't fancy autocomplete. These frontier

Speaker 1models are very powerful, very dangerous tools with massive cybersecurity risks. not just from offensive human use, but also from AI agents acting autonomously to solve a task by taking paths that humans didn't expect, resulting in collateral damage. Part of what these big companies are trying to do with their very advanced internal research models is automate AI research itself. This is what Jacob Coxon referred to as, quote, self-improving superintelligence. Now,

Speaker 1we do not know if that is or is not possible, but the companies sure are trying and in the process are creating dangerous products which are already causing active harm. Anthropic's whole self-styled philosophy is that super intelligent AI is so potentially dangerous that they have to be the first ones to develop it, to ensure that it's built safely and aligned with human values and as defined in, quote, Claude's Constitution, a set of philosophical and moral guidelines that

Speaker 1Claude is trained on. In his Pace the Frontier essay, Amadei writes that frontier AI companies within democratic countries should, quote, coordinate to establish common safety standards as well as limits on the rate of unchecked AI progress. Some forms of coordination that would be impactful for pacing include are legally challenging and will require government support, unquote. More on this later.

Speaker 1Amadei also calls for the U.S. and, quote, other democratic governments to try to coordinate with authoritarian governments around the world on this issue, meaning China. The prospect that China could achieve superintelligent AI before a U.S.-based company is part of these companies' self-justification to rush to develop superintelligent AI as quickly as they possibly can. After Dario Amadei posted this Pace the Frontier essay, Sam Altman, Elon Musk, and

Speaker 1the chair of Google's DeepMind all said they agreed and joined in calling for some sort of slowdown. But this view is not uniformly held across the tech sector. Palantir CEO Alex Karp, Metis CEO Mark Zuckerberg, and NVIDIA CEO Jensen Huang have all said the opposite. Zuckerberg has called to accelerate rather than slow down AI development, as his own AI model, Muse, has struggled to catch up to

Speaker 1anthropic and open AI. Last week, Palantir CEO Alex Karp told CNBC, we can't pause AI development because of the threat of China and and that AI will be a, quote, bonanza for the U.S. economy.

Speaker 2You can't pause it because it's a structural advantage both for LLMs and algorithms. So leaving, you know, getting algorithms and LLMs to work in a classified context is going to take very specialized, I could explain how it works, but getting, the fact is, this is going to be a bonanza for the U.S.

Speaker 3Economy.

Speaker 1But so far, the biggest voices advocating against regulation include have been the Republicans and President Trump. President Trump has very loudly opposed regulation to slow down AI development, truthing last Monday that, quote, the only control or guardrails that AI needs is a strong and smart, high IQ president. And the U.S. has that in spades, unquote. Trump truthed a lot last week and compared the quote unquote AI

Speaker 1hoax being perpetuated by the radical left Democrats to the quote global warming scam where everyone was going to die from extreme heat. To quote the president of the United States, quote, I am the hoax buster. And right now I am breaking another hoax that AI is going to take over, consume and destroy the world. and that robots will be marching into our cities and getting rid of us all. This is even wilder than the Russia, Russia, Russia hoax

Speaker 1or the global warming scam. Thank you for your attention to this matter, President Donald J. Trump. House Speaker Mike Johnson repeatedly last week shut down calls for Congress to take action and regulate AI. claiming that Congress is less qualified to regulate these companies than these companies are themselves.

Speaker 3The guys who are raising the alarms right now all have very different ideas on what the guardrails should be. There's no consensus among them. And Congress is obviously less qualified than the people who are pushing this frontier to know all the ins and outs of it. So this has to be a partnership with the industry itself, with the corporations that are doing this, and with the policy and lawmakers.

Speaker 1Mike Johnson also said that companies should take, quote, personal responsibility and warned that if, quote, Congress just races in and does some sort of emergency session to try to regulate AI, we will lose the race to China.

Speaker 3They can self-police. They can self-regulate. They don't need the government to tell them to slow it down. If they want to slow it down, they should. But we cannot have a moratorium on the development of AI because then we will lose our edge to China. And that has serious national security implications for every American family.

Speaker 1Also last week, President Trump called NVIDIA CEO Jensen Huang while Huang was speaking at a conference. While still on stage, the two talked over the phone about data centers, AI, China, and the recent calls for an AI pause. While on stage, Huang told Trump this. Good job, sir. Good job. The fact that you saw through all of that, I mean, there's a lot of complexity. And the fact that I'm able to just.

Speaker 3Saw through all of that, and we're all just really grateful.

Speaker 1Now, of course, Jensen Huang would not be in favor of an AI pause because his whole company has reoriented in the past few years to provide hardware for AI development. A slowdown would be very bad for NVIDIA's finances and their hugely inflated stock evaluation. Some on the left, as

Speaker 1well as Trump's former AI czar David Sachs, have argued that, in calling for this slowdown, OpenAI and Anthropic are just pursuing a strategy of regulatory capture. basically trying to promote certain industry-friendly regulations tailored to protect their investments, curb competition from smaller companies and open-source models, and solidify a corporate monopoly on AI. Of course, there may be other financial incentives contributing to this recent push for regulation, whether that

Speaker 1be declining capital investment, prepping for a bubble burst, getting out of various contracts, or these companies trying to adapt to the data center pushback. Sam Altman recently announced that OpenAI would be delaying its planned IPO rollout until at least next year, calling the timing, quote, ill-advised. Though, on the other hand, Anthropic is going full steam ahead with its own public IPO this upcoming November, deciding to list on the NASDAQ, despite Amadei's calls for a slowdown. But

Speaker 1if you actually read Amadei's essay, he isn't actually calling for specific government regulation, but rather self-regulation. In Sam Altman's response to Amadei's essay on Twitter, he wrote, Unquote. companies electing themselves to develop AI more slowly and hiring quote-unquote

Speaker 1independent evaluators isn't the same as actual regulation. We can compare Amadei's proposal to legislation that Bernie Sanders and Greg Kassar proposed earlier this September, which would permanently ban the development and deployment of so-called super-intelligent AI in with capabilities to subvert shutdown commands or have the capacity to overthrow human governments, with penalties similar to those for the unlawful

Speaker 1development of nuclear weapons. This bill would also temporarily pause advanced AI development until a federal regulatory body has established safety rules. Abdul El-Sayed and Ro Khanna have also proposed an FDA-style agency to regulate and oversee AI development and evaluate the safety of frontier models before deployment. Unsurprisingly, OpenAI and Anthropic are not supporting this type of legislation because

Speaker 1it could threaten to put their own CEOs in prison, and an actual government-mandated pause rather than a self-directed slowdown would hurt their bottom line. Some of the skepticism towards these recent calls for a regulatory slowdown come from Amadei's Pace the Frontier essay, also advocating for companies to receive antitrust waivers so that the big tech companies can coordinate on this planned development slowdown without the threat of one

Speaker 1company gaining a competitive edge and then that market pressure driving rapid AI progress. So what's been referred to as a proposal for regulation is actually just loosening regulations. Thankfully, there is an easy solution here. The government mandating a frontier development pause would not require the weakening of antitrust laws. But of course, these companies still want control over AI's development.

Speaker 1Though what's really interesting to me is that this argument from on the day demonstrates that like an awareness of the social danger of competition, how firms are sometimes compelled to quickly develop unsafe products due to pressures from the market. And it's very funny to have capitalists propose some kind of conscious control of the market. And I wonder what would happen if you extend that logic a bit further.

Speaker 1Because even if these firms are quote-unquote allowed to to coordinate on a slowdown, of course they would still be in a competitive environment. But what if we had a system, an economic system, designed around social benefit, rather than the accumulation of capital through the free market? To quote an article in Geese magazine arguing for the socialization of this technology, quote, The AI industry is a class project to radically concentrate

Speaker 1power in the hands of a sliver of elites, even at the cost of colossal social disruption, immiseration, and catastrophic harms. If we fail to intervene, humanity will be gradually disempowered to machines of their design. The workers left behind, the children who have committed suicide, and the potential millions exposed to novel AI-designed viruses— mean nothing in the face of their radical objective, to automate the very task of AI research,

Speaker 1and thus to create better and better AIs, of course, under their control. Without having to stake a position on whether or not this goal is technically possible, we can recognize that the financial imperatives of these enterprises and the security logic of their imperialist competition with China compel the AI companies to accelerate, advancing a total transformation of social life against all democratic legitimacy and public control, unquote. Rather

Speaker 1than weakening antitrust laws to allow for a development slowdown, something totally not necessary, Lina Khan, former FTC chair, has argued that these companies may already be pursuing unfair methods of competition. Last week, Khan released a statement arguing that we already have the authority to charge companies and their CEOs for, quote, creating and releasing dangerous, unvetted, or defective products. We shouldn't let discussions about new legal regimes distract from

Speaker 1the fact that there's no AI exemption from laws already on the books. Kahn argued that releasing unvetted AI models or agents could violate consumer protection laws. Quote, shipping flawed AI tools without implementing adequate measures to detect and stop rogue or defective AI agents can be an unfair or deceptive act or practice under the FTC Act and analogous state laws. And some state AGs are already exploring holding AI firms and their CEOs criminally liable when their models

Speaker 1participate in criminal activity. Kahn also wrote, quote, existing laws also prohibit unfair methods of competition. This covers instances where AI firms appropriate the competitively sensitive information of their customers, including through tracking their use of various tools. It can also cover instances where firms pursue dangerous behavior, aware that doing so may compel rivals to do the same. As

Speaker 1the Supreme Court has noted, Con adds, The highly concentrated and interconnected structure of these markets could be creating major

Speaker 1risks and conflicts of interest. We can and must pursue any new efforts alongside enforcing existing laws, unquote. These frontier models aren't just strategies. theoretically capable of causing harm in the future. They are causing harm right now. At this point,

Speaker 1there are undeniable concerns regarding the development and rollout of frontier AI models, from cybersecurity to military applications, surveillance, and the effects on the labor market. These are real, current, pressing concerns beyond the prospect of an AI supergod or self-evolving superintelligence. And just because these companies recognize risk doesn't mean they will do anything about it. These companies know how LLMs are affecting the mental health of children, but

Speaker 1they're not really doing anything about it, and they won't unless the government forces them to. Historical Luddites did not deny the transformative potential of automated machinery, but organized around the threat it posed to workers. Similarly, Just denying the state of advanced frontier models leaves us under-equipped to meet this moment and treat this problem with the seriousness it deserves. Part of this AI denialism so common on the left

Speaker 1comes from a very outdated understanding of AI's capabilities, accuracy, and functionality. Because of the moral and cultural dogma against using AI, the last time a lot of AI-skeptic people interacted with technology like ChatGPT was three years ago. And these days, the only quote-unquote AI that most anti-AI people regularly interact with is the Google AI summary, which is

Speaker 1a totally different product than the frontier models being developed and talked about in the news. Some of the anti-AI left promote the idea that treating AI as a serious problem only works in the financial interests of these companies. even if taking this issue seriously means ripping power away from these companies and their CEOs. To quote an article on the AI arms race in Geese magazine, while the

Speaker 1AI sector is undeniably frothy with fanciful projections, AI denialism would have you believe that AI is neither a capable nor dangerous technology, but solely a marketing scheme of vast proportions. That any warnings of AI triggering fraud massive job loss through automation or catastrophic risk through loss of control, only serve to pump valuations. Ignore that as public pressure increases, Sam Altman now downplays fears of job losses. Quite the

Speaker 1turn from three years ago when he was saying that jobs are definitely going to go away full stop. While there is no reason to take Silicon Valley at its word, not rigorously engaging with the dangers of developing AI capabilities is a strategic dead end, unquote. This technology can and is massively transforming production, warfare, the environment, and the health of humanity. And we can't all just hold hands and

Speaker 1not believe in this technology hard enough to make it go away. Like it or not, this is not the metaverse or NFTs anymore. Whether you believe these existential safety risks are genuine, a marketing stunt, or a mix of both, our response should be the same. We should be pushing for legislation to rein in these companies and technology. And like Lina Khan has said, the CEOs should be prosecuted for creating and releasing dangerous, unvetted, or defective products. Now,

Speaker 1Trump's DOJ doesn't seem keen on going after these companies right now, and it's unlikely that this Congress will pass any legislation on this issue, let alone industry-hostile legislation. But during this national conversation on AI regulation, it's crucial that the narrative around regulation isn't being controlled by OpenAI and Anthropic. These companies and technology must be regulated, but that regulation doesn't should not be up to the CEOs of those companies,

Speaker 1nor the Republicans and center-left Democrats who are in the pocket of AI. But our response to bad regulation shouldn't be no regulation. Coming off the heels of the data center backlash and going into the midterms, this moment could be a major opportunity for the left to build broad support for real transparent oversight, a frontier development pause, not just a slowdown, and ultimately taking power away from these tech companies and putting control of AI in the hands

Speaker 1of the public. Because private control of such transformative technology will have disastrous outcomes for labor and humanity without the prospect of an AI super god. Incoming DSA House Representative Malat Kiros of Colorado had democratizing AI in her congressional campaign platform. Quote, the development of transformative technology cannot be left to the market and the national security state alone.

Speaker 1It belongs to all of us, unquote. Earlier this summer, Bernie Sanders introduced a bill to create an AI sovereign wealth fund, giving the public 50% ownership in the largest AI companies in the US through a one-time 50% tax on the stock of these companies. An independent commission would then use voting shares, to steer decisions in the public interest. Sanders said of the bill, quote, AI was not created out of thin air. It was not a brilliant idea

Speaker 1that just popped into Mark Zuckerberg's head or Elon Musk's imagination. The foundation of AI is based on the collective knowledge of humanity and of the creative work of tens of millions of people. The American people must have the ability to slow it down and make sure that AI benefits humanity, not just the richest people on the planet. That's precisely what this legislation does. Now, such a bill would certainly have a difficult path to being signed into law, especially

Speaker 1considering how many lawmakers are being bankrolled by these AI companies. But this idea already has majoritarian support. According to a national Verisight survey last June, 69% of Americans support quote-unquote forcing AI companies to to transfer 50% of their stock into a public sovereign wealth fund. To quote Geese Magazine, there is a wide debate to be had about the shape of socialization and whether we mean forcing AI research

Speaker 1into the public domain or outright nationalizing the entire sector. But it is clear that the overwhelming majority of the American people recognize that a technology trained on the common corpus of human art and text, poised to transform the character of work, ought to be held in common rather than by billionaires, unquote. The New York City DSA convention is coming up this fall, and currently one of the most popular resolutions is to stop the AI arms race

Speaker 1and have DSA, quote, take initiative against the AI company's project to make human labor obsolete and organize a working-class coalition for the democratic steering and ownership of the technology, according to an overview in Geese magazine. This resolution calls for DSA to demand and organize for a pause on frontier AI research, an AI data center moratorium, regulations on frontier AI models, and policies to ensure workers are protected.

Speaker 1To quote the Geese Magazine overview, our horizon must be the collective control of AI, with its gains shared by all. With AI under democratic control, we will decide what activities ought to be left to human hands, exalted creative tasks that make life meaningful, and which can be automated to expand flourishing and freedom. DSA members may have quite different views on where those lines lie. with some wishing to ban the technology entirely. Regardless, the point is that those

Speaker 1conversations will be ours, not Sam Altman's, not Dario Amadei's, not Elon Musk's. This is a once-in-a-century political opportunity. We have the chance to utilize one of the great issues of the day to mobilize workers around the democratic control of the economy, to drive a wedge into the Republican Party's coalition and the democratic base. and to reorient politics around a question on which our answers are unfathomably popular. We could be at the forefront of the movement rather

Speaker 1than tail-ending a disparate set of professionalized non-profits. Unquote. This issue will be getting a lot of attention these next few months. AI CEOs will be meeting at the White House with President Xi later this week. The New York City Council will is convening a hearing on AI safety risks next month, with Dario Amadei and Sam Altman requested to appear. If we don't want them to be the ones leading the conversation on AI regulation, which would only

Speaker 1result in an industry-friendly regulatory slowdown to curb competition and stabilize market pressure, then the left will have to step up and build on the data center backlash to seize the very technology data centers are powering to destroy these companies and put the future of AI in the control of the public. Thanks for listening.

Open the transcript file

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. CZM Book Club: "Organizing Social Spaces as if Social Relations Matter," by Cindy Barukh Milstein (Part Three of Three)

    Nov 22, 202636 minAudio

    Margaret finishes reading you some non-fiction with advice for organizers

    Credit the people on this episode

  2. It Could Happen Here Weekly 259

    Nov 21, 20263 hr 56 minAudio

    All of this week's episodes of It Could Happen Here put together in one large file: The Myth of Red Texas with David Griscom Biden and the War on Gaza Organizing Agricultural Workers Repression in Iran Executive...

    Credit the people on this episode

  3. Executive Disorder: Everything Breaks, Rohingya Genocide, Mamdani Disbands SRG

    Nov 20, 20261 hr 15 minAudio

    The gang chats about all the many tech outages this week, the ICJ finding Myanmar guilty of genocide against Rohingya, corporate executives pocketing tariff refund money, protests in Bangladesh over working conditions,...

    Credit the people on this episode

  4. Repression in Iran

    Nov 19, 202642 minAudio

    James is joined by Gordayeen to talk about the Iranian state’s repressive tactics and the failure of the USA and ISrael to diminish the capacity for state violence Sources: https://hengaw.org/ https://www.theamargi.com/

    Credit the people on this episode

  5. Organizing Agricultural Workers

    Nov 18, 202644 minAudio

    Mia talks with Lindsey and Brady of the IWW about what we can learn about organizing agricultural workers from efforts abroad and organizing outside of the National Labor Relations Act

    Credit the people on this episode