Former employees of Anthropic, OpenAI and Google DeepMind told New York City lawmakers that frontier AI development lacks sufficient oversight and transparency. Current OpenAI and Meta representatives emphasized safety work and potential benefits, but did not provide a numerical estimate of catastrophic risk, according to Associated Press reporting.
At the City Council’s October 5, 2026, Committee of the Whole hearing, the central question was how the public should evaluate safety assurances when much of the evidence remains inside the companies building the systems.
The hearing brought major AI labs and former insiders onto the same public record under oath. It offered an opportunity to examine whether voluntary assurances should be backed by disclosure requirements, outside validation and legal protections for people reporting safety concerns. It did not establish that catastrophe is inevitable or that a particular product had failed.
Former Insiders Warned About Oversight, Not Just Capability
AP reported that former employees from OpenAI, Anthropic and Google DeepMind warned lawmakers about inadequate oversight and transparency in frontier AI development. Their concern was institutional as well as technical: who can inspect the evidence, challenge a safety assessment and act when they believe safeguards are insufficient?
Before the hearing, the Council’s September 16 announcement cited departing Anthropic researcher Jacob Coxon’s warning that the technology “could kill us all by the end of the decade” without additional safeguards.
That was a former researcher’s forecast, quoted by the Council as part of its rationale for convening the hearing, not an established scientific prediction. The announcement also does not establish that Coxon repeated those exact words during testimony.
Former employment gives a witness relevant experience, but does not automatically validate every conclusion about future systems. Predictions about loss of control or extinction remain risk judgments whose evidentiary weight depends on the observations, assumptions and reasoning supporting them.
For lawmakers, the more actionable issue was whether outsiders have enough information to assess those judgments. A transparency requirement can be evaluated without first agreeing on a probability of extinction.
OpenAI and Meta Emphasized Safety and Benefits
OpenAI and Meta representatives highlighted their safety efforts and AI’s potential social benefits, AP reported. These were company positions, not independent verification that their safeguards are sufficient.
The representatives did not give lawmakers a numerical estimate of catastrophic risk. That omission establishes neither that the systems are safe nor that a catastrophe is likely. Even a single number would be difficult to interpret without a defined outcome, time horizon and methodology.
Lawmakers can ask more concrete oversight questions: which risks were evaluated, what the tests found, what would trigger a deployment restriction, and who can independently examine those decisions. A company’s confidence in its safety work is different evidence from an external assessment of that work.
Testifying under oath added accountability to the exchanges, though it did not turn them into a technical audit. The hearing created a public record against which subsequent statements and disclosures could be compared.
The Council’s September 28 attendance announcement identified Anthropic, OpenAI, Google and Meta as participating companies. It said that, apart from Meta, they confirmed attendance after the Council explicitly threatened subpoenas.
Although the Council initially requested participation from chief executives, those requests are not proof that every named CEO personally appeared. The reporting cited here describes company representatives.
NYC’s Proposals Would Turn Assurances Into Obligations
The Council’s September 25 legislative package outlined several possible routes to enforceable accountability. These remained proposals under consideration; holding the hearing did not create the obligations.
Their scopes differ substantially. Some would reach AI businesses operating in the city; others concern city contracts, municipal workers or government infrastructure. Describing them as a single AI regulation would obscure who must comply and what each measure would require.
Third-Party Validation Before Sale or Deployment
Introduction 2602 would make it unlawful for a business to market, offer for sale or deploy an AI system in New York City without third-party validation.
According to the Council’s summary, validators would examine data quality, bias, decision outputs, privacy and security, along with additional validation requirements set by the city’s Cyber Command. They would also have to disclose relevant conflicts of interest.
The proposal would require a human override, described as a “kill switch,” and require validators to verify that it exists. Businesses and validators could face a $25,000 penalty for each instance of marketing, selling or deploying a system without validation, or where validation was falsified.
This is the package’s clearest move toward external scrutiny. The announcement, however, does not provide a complete audit methodology or establish that every validation would include frontier-model catastrophic-risk testing.
A privacy review, a bias assessment and an evaluation of autonomous cyber capabilities answer different questions. Confirming that an override exists is also narrower than demonstrating that people could reliably stop every harmful activity in a complex deployment. The eventual standards would determine how much assurance validation actually provides.
Disclosure and Rapid Incident Reporting
Introduction 2603 would require certain disclosures about AI tools and prohibit false or misleading representations about their safety. The Council’s announcement does not specify the full disclosure scope, so it should not be described as requiring publication of every internal evaluation, training dataset or safety incident.
Introduction 2601 is more specific, but narrower. It would require Cyber Command to establish standards and procedures for identifying AI safety incidents related to covered city contracts.
If a contractor or the contracting agency became aware of such an incident during the contract term, it would have to notify Cyber Command in writing within 24 hours. Cyber Command would then have to publicly disclose the occurrence of a reported incident within 24 hours.
This would create an incident-reporting channel with deadlines. Based on the Council’s summary, it would not impose the same reporting requirement on every incident at every AI lab. A city-contract reporting rule could provide useful public evidence about government deployments without becoming a general disclosure regime for the entire AI industry.
Whistleblower Protections and Financial Incentives
Two proposals address the people who might bring otherwise inaccessible information to authorities.
Introduction 2604 would clarify that the city’s whistleblower protections cover New York City employees and covered city contractors and subcontractors who report AI-related conduct they know, or reasonably believe, presents a public safety threat. That scope does not support a claim that the bill protects every private-sector employee at Anthropic, OpenAI, Google or Meta.
Introduction 2605 would allow individual whistleblowers to receive a portion of fines or penalties recovered from AI companies that violate applicable laws.
Frequently Asked Questions
3 questions
1Are NYC’s proposed AI safeguards already law?
No. The Council’s September 25 announcement described proposed bills covering validation, disclosures, incident reporting, whistleblower measures and civil liability. Holding the October 5 hearing did not itself make those obligations enforceable against Anthropic, OpenAI, Meta or other AI businesses.