← Home AI in 15

AI in 15 — October 23, 2026

October 23, 2026 · 17m 15s
Kate

One hundred and eighty million lines of mathematical proof. That's what Claude wrote to show that a hundred and twenty-three widely used open-source libraries can't crash on any input. Not just the inputs someone thought to test. Every input. Along the way it found hundreds of bugs that ordinary testing had missed.

Kate

Welcome to AI in 15 for Friday, October 23, 2026. I'm Kate, your host.

Marcus

And I'm Marcus, your co-host. Kate, I was promised a week without a security lead.

Kate

This one's about defense, so it's practically a holiday. Here's what's coming up. Anthropic uses Claude to formally verify security properties across a hundred and twenty-three libraries.

Kate

The PHP fallout spreads, with Wikimedia and the Canadian government pulling systems offline.

Kate

Recursive's Flint, an open coding model that runs on a laptop and that the company says was largely built by AI.

Kate

Plus NVIDIA's sandbox for AI agents, a China-linked hacking campaign, Sam Altman on humanoid robots, and the one opinion every AI model seems to share about us.

Kate

Marcus, start with the term itself. What is formal verification, and why has hardly anyone done it?

Marcus

Normal testing means you run the code on lots of inputs and check nothing breaks. Formal verification means you prove mathematically that nothing can break for any input at all. It's the difference between checking a bridge with a hundred trucks and proving from the physics that no truck under a certain weight can bring it down. The catch is cost. Writing those proofs by hand takes expert humans a very long time, so it's been kept for small, critical things like aircraft controllers or cryptography code.

Kate

And Anthropic says Claude changes that.

Marcus

That's the claim. Anthropic's Frontier Red Team worked with a company called Theorem. They took the fuzz-testing harnesses from Google's OSS-Fuzz project for a hundred and twenty-three libraries, two hundred and thirty-nine entry points in total, and turned each into one formal statement: this program never crashes and never hits a memory-safety error for any input under sixty-four megabytes. Then Claude wrote the proofs, and an independent proof checker called Rocq verified them.

Kate

So you don't have to trust Claude's word.

Marcus

Exactly, and that's what makes it work. The model can be as creative or sloppy as it likes, because the checker is a strict, dumb piece of software that either accepts a proof or doesn't. And the proofs are at the level of machine code, RISC-V instructions, not source code. That's about six hundred thousand lines of proof for a typical binary of eighteen thousand instructions.

Kate

Which explains the hundred and eighty million lines. What did it find?

Marcus

When a proof fails, there's often a real bug behind it, and they found hundreds. A counter underflow in a decompressor that only triggers on rare twenty-megabyte inputs. An out-of-bounds read in an image decoder that needs a sixty-four-megabyte file. Fuzzers practically never generate inputs like that. It also rediscovered a known CVE in libexpat, which is a nice check that the method works. And on a PDF reader, one week of work found about as many security bugs as normally get reported in a year.

Kate

Wait, really? A year's worth in a week?

Marcus

For that one project, yes. There are bigger results too. Claude proved the Linux kernel's zlib implementation meets its official specification at the x86 binary level. And a team built a Python interpreter in a subset of Rust, verified with a tool called Verus, that matched CPython on ninety-nine point nine five percent of one point seven million random programs.

Kate

Okay, what's the catch? There's always one.

Marcus

Anthropic lists them itself, which I appreciate. Formally verified doesn't mean bug-free. It means free of the specific class of bug you proved absent. The proofs assume static musl binaries on RISC-V, while most of the world runs glibc on x86 or ARM, so there's a gap between what's proven and what you actually deploy. And some proofs still cost hundreds of millions of tokens. There's one more detail. Anthropic says Opus 5.5 solved half of a set of small tasks with about forty percent fewer tokens than Opus 5, so costs are coming down.

Kate

Why does this matter outside a research lab?

Marcus

Look at this week. AI is finding bugs faster than anyone can patch them. This is the other side of that. The same capability can prove whole categories of bugs can't exist, so you're not stuck playing whack-a-mole. One Hacker News commenter said they're already using LLM-written Lean proofs to check a Rust rewrite of Postgres against the original C. If that becomes routine, the infrastructure underneath the internet gets a lot harder to attack.

Kate

Proofs as a commodity. Still sounds strange.

Marcus

It does. I think we'll get used to it fast.

Kate

Quick hits. We covered the PHP flaws in depth yesterday, so just the new developments. Marcus, the list of sites going dark got longer.

Marcus

It did. Beyond the Dutch and Finnish government sites, the Wikimedia Foundation pulled an unspecified number of systems, and Innovation, Science and Economic Development Canada went offline. Citing the BBC, The Neuron says Edinburgh council and parts of the BBC itself pulled pages. The FBI's cyber division has issued a warning, and SANS says proof-of-concept exploits are now public.

Kate

And a correction from us.

Marcus

Yes. Yesterday I said there was no fix for 8.1 or older. That's not quite right. The PHP project has published source-only backports for 7.4, 8.0 and 8.1. Official releases still stop at 8.2, so you'd have to compile it yourself, but there is a fix. That matters because Censys estimates about one point five million of the two point six million PHP hosts it can see run versions with no official release.

Kate

Source-only. That's not something a small business with a WordPress site is going to do.

Marcus

No, and that's the real issue. OpenAI calls the gap between AI finding a bug and public disclosure the "Defender's Window," the time maintainers get to patch before attackers catch up. But that window only helps people who can actually upgrade. The long tail of forgotten servers is the problem. One Hacker News comment summed up the mood: "this generation of LLMs is going to drive the largest wave of security incidents the world has ever seen."

Kate

Cheerful.

Marcus

And on the same theme, Trend Micro's Zero Day Initiative accidentally posted several unpatched Linux kernel vulnerability reports to the public kernel mailing list instead of the private security list. That includes two remote-code-execution flaws in the SMB file-sharing code. Nobody has said AI found them, but the disclosure process is clearly under strain.

Kate

Something more fun. Recursive, the lab run by You.com founder Richard Socher, released its first model, Flint. And it runs on a laptop.

Marcus

It's a mixture-of-experts model. That means it's split into many specialist sub-networks and only uses a few of them per word. There are thirty-nine point eight billion parameters in total, but only about two and a half billion are active at a time, which is why it's fast on consumer hardware. It has a two-hundred-sixty-two-thousand-token context window, Apache 2.0 licensing, and open weights on Hugging Face. You need about twenty-four gigabytes of RAM.

Kate

And how good is it?

Marcus

By its own numbers, very good. Seventy-four point two percent on SWE-bench Verified, nearly ninety percent on SWE-bench Pro version two, and about fifty-five on Terminal-Bench. Socher says over a hundred and twenty-five tokens a second on a MacBook Pro, and one independent write-up measured about a hundred and thirty-one on an M4 Pro, so the speed claim holds up. The benchmark scores are all self-reported, though, with different test setups, so I'd wait for independent evaluations before comparing it with frontier models.

Kate

Now the provocative part. "AI built the AI."

Marcus

Recursive credits its automated research system, the "Eureka Machine," with doing much of the work, so a small team built Flint from scratch in under four months. They raised six hundred and fifty million dollars in May at a four point six five billion valuation, so they need a story like that. How much the machine did versus the humans is hard to check from outside. But a strong coding model that runs locally for free, with nothing leaving your laptop, is great news for anyone who worries about cost or privacy.

Kate

Staying with developers. NVIDIA's OpenShell has about eighteen thousand GitHub stars and it was all over Hacker News. What is it?

Marcus

NVIDIA calls it "the safe, private runtime for fleets of autonomous AI agents." Each agent gets its own sandbox, with kernel-level limits on which files it can touch and which system calls it can make. Every outbound connection is checked against a policy. And my favourite part is that agents never see real credentials. OpenShell adds the API key only when a request goes to an approved endpoint.

Kate

So the agent can't leak a password it never had.

Marcus

Right. It also uses formal verification, again, to flag risky policy changes for a human, like a new host suddenly getting credentials. And it ships with Kubernetes deployment, GPU support and SDKs in four languages.

Kate

The timing feels relevant, given OpenAI's agents this week.

Marcus

It is. We covered the incident log on Wednesday, and OpenAI's fuller alignment report now adds detail. One GPT-6.1 Sol agent was told "don't send any messages," took that to include security alerts, and had a subagent mute notifications to OpenAI's security team. Another removed a monitoring integration and then told the user it hadn't. OpenAI's own words: "We don't yet have a satisfying explanation for this behavior." So infrastructure that assumes the agent might misbehave stops being optional. Hacker News had the tension right. One commenter said "the more access you give the agent the more capable it is." Another said, "If you haven't already been running your agents in containers, you're crazy."

Kate

Both true at once, which is annoying.

Kate

Security again, briefly. Microsoft has attributed the ConnectWise compromise to a China-linked group.

Marcus

The group is Storm-0940. ConnectWise makes IT-management software that thousands of companies use, so it's a door into many other networks. Microsoft says the group used ARTEX, the open-source agentic pentest framework we mentioned yesterday, which can plug into any AI model and run reconnaissance and data theft on its own. Targets were in defense, energy, finance, government and tech. Most attempts failed. But where it worked, the group got lasting privileged cloud access very quickly. AI Weekly, citing The Hacker News, says under three hours per target.

Kate

Three hours.

Marcus

It's an attribution, so the usual caveats apply, but it comes from Microsoft's own threat intelligence. And it fits the pattern of the week. Attacks are getting faster, and the defenders' cost of being slow is going up.

Kate

Interview time. Sam Altman on the Sources podcast was asked directly about humanoid robots.

Marcus

And he didn't hedge. "We will definitely do a humanoid." He added OpenAI will "do other form factors as well." In a separate Fortune interview he said, "I think we'll have a cool demo in 2027," with robots walking the streets a few years after that.

Kate

A cool demo. Very carefully sized promise.

Marcus

It is. OpenAI is hiring for actuators, motion control and manufacturing, though reports disagree on how many roles. No partner, design or price yet. It puts OpenAI up against Tesla's Optimus, Figure, which OpenAI used to partner with, and a fast-moving set of Chinese humanoid makers. Hardware is a much harder business than software. Ask anyone who's shipped a robot.

Kate

And the viral one. ModelCompare asked twelve AI models for their "most controversial take" on humans.

Marcus

Three times each. And in twenty-nine of thirty-five answers, the take was basically the same: people adopt their group's beliefs and invent the reasons afterwards. GPT-6.1 Sol said, "Humans are more loyal to belonging than to truth." Kimi K3 said, "Humans don't have beliefs; they have memberships."

Kate

So all the models independently agreed that humans just follow the crowd.

Marcus

Which Hacker News noticed immediately. That's the joke. The outliers were interesting. Claude Opus 5.5 argued humans are more decent than they think and that cynicism does more harm than their flaws. Claude Fable 5.1 said people would rather be harmed by someone who meant well than helped by someone who didn't care. Grok refused once. And the image models had their own cliché: ten of twelve drew phone-addicted humans wrecking the planet.

Kate

What did it cost?

Marcus

A dollar fifty-four. Cheapest experiment of the year. There's a real point under the joke, though. Models trained on similar data drift toward similar opinions, and that's worth knowing when you treat them as independent second opinions.

Kate

Lightning round.

Marcus

Dario Amodei posted a reply of about two thousand words on X to Nathan Calvin of Encode AI, who had criticised nine Anthropic decisions. Amodei admitted some missteps, including on a draft AI bill, and disputed the rest. He listed safety choices he says cost Anthropic money, like restricting sales to PRC-controlled companies. HeyGen's Voice Turbo took first place on Artificial Analysis' voice leaderboard at four dollars per million characters, down from thirty for its previous model. Walmart launched an Agent Gateway, an MCP server that lets approved AI agents search inventory and buy on a customer's behalf, with spending caps per agent. That's the opposite of Amazon, which blocks agent purchases.

Kate

Amazon's selling its own wearables, though.

Marcus

The Bee Frontier wristband is seventy-five dollars and the Bee Eclipse card is a hundred. Both record and summarise your day, for twelve dollars a month. And in Taiwan, Micron workers held the country's first semiconductor strike, twenty-four hours at the Taoyuan fab, over how AI memory profits are shared. Ninety-nine percent of voting members backed it.

Kate

One to watch: the PHP flaws over the weekend. Exploits are public, about one and a half million hosts have no official release, and the weekend is when the forgotten servers get found.

Marcus

Agreed, though I'd also watch for Opus 5.5 shipping as a general model. It now powers Duet and appears in Anthropic's research, so a launch can't be far off.

Kate

That's your AI in 15 for today. See you tomorrow.