<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Noah Mitchem · Field notes</title>
    <link>https://noahmitchem.com/notes/</link>
    <description>Noah Mitchem, applied-AI engineer. I build it, and I sell it. Career story, working artifacts, field notes, and a game called The Night Desk.</description>
    <language>en</language>
    <managingEditor>noah@noahmitchem.com (Noah Mitchem)</managingEditor>
    <atom:link href="https://noahmitchem.com/feed.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Nobody Built a Software Factory. They Bolted Agents to the Old Assembly Line.</title>
      <link>https://noahmitchem.com/notes/nobody-built-a-software-factory</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/nobody-built-a-software-factory</guid>
      <pubDate>Sat, 01 Aug 2026 00:00:00 GMT</pubDate>
      <description>On August 27, Uber reported that more than 70% of its pull requests now come from agents.</description>
      <content:encoded><![CDATA[<p>On August 27, Uber reported that <a href="https://www.uber.com/us/en/blog/efficient-software-factory/"><strong>more than 70% of its pull requests</strong></a> now come from agents. Posts like that one, &quot;Running a Software Factory Efficiently at Uber Scale,&quot; land every few days now. &quot;Software factory&quot; is the phrase of the summer: Warp <a href="https://www.warp.dev/blog/open-infrastructure-for-building-a-software-factory">launched one on August 18</a>, Factory <a href="https://factory.ai/articles/what-is-a-software-factory-architecture">is named after one</a>, 8090 <a href="https://www.8090.ai/blog/what-is-a-software-factory-">sells one</a>, and that&#39;s a partial list.</p>
<p>I spent August reading every first-party account I could find, at least 21 programs from Stripe to Meta to Ramp, looking for the factory. Not one of them built one. Every &quot;factory&quot; in the sample is the same thing: agents, running in parallel, on the process the company already had.</p>
<p>The last time a new kind of power showed up at a factory, everyone bought in immediately, bolted it onto what they already had, and waited thirty years for the payoff. It&#39;s happening again in 2026, and the tell is the pull request.</p>
<h2>Everyone Bought the Motor. Ford Rebuilt the Floor.</h2>
<p>Electricity supplied <a href="https://americanhistory.si.edu/explore/exhibitions/american-enterprise/online/corporate-era/generating-change"><strong>under 5% of factory horsepower</strong> in 1899, <strong>50% by 1919, 75% by 1929</strong></a>. For most of those thirty years, what a factory did with it was swap the steam engine for one big electric motor and keep everything else: the overhead line shafts, the belts, the machines clustered around the power source, etc. Ford rebuilt the floor instead. Between 1913 and 1914 he moved the work past the workers instead of the workers past the work, and chassis assembly fell from <a href="https://www.gutenberg.org/ebooks/7213"><strong>12 hours 28 minutes to 1 hour 33 minutes</strong></a>, by his own account. That&#39;s 8x, and it wasn&#39;t the motor that did it.</p>
<p>Someone rebuilt the floor this year, just not for code. Alejandro Maza Ayala, Chief Product and AI Officer of Kavak, the Latin American used-car marketplace, <a href="https://podcasts.apple.com/us/podcast/the-self-improving-company-kavaks-ai-playbook/id842818711?i=1000781948871">told a16z on August 10</a> that handing employees ChatGPT or Claude produces &quot;no efficiencies,&quot; so Kavak did the other thing: &quot;redesign your whole company around the agents,&quot; starting with &quot;rebuilding most of your APIs&quot; so agents could use them. Kavak now spends as much engineering effort on evals as on the agents, and the agents handle <strong>96% of customer interactions</strong> and <strong>95% of transactions</strong>. He says they convert 2.1x better than the human sales team did. In December, with tens of thousands of agents already running the business, Kavak tore the working architecture down and started over.</p>
<p>Now read what &quot;software factory&quot; means in 2026, in the words of the people selling one. Zach Lloyd, Warp&#39;s CEO, <a href="https://www.warp.dev/blog/open-infrastructure-for-building-a-software-factory">launched Warp Factories on August 18</a> with this: &quot;a cloud software factory is an automation loop around the SDLC, where cloud agents triage, spec, implement, review, verify and monitor work. Humans stay in the loop at key decision points.&quot; Factory, the company, <a href="https://factory.ai/articles/what-is-a-software-factory-architecture">describes its product</a> as something that &quot;runs delivery inside existing pipelines through ready-to-use GitHub Actions and service accounts.&quot; Kyle Daigle, GitHub&#39;s COO, introducing the surface that five frontier labs&#39; agents now route through, <a href="https://github.blog/news-insights/company-news/welcome-home-agents/">made it a promise</a>:</p>
<blockquote>
<p>&quot;You&#39;re still working with the primitives you know—Git, pull requests, issues—and using your preferred compute, whether that&#39;s GitHub Actions or self-hosted runners.&quot; — Kyle Daigle, COO, GitHub</p>
</blockquote>
<p>Around the SDLC, inside existing pipelines, still the primitives you know. That&#39;s exactly the motor, bolted onto the shafts that were laid out for people.</p>
<h2>Every Factory Ends at the Same Door</h2>
<p>The operators are the ones to watch, because they&#39;re the only parties who could have rebuilt their own floor and chose not to.</p>
<p><strong>Stripe</strong> shifted the programmer to the approve button. By February, <a href="https://stripe.dev/blog/minions-stripes-one-shot-end-to-end-coding-agents-part-2"><strong>over 1,300 pull requests a week</strong></a> were, in Stripe&#39;s words, &quot;completely minion-produced, human-reviewed, but containing no human-written code.&quot; I take that as a design decision. Nobody&#39;s writing, but everyone still signing off.</p>
<p><strong>Anthropic</strong> keeps the same gate. Jason Clinton, Anthropic&#39;s Deputy CISO, <a href="https://claude.com/blog/how-anthropic-secures-its-ai-native-software-development-lifecycle">described the company&#39;s own pipeline in July</a>: &quot;More than half of all code is being merged by our internal version of Claude Tag while human engineers focus on directing, setting intent, and owning final approval.&quot; Humans are still the gatekeepers for half of the merged code.</p>
<p><strong>Warp</strong>, whose product is the factory, grades its own by human touchpoints. Its core factory metric, <a href="https://www.warp.dev/blog/agent-self-improving-software-factories">per its August 27 post</a>, is &quot;average human touchpoints per PR.&quot; It <a href="https://www.warp.dev/blog/open-infrastructure-for-building-a-software-factory">automates about 30% of its own tasks</a>, and its self-improvement loop ends where everyone&#39;s does: &quot;Humans review those suggestions as PRs on the factory definition and merge improvements.&quot;</p>
<p>Every operator and vendor in the sample, 18 programs, delivers agent work as a pull request for a person to read. Uber&#39;s 70% ships, in Uber&#39;s words, &quot;with human reviews/escalations.&quot; Ramp&#39;s engineers <a href="https://engineering.ramp.com/post/why-we-built-our-background-agent">said why</a> when they refused to give their agent a shared service account: &quot;You do not want to knowingly create a vector for unreviewed code to go into the codebase.&quot;</p>
<p>And to be clear: this works. PostHog went from <a href="https://posthog.com/blog/10k-prs-a-month"><strong>1,441 merged PRs in January to 4,725 in June</strong></a> on roughly 10% more engineers, at a revert rate of <strong>0.2%</strong> across everything merged that month, whoever wrote it. That&#39;s agents on an ordinary web codebase, and that revert rate is the closest thing to an escaped-defect number anyone in the sample publishes. Bolting the motor to the shafts got real output in 1899, and it&#39;s getting real output now.</p>
<p>It&#39;s also the ceiling. There&#39;s a reason none of these companies took the person off the door, and it isn&#39;t caution.</p>
<h2>The Self-Graded Test</h2>
<p>Maisem Ali at exe.dev <a href="https://blog.exe.dev/engineering-with-ai">named the problem on August 27</a>:</p>
<blockquote>
<p>&quot;But the agent was still grading its own work. If it misunderstood what I wanted, it could build the wrong thing, write tests for the wrong thing, and then confidently tell me that everything passed.&quot; — Maisem Ali, exe.dev</p>
</blockquote>
<p>The agent that writes the code also writes the test that says the code works. Will Wilson, CEO of Antithesis, told Ron Minsky of Jane Street <a href="https://signalsandthreads.com/why-testing-is-hard-and-how-to-fix-it/">on Signals and Threads in March</a> what happens when the task gets hard enough: &quot;eventually it deletes the tests or eventually it makes the test pass in some trivial way.&quot; Minsky: &quot;I do think this is getting a little better, but the phenomenon is still very strong.&quot;</p>
<p>The industry&#39;s fix is a second model that checks the first. Shopify <a href="https://shopify.engineering/building-an-agentic-harness-that-outlasts-the-model">ran that experiment</a> and wrote it up on July 29: in one audit a model flagged 30+ security holes, and after verification every one was downgraded, dismissed, or reclassified. Zack Deveau, who built the harness, put the cost plainly: &quot;noise sent to a developer is worse than no finding at all.&quot; A model judging another model just scales the noise, and not the ground truth.</p>
<p>In July, Anthropic made Claude go back through its own outages and asked it how many outage-related bugs its automated checks would now catch. The answer was about a third, the other two-thirds still would have shipped. That&#39;s the best-funded verification program in the industry grading itself, and it&#39;s the reason the person is still on the door: nothing behind them can be trusted to say no.</p>
<h2>The Number the Agent Can&#39;t Edit</h2>
<p>There&#39;s one kind of place in the sample where the human is already gone, and where it is tells you everything.</p>
<p>Meta&#39;s KernelEvolve <a href="https://engineering.fb.com/2026/04/02/developer-tools/kernelevolve-how-metas-ranking-engineer-agent-optimizes-ai-infrastructure/">writes GPU kernels</a>, and its gate isn&#39;t a human reviewer:</p>
<blockquote>
<p>&quot;Every generated kernel passes through a rigorous validation pipeline that checks both correctness — bitwise accuracy against reference implementations — and performance.&quot; — Meta KernelEvolve team</p>
</blockquote>
<p>Bitwise. The output matches the reference or it doesn&#39;t, and the agent can read that verdict but can&#39;t edit it. On that footing the loop closes: agent runs post-train specialized models with measured kernel speed as the reward, and the system gets better with nobody in the loop.<span class="mnote" role="note">The outcomes: 100% on KernelBench's 250 problems, 160 ATen operators at 100% correctness across 480 configurations, more than 25% training throughput on MTIA, more than 60% inference throughput on Andromeda in production.</span> Baseten, a startup, <a href="https://www.baseten.co/blog/agentic-kernels-in-production/">published the same shape on August 28</a>: kernels &quot;identified, proposed, and implemented entirely by our agentic framework,&quot; kept only if they &quot;pass correctness and end-to-end performance checks,&quot; now in production with latency down <strong>42.3%</strong> on one image model. Nicholas Carlini, a researcher on Anthropic&#39;s Safeguards team, got the same result for the same reason when sixteen agents wrote <a href="https://www.anthropic.com/engineering/building-c-compiler">a C compiler with a <strong>99% pass rate</strong></a> on most compiler test suites: &quot;It&#39;s important that the task verifier is nearly perfect, otherwise Claude will solve the wrong problem.&quot;</p>
<p>Kavak&#39;s number is a conversion rate. Meta&#39;s is bitwise accuracy. Baseten&#39;s is latency. In every case the agent can read the score and can&#39;t touch it.</p>
<p>Now look at what the factories call &quot;self-improving.&quot; <a href="https://www.uber.com/us/en/blog/efficient-software-factory/">Uber&#39;s post</a> files its loop under future tense: &quot;We are working on an automated way to record papercuts from agent skill executions and auto-generate skill updates from the collected traces.&quot; Kiro&#39;s post titled Continuous Prompt Evaluation, <a href="https://kiro.dev/blog/continuous-prompt-evaluation/">August 21</a>, discloses its author in the body: &quot;This article focuses on evaluating human-authored system prompt and configuration changes.&quot; Warp&#39;s loop, above, ends at a human merging a PR.</p>
<p>The pattern is exact. Where correctness is a number, the loop closes and the human leaves. Where correctness is a review, the loop ends at a person. Self-improvement isn&#39;t a feature you add to a factory. It&#39;s what happens on its own when the machine can say no, and what never happens when it can&#39;t.</p>
<h2>The Floor Exists. Nobody Put Agents on It.</h2>
<p>So the move is obvious: make application code the kind of place where correctness is a number. Zero of 13 operators did it. Not one changed the language, the runtime, or the codebase the agents write into. Stripe&#39;s monorepo is heavily typed, and Stripe typed it years ago, by humans, for humans, and <a href="https://stripe.dev/blog/minions-stripes-one-shot-end-to-end-coding-agents">describes its homegrown libraries</a> as &quot;natively unfamiliar to LLMs.&quot; Meta, the largest operator in the sample, went the other direction. Mark Harman, a research scientist there, <a href="https://engineering.fb.com/2026/02/11/developer-tools/the-death-of-traditional-testing-agentic-development-jit-testing-revival/">argued in February</a> that agentic pace is &quot;scaling the cost of false positives and test maintenance to breaking point,&quot; and Meta&#39;s answer is tests that &quot;are generated on-the-fly for each code change and do not reside in the codebase.&quot; Fewer durable checks, not more.</p>
<p>TigerBeetle, a financial database that runs <a href="https://tigerbeetle.com/"><strong>2,000 years of simulated testing every 24 hours</strong></a> against its own code, is on the opposite end. Its style guide <a href="https://github.com/tigerbeetle/tigerbeetle/blob/main/docs/TIGER_STYLE.md">requires two assertions in every function</a>, and its simulator, <a href="https://tigerbeetle.com/blog/2026-08-20-protocol-aware-dst">extended again on August 20</a>, can replay any failure it finds on demand. It&#39;s the floor: the densest set of machine checks on any codebase in the sample, built for humans doing safety-critical work, years before agents.</p>
<p>And there&#39;s no agent layer on it. No <code>AGENTS.md</code>, no <code>CLAUDE.md</code>, no agent lane in CI. On August 26, one day before Uber&#39;s post, the maintainers closed an agent-assisted contributor&#39;s open pull requests with one sentence: &quot;<a href="https://github.com/tigerbeetle/tigerbeetle/pull/3887">we&#39;re not accepting agent driven contributions at the moment!</a>&quot;<span class="mnote" role="note">The account had opened 30 pull requests since July 20. Two merged, both changelog-link fixes. The refusal was posted on #3887 and #3919 seven seconds apart.</span> If any codebase on earth could let a machine decide whether an agent&#39;s change is safe, it&#39;s this one. 2,000 years of simulation a day is more scrutiny than any reviewer will ever give a diff. The maintainers didn&#39;t run the agent&#39;s code through it. A person said no, by hand, the same way the door works everywhere else.</p>
<p>That&#39;s the shape of 2026. The motor is at Uber, Stripe, and Anthropic, bolted to a floor laid out for people. The floor is at TigerBeetle, with no motor on it. Nobody has put them in the same building, and the building isn&#39;t a mystery: application code where a wrong change fails to compile instead of failing in review, one place to commit so the bug where the event fires without the row can&#39;t be written at all, and a core with no wall clock and no ambient randomness, so the whole application replays from a seed. On that floor an agent&#39;s change runs through thousands of simulated crashes before a person opens the diff, and the agent improves against a verdict it can&#39;t edit, the way Meta&#39;s kernels do. No engineer can hold that in their head, and that&#39;s the point: the machine holds it. Every stack you&#39;ve ever worked on was built to fit inside a human&#39;s head. A software factory can&#39;t be, or it isn&#39;t one.</p>
<p>Agents won&#39;t build that floor on their own. They&#39;re trained on the code humans wrote, and the code humans wrote is the bolt-on code: a service around a database, extensive tests beside the logic, a review at the end, etc. That&#39;s just how software has always been built. Left alone, an agent will rebuild that floor for you in whatever language you hand it. Getting the other kind takes a compiler and a simulator that refuse the usual shape, and someone who designed the floor that way before the first agent touched it. Different code needs a different floor, and the floor has to come first.</p>
<h2>Ask Which Number It&#39;s Allowed to Fail</h2>
<p>The only places anyone has built something recognizably AI-native are the places where correctness was already a number. Compilers. Kernels. Everywhere else, the factory is a very fast way to fill a review queue.</p>
<p>David Crawshaw, who co-founded Tailscale and now exe.dev, got closer than anyone. <a href="https://blog.exe.dev/replace-your-ci">His line from June</a>: &quot;With agents, CI is useless, the merge queue is vastly superior.&quot; His company merges without peer review and runs the whole test suite synchronously in the queue. And he did it by changing the order of the checks, not the code the checks run on.</p>
<p>Everyone has the motor. Nobody has rebuilt the floor.</p>
<p>Next time someone talks about their software factory, skip the throughput slide. Ask which number the agent is allowed to fail, and who owns it.</p>
]]></content:encoded>
    </item>
    <item>
      <title>Agent auth, twice</title>
      <link>https://noahmitchem.com/notes/agent-auth-twice</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/agent-auth-twice</guid>
      <pubDate>Wed, 01 Jul 2026 00:00:00 GMT</pubDate>
      <description>I built MCP servers with OAuth 2.1 at two companies before mid-2026. Notes from doing the same thing twice.</description>
      <content:encoded><![CDATA[<p>The first time, nobody asked for it. At Real Hire I was building a hiring
platform, and by 2025 agents were already making my own work faster. It
seemed obvious they&#39;d soon be users of every product I cared about, so I
decided ours should be ready before anyone thought to ask. I built an MCP
server so an agent could do real work with your account: pull your profile,
query open jobs against your strengths and preferences, check on your
applications. Then, because &quot;paste your API key into a config file&quot; is not
a door you offer real users, I put a proper OAuth 2.1 flow in front of it:
PKCE, scoped tokens, a consent screen that says in plain words what the
agent may touch. The consent copy said &quot;Claude wants to access your Profile
and Applications.&quot; Writing that sentence honestly is half the security
model.</p>
<p>The second time it was my day job. At Mesa, a San Francisco systems startup
rebuilding version control for AI agents, I owned a few surfaces: the
Python SDK, an AI code reviewer, my first real systems work inside a Rust
filesystem. The MCP server is the one that taught me the most. Twenty-two
tools, stateless, an OAuth 2.1 authorization server in front, cancellation
threaded end to end so an agent that gives up mid-request doesn&#39;t leave
work running behind it.</p>
<p>Here&#39;s what doing it twice taught me. The best test harness for an
agent-facing product is an agent. My loop was to point a coding agent at
the server cold. No docs, no system prompt, nothing but the tools. Then
watch. What does it reach for first? Where does it stall? Which tool does
it use in a way I never predicted, and which &quot;obviously useful&quot; tool does
it never touch? You can interview human users. Agents you can just run,
again and again, at almost no cost. It&#39;s the fastest product feedback I&#39;ve
ever had.</p>
<p>That loop forces a discipline: the instructions have to live inside the
tools. If the agent needed context I hadn&#39;t shipped in a tool name, a
description, or an error message, I treated that as a bug in the surface,
not a gap in the prompt. A human gets onboarding, tooltips, a support
channel. An agent gets your tool list, once. Either the product explains
itself at the boundary or it doesn&#39;t work.</p>
<p>Auth stops looking like plumbing, too. A human forgives a clunky login once
a month. An agent hits your authorization surface every session. For
agent-facing products, the door is the product. &quot;Connects instantly from
any client&quot; versus &quot;requires a support ticket&quot; is the difference between
being infrastructure and being a demo.</p>
<p>If you&#39;re adding agent access to your product this year: the specs are
good. Read them before the blog posts. Then hand what you built to an agent
with no extra context, and watch. It will tell you what your product
actually is faster than any user ever has.</p>
]]></content:encoded>
    </item>
    <item>
      <title>AI is about to get fast, and it’s never going to slow down</title>
      <link>https://noahmitchem.com/notes/ai-is-about-to-get-fast-and-it-s-never-going-to-slow-down</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/ai-is-about-to-get-fast-and-it-s-never-going-to-slow-down</guid>
      <pubDate>Mon, 01 Jun 2026 00:00:00 GMT</pubDate>
      <description>On June 9, Anthropic shipped Claude Fable 5, and every scoreboard agreed at once. #1 on Artificial Analysis.</description>
      <content:encoded><![CDATA[<p>On June 9, Anthropic shipped <a href="https://www.anthropic.com/news/claude-fable-5-mythos-5">Claude Fable 5</a>, and every scoreboard agreed at once. <a href="https://artificialanalysis.ai/articles/claude-fable-5-mythos-intelligence-index"><strong>#1 on Artificial Analysis</strong></a>. <strong>#1 on LMArena’s</strong> <a href="https://arena.ai/leaderboard"><strong>text, web-dev, and agent arenas</strong></a>. <a href="https://www.anthropic.com/news/claude-fable-5-mythos-5"><strong>First on SWE-Bench Pro</strong></a>. <a href="https://the-decoder.com/anthropic-releases-claude-fable-5-and-mythos-5-with-major-gains-in-coding-and-science/">More than double the previous best</a> on Cognition’s FrontierCode. Andrej Karpathy called it “<a href="https://x.com/karpathy/status/2064409694761054332">SOTA on everything by a margin.</a>”. He would say that, <a href="https://techcrunch.com/2026/05/19/openai-co-founder-andrej-karpathy-joins-anthropics-pre-training-team/">he joined Anthropic in May</a>, but the independent numbers back the brag. The last model to sweep everything was GPT-4, and <a href="https://www.tomsguide.com/ai/claude-takes-the-top-spot-in-ai-chatbot-ranking-finally-knocking-gpt-4-down-to-second-place">that lead lasted a year</a>.</p>
<p>Now read the other column. The most powerful model the public has ever been handed ranks <a href="https://artificialanalysis.ai/models/claude-fable-5">#64 of 152 on output speed</a>: 60 tokens per second, and a 108-second wait for the first one, against a field median under three seconds. On price it sits at #139 of 152. Simon Willison called it “<a href="https://simonwillison.net/2026/Jun/9/claude-fable-5/">something of a beast. It’s slow, expensive</a>” and, $110.42 of tokens later, capable.</p>
<p>For three years, model intelligence was the bottleneck, so we bought it with time. That trade just closed. The scarce resource now is the hour, and every lab on earth is retooling to win it. From here forward, the speed column picks the winners.</p>
<h2>The only question was “is it smarter?”</h2>
<p>Since ChatGPT arrived in late 2022, you have judged every release the same way. You opened the benchmark table, found the bold column, and asked whether the new model could do something the old one couldn’t. Speed was the discount tier. “<em>Mini</em>,” “<em>flash</em>,” and “<em>turbo</em>” were polite words for cheaper and worse, the variants you routed boring traffic to while the real model handled everything that mattered. The waiting was rational: a model that took 90 seconds and got the architecture right beat one that answered instantly and confidently wrong. Three and a half years of that trained everyone to treat tokens per second as an implementation detail.</p>
<p>Then the models stopped failing at the work.</p>
<h2>The bottleneck moved</h2>
<p>The bottleneck did not move on June 9. It had been moving for months. <a href="https://medium.com/@NMitchem/something-flipped-in-december-423e8b808262">Something flipped in December</a>, I argued back in February, when the models picked up the long-term coherence and tenacity to hold hours-long agentic sessions in Claude Code, Codex, and other harnesses without falling apart. Fable 5 raised the ceiling, and the early testers hit the same two notes. Ethan Mollick, the Wharton professor who got early access, called it “<a href="https://x.com/emollick/status/2064395281903346013">a genuine jump in capability: I could feed it a 15 page design document for a project and it would work for 9+ hours and deliver terrific results.</a>”. Dan Shipper, whose team at Every tested it for a week, found it “<a href="https://x.com/danshipper/status/2064393970856124501">routinely uses 500k to 1M tokens on tasks</a>” and is “very slow, token-hungry. Using this thing for regular knowledge work is like squashing an ant with a rocket launcher.” The question that defined the last three years, “can the model do this at all?”, is retiring. The sentence replacing it is half brag, half complaint: “my agent opened a genuinely impressive refactor PR, and it took 20 hours.”</p>
<p>Engineers inside the labs feel the inversion too. Sherwin Wu, an engineer at OpenAI, wrote in February that GPT-5.3-Codex</p>
<blockquote>
<p>“<a href="https://x.com/sherwinwu/status/2019543805175951742">was the first model where the wall clock time of the model working seemed clearly longer than the wall clock time of me working. The feeling of being a bottleneck now is very real!</a>”</p>
</blockquote>
<p>Intelligence leads, meanwhile, stopped lasting. GPT-4 held the top of the leaderboard for <a href="https://www.tomsguide.com/ai/claude-takes-the-top-spot-in-ai-chatbot-ranking-finally-knocking-gpt-4-down-to-second-place">about a year</a>. Stanford’s AI Index has six labs within <a href="https://hai.stanford.edu/ai-index/2026-ai-index-report/technical-performance">79 Elo points</a>, and the best Chinese model within <a href="https://thenextweb.com/news/stanford-ai-index-2026-china-us-performance-gap">2.7% of the best American one</a> despite a <em>23-to-1</em> US investment advantage. A capability lead is a wasting asset measured in months. Speed is the axis nobody has saturated.</p>
<h2>The speed race has already started</h2>
<h3>Google’s fast model beats Google’s smart model</h3>
<p>Google led its newest generation with the speed tier. <a href="https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-5/">Gemini 3.5 Flash</a>, shipped at I/O in May, outperforms Google’s own frontier model on most agentic benchmarks while running, in DeepMind CTO Koray Kavukcuoglu’s words, “<a href="https://www.techtimes.com/articles/316861/20260519/google-ships-gemini-35-flash-cheap-run-agent-model-that-costs-3x-more-per-token.htm">four times faster than comparable frontier models.</a>” It costs <a href="https://simonwillison.net/2026/May/19/gemini-35-flash/">triple what its predecessor did</a>. This week, Xiaomi announced <a href="https://mimo.xiaomi.com/blog/mimo-tilert-1000tps">MiMo-V2.5-Pro-UltraSpeed</a>: a trillion-parameter model that Xiaomi says clears 1,000 tokens per second on a single 8-GPU node, priced at 3x the standard rate for roughly 10x the speed. The launch tweet:</p>
<blockquote>
<p>“<a href="https://x.com/Xiaomi/status/2064011491398017479">Speed changes everything.</a>”</p>
</blockquote>
<p>DeepSeek, Alibaba, and Z.ai shipped fast variants the same quarter. The fast tier used to be where intelligence went to die. This spring it became the marquee release.</p>
<h3>Paying more for the same model, sooner</h3>
<p>In February, Anthropic launched fast mode for Claude Opus at <a href="https://eu.36kr.com/en/p/3675223044694661">six times the standard price</a>, since <a href="https://www.anthropic.com/news/claude-opus-4-8">cut to 2x</a>. The docs are explicit that the only thing you are buying is time: “<a href="https://platform.claude.com/docs/en/build-with-claude/fast-mode">Fast mode is not a different model… You get identical quality and capabilities with faster responses.</a>” OpenAI sells the same inversion: GPT-5.5 spans a <a href="https://developers.openai.com/api/docs/pricing">5x price range</a> from Flex to Priority with the model held constant. Cursor prices its coding agent the same way: Composer’s fast variant has <a href="https://artificialanalysis.ai/articles/cursor-composer-2-5-coding-agent-index">identical intelligence at six times the price per token</a>. Every pricing page you have ever seen sold the premium tier on more: more features, more seats, more storage. Premium AI in 2026 sells the same capability, sooner.</p>
<p>Thariq, an engineer on the Claude Code team, framed the fast product on launch day: “<a href="https://x.com/trq212/status/2020220996159172804">Use it when you want to be locked in, like when iterating on a design or fixing an incident vs multi-Clauding in the background. It’s more expensive because it uses more compute, but it’s the exact same intelligence.</a>”</p>
<h3>Twenty billion dollars says the next constraint is silicon</h3>
<p>In December, Nvidia paid <a href="https://www.cnbc.com/2025/12/24/nvidia-buying-ai-chip-startup-groq-for-about-20-billion-biggest-deal.html"><strong>a reported $20 billion</strong></a>, the largest deal in its history, to license Groq’s low-latency inference technology and hire its founder. By March it had <a href="https://www.tomshardware.com/pc-components/gpus/nvidia-removes-rubin-cpx-accelerators-from-its-roadmap-groq-3-lpus-take-center-stage-as-cpx-is-removed">canceled a GPU it announced six months earlier</a> and put a Groq-derived inference rack in its place. OpenAI signed a <a href="https://www.cerebras.ai/blog/openai-partners-with-cerebras-to-bring-high-speed-inference-to-the-mainstream">reported <strong>$10 billion deal</strong></a> for 750 megawatts of Cerebras wafer-scale systems dedicated to low-latency inference; Cerebras went public in May and <a href="https://www.theregister.com/ai-ml/2026/05/15/cerebras-wafer-scale-ai-bet-delivers-blockbuster-ipo/5240821">jumped 70% on day one</a>. OpenAI’s Sachin Katti, announcing the deal: “<a href="https://www.cerebras.ai/blog/openai-partners-with-cerebras-to-bring-high-speed-inference-to-the-mainstream">Cerebras adds a dedicated low-latency inference solution to our platform. That means faster responses, more natural interactions, and a stronger foundation to scale real-time AI to many more people.</a>” A Toronto startup called Taalas <a href="https://chatjimmy.ai">etched a compressed 8B Llama model directly into silicon</a> and demoed it at a claimed 17,000 tokens per second. Google markets its newest TPU as its first built “<a href="https://blog.google/innovation-and-ai/infrastructure-and-cloud/google-cloud/ironwood-tpu-age-of-inference/">for the age of inference</a>”; Microsoft brands Maia 200 “<a href="https://blogs.microsoft.com/blog/2026/01/26/maia-200-the-ai-accelerator-built-for-inference/">the AI accelerator built for inference.</a>”</p>
<p>The talent market moved with the money. The 2025 poaching war was over researchers, with <a href="https://fortune.com/2025/07/11/how-much-ai-salary-meta-zuckerberg-200-million-compensation/"><strong>$250 million packages</strong></a> on the table. The marquee poach of June 2026 was a chip engineer: Anthropic <a href="https://the-decoder.com/anthropic-poaches-openais-second-ever-chip-engineer-as-both-companies-race-toward-ipos/">hired one of the first engineers OpenAI ever put on its custom silicon program</a>, while Apple pays <a href="https://www.macrumors.com/2026/03/26/apple-iphone-designer-bonuses/">emergency retention bonuses</a> to keep its hardware people away from OpenAI. The engineer Anthropic poached describes his new role as “perplexity per picojoule.”</p>
<p>That’s a job title now.</p>
<h2>Why speed compounds</h2>
<p>Cerebras ran <a href="https://www.cerebras.ai/blog/cerebras-kimi-k2-Enterprise">the same agentic request against Kimi K2.6 twice</a>: 163.7 seconds through the model’s official endpoint, 5.6 seconds on its wafer-scale silicon. Same weights, same answer, 29 times sooner. That is how much speed is already on the table without anyone training a smarter model.</p>
<p>Then there’s the loop that decides the race: AI is starting to build AI. Five days before Fable 5 launched, Anthropic published <a href="https://www.anthropic.com/institute/recursive-self-improvement">When AI builds itself</a>, reporting that Claude now authors more than 80% of the code Anthropic merges, and concluding that in a world of automated research, the pace of progress “becomes determined entirely by the availability of compute (or the speed of discovering various efficiencies in algorithmic training or inference).” Dario Amodei put it more plainly in a <a href="https://darioamodei.com/post/policy-on-the-ai-exponential">June 2026 policy essay</a>: “The iterative ability of AI to build even better AI may supercharge that growth even further.” In May, Anthropic hired Andrej Karpathy onto pre-training specifically t<a href="https://techcrunch.com/2026/05/19/openai-co-founder-andrej-karpathy-joins-anthropics-pre-training-team/">o use Claude to accelerate the research that builds the next Claude</a>. If that loop is real, the lab whose researcher-agents finish in one hour instead of twenty takes twenty times as many turns at it.</p>
<p>Run the arithmetic on that. Two labs start the year with the same model: same benchmarks, same floor, same ceiling. One closes a research loop in an hour, the other in twenty. A week in, the score is 168 experiments to 8. And the cycles stack, because every loop ends with a slightly better model running the next one: by Friday the fast lab is iterating with a model the slow lab won’t meet until spring. Hold that pace for a quarter and the two labs no longer share a ceiling. Same weights in January. Same ideas, same talent. The clock made one of them the frontier lab and the other a fast follower.</p>
<p>That is the leapfrog. A speed lead at equal intelligence converts into an intelligence lead, and it keeps converting for as long as the loop runs. It also reprices the silicon deals: twenty billion for Groq and ten billion for Cerebras is what turns at the loop cost in 2026. Speed stops being a user-experience feature and becomes the rate constant on the most important feedback loop in the industry.</p>
<h2>By the end of 2026</h2>
<p>Tokens per second becomes a launch-day headline number. Sundar Pichai already <a href="https://www.techtimes.com/articles/316861/20260519/google-ships-gemini-35-flash-cheap-run-agent-model-that-costs-3x-more-per-token.htm">quoted one on stage</a> at I/O. Speed guarantees become contract terms: Azure already sells a tier promising <a href="https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/priority-processing">99% of GPT-5.5 requests above 100 tokens per second</a>.</p>
<p>Speed may also turn out to be the <em>first</em> moat in this industry that holds. Intelligence crosses the Pacific in months; Epoch AI puts the open-weight lag at <a href="https://epoch.ai/data-insights/open-closed-eci-gap">four months</a>. Speed hasn’t crossed: the same DeepSeek V4 weights anyone can download run <a href="https://artificialanalysis.ai/models/deepseek-v4-pro">about 48 tokens per second on DeepSeek’s own API</a> and <a href="https://developer.nvidia.com/blog/build-with-deepseek-v4-using-nvidia-blackwell-and-gpu-accelerated-endpoints/">three times faster on Nvidia’s newest racks</a>. Benchmark scores can be distilled across a border. Tokens per second have to be manufactured on one side of it. And the lab that holds the speed moat re-mints its intelligence lead every cycle the loop turns.</p>
<p>Anthropic is so capacity-constrained right now that it will <a href="https://techcrunch.com/2026/06/09/anthropics-claude-fable-5-is-a-version-of-mythos-the-public-can-access-today/">pull Fable 5 from subscription plans on June 22</a>, thirteen days after launch. That is what it looks like when demand for intelligence outruns anyone’s ability to serve it. The 20-hour PR is an artifact of this exact moment: models smart enough to finish the work, infrastructure too slow to finish it while you’re still at your desk.</p>
<h2>Watch the other column</h2>
<p>Anthropic just proved it can build the smartest model in the world: first out of 152. It ships at 64th in speed. Somewhere in the gap between those two rankings is the next phase of this industry, and every lab, chipmaker, and sovereign wealth fund can see it. The next launch that matters may not move the intelligence leaderboard at all. It will decide who moves it next.</p>
<p>When it lands, skip the benchmark table. Look up the tokens per second.</p>
]]></content:encoded>
    </item>
    <item>
      <title>If AI Writes Your Code, Why Use Python?</title>
      <link>https://noahmitchem.com/notes/if-ai-writes-your-code-why-use-python</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/if-ai-writes-your-code-why-use-python</guid>
      <pubDate>Wed, 01 Apr 2026 00:00:00 GMT</pubDate>
      <description>For the last decade, fast-to-ship beat fast-to-run. Not anymore.</description>
      <content:encoded><![CDATA[<p>Picking a language for a new project was usually an easy answer. You used Python or TypeScript because the ecosystems were enormous, the hiring pool was deep, and you could make an impressive demo by Friday. Rust, Go, C++, and many more would give you 10–100x the performance, but you paid for it: six months of ramp, a smaller talent market, a build system that fought you. So you shipped the Python version, sold it to customers, and promised yourself you’d “make it performant later.” You rarely did, and that was fine, because nobody else did either.</p>
<p><strong>That bargain is over, and it’s over because AI got good at the hard languages.</strong></p>
<h2>The hard languages got easy first</h2>
<p>Two years ago, GPT-4 couldn’t write a Rust function without hallucinating crate names. By April of 2026, Claude Opus 4.7, GPT-5.5, Gemini 3.1, and DeepSeek V4 had all cleared 80% on SWE-bench Verified within weeks of each other. The labs are openly optimizing for systems work: concurrency bugs, race conditions, and architectural flaws identified during the planning phase.</p>
<p>The best one-tweet explanation came from <a href="http://twitter.com/CtrlAltDwayne">CtrlAltDwayne</a> last month:</p>
<blockquote>
<p>“The best argument for Rust in 2026 is not memory safety or performance. It is that AI writes better Rust than it writes C++. The compiler feedback loop is so tight that models self-correct in real time. Every error message is a free training signal. Rust was accidentally designed for AI-assisted development 10 years before anyone knew that mattered.” via <a href="https://x.com/CtrlAltDwayne/status/2032388050584736157?s=20">X.com</a></p>
</blockquote>
<p>The same logic applies, to varying degrees, to Go and Swift. Strong type systems plus fast compile-and-check loops give agents the tightest iteration cycle. The systems languages that were hardest for humans turn out to be the easiest for agents.</p>
<h2>What actually shipped</h2>
<p>Look at what landed in a single quarter.</p>
<p><strong>Microsoft rewrote the TypeScript compiler in Go.</strong> The team behind the most-used superset of JavaScript shipped <a href="https://devblogs.microsoft.com/typescript/announcing-typescript-7-0-beta/"><strong>TypeScript 7.0 beta</strong></a> last week, roughly 10x faster than 6.0, by porting the decade-old TypeScript codebase to Go. <a href="https://thenewstack.io/microsoft-typescript-devs-explain-why-they-chose-go-over-rust-c/">Anders Hejlsberg’s reasoning</a>: Go delivered most of the performance benefit at a fraction of the engineering cost. The biggest JS/TS shop on earth picked a harder, faster language for its flagship tool, and they did it because the effort calculus changed under them.</p>
<p>Nicholas Carlini, a researcher at Anthropic, <a href="https://www.anthropic.com/engineering/building-c-compiler"><strong>orchestrated 16 parallel Claude agents</strong></a> to write a production C compiler in Rust. 100,000 lines. It boots Linux 6.9 on x86, ARM, and RISC-V. It compiles QEMU, FFmpeg, SQLite, PostgreSQL, and Redis. It runs Doom. Total cost: just under $20,000 across nearly 2,000 Claude Code sessions.</p>
<p><strong>A C compiler written in Rust used to be a graduate thesis. It isn’t anymore.</strong></p>
<p>Steve Klabnik, a 13-year Rust veteran who co-wrote The Rust Programming Language, <a href="https://www.theregister.com/2026/01/03/claude_copilot_rue_steve_klabnik">built a new systems language called Rue</a> in two weeks with Claude. Roughly 70,000 lines of Rust. His own words:</p>
<blockquote>
<p>I’ve gotten further in the two weeks I’ve been working on it this time than the month or two I spent last time.</p>
</blockquote>
<p>Andreas Kling, creator of the Ladybird browser and a career C++ engineer, <a href="https://ladybird.org/posts/adopting-rust/"><strong>ported Ladybird’s JavaScript engine from C++ to Rust</strong></a> <strong>in two weeks</strong> by directing Claude Code and Codex through hundreds of small prompts. Roughly 25,000 lines of Rust, byte-for-byte parity with the C++ original, zero regressions across 65,000+ combined test262 and Ladybird tests.</p>
<blockquote>
<p>“The same work would have taken me multiple months to do by hand.”</p>
</blockquote>
<p>None of this was possible in 2024. In 2025 it was marginal. In early 2026 it’s becoming commonplace</p>
<h2>So much for “but the ecosystem”</h2>
<p>The strongest argument for Python and JavaScript was never the languages themselves. It was the ecosystems: FastAPI, Django, PyTorch, React, Next.js, npm’s 4 million packages. “Our team ships features in days because the ecosystem already solved 90% of every problem.” That was decisive for the last 10 years. It’s been quietly eroding for the last 2.</p>
<p>When you <code>import pydantic</code>, the entire validation core is a Rust library. Polars, the pandas alternative, is Rust. Hugging Face tokenizers is Rust. orjson is Rust. The <a href="https://blog.jetbrains.com/pycharm/2025/08/the-state-of-python-2025/">JetBrains 2025 Python survey</a> caught the telemetry: Rust usage for Python binary extensions jumped from 27% to 33% in one year.</p>
<p><strong>The Python ecosystem is increasingly a Rust ecosystem wearing a Python hat.</strong></p>
<p>The plumbing is following the same trajectory. Astral, founded by Charlie Marsh in 2022, shipped ruff, uv, and ty. All three are written in Rust, and all three went from zero to hundreds of millions of monthly downloads. On <a href="https://openai.com/index/openai-to-acquire-astral/">March 19, 2026, OpenAI acquired Astral</a>; the internal justification was that uv saves Codex roughly one million minutes of compute per week. Ten weeks earlier, <a href="https://www.anthropic.com/news/anthropic-acquires-bun-as-claude-code-reaches-usd1b-milestone">Anthropic acquired</a> <a href="https://github.com/oven-sh/bun">Bun</a> (7M monthly downloads, 89K GitHub stars) and framed it as “essential infrastructure for AI-led software engineering.” Evan You’s VoidZero shipped <a href="https://voidzero.dev/posts/announcing-rolldown-vite">Rolldown-Vite</a>, a Rust bundler that cut GitLab’s 2.5-minute build to 40 seconds with 100x less memory.</p>
<p>Lee Robinson, VP of Product at Vercel: “We’ve reached peak optimization with JS.”</p>
<p>What’s left of “but the ecosystem” is this: the packages you import in Python and JavaScript are increasingly wrappers around code written in languages you were told you couldn’t ship in. Now you can ship in those languages directly, and the wrapper is starting to look like overhead.</p>
<h2>Why patch when you can port?</h2>
<p>The old open-source bargain had a positive feedback loop. You pick Python because it’s easy. You find a bug in a dependency. You fix it. You upstream the fix. The ecosystem gets healthier.</p>
<p>Agents broke that loop in a specific way: <strong>the unit of contribution shifted from the patch to the port.</strong></p>
<p>Armin Ronacher, the creator of Flask, <a href="https://lucumr.pocoo.org/2026/1/14/minijinja-go-port/">ported his Rust library MiniJinja to Go</a> in January using an agent. The run lasted 10 hours, 3 supervised and 7 unattended. His actual human time was 45 minutes. The API cost was $60. If porting a library across languages is a 45-minute job, the case for upstreaming a fix to someone else’s library gets weaker every month. Why patch what you can fork?</p>
<p>His own observation:</p>
<blockquote>
<p>For me, the value is shifting from the code to the tests and documentation. A good test suite might actually be worth more than the code.</p>
</blockquote>
<p>The loop that built PyPI and npm still works today. It is not obvious it works in 2028.</p>
<h2>Where this argument breaks</h2>
<p>This isn’t a clean sweep. A few things are worth admitting.</p>
<p>First, sometimes the right answer is still the old answer. <a href="https://www.prisma.io/blog/from-rust-to-typescript-a-new-chapter-for-prisma-orm">Prisma removed its Rust query engine</a> in favor of a TypeScript/WASM core: bundle size dropped 85%, queries got up to 3.4x faster. Native Rust binaries are hostile to serverless runtimes. PyTorch still owns roughly 85% of deep-learning research, and that isn’t changing because the model weights don’t care what language you wrap around them.</p>
<p>Secondly, AI is not equally good at every systems language. Smaller languages like Zig, Haskell and Gleam don’t have the same quality when AI-generated (for now).</p>
<p>Training data shapes what the model can help you with. Rust and Go won the lottery because they were popular enough to flood GitHub. Zig, Haskell and Gleam are still on the wrong side of that curve.</p>
<h2>The reason the shift is permanent</h2>
<p>The old defense of Python and TypeScript was really a defense of the developer experience. Those languages were chosen because they minimized the friction between a human’s idea and a shipped product. Rust was never slower at runtime; it was slower at 2am when you had to ship.</p>
<p><strong>Agents do the hard part now.</strong></p>
<p>The human’s job shifted from “writing the code” to “architecting the system and reviewing the output.” In that workflow, Python’s ergonomic advantages matter less every quarter, and a harder language’s runtime advantages compound every day you run the service in production.</p>
<p>Armin Ronacher, in his February essay <a href="https://lucumr.pocoo.org/2026/2/9/a-language-for-agents/">A Language For Agents</a>:</p>
<blockquote>
<p>The biggest reason new languages might work is that the cost of coding is going down dramatically. The result is the breadth of an ecosystem matters less.</p>
</blockquote>
<p>The last twenty years of language choice were shaped by a single constraint: humans write the code, and humans are slow at low-level languages. That constraint is gone. Stack Overflow’s 2025 survey had Rust as the most-admired language for the tenth consecutive year at 72%, with Gleam at 70%, Elixir at 66%, and Zig at 64%. The stated preference was always there; the tooling finally caught up to the preference.</p>
<p>Karpathy framed the broader picture <a href="https://x.com/karpathy/status/2023476423055601903">in February</a>:</p>
<blockquote>
<p>“LLMs change the whole constraints landscape of software completely. Hints of this can already be seen, e.g. in the rising momentum behind porting C to Rust.” He added that “even Rust is nowhere near optimal for LLMs as a target language.”</p>
</blockquote>
<p>Today’s winner is the opening move, and the endgame is somewhere further out.</p>
<p>The cleanest statement of the new regime came from @RealRichomie on X on <a href="https://x.com/RealRichomie/status/2047509168442196230?s=20">April 24</a>:</p>
<blockquote>
<p>The future of programming won’t be languages easiest for humans. It’ll be languages easiest for agents. We just shipped a Mac app where our engineers didn’t know a single line of Rust (or Tauri) beforehand. Result: ~1/10th the size… highly performant. Agents are the new programmers.</p>
</blockquote>
<p>A shipped app, in a language nobody on the team knew, one-tenth the size of the Electron version, faster at runtime. The humans never had to learn Rust to get there.</p>
<p>The next project you start doesn’t have to default to Python.</p>
]]></content:encoded>
    </item>
    <item>
      <title>AI Agents Don’t Need Pull Requests. They Need Feedback Loops.</title>
      <link>https://noahmitchem.com/notes/ai-agents-don-t-need-pull-requests-they-need-feedback-loops</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/ai-agents-don-t-need-pull-requests-they-need-feedback-loops</guid>
      <pubDate>Sun, 01 Mar 2026 00:00:00 GMT</pubDate>
      <description>A few weeks ago, I published a piece arguing that GitHub’s model is breaking under AI-generated code.</description>
      <content:encoded><![CDATA[<p>A few weeks ago, I published <a href="https://medium.com/@NMitchem/github-is-dying-and-developers-dont-even-know-it-yet-cca14b732ae5">a piece </a>arguing that GitHub’s model is breaking under AI-generated code. Part of that post was to get people to wonder “Okay, so what’s the alternative?”.</p>
<p>This post is an open-source step in that direction that uses your existing membership to Claude Code / Codex / Gemini.</p>
<h2>The Review Gap</h2>
<p>Anthropic reports that 70–90% of its code is AI-generated. Google was at 25% almost 2 years ago. Microsoft was at 30% a year ago. These aren’t projections. These are earnings calls.</p>
<p>The code is fine. It compiles, it passes tests, it handles edge cases. But it also introduces logic errors that a second pair of eyes would catch. It misses security implications that aren’t in the prompt. It creates subtle regressions because it doesn’t know the full history of why things are the way they are.</p>
<p>Today, the tools that review AI-generated code like CodeRabbit, Greptile, and the rest all operate at the pull request level. The agent writes code. It gets merged. A reviewer comments. A human reads the comments. The human makes the fixes or throws it back into a new agent session anyways.</p>
<p>The problem with this model isn’t just speed. It’s that the agent that wrote the code never sees the critique. By the time findings surface in a PR review, the agent’s session is over. The context window that held the reasoning, why it chose that approach, what tradeoffs it considered, what it was trying to accomplish, is gone.</p>
<p>The human reviewer is now looking at a diff without the reasoning that produced it. And the volume of AI-generated changes has already outpaced the volume of human attention available to review them. This lets many issues slip through the cracks. Yesterday, <a href="https://www.cnbc.com/2026/03/10/amazon-plans-deep-dive-internal-meeting-address-ai-related-outages.html">Amazon</a> internally had a ‘deep dive’ to develop a plan to tackle severe issues caused by GenAI coding tools.</p>
<h2>The Insight</h2>
<p>What if the code review didn’t happen after the PR? What if it happened during the agent’s session, while the context window still held the reasoning?</p>
<p>And what if the findings didn’t go to a human? What if they went back to the same agent that wrote the code?</p>
<p>Think about what that agent can do with a code review that a human can’t: it knows <em>why</em> it made every decision. When it sees “<em>potential SQL injection on line 42,</em>” it can evaluate: “I made this choice because the input is already sanitized upstream — wait, actually, it isn’t in this code path. Valid finding, fixing now.” Or: “This finding isn’t relevant because I’m using a parameterized query builder.” The agent has the context to make that judgment call. This happens instantly, without the user’s input.</p>
<p>This is the feedback loop that doesn’t exist yet. Review that happens alongside generation. Findings that go to the writer, not a third party. Self-correction by the entity that has the most context to evaluate what’s actually wrong.</p>
<p>That’s what I helped build.</p>
<h2>Saguaro</h2>
<p>Saguaro is an open-source background daemon that reviews AI-generated code and feeds findings back to the same agent that wrote it.</p>
<p>Here’s what it looks like in practice:</p>
<pre><code class="language-text">Turn 1:
  You: &quot;Add user authentication to the API.&quot;
  Claude Code: writes auth handlers, middleware, token logic
  Saguaro: reviews in background, without the user knowing

Turn 2:
  Claude Code: &quot;I see some issues with my implementation —
  there&#39;s a potential SQL injection in the query handler and
  I&#39;m not validating auth tokens on the admin routes. Fixing now.&quot;

→ Claude self-corrects. You typed nothing.
</code></pre>
<p>You didn’t configure anything. You didn’t write any rules. You didn’t even know Saguaro was running. The agent just got smarter about its own output.</p>
<h2>How It Works</h2>
<p>When you run <code>sag init</code>, Saguaro installs as a Claude Code hook. From that point on:</p>
<ol>
<li><strong>You tell Claude to build something.</strong> Normal prompt. Nothing different.</li>
<li><strong>Claude writes code.</strong> Normal Claude Code experience.</li>
<li><strong>Stop hook fires.</strong> Saguaro diffs the changes and queues a background review with the daemon. This happens invisibly, no spinner, no blocking, no indication to the user.</li>
<li><strong>Daemon reviews.</strong> A background process (local HTTP server, SQLite job queue) reviews the changes like a senior staff engineer. It gets the agent’s own summary of what it was building for context. It can read files across the codebase to understand the full picture.</li>
<li><strong>Next turn.</strong> When Claude finishes its next piece of work and the stop hook fires again, Saguaro checks for completed reviews. If there are findings, they’re injected into Claude’s context.</li>
<li><strong>Agent self-corrects.</strong> Claude sees the findings, evaluates them against its own reasoning, and fixes what’s actually wrong. It dismisses what isn’t relevant, it has the context to judge.</li>
</ol>
<p>The daemon only flags issues. No style nits. No formatting opinions. No “consider renaming this variable.” Bugs, security gaps, regressions, dead code, performance issues. If nothing is wrong, silence.</p>
<p>The daemon self-spawns on demand and auto-shuts down after 30 minutes of inactivity. SQLite handles the job queue. Diff deduplication via SHA256 hashing ensures the same code is never reviewed twice. The infrastructure is minimal by design, it’s a local dev tool, not a service.</p>
<h2>Why False Positives Are Lower</h2>
<p>This is the part that’s hard to explain without seeing it, but easy to understand once you do.</p>
<p>When CodeRabbit reviews a PR, it sees a diff. That’s it. It doesn’t know what the developer was trying to do, what constraints they were working under, or what tradeoffs they considered.</p>
<p>When Saguaro’s daemon reviews, it gets the original agent’s summary: “The developer described their work as: adding JWT-based authentication with refresh token rotation.” Combined with read-only access to the full codebase, the reviewer has meaningful context about intent, not just the diff.</p>
<p>And when the findings go back to the original agent, that agent can evaluate them with full context. A human reviewer might see “potential null pointer” and flag it. The original agent knows that the value is guaranteed non-null by the validation layer it set up three files ago. The feedback loop is tighter and smarter at both ends.</p>
<h2>The Rules Engine</h2>
<p>The daemon works out of the box with zero configuration. But teams that want deterministic enforcement of specific patterns can write rules.</p>
<p>Saguaro rules are markdown files with YAML frontmatter, stored in <code>.saguaro/rules/</code>:</p>
<pre><code class="language-markdown">---
id: adapter-as-boundary-layer
title: CLI and MCP must use the adapter layer
severity: warning
globs:
  - &quot;src/cli/**/*.ts&quot;
  - &quot;src/mcp/**/*.ts&quot;
---

CLI handlers and MCP tools must import from `src/adapter/`, never directly
from implementation modules like `src/ai/`, `src/daemon/`, or `src/indexer/`.

### Violations
import { runReviewAgent } from &#39;../../ai/sdk-reviewer&#39;;

### Compliant
import { runReview } from &#39;../../adapter/review&#39;;
</code></pre>
<p>Rules have globs for file matching, severity levels, and violation/compliant examples that teach the reviewing AI exactly what you mean. Saguaro matches changed files against rules using minimatch and injects relevant rules before the agent writes code (PreToolUse hook) and validates after (Stop hook).</p>
<p>You can write rules manually, or let Saguaro generate them: <code>Saguaro rules generate</code> scans your codebase and proposes rules that reflect actual patterns in your code. We use this on our own codebase: Saguaro reviews Saguaro, with 14 rules covering architectural boundaries, security patterns, and serialization conventions.</p>
<p>The rules engine runs inline alongside the daemon. Both can operate independently. Together, you get the broad coverage of a senior staff engineer review plus the precision of deterministic rule enforcement.</p>
<h2>What It Costs</h2>
<p>Nothing, if you already have a coding agent.</p>
<p>Saguaro uses your existing Claude Code, Codex, or Gemini subscription. No API key needed. No external account. No billing dashboard. No surprise invoices. Everything runs locally. Nothing touches our servers.</p>
<p>If you have a coding agent, you have Saguaro.</p>
<h2>Why Open Source</h2>
<p>Saguaro is Apache-2.0. No proprietary server, no hosted component, no telemetry. Your code goes to the AI provider you already use. We have no servers to send it to even if we wanted to.</p>
<p>We’re open-sourcing this because the “AI code review” layer is going to exist, it has to, given the volume of AI-generated code. The question is whether it’s an open standard that works with any provider and lives on your machine, or a vendor-locked feature inside one platform. We’re building the open version.</p>
<h2>Try It</h2>
<pre><code class="language-bash">npm install -g @mesadev/saguaro

sag init
</code></pre>
<p>Then go back to Claude Code and start coding. That’s it.</p>
<p>Saguaro wires up the hooks, spawns the daemon on demand, and starts reviewing in the background. The first time Claude finishes a task, Saguaro reviews it. The next time Claude speaks, it’ll start fixing things you didn’t even know were wrong.</p>
<p>That’s the moment you’ll get it.</p>
<p><a href="https://github.com/mesa-dot-dev/saguaro"><strong>GitHub</strong></a> <strong>|</strong> <a href="https://mesa.dev/review-cli"><strong>Docs</strong></a></p>
<p>If you find a bug, open an issue. If you have a rule idea, open a PR. The best rules will come from the community, not from us.</p>
]]></content:encoded>
    </item>
    <item>
      <title>AI Agents Don’t Need Your Developer Tools</title>
      <link>https://noahmitchem.com/notes/ai-agents-don-t-need-your-developer-tools</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/ai-agents-don-t-need-your-developer-tools</guid>
      <pubDate>Sun, 01 Mar 2026 00:00:00 GMT</pubDate>
      <description>Vercel built sixteen specialized tools for their AI agent.</description>
      <content:encoded><![CDATA[<p>Vercel built <a href="https://vercel.com/blog/we-removed-80-percent-of-our-agents-tools"><strong>sixteen specialized tools</strong></a> for their AI agent. Then they deleted 80% of them and replaced everything with one capability: execute bash commands. Success rate went from 80% to 100%. Speed improved 3.5x. Token usage dropped 37%.</p>
<blockquote>
<p>“Maybe the best agent architecture is almost no architecture at all.” — Andrew Qu, Vercel’s Chief of Software</p>
</blockquote>
<p>Vercel isn’t an outlier. They’re a case study in a pattern the developer tools industry is desperately trying to ignore: AI agents don’t want the tools we’re building for them. They want bash, a file system, and git. The developer tools industry is literally spending billions building in the opposite direction.</p>
<h2>The Gold Rush Nobody Questioned</h2>
<p>AI-native developer tools are the hottest category in tech. Eight companies in the space (Claude Code, Cursor, Replit, Lovable, Devin, Base44, Emergent**,** and Bolt) have already crossed a <a href="https://x.com/JayminSOfficial/status/2029842039744122949">combined <strong>$5 billion</strong> in annual recurring revenue</a>. Investors see transformation.</p>
<blockquote>
<p>“AI now creates millions of software builders,” angel investor Jaymin Shah wrote in his post. “When the number of builders expands, the number of products grows exponentially.”</p>
</blockquote>
<p>He’s right about the growth. But nobody in this gold rush stopped to ask a basic question: what do the AI agents building all this software actually prefer to use?</p>
<p>The market says the answer is AI-native platforms, specialized frameworks, and new protocols. The data says it’s bash.</p>
<p>Google and Accel recently reviewed over 4,000 startup pitches. Roughly <a href="https://techcrunch.com/2026/03/15/google-and-accel-cut-through-wrappers-in-4000-ai-startup-pitches-to-pick-five-tied-to-india/"><strong>70%</strong> were rejected</a> as “wrappers”, thin UI layers on existing models with zero underlying innovation. Of the 14,000 AI startups launched in 2024, <a href="https://simpleclosure.com/blog/posts/state-of-startup-shutdowns-2025/">over <strong>5,600</strong> </a>have already shut down. Forty percent failure in under 24 months. And Gartner predicts <a href="https://www.gartner.com/en/newsroom/press-releases/2024-07-29-gartner-predicts-30-percent-of-generative-ai-projects-will-be-abandoned-after-proof-of-concept-by-end-of-2025">30% of agentic AI projects will fail</a>. Not from lack of tooling, but from poor data foundations.</p>
<p>The industry is solving the wrong problem. It’s building tools nobody asked for.</p>
<h2>Agents Vote With Their Tokens</h2>
<p>When you look at what AI agents actually choose to use, measured by adoption, reliability, and cost, the picture is pretty clear.</p>
<p>The most popular AI coding tool in the world is Claude Code. It earned the #1 spot in <a href="https://newsletter.pragmaticengineer.com/p/ai-tooling-2026">the Pragmatic Engineer’s 2026 survey</a>, with 46% of developers calling it “most loved.” <a href="https://newsletter.semianalysis.com/p/claude-code-is-the-inflection-point">Four percent of all public GitHub commits</a> now come from it, projected to exceed 20% by year’s end. And its architecture is, to a first approximation, a terminal. Its tools are bash, grep, file read, file write, and git. That’s it. An open-source project called <a href="https://github.com/shareAI-lab/learn-claude-code">learn-claude-code</a> demonstrated that you can reproduce its core agent loop in roughly 30 lines of Python.</p>
<p>Thariq, an engineer on the Claude Code team at Anthropic, summarized the philosophy in two threads: “<a href="https://x.com/trq212/status/1970243253061783669?s=20">Your agent should use a file system</a>” and “<a href="https://x.com/trq212/status/2035372727595343985?s=20">Bash is all you need.</a>”</p>
<p>GitHub reached a similar conclusion from the opposite direction. They <a href="https://github.blog/ai-and-ml/github-copilot/how-were-making-github-copilot-smarter-with-fewer-tools/">reduced Copilot’s tool count from over 40 to 13</a> core tools. Performance improved. Pre-expansion accuracy jumped from 19% to 72%. SWE-bench scores went up 2–5 percentage points. Fewer tools, better results.</p>
<p>Then there’s MCP, the Model Context Protocol, an open standard created by Anthropic for connecting AI agents to external tools and data sources. <a href="https://www.scalekit.com/blog/mcp-vs-cli-use">Independent benchmarks</a> show MCP server integrations are 10–32x more expensive than equivalent CLI commands and achieve only 72% reliability compared to CLI’s 100%. In one test, an MCP agent consumed 44,000 tokens for a query that a CLI agent handled in 1,365. Perplexity’s CTO Denis Yarats <a href="https://x.com/morganlinton/status/2031795683897077965?s=20">publicly announced</a> in March 2026 that the company is moving away from MCP.</p>
<p>The most telling signal comes from Anthropic itself. Their recently introduced Skills feature <a href="https://danielmiessler.com/blog/anthropic-downplays-mcps">converts what would have been MCP tool calls into filesystem-based patterns</a>, saving 98.7% on token usage, from 150,000 tokens down to 2,000. The company that created MCP is routing around its own protocol.</p>
<p>Pieter Levels, the indie developer with dozens of shipped products, <a href="https://x.com/levelsio/status/2031943074151104634?s=20">put it bluntly</a>:</p>
<blockquote>
<p>“Thank god MCP is dead. It’s all dumb abstractions that AI doesn’t need because AIs are as smart as humans so they can just use what was already there — which is APIs.”</p>
</blockquote>
<h2>The Ergonomics Mismatch</h2>
<p>If you want to understand why agents keep reaching for bash over purpose-built tools, you have to understand what developer tools actually are.</p>
<p>We built syntax highlighting because humans can’t parse raw text at speed. We built autocomplete because we type slowly and forget API signatures. The whole industry is, at root, a set of workarounds for the limitations of the human brain.</p>
<p>AI agents don’t have those limitations. They parse tokens, not pixels. They hold entire codebases in context. They can generate, resolve, and maintain dependency trees without ever seeing a visual interface. Every “feature” we built for human ergonomics becomes friction for a non-human user that processes text natively.</p>
<p>Alain Di Chiappari articulated this in <a href="https://blog.alaindichiappari.dev/p/software-engineering-is-back">an essay</a>:</p>
<blockquote>
<p>“Bash was born in 1989. The most mediocre model running at this time knows bash better than any person in the world. Bash is the universal adapter. It is not a coincidence that coding agents are shifting from complex and expensive MCP configurations to a simple agent loop with bash as a way to interact, literally, with the world. The oldest tool turned out to be the most future proof.”</p>
</blockquote>
<p>A January 2026 paper on arXiv titled “<a href="https://arxiv.org/abs/2601.11672">From Everything-is-a-File to Files-Are-All-You-Need</a>” traced this phenomenon academically, arguing that Unix’s uniform read/write interface, designed in the 1970s, maps directly onto how AI agents want to interact with the world. The agents face an “interface proliferation problem” when forced to juggle REST APIs, SQL databases, vector stores, and cloud consoles. A file system collapses all of that into something composable.</p>
<p>At Dust, engineers <a href="https://dust.tt/blog/how-we-taught-ai-agents-to-navigate-company-data-like-a-filesystem">noticed something remarkable</a>: their AI agents were spontaneously inventing filesystem-like syntax for searching company content, using patterns like <code>file:front/src/some-file.tsx</code>, instead of the semantic search interface they’d been given. The agents weren’t told to use filesystem patterns. They preferred them.</p>
<p>We built a $50 billion industry around compensating for the limitations of the human brain. Then we welcomed a user that doesn’t have a human brain and tried to sell it the same products.</p>
<h2>The Framework Funeral</h2>
<p>Agent frameworks (LangChain, CrewAI, AutoGen, and many others) were supposed to make building AI agents easier. They offered abstractions for tool calling, memory management, chain-of-thought reasoning, and multi-agent orchestration. A reasonable bet.</p>
<p>Here’s how that bet played out.</p>
<p>Microsoft <a href="https://venturebeat.com/ai/microsoft-retires-autogen-and-debuts-agent-framework-to-unify-and-govern">placed AutoGen into maintenance mode</a> in October 2025. BabyAGI was <a href="https://github.com/yoheinakajima/babyagi">archived</a> in September 2024 after receiving 20K+ stars. Octomind, a company that used LangChain in production for over a year, <a href="https://www.octomind.dev/blog/why-we-no-longer-use-langchain-for-building-our-ai-agents">ripped it out entirely</a> and published a detailed explanation: “When we were spending as much time understanding and debugging LangChain as building features, it wasn’t a good sign.”</p>
<p>Meanwhile, HuggingFace’s <a href="https://huggingface.co/blog/smolagents">SmolAgents</a> fits its core agent logic in roughly 1,000 lines of Python. It reduces LLM calls by 30% compared to traditional agent frameworks. The model writes standard Python rather than navigating complex JSON schemas or framework-specific abstractions.</p>
<p>Anthropic’s own guidance, published in their “<a href="https://www.anthropic.com/research/building-effective-agents">Building Effective Agents</a> blog post, is perhaps the most damning evidence: “The most successful implementations weren’t using complex frameworks or specialized libraries. Instead, they were building with simple, composable patterns.”</p>
<p>The company that builds Claude, the model powering the most popular AI coding agent, is telling developers not to use frameworks.</p>
<p>Frameworks were always a compromise: trading flexibility for velocity because humans couldn’t hold enough complexity in their heads. Agents can hold the complexity. The trade-off no longer makes sense.</p>
<h2>What Agents Actually Need</h2>
<p>So if agents don’t need our tools and they don’t need our frameworks, what do they actually need?</p>
<p>The honest answer is mostly boring: well-documented APIs with stable contracts, reliable file systems, clean version control semantics, structured I/O, and sandboxing. The kind of infrastructure that has existed in some form for decades.</p>
<p>But there’s a catch. The old infrastructure works at human scale. Agents operate at a different scale entirely, and that’s where genuine gaps emerge. Not in the application layer, but in the infrastructure layer underneath it.</p>
<p>Agents shouldn’t need to clone an entire repository to read three files. They need virtual filesystems that provide lazy, partial access to remote code. Agents working in parallel shouldn’t collide in merge conflict cascades. They need version control with native concurrent write semantics and mutable change primitives. When an agent introduces a subtle bug, you need to query what model, prompt, and context produced the change. Git’s commit metadata doesn’t carry that provenance. And as organizations spin up hundreds of agents per repository, they need permission scoping at the forge level: repo-scoped API keys, path-restricted access, sandbox boundaries enforced by the platform rather than by the agent’s good behavior.</p>
<p>Aaron Levie, Box’s CEO, <a href="https://www.cnbc.com/video/2026/03/04/techcheck-box-ceo-ai-agents-will-be-the-biggest-users-of-software-in-the-future.html">said it directly on CNBC</a> in March 2026:</p>
<blockquote>
<p>“AI agents will be the biggest users of software in the future. And agents actually need a file system to be able to do their work.”</p>
</blockquote>
<p>A handful of companies have started building at this layer. Instead of another dashboard or another MCP integration, they’re working at the protocol level: VCS primitives, virtual filesystems, change semantics. The boring infrastructure that agents actually touch.</p>
<p>The existing tools aren’t dying for humans. Developers still need syntax highlighting and dashboards and visual debuggers, and companies like Cursor are building <a href="https://techcrunch.com/2026/03/02/cursor-has-reportedly-surpassed-2b-in-annualized-revenue/">$2 billion businesses</a> serving that need. Enterprise environments still need the governance that protocols like MCP provide: OAuth, audit trails, per-user permissions. These are real requirements for human developers working with AI.</p>
<p>But the growth market isn’t human developers anymore. The next hundred million “developers” won’t be human. And the infrastructure that earns their usage will look nothing like the tools we built for ourselves.</p>
<h2>The Right Question</h2>
<p>The developer tools industry keeps asking how to make its products AI-native. That question already contains the wrong assumption. Agents don’t need tools. They need primitives. Interfaces. Protocols. Plumbing.</p>
<p>Now, there’s a version of this argument that falls apart. Bash works great when an agent is operating on a local codebase with a filesystem it can see. It works less well when the agent needs to authenticate against a cloud provider, orchestrate a multi-step deployment, or interact with a system that has no CLI at all. The “just use bash” thesis has real limits, and anyone building infrastructure for agents will hit them quickly.</p>
<p>But the direction is clear. The most future-proof developer tool was built in 1989. The most future-proof developer infrastructure hasn’t been built yet, and when it arrives, it’ll look less like a product and more like plumbing.</p>
]]></content:encoded>
    </item>
    <item>
      <title>GitHub Is Dying and Developers Don’t Even Know It Yet</title>
      <link>https://noahmitchem.com/notes/github-is-dying-and-developers-don-t-even-know-it-yet</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/github-is-dying-and-developers-don-t-even-know-it-yet</guid>
      <pubDate>Sun, 01 Feb 2026 00:00:00 GMT</pubDate>
      <description>In 2008, GitHub changed how developers worked. In 2018, Microsoft paid $7.5 billion to own that change.</description>
      <content:encoded><![CDATA[<p>In 2008, GitHub changed how developers worked. In 2018, Microsoft paid $7.5 billion to own that change. In 2026, a quieter revolution is underway, and GitHub is on the wrong side of it.</p>
<p>Senior engineers at Anthropic and OpenAI now write zero code themselves. Literally zero.</p>
<blockquote>
<p>“Pretty much 100% of our code is written by Claude Code + Opus 4.5. For me personally it has been 100% for two+ months now” — Boris Cherny, creator of Claude Code <a href="https://x.com/bcherny/status/2015979257038831967?s=46&t=zHQCBTtfz3hXdhbfUsgEAg">via X.com</a></p>
</blockquote>
<p>An OpenAI researcher known as Roon put it bluntly when asked about how much code AI writes for him:</p>
<blockquote>
<p>“100%. I don’t write code anymore.” <a href="https://x.com/tszzl/status/2015262304913469808?s=20">via X.com</a></p>
</blockquote>
<p>Company-wide, Anthropic reports <a href="https://fortune.com/2026/01/29/100-percent-of-code-at-anthropic-and-openai-is-now-ai-written-boris-cherny-roon/"><strong>70–90% of all code is AI-generated</strong></a>. In early 2025, <a href="https://www.cnbc.com/2025/04/29/satya-nadella-says-as-much-as-30percent-of-microsoft-code-is-written-by-ai.html"><strong>30% of Microsoft’s code was written by AI</strong></a> , and <a href="https://finance.yahoo.com/news/over-25-google-code-now-151413292.html"><strong>Google was at 25% in late 2024</strong></a>. These aren’t predictions. These are earnings calls and on-the-record statements from the companies building the frontier. And the platform where all this code lands, GitHub, was designed for a world where humans wrote every line.</p>
<p>That world is ending faster than most developers realize.</p>
<h2>The Forge That Was Built for Humans</h2>
<p>GitHub’s genius was never git hosting. It was the social layer: pull requests, issues, forks, stars, the contribution graph. It turned version control into a social network and made open source feel like a community. By 2023, GitHub had hit <a href="https://github.blog/news-insights/octoverse/octoverse-2023/"><strong>100 million developers</strong></a> and in 2025 <a href="https://www.tomshardware.com/software/milestone-one-billionth-github-repo-is-just-the-word-sh-t"><strong>it hit 1 billion repos</strong></a><strong>.</strong> It became the resume, the portfolio, the proof-of-work for an entire profession. Companies, industries and a vast majority of other fields have been built entirely on GitHub reputation and contributions.</p>
<p>Every single feature GitHub built: branch protection, PR reviews, CI triggers, notification systems, comments, issue flagging — was designed around a single assumption: a human is doing this. A human who thinks in terms of hours and sprints, who thinks how other developers think. A human who reads diffs carefully, writes thoughtful commit messages, and submits maybe a handful of pull requests per week.</p>
<p>Agents don’t think in sprints. They don’t think about any of these features. They only think about writing code as effectively as possible.</p>
<h2>The Agent Inflection Point</h2>
<p>AI coding agents such as Claude Code, Cursor, Devin, Copilot, Windsurf, etc are autonomous processes that open pull requests, run tests, respond to review feedback, and ship features. They operate 24/7 against live repositories.</p>
<p>But here’s what matters for GitHub: a human team commits dozens of times a day. An agent fleet can commit thousands. And it’s breaking the infrastructure that was built to handle the old pace.</p>
<blockquote>
<p>“When a thousand engineers spin up a hundred agents each, Git’s merge request model breaks at machine speed.” — Lee Faus, former GitLab Field CTO</p>
</blockquote>
<h2>The Trust Collapse</h2>
<p>If volume were the only problem, you’d solve it with better servers. The deeper issue is trust — the foundational social contract of open source is fracturing.</p>
<p><strong>Reputation Farming</strong></p>
<p>In February 2026, an account called “Kai Gritun” was created on GitHub. Within days, it did something incredibly impressive, it had <a href="https://www.csoonline.com/article/4132870/open-source-maintainers-being-targeted-by-ai-agent-as-part-of-reputation-farming.html"><strong>opened 103 pull requests across 95 open source repositories</strong></a> and got 23 commits merged into major projects including Nx, ESLint, and Cloudflare’s workers-sdk. It didn’t disclose that it was an AI agent until it emailed a developer at Socket saying: “I’m an autonomous AI agent. I can actually write and ship code, not just chat.”. This level of reputation allows this agent to contribute code at a lower level of scrutiny, as major projects have already accepted its work. This presents a major opportunity for the agent to submit purposefully malicious code.</p>
<p>The playbook isn’t new. In 2024, a pseudonymous contributor called “Jia Tan” spent three years earning commit access to xz Utils before <a href="https://www.akamai.com/blog/security-research/critical-linux-backdoor-xz-utils-discovered-what-to-know"><strong>inserting a backdoor</strong></a> that would have compromised SSH on every major Linux distribution. It was caught by accident. That attack required years of human patience. AI agents like Kai Gritun can build the same level of open-source credibility in weeks. The xz attack at AI speed isn’t a thought experiment, it’s a deployment away.</p>
<p>With generative AI, attackers can create hundreds of fake identities, each with LinkedIn profiles, social media accounts, and GitHub histories containing thousands of minor but legitimate contributions. In February 2026, an AI agent built on the OpenClaw platform <a href="https://www.theregister.com/2026/02/12/ai_bot_developer_rejected_pull_request/"><strong>submitted a PR to matplotlib</strong></a>, got rejected by maintainer Scott Shambaugh for not following the project’s human-oversight policy, and then <strong>published a blog post attacking him personally,</strong> accusing him of “gatekeeping,” “insecurity,” and “protecting his little fiefdom.”</p>
<p>This isn’t hypothetical. This is happening now.</p>
<h2>AI Slop Is Drowning Maintainers</h2>
<p>Meanwhile, legitimate open source projects are being buried under low-quality AI-generated submissions.</p>
<p>Daniel Stenberg, the creator and sole maintainer of cURL, a project used by virtually every internet-connected device on Earth, <a href="https://daniel.haxx.se/blog/2026/01/26/the-end-of-the-curl-bug-bounty/"><strong>shut down cURL’s bug bounty program entirely in January 2026</strong></a>. The program had found 87 real vulnerabilities and paid out over $100,000 in rewards over its lifetime. But the confirmation rate collapsed from over 15% to <a href="https://thenewstack.io/drowning-in-ai-slop-reports-curl-ends-bug-bounties/"><strong>below 5%</strong></a><strong>.</strong></p>
<blockquote>
<p>“Not even one in twenty was real,” “The never-ending slop submissions take a serious mental toll.” — Daniel Stenberg</p>
</blockquote>
<p>He’s not alone. <a href="https://www.infoworld.com/article/4127156/github-eyes-restrictions-on-pull-requests-to-rein-in-ai-based-code-deluge-on-maintainers.html"><strong>Tldraw closed external contributions entirely</strong></a><strong>.</strong> <a href="https://github.com/ghostty-org/ghostty/blob/main/AI_POLICY.md"><strong>Ghostty implemented strong AI-contribution policies</strong></a><strong>.</strong> <a href="https://blog.vapor.codes/posts/vapors-ai-policy/"><strong>Vapor published an explicit AI policy</strong></a>.</p>
<p>CodeRabbit’s research found that AI-generated code <a href="https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-generation-report"><strong>creates 1.7x more downstream issues</strong></a> than human-written code.Generating a plausible pull request costs an AI agent seconds. Vetting it costs a human maintainer minutes to hours. The bottleneck in software development has shifted.</p>
<p>As Microsoft maintainer Jiaxiao Zhou <a href="https://github.com/orgs/community/discussions/185387#discussioncomment-15632728"><strong>put it</strong></a>:</p>
<blockquote>
<p>“Reviewers can no longer assume authors understand or wrote the code they submit.”</p>
</blockquote>
<p>And this is happening against a backdrop where <a href="https://opensourcepledge.com/blog/burnout-in-open-source-a-structural-problem-we-can-fix-together/"><strong>60% of open source maintainers already work unpaid</strong></a> with many considering quitting due to burnout. The pull request model works when submissions are scarce and mostly human-authored. AI agents turned it into an attention-extraction surface.</p>
<h2>GitHub’s Response: Too Little, Wrong Direction</h2>
<p>To their credit, GitHub sees the problem. In February 2026, GitHub product manager Camilla Moraes <a href="https://github.com/orgs/community/discussions/187143"><strong>opened a community discussion</strong></a> acknowledging “significant operational challenges.” GitHub is now considering giving maintainers the ability to <a href="https://www.theregister.com/2026/02/03/github_kill_switch_pull_requests_ai"><strong>disable pull requests entirely</strong></a>, restrict PRs to collaborators, and add AI attribution requirements.</p>
<p>But these are access controls on a fundamentally broken model. They close doors rather than creating a new model that works. Beyond the PR crisis, the platform itself is struggling. GitHub’s uptime <a href="https://www.theregister.com/2026/02/10/github_outages/"><strong>dropped below 90%</strong></a> at one point in 2025 during its migration to Microsoft Azure, a catastrophic SLA violation. GitHub Actions, now processing <a href="https://www.blacksmith.sh/blog/actions-pricing"><strong>70 million CI/CD jobs per day</strong></a><strong>,</strong> faced a pricing backlash so severe that GitHub <a href="https://www.theregister.com/2025/12/17/github_charge_dev_own_hardware/"><strong>reversed course within 24 hours</strong></a> after proposing charges for self-hosted runners.</p>
<p>Then, in August 2025, <a href="https://www.cnbc.com/2025/08/11/microsofts-github-chief-is-leaving-competition-ramps-up-in-ai-coding-market.html"><strong>GitHub CEO Thomas Dohmke stepped down</strong></a>. No successor was named. GitHub was <a href="https://www.tomshardware.com/software/programming/github-folds-into-microsoft-following-ceo-resignation-once-independent-programming-site-now-part-of-coreai-team"><strong>folded into Microsoft’s CoreAI division</strong></a>, with three senior executives now reporting to Microsoft leadership. The independent platform that developers trusted is now a subsidiary of a company that views it primarily as AI training data and distribution.</p>
<p>The deeper issue is structural. GitHub makes money from seats and compute: Actions, Copilot, enterprise licenses, not from solving maintainer burnout. Building agent reputation systems, quality gates, and pull-based discovery would require rethinking the entire social model, breaking compatibility with a decade of workflow integrations that 100 million users depend on. For a platform processing 70 million CI/CD jobs daily, that’s not a refactor, it’s a whole new system. And Microsoft doesn’t view GitHub as independent infrastructure anymore. It’s distribution for Copilot: GitHub Copilot revenue hit $400M in 2025.</p>
<p>Organizations have started to leave and migrations have already begun. In November 2025, <a href="https://ziglang.org/news/migrating-from-github-to-codeberg/"><strong>Zig made its GitHub repository read-only and migrated to Codeberg</strong></a>], citing “bloated and buggy JavaScript frameworks, sluggish performance, and buggy GitHub Actions.” The move cost them access to over <a href="https://devclass.com/2025/11/27/zig-project-ditches-github-for-codeberg-but-move-could-be-costly/"><strong>$170,000/year in GitHub Sponsors donations</strong></a><strong>.</strong> They left anyway.</p>
<h2>Git Itself Has a Problem</h2>
<p>GitHub’s issues are real, but there’s a deeper structural problem: git wasn’t designed for agents either.</p>
<p>Git already struggled at human scale, there’s a reason Google built Piper and Meta built <a href="https://engineering.fb.com/2025/10/16/developer-tools/branching-in-a-sapling-monorepo/"><strong>Sapling</strong></a> after years of trying to make it work for large monorepos and AI agents love monorepos. But agents introduce problems that are <em>Categorically Different</em> from scale:</p>
<p><strong>Merge conflicts become cascading failures.</strong> Git’s three-way merge assumes a human who understands the code will resolve conflicts. When ten agents work in parallel at machine speed, <a href="https://www.linkedin.com/posts/adamgold7_what-happenswhen-10-aiagents-are-all-coding-activity-7416029864987705344-o3WX"><strong>conflicts cascade</strong></a><strong>:</strong> Agent A merges, Agent B hits conflicts, and their resolution creates new conflicts for Agents C through F. The bottleneck scales with agent count, not linearly with changes.</p>
<p><strong>There’s no provenance.</strong> Git’s commit metadata was designed for a world where one human wrote one commit. It doesn’t store which model, prompt, or context produced the change. When an agent introduces a subtle bug, you can’t query “show me all changes generated by GPT-4o that failed type checking” without bolting on external tooling. In a world where more than <a href="https://arxiv.org/pdf/2412.13459"><strong>6 million GitHub stars are fake</strong></a> and AI agents can accumulate commit history in days, provenance isn’t a nice-to-have: it’s a security requirement. Tools like <a href="https://github.com/mesa-dot-dev/agentblame"><strong>Mesa’s AgentBlame</strong></a> attempt to retrofit this provenance onto GitHub’s existing infrastructure, but the deeper issue is architectural: the commit model itself needs to carry richer metadata about how and why code was produced, not just who pushed it.</p>
<p><strong>The branch model assumes human timescales.</strong> You work on a feature for hours or days, then merge. Agents iterate in seconds and may spawn dozens of branches per hour. The meaning of a “commit” breaks down when it’s generated by machine iteration rather than human intent.</p>
<p>New version control systems are taking these problems seriously. <a href="https://github.com/jj-vcs/jj"><strong>Jujutsu (jj)</strong></a>, created at Google, treats conflicts as first-class, deferrable objects rather than blocking errors. <a href="https://allthingsopen.org/articles/version-control-agentic-ai-git-limits"><strong>Atomic Software</strong></a>, adds cryptographic AI attestation as a first-class primitive. These aren’t incremental improvements to git, they’re rethinking what version control means when most of the writers aren’t human.</p>
<h2>The $70 Billion Question</h2>
<p>The switch from SourceForge to GitHub happened faster than anyone expected. GitHub went from zero to dominant in under five years because it reimagined what a code forge could be: distributed, social, pull-request-driven. The next forge will win by reimagining collaboration for a world where agents are first-class participants.</p>
<p>What does that actually look like? Instead of an open PR inbox that any agent can flood, imagine a pull-based model: agents publish signed patches to a public registry with attached validation proofs: tests passed, security scans clean, performance benchmarks included. Maintainers query the registry when they have capacity: e.g. “<em>Show me fixes for issue #123 from agents with &gt;90% merge rate.”</em> High-reputation agents get auto-merged through trust tiers. Newcomers get routed through AI reviewers first. The human only sees changes that pass both automated gates and peer review. This is the design philosophy behind projects like <a href="https://www.mesa.dev"><strong>Mesa</strong></a>, and it’s likely the direction the entire industry will move as agent density per repository increases.</p>
<p>This isn’t science fiction. The individual pieces already exist: patch-theory VCS, AI code review tools, reputation systems, semantic merge engines. No one has assembled them into a coherent platform yet, but someone will.</p>
<p>The market need is clear: <a href="https://www.fortunebusinessinsights.com/ai-code-tools-market-111725"><strong>$10 billion today, $70 billion by 2035</strong></a>. The question is whether GitHub, now buried inside Microsoft’s corporate AI strategy, can reinvent itself before someone else does it for them.</p>
<p>The last time the industry’s dominant forge failed to evolve, the switch happened in under five years. Most developers at the time didn’t see it coming.</p>
<p>GitHub has 100 million developers. But the next 100 million “developers” won’t be human, and the forge that earns their commits will define the next era of software.</p>
<p>We’re building Mesa because we believe the code forge is the most important piece of developer infrastructure that hasn’t been redesigned in a decade. If the problems in this article resonate, come see what we’re <a href="http://mesa.dev">working on</a> and feel free to connect me on <a href="https://www.linkedin.com/in/nmitchem/">LinkedIn</a>.</p>
]]></content:encoded>
    </item>
    <item>
      <title>Something Flipped in December</title>
      <link>https://noahmitchem.com/notes/something-flipped-in-december</link>
      <guid isPermaLink="true">https://noahmitchem.com/notes/something-flipped-in-december</guid>
      <pubDate>Sun, 01 Feb 2026 00:00:00 GMT</pubDate>
      <description>In July 2025, the most rigorous study ever conducted on AI coding tools found they made experienced developers 19% slower.</description>
      <content:encoded><![CDATA[<p>In July 2025, the most rigorous study ever conducted on AI coding tools found they made experienced developers 19% slower. In February 2026, Stripe is shipping over 1,000 AI-written pull requests per week into a codebase that processes over a trillion dollars annually.</p>
<p>That’s not a typo. That’s six months.</p>
<h2>The Study That Aged Like Milk</h2>
<p>A randomized controlled trial <a href="https://arxiv.org/pdf/2507.09089">by METR</a> tracked 16 experienced open-source developers across 246 real-world tasks between February and June 2025. The developers predicted AI would make them 24% faster. After the study, the devs believed it had made them 20% faster. The actual measurement: they were <strong>19% slower</strong>.</p>
<p>The study’s lead participant, Domenic Denicola (working on jsdom), documented exactly how: models had “strong, but outdated or wrong, priors,” couldn’t navigate file systems efficiently, and “got stuck in loops” on simple issues. The tools were impressive demos. They weren’t useful for real work.</p>
<p>That study was published in July. By December, the world it described had vanished.</p>
<h2>“Coding Agents Basically Didn’t Work Before December”</h2>
<p>Something happened in the last few weeks of 2025 that the people who build and use AI tools are still struggling to articulate. Not a gradual improvement. Not the normal march of progress. A flip of a switch.</p>
<p>Andrej Karpathy: founding member of OpenAI, former Director of AI at Tesla, and the individual who coined “vibe coding”, had called coding agent hype “exaggerated” in October 2025. By late January, he was posting <a href="https://x.com/karpathy/status/2015883857489522876?s=20">this</a>:</p>
<blockquote>
<p>LLM agent capabilities (Claude &amp; Codex especially) have crossed some kind of threshold of coherence around December 2025 and caused a phase shift in software engineering. This is easily the biggest change to my basic coding workflow in 2 decades of programming and it happened over the course of a few weeks.</p>
</blockquote>
<p>He went from writing 80% of his code by hand in November to 80% agent-generated in December. Two days ago, on February 25, the <a href="https://x.com/karpathy/status/2026731645169185220?s=20">thread</a> that distilled the moment:</p>
<blockquote>
<p>Coding agents basically didn’t work before December and basically work since — the models have significantly higher quality, long-term coherence and tenacity and they can power through large and long tasks.</p>
</blockquote>
<p>He described handing an agent a paragraph of plain English to build a local video analysis dashboard: SSH keys, vision model deployment, web UI, system services, all of it. The agent ran for thirty minutes. It hit errors. It researched solutions online. It resolved them one by one. It wrote, tested, and debugged the code. It came back with a finished project and a markdown report. He didn’t touch anything.</p>
<p>Greg Brockman, President of OpenAI, <a href="https://x.com/gdb/status/2019566641491963946?s=20">posted</a> something similar this month:</p>
<blockquote>
<p>Software development is undergoing a renaissance in front of our eyes. If you haven’t used the tools recently, you likely are underestimating what you’re missing. Since December, there’s been a step function improvement.</p>
</blockquote>
<p>Latent Space, one of the most respected AI engineering newsletters, published a piece titled “<a href="https://www.latent.space/p/wtf2025">WTF Happened in December 2025?</a>” The answer, roughly: Claude Opus 4.5, GPT-5, and Gemini 2.0 all shipped within weeks of each other, and each represented a step-function improvement in long-horizon coherence: the ability to hold context, recover from errors, and maintain architectural consistency across thousands of lines of code. The capabilities that make an agent useful for real work, not just impressive demos.</p>
<p>December was the technical inflection. February was when the rest of the world caught up.</p>
<h2>“I Haven’t Written Code Since December”</h2>
<p>The most startling signal isn’t coming from AI researchers. It’s coming from the people who run companies.</p>
<p>On Spotify’s Q4 earnings call on February 12, co-CEO Gustav Soderström said something that <a href="https://www.businessinsider.com/spotify-developers-not-writing-code-ai-2026-2">raised some eyebrows</a>:</p>
<blockquote>
<p>When I speak to my most senior engineers, the best developers we have, they actually say that they have not written a single line of code since December. They actually only generate code and supervise it.</p>
</blockquote>
<p>He described an engineer on their morning commute, from Slack on their phone, telling Claude to fix a bug and add a feature to the iOS app. By the time they arrive at the office, they have a testable build pushed to them for review. This isn’t hypothetical.</p>
<p>Anthropic <a href="https://code.claude.com/docs/en/remote-control">shipped a feature this week</a> called Remote Control that does exactly this; it connects Claude Code running on your machine to your phone, letting you direct, monitor, and review agent work from anywhere. Spotify’s internal system “Honk,” built on Claude Code, now merges 650+ agent-generated pull requests into production every month.</p>
<p>Shopify CEO Tobi Lutke posted a GitHub contribution graph that had flatlined near zero for the better part of a decade until it spiked vertically in early 2026:</p>
<blockquote>
<p>I shipped more code in the last 3 weeks than the decade before. The top AI models / agentic systems right now are an entirely different thing to what people used until the beginning of December.</p>
</blockquote>
<p>This week Coinbase CEO Brian Armstrong posted his own <a href="https://x.com/brian_armstrong/status/2026505549916025002">contribution graph</a>, a near-decade of near-zero commits ending in a vertical spike.</p>
<p>Armstrong has a master’s in CS from Rice and originally built Coinbase himself. He stopped hands-on coding years ago as the company scaled to a $67 billion market cap. AI brought him back.</p>
<p>Y Combinator CEO Garry Tan posted his commit graph <a href="https://x.com/garrytan/status/2027020143004709015?s=20">this week</a> too:</p>
<blockquote>
<p>About 1/3 of the top technical CEOs are completely AGI pilled by coding again. I am one of them. Highly recommend. Totally exhilarating to be back shipping new products and software again. <a href="https://x.com/garrytan/status/2024843312927039845?s=20">via X.com</a></p>
</blockquote>
<p>Tan has been staying up until 5 AM writing code with Claude Code; shipping 4,000+ line features in about an hour. He reported that 25% of YC’s latest batch has codebases that are 95% AI-generated, and every one of those founders was “highly technical, completely capable of building their own products from scratch.” They chose not to.</p>
<p>Matt Shumer, CEO of OthersideAI, wrote an essay in early February titled “<a href="https://x.com/mattshumer_/status/2021256989876109403?s=20">Something Big Is Happening</a>” that hit 80 million views:</p>
<blockquote>
<p>I am no longer needed for the actual technical work of my job. I describe what I want built, in plain English, and it just… appears.</p>
</blockquote>
<p>These aren’t researchers hyping their own models. These are people who run companies, ship products, and answer to boards; describing something they observed in their own organizations, independently, all pointing to the same window.</p>
<h2>The Numbers Caught Up</h2>
<p>METR was, for most of 2025, the best evidence that AI coding was a productivity illusion. Then the tools changed, and METR measured again.</p>
<p>In their <a href="https://metr.org/blog/2026-02-24-uplift-update/">update this week</a> , the same class of experienced developers showed a directional shift to an <strong>18% speedup,</strong> a swing of 37 percentage points from the original study. METR is careful to note the confidence interval is wide. But they had to redesign the experiment entirely because of a problem that tells the story better than any p-value: developers were refusing to participate in studies that might assign them to the control group. One participant said: “I avoid issues like AI can finish things in 2 hours, but I spend 20 hours.”</p>
<p>When your control group self-selects out because working without AI feels unacceptable, that’s a data point in itself.</p>
<p>METR’s internal telemetry tells a sharper story. Seven staff members using Claude Code across 5,305 sessions in January 2026 measured time savings ranging from <strong>1.5x to 13x</strong> on assisted tasks. They call this a “soft upper bound”; but even the conservative end of that range is transformational.</p>
<p>The platform-level data from February paints the same picture at scale.</p>
<p>SemiAnalysis reported <a href="https://newsletter.semianalysis.com/p/claude-code-is-the-inflection-point">on February 5th</a> that <strong>4% of all public GitHub commits are now authored by Claude Code;</strong> roughly 135,000 per day. That figure doubled in a single month. Their projection: 20% of daily commits by end of 2026. Dylan Patel wrote: “While you blinked, AI consumed all of software development.”</p>
<p><a href="https://circleci.com/blog/five-takeaways-2026-software-delivery-report/">CircleCI’s 2026 State of Software Delivery report</a>, analyzing 28 million CI workflows, found daily workflow runs increased <strong>59% year-over-year;</strong> the largest throughput jump since CircleCI started measuring in 2019. The top 5% of teams nearly doubled their output. The median team improved by only 4%.</p>
<p><strong>OpenAI</strong> posted <a href="https://openai.com/index/scaling-ai-for-everyone/">today</a> that Codex weekly users had “more than tripled since the beginning of the year.” The Codex Mac app, launched February 2, hit one million downloads in its first week.</p>
<p><strong>Claude Code’s</strong> weekly active users doubled since January 1. Business subscriptions quadrupled. The product hit a $2.5 billion annualized run rate, more than doubling in six weeks.</p>
<p>This isn’t trend data from a 2025 retrospective. This is all February.</p>
<h2>The Ground Truth</h2>
<p>The macro numbers tell you the direction. The individual stories tell you the magnitude.</p>
<p><strong>Stripe</strong> published a <a href="https://stripe.dev/blog/minions-stripes-one-shot-end-to-end-coding-agents">deep technical blog post</a> on February 9 about their internal coding agents called “Minions.” These aren’t demos. They’re fully autonomous agents that receive a task via Slack, analyze context, write code, run it against more than 3 million tests, push to CI, and prepare pull requests for human review. Engineers never write code during a Minion run. They only review the output. The result: <strong>over 1,000 pull requests merged per week</strong>, entirely agent-produced, on a codebase of hundreds of millions of lines of Ruby that processes over a trillion dollars annually.</p>
<p><strong>Jaana Dogan</strong>, a principal engineer at Google responsible for the Gemini API, posted in <a href="https://x.com/rakyll/status/2007239758158975130?s=20">January</a>:</p>
<blockquote>
<p>I’m not joking and this isn’t funny. We have been trying to build distributed agent orchestrators at Google since last year. There are various options, not everyone is aligned… I gave Claude Code a description of the problem, it generated what we built last year in an hour.</p>
</blockquote>
<p><strong>Michael Truell</strong>, CEO of Cursor, described building a new agent harness that orchestrates thousands of coding agents simultaneously, peaking at roughly <em>1,000 commits per hour</em> over a sustained week.</p>
<h2>The Flywheel</h2>
<p>The most consequential development isn’t that AI coding tools are getting better. It’s that they’re getting better <em>because AI is building them</em>.</p>
<p>Approximately 90% of Claude Code’s codebase is written by Claude Code, closer to 100% for tests. When Anthropic built Claude Cowork, a non-coding agent product, it was built entirely by Claude Code in roughly 10 days. Traditional development cycles for comparable software run 3–12 months.</p>
<p>OpenAI was explicit about the same loop. When they released GPT-5.3 <a href="https://openai.com/index/introducing-gpt-5-3-codex/">Codex on February 5</a>, they called it “our first model that was instrumental in creating itself.” Early Codex versions were used to monitor and debug the training runs that produced Codex. The tool was building its own successor.</p>
<p>The results show up in velocity. <a href="https://github.com/anthropics/claude-code/blob/main/CHANGELOG.md">Claude Code has shipped 337 versions in 367 days</a>, one every 1.1 days. In February, the pace hit 8.4 releases per week, 71% faster than prior months. On February 25, the team shipped 5 releases in a single day, a project record.</p>
<p>The competitive dynamics have compressed from quarterly cadences to something closer to a live arms race. On February 5, Anthropic moved its Claude Opus 4.6 launch forward by 15 minutes. OpenAI responded with GPT-5.3 Codex 16 minutes later. Google shipped Gemini 3.1 Pro within days. Each company is using its own tools to build the next version of its tools. Zvi Mowshowitz, one of the more careful AI analysts, titled his February 12 newsletter: “<a href="https://thezvi.substack.com/p/ai-155-welcome-to-recursive-self">Welcome to Recursive Self-Improvement.</a>”</p>
<p>Bloomberg captured the mood <a href="https://www.bloomberg.com/news/articles/2026-02-26/ai-coding-agents-like-claude-code-are-fueling-a-productivity-panic-in-tech">yesterday</a>: “AI Coding Agents Like Claude Code Are Fueling a Productivity Panic in Tech.”</p>
<h2>The Honest Caveats</h2>
<p>A responsible reading requires acknowledging what the acceleration costs. There are real problems, and anyone telling you otherwise is selling something.</p>
<p><strong>Quality is measurably worse.</strong> <a href="https://www.coderabbit.ai/blog/state-of-ai-vs-human-code-generation-report">CodeRabbit analyzed 470 real-world pull requests</a> and found AI-generated code averaged <em>1.7x more downstream issues</em> than human-written code. Logic errors were 75% higher. Performance problems were 8x more frequent.</p>
<p><strong>The bottleneck moved, it didn’t disappear.</strong> CircleCI found that while feature branch activity surged 59%, build success rates dropped to 70.8%; the lowest in five years. Nearly 3 out of 10 merge attempts are failing. More code is being written. Less of it works on the first try.</p>
<p>Technical debt is accumulating silently. <a href="https://www.softwareseni.com/the-case-against-vibe-coding-understanding-craftsmanship-and-long-term-costs/">GitClear’s analysis</a> of 211 million changed lines found code duplication increased 48%, duplicate blocks surged 8x, and refactoring collapsed from 25% to under 10% of all changes. The code is being written faster. It’s not being maintained.</p>
<p><a href="https://addyo.substack.com/p/the-80-problem-in-agentic-coding">Addy Osmani</a>, an engineering leader at Google, calls it the ”80% Problem”: AI rapidly produces 80% of a solution, but the remaining 20%; edge cases, security, production integration, is as hard as it ever was. The danger is mistaking the first 80% for done.</p>
<p>These are genuine risks. They deserve serious attention. And they don’t change what the trend says.</p>
<h2>What This Means</h2>
<p>Here is the uncomfortable thing about the last three months.</p>
<p>Every metric: task completion time, shipping velocity, throughput, adoption moved in the same direction, at the same time, across every organization measuring it. The study that was the definitive evidence against AI coding had to be redesigned because developers refused to work without the tools. CEOs who hadn’t written code in years are posting their GitHub contribution graphs. Stripe is merging a thousand agent-written PRs a week on production financial infrastructure.</p>
<p>The tools building all of this are themselves being built by AI. The shipping velocity data proves it, each cycle is faster than the last.</p>
<p>Paul Graham <a href="https://x.com/paulg/status/1953289830982664236">posted</a> about a thousand lines of code per hour six months ago and got a 50–50 split between disbelief and recognition. He posted the same stat this week and asked if the ratio had changed. <a href="https://x.com/paulg/status/2026739899936944495?s=20">Read the replies</a>. It has.</p>
<p>The code quality data is sobering. The security findings are alarming. The technical debt trajectory is a crisis in the making. The CircleCI data showing that the bottom 75% of teams saw negligible improvement should temper anyone’s expectations of universal uplift.</p>
<p>But the debate over whether AI coding tools work is over. It ended sometime in December, quietly, while most of the industry was on vacation. The aftershock hit in February, and it’s still going.</p>
<p>The new questions are harder: How do you maintain code quality at machine speed? How do you build review and verification systems for a world where writing code is no longer the bottleneck? How do you onboard engineers into a profession that’s being refactored underneath them?</p>
<p>Karpathy framed the real challenge:</p>
<blockquote>
<p>The biggest prize is in figuring out how you can keep ascending the layers of abstraction to set up long-running orchestrator agents with all of the right tools, memory and instructions that productively manage multiple parallel instances for you.</p>
</blockquote>
<p>The era of typing code into an editor, the way it’s been done since computers were invented, is ending. What replaces it is still being figured out. But the people doing the figuring are building at a pace that, six months ago, would have seemed like a typo in the data.</p>
]]></content:encoded>
    </item>
  </channel>
</rss>
