After agents write code, Shopify's CEO shifts focus to acceptance
Tobi Lütke said at Vercel Ship SF that we've all become verification engineers: building harnesses, building acceptance tests, building verifiable artifacts. The comments added a jab: first verify your verification tools.
At Vercel Ship SF, Tobi Lütke said: "we are now all verification engineers. We are building harnesses, we are building acceptance tests, and we are building… verifiables." He is the CEO of Shopify. The remark was excerpted by Mike Darlington on X, and the original post also included the fireside video with @rauchg.
Put back into context, the meaning is clear: when agents write code, human work doesn't disappear — it moves. Before, developers typed line by line; now you build harnesses that can run repeatedly and constrain agent output, build acceptance tests that define "done," and build verifiable artifacts that machines can check without a human squinting at diffs.
One commenter replied, "Verifiability is the name of the game now." Another, Richard Burton, saw Tobi mention the days of writing code by hand and connected it to how the physical world will go through the same transition. He also asked whether the Shopify team uses LoRA adapters to fine-tune small models to reach frontier quality on tasks like writing unit tests, integration tests, and emails — and how much of that comes from prompt engineering, how much from LLM progress, and how much from fine-tuning. The material doesn't answer, so I can't fill it in for him.
More worth developers' attention is Chen Yu's reply: test the harness first, then trust it. Their build step once showed "passed," but the build tool wasn't even installed; now a missing command halts the run immediately. That detail is more useful than a slogan. The verification layer itself can lie — a passing test may only prove the test didn't run.
The point of Tobi's line is the weight of acceptance infrastructure. The more capable agents get at writing, the more expensive it becomes to define "what counts as right." Don't rush to expand agent permissions — first run a negative test on your harness: delete a dependency and see if it turns red.
Sources: Mike Darlington's original post, Hamel Husain's repost.
发布时间: 2026-11-17 11:27