📊 Full opportunity report: The Model Is Only 10%: The Real Lesson of the New SDLC on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

TL;DR

A recent Google whitepaper emphasizes that in AI coding, the model accounts for only 10% of system behavior. The majority depends on how developers configure, verify, and manage the AI’s harness and context, shifting focus from model size to system design.

A new Google whitepaper, “The New SDLC With Vibe Coding,” asserts that the most significant shift in software engineering is moving from focusing on the AI model to emphasizing the harness, verification, and context management, which determine system behavior far more than the model size.

The paper, authored by Addy Osmani, Shubham Saboo, and Sokratis Kartakis, reports that as of early 2026, 85% of professional developers use AI coding agents regularly, with 51% using them daily and roughly 41% of new code being AI-generated. Despite this widespread adoption, the authors emphasize that the model itself constitutes only about 10% of what influences the AI’s behavior.

The core insight is that system performance depends primarily on the harness—the prompts, tools, rules, and observability surrounding the model—rather than the model alone. Changes to harness configurations can dramatically improve outcomes, as evidenced by experiments where tweaking only the harness or context improved performance without changing the underlying model.

The paper advocates for a shift toward agentic engineering, where AI systems are built with structured verification, context management, and modular skills, rather than relying solely on raw model capabilities. This approach offers a more cost-effective and reliable strategy, especially considering the total cost of ownership in AI development.

At a glance
reportWhen: published early 2026
The developmentThe whitepaper by Addy Osmani and colleagues highlights that the core of effective AI development lies in harness design and verification, not just the AI model itself.
The Model Is Only 10% — The New SDLC With Vibe Coding
AI Dispatch · Field Notes
Google · Osmani, Saboo & Kartakis · May 2026

The model is only 10%

A Google whitepaper argues software’s biggest shift is from writing code to expressing intent. Its sharpest claim: the model you obsess over is the smallest part of the system — the scaffolding around it does the real work.

A spectrum, not a binary — the differentiator is how outputs get verified
Vibe Coding
Casual prompts · “does it seem to work?” · disposable code · high risk
Structured AI-Assisted
Detailed prompts + constraints · manual testing · features in real codebases
Agentic Engineering
Formal specs · automated tests + evals + CI gates · production scale · low risk
Tests verify the deterministic; evals verify the rest. Without both, it’s vibe coding — however clever the prompt.
The idea worth building your strategy around
Agent = Model + Harness
~10%
HARNESS — prompts · tools · context · hooks · sandboxes · observability
MODEL~90% IS YOUR SURFACE AREA, NOT THE PROVIDER’S
Outside Top 30 → Top 5 on Terminal Bench 2.0 by changing only the harness — same model.
“Most agent failures, examined honestly, are configuration failures” — a missing tool, a vague rule, a noisy context.
The economics: it’s a token-cost problem (CapEx vs OpEx)
Vibe Coding
Low CapEx · High OpEx
Looks free, hides debt: token burn (fix-it loops), maintenance tax (AI spaghetti), security remediation. Crosses over to 3–10× more per feature.
Agentic Engineering
High CapEx · Low OpEx
Pay upfront (specs, evals, context), then ship cheaply. Levers: context engineering for first-pass success + intelligent model routing — cheap models for the easy work.
85%
of devs use AI coding agents (51% daily)
41%
of all new code is AI-generated
~90%
of agent behavior is the harness, not the model
+19%
longer on some tasks (METR) — verification is the cost
The read

The clearest map yet of how serious AI development works — and mostly tool-agnostic. But it’s a Google funnel: the concepts are neutral, the on-ramps point to Gemini, Jules & the ADK. If the harness is 90% and it’s yours, your moat and your costs both live there — so own your scaffolding, route across models, and remember: AI amplifies whatever engineering culture it lands in.

Source: Osmani, Saboo & Kartakis, “The New SDLC With Vibe Coding,” Google (May 2026). Figures are the paper’s own, incl. METR & LangChain. Analysis is the author’s.
thorstenmeyerai.com

Why Focus on Harness and Verification Matters

This shift redefines how organizations should invest in AI development. Instead of chasing the latest model, companies should prioritize building robust harnesses, verification processes, and context management strategies. Doing so can dramatically reduce costs, improve reliability, and create durable competitive advantages, as these components are within the organization’s control and can be tailored to specific needs.

Furthermore, the emphasis on configuration and verification challenges the common narrative that model size or complexity is the primary driver of AI performance. Instead, it highlights that system design and management are the real levers for success in AI projects.

AI Model Validation & Testing: Ensuring Reliable AI Systems — Bias Testing, Robustness Evaluation & Regulatory Compliance (AI Compliance Toolkit)

AI Model Validation & Testing: Ensuring Reliable AI Systems — Bias Testing, Robustness Evaluation & Regulatory Compliance (AI Compliance Toolkit)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on the Shift Toward Intent Expression

The whitepaper builds on recent trends where AI adoption has skyrocketed, with a focus on large language models and generative AI tools. Prior to this, the industry often equated better models with better results, but recent experiments and benchmarks show that system configuration can outweigh model improvements. This perspective aligns with broader movements toward agent-based architectures and verification-driven development in AI engineering, emphasizing control and reliability over raw model size.

This evolution reflects a maturation in AI practice, recognizing that trust, verification, and system management are critical for deploying AI at scale and ensuring safety and cost-efficiency.

“The model is only 10% of what determines behavior; the harness is 90%. The real work is in configuration and verification.”

— Addy Osmani

Amazon

AI system harness configuration software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unclear Aspects of Model-Harness Balance

While the paper presents compelling evidence that harness design outweighs model size, it remains unclear how universally applicable these findings are across different AI tasks, industries, and scale. Specific best practices for harness configuration and verification are still evolving, and the optimal balance may vary depending on context.

Additionally, the long-term impacts of this shift on AI model development and industry standards are still being debated, with some experts questioning whether model improvements will regain primacy in certain domains.

Verification of Autonomous Systems

Verification of Autonomous Systems

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Future Directions in AI System Design

Organizations are expected to begin prioritizing the development of modular, verifiable harnesses and context strategies. Industry leaders may invest more in tools and frameworks that facilitate system configuration, testing, and monitoring, shifting away from solely model-centric R&D.

Research into best practices for harness design, verification protocols, and context engineering will likely accelerate, shaping the next wave of AI deployment standards. Monitoring how these practices impact cost, reliability, and safety will be key in the coming months.

AI-Powered Observability: From Noise to Insight: Transforming How We Monitor, Detect, and Respond

AI-Powered Observability: From Noise to Insight: Transforming How We Monitor, Detect, and Respond

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Why is the model only 10% of system behavior?

The paper argues that system configuration, verification, and context management are the primary drivers of AI performance, with the model itself contributing only a small fraction to overall behavior.

How can organizations improve AI outcomes without changing models?

By focusing on harness design, prompt engineering, tools, and verification processes, organizations can significantly enhance AI performance and reliability without needing the latest, largest models.

Does this mean model development is less important?

Not necessarily. While the whitepaper emphasizes system design, ongoing model improvements remain valuable. However, system configuration and management are now recognized as equally, if not more, critical for effective deployment.

What practical steps should companies take based on this insight?

Companies should invest in building robust harnesses, developing verification protocols, and structuring context management strategies to maximize AI system performance and cost-efficiency.

Will this shift reduce AI development costs?

Yes, focusing on configuration and verification can lower long-term costs by reducing token burn, improving reliability, and minimizing security vulnerabilities, despite higher initial investments in system design.

Source: ThorstenMeyerAI.com

You May Also Like

AI 2040: Plan A

The global initiative AI 2040: Plan A was announced today, outlining a comprehensive vision for artificial intelligence development through 2040.

White House drops restrictions on Anthropic AI models after two-week ban

The White House has lifted restrictions on Anthropic’s AI models after a two-week ban, signaling a shift in federal AI policy and regulatory approach.

AI models capable of devastating attacks on governments and business months away, rare Five Eyes statement warns

A rare Five Eyes intelligence alliance warns that advanced AI models may soon be capable of enabling severe cyber and physical attacks, with potential deployment within months.

Acoustic Dampening, Placement, and the “Rig in the Closet” Setup

Effective strategies for reducing noise from high-power AI workstations include placement in separate rooms and proper ventilation, not just acoustic foam.