Research·July 16, 2026·6 min read

Where four AI models break when they build a landing page

8 designers annotated 40 pages from GPT 5.6 Sol, Claude Fable 5, Grok 4.5, and Muse Spark 1.1, marking 754 failure points across 8 tags. Every model broke differently.

  1. 018 designers drew 754 failure boxes across 40 AI-built pages
  2. 02Over half of Sol's annotations are about size and placement
  3. 03Sol drew the fewest marks: 3.4 per page vs Muse Spark's 5.25
  4. 04Grok's 9.2% blocker rate is the highest in the field
Contra Labs
Contra Labs
Research

4 frontier models built 40 landing pages. 8 designers went through them one page at a time and drew 754 boxes around the parts that failed.

Every model broke differently. Sol got marked for size and placement, Fable for finish, Grok for how a page behaves when you touch it, Muse Spark for the volume of the marks.

This follows last week's study, where 4 models ran against 10 briefs and 9 designers judged them blind. That round found the brief picks the winner: GPT 5.6 Sol won 82% of its loose-brief matchups, Claude Fable 5 led on tight specs, and Sol finished last. This round asks a narrower question: page by page, where does each model break?

The mechanic was simple. Each designer drew a box around anything they read as a failure, tagged it with one of 8 labels (layout/spacing/hierarchy, polish and consistency, typography, originality, color and contrast, interaction and motion, cues and affordances, brand fit and tone), and rated it minor, major, or a blocker. 5 briefs, 4 models, 40 pages, 754 marked failure points.

Failure tag distribution by model
Share

2 tags lead for everyone. Layout, spacing and hierarchy is the most marked tag in the study, polish and consistency is second, and that order holds for 3 out of the 4 models. The models separate on what comes after.

More than half of Sol's issues are about size and placement.

Annotations per model by severity
Share

Sol drew fewer failure points than any other model in the study. 136 in total, against Muse Spark's 210. Per designer per page that is 3.4 annotations to Muse Spark's 5.25. The annotations were gentler too. Two thirds were minor, and Sol accounts for 4 of the 47 blockers in the study.

Failure tag share of annotations per model
Share

Sol's highest share came from one place. Layout, spacing and hierarchy accounts for 37% of its tags, the biggest concentration any model reached, and typography adds another 15%. More than half of everything designers flagged on a Sol page came down to how big something was or where it sat. Sol's feedback produced 4 blockers in the whole study. 3 were layout, from 3 different designers on 3 different pages.

GPT 5.6 Sol, Switchboard, with annotation overlay
Share

Switchboard is where it peaks. 56% of Sol's tags on that page were layout, spacing and hierarchy, all 8 designers marked at least one, and it ties as Sol's heaviest page for major and blocker annotations. It's the brief where Sol did worst in the first study, winning 1 matchup out of 27. Shown the page alone, the designers went after the same thing again.

Fable's biggest tag is polish and consistency

Fable drew 191 failure points, 4.7 per designer per page, which puts it second on volume, close to Grok, and mid table on severity at 36% major and 5% blocker. Layout, spacing and hierarchy is the smallest share of Fable's annotations. 21% of its tags, against 28% to 37% for everyone else, and the only model in the study under a quarter. Polish and consistency at 24%, originality and generic feel at 15%, color and contrast at 7%.

Claude Fable 5, Rue Mistral, with annotation overlay
Share

Originality and brand fit together account for 22% of its tags, just ahead of layout at 21%. For every other model, layout leads by a distance. The pattern sharpens at the severe end. Polish and originality carry 11 of the 18 tags on Fable's blockers.

Rue Mistral, one of the loose briefs, is the sharpest version. Originality, polish and color tie at 21% each. Layout sits at 12%.

Grok's blocker rate is the highest in the field

Grok sits mid table on volume, 184 points at 4.6 per designer per page. It carries the highest blocker rate in the study at 9.2% of its rated annotations, with Muse Spark close behind at 7.6%. Those blockers are equally distributed among the top 3: polish, layout and originality.

Grok's blocker severity breakdown by tag
Share

Grok's profile is close to field average. Layout at 28%, polish at 22%, originality at 14%. The one place it moves is interaction. Interaction and motion plus cues and affordances make up 16% of Grok's annotations, the heaviest interaction load in the field. Typography at 10% and color and contrast at 4.4% are the lowest shares of any model.

Grok 4.5, Tidewater, with annotation overlay
Share

Tidewater brief shows this perfectly. Interaction tags account for 27% of everything designers marked on that page, against 11% for Muse Spark, 9% for Fable and 5% for Sol on the same brief. Grok is the only model that got marked for what its page did rather than how it looked.

Muse Spark drew the most annotations in the study

Muse Spark leads on none of the 8 tags. Its highest relative tag, brand fit and tone at 7%, is tied with Fable. Layout at 28%, polish at 22%, originality at 14%. Of the 4 models, Muse Spark's profile sits closest to the study average in shape but remains the highest in volume of each tag.

210 rated annotations, 5.25 per designer per page, the most in the study. 48% of them were major or blocker, against Sol's 32%. That works out at 2.5 serious annotations per designer per page, more than double Sol's 1.1. And it holds brief by brief rather than resting on one bad page: Muse Spark drew the most serious annotations on 4 of the 5.

Cobble is where it gathers. 8 designers left 44 annotations on that page, 28 of them major or blocker, spread across layout, originality, polish and typography.

Muse Spark 1.1, Cobble, with annotation overlay
Share

The takeaway

We generated pages with 4 models and had 8 designers mark every failure they could find.

Something always turned up. 40 pages, 8 designers, 754 boxes drawn. Sol took 82% of its loose-brief matchups last week and still came back with 3.4 annotations a page.

Each model gave the designers a different list. More than half of Sol's annotations are about size and placement, and on Switchboard that climbs to 56%. Fable's structure holds up. The finish is what designers went after. Grok's profile is the field average right up until Tidewater, where a quarter of the annotations are about what the page does rather than how it looks. Muse Spark leads on none of the 8 tags and still draws the most annotations of anyone.

The first study was about writing the brief. This one is about reading what comes back. Every page came back needing a designer. The only thing that changed by model was which part.

Methodology and limitations

8 of the 9 designers from the first study returned, all working in UI/UX and web design and sourced from Contra's network. They annotated the outputs of 4 models across 5 of the original 10 briefs: Tidewater, Switchboard, The Undercurrent, Cobble and Rue Mistral.

There were no pairwise comparisons in this round. Each designer viewed one page at a time and marked failure points directly on it, choosing from 8 fixed tags and rating each mark minor, major or blocker. Multiple tags per mark were allowed, so the 754 annotations carry 1,051 tag mentions between them. 721 of the 754 carry a severity rating, and the severity figures above are calculated on those.

Coverage is complete. Every designer annotated every page for every model, so each model has 40 designer-page cells behind it.

One timing note. Sol's annotations were collected on 10 July, and the other three models were annotated on 13 and 14 July, in a separate session with the same designers and the same instructions. We treat the rounds as comparable and report Sol's counts alongside the rest, but Sol's lower volume is the one figure here that a session effect could touch. Its tag composition, which is what the Sol section rests on, is unaffected by volume.

As in the first study, we generated 1 page per model per brief, which caps every claim above. The per-model patterns hold across all 8 designers and all 5 briefs. The per-page examples illustrate those patterns rather than standing as evidence on their own.

How we ran this study → Methodology
Continue reading3 studies
All research
  1. July 16, 2026Benchmark
    GPT Image 2 won 41.9% of logo tournaments, and still only half its logos were client-ready10 brand designers judged GPT Image 2, Nano Banana Pro, MAI Image 2.5, and Meta Muse across 12 logo briefs. The winner is clear, and still only half its logos cleared the client bar.Read
  2. July 15, 2026Dataset
    How professional editors work: 234 annotated Premiere stepsA preview dataset of 234 annotated steps across 4 computer-use trajectories, recorded as professional editors built vertical social reels in Adobe Premiere Pro.Read
  3. July 14, 2026Research
    Pretty isn’t the same as right: One image model runs away with brief fidelityFive designers, four criteria, 6,400 blind pairwise ratings. Nano Banana 2 takes first on every brief-fidelity axis while the aesthetics standings invert behind it.Read