Benchmark·May 6, 2026·4 min read

Seedream 5.0 Lite swept the field on product detail shots.

A blind head-to-head against the leading image models from Google, OpenAI, and Black Forest Labs, evaluated by professional creatives.

Contra Labs
Contra Labs
Research

We ran a blind pairwise evaluation of the four leading image models on a single job: product detail shots from a hero reference. The field included Seedream 5.0 Lite alongside the then-current flagship models from Google, OpenAI, and Black Forest Labs.

The result

Seedream 5.0 Lite won 63.9% of all head-to-head matchups. The next-best model followed at 52.8%. The remaining two finished at 44.4% and 38.9%, both losing more matchups than they won.

Pairwise win rates across all blind comparisons. Seedream 5.0 Lite won the majority of head-to-head matchups against every competitor.
Share

In Bradley-Terry Elo, Seedream landed at 1567 and the runner-up at 1545. The bottom two were tied around 1442. A clean top and bottom tier.

Bradley-Terry Elo derived from pairwise rankings. The two-tier separation is the most notable feature of the landscape.
Share

How we ran it

Professional creatives evaluated outputs from all four models, blind, against a real product reference (jewelry, leather goods, electronics, audio). Each evaluator ranked the outputs head-to-head and rated them across five scalar categories: lighting and shadows, color consistency, product detail handling, prompt adherence, and production-readiness. Models were the latest publicly available versions at the time of evaluation.

No model names or watermarks. Bias removed at the evaluator's eye.

Seedream led every category we measured

Professional creatives rated each output across all five scalar categories. Seedream led all five.

Its top marks were in lighting and shadows (4.25 / 5) and color consistency (4.17 / 5). The widest gap between Seedream and the lowest-scoring model was in color consistency (1.09 points). The narrowest was in lighting and shadows (0.58). Even where the field tightened, Seedream stayed on top.

Why evaluators picked it: fidelity to the reference

The pattern in the rationales was consistent. Evaluators didn't pick Seedream because it was the prettiest. They picked it because it preserved the source.

Creative director Joao Paulo Bastos, on a handbag prompt:

Model C keeps the neutral background closer to the original, preserves the leather texture more accurately, and the clasp hardware reads truer to the reference image. That consistency with the input is what pushed it to first place for me, since the whole point of this task is evaluating how well the models maintain details from the source.Joao Paulo Bastos, creative director
Seedream 5.0 Lite output, handbag prompt. Selected for fidelity to the reference over a more visually striking alternative.
Share

Brand director Anna Gudvin, on a jewelry prompt where Seedream avoided embellishing details that weren't in the source:

The selected image maintained the original design without introducing additional milgrain detailing that was not present in the reference, preserving product integrity. It also replicated the lighting most accurately, with soft, diffused highlights and coherent reflections consistent with the hero image.Anna Gudvin, brand director
Seedream 5.0 Lite output, jewelry prompt. Preserved the original design without adding milgrain detailing not present in the reference.
Share
Themes evaluators cited most often as reasons for picking Seedream. Fidelity to the reference dominated the rationales, with production-readiness and lighting accuracy close behind.
Share

For product detail shots specifically, this is the right thing to optimize for. The output isn't a new image. It's a faithful zoom on an existing one. Inventing details, however tasteful, is a hard fail.

Where it lost

Seedream wasn't perfect. On a MacBook prompt, it ranked last. The issue was compositional focus.

Model C felt the least focused overall, with less control over where the viewer's attention goes.Joao Paulo Bastos, creative director
Seedream 5.0 Lite output, MacBook prompt. The only prompt where Seedream ranked last; evaluators cited weaker compositional focus.
Share

Worth flagging because the same evaluator picked Seedream first on the handbag prompt. The model is strong, but compositional control on tech products with hard edges and screens is an open weakness.

What this means

For catalog work, PDP imagery, and any use case where the output has to read as a continuation of the hero shot, Seedream 5.0 Lite is the strongest model we've tested. Its lead comes from a specific quality (fidelity to the reference) that matters more for product shots than aesthetic flourish does.

Continue reading
All research
Research
Creatives keep telling us the same thing about AI: every output looks the same.
Across 12 models and 5 domains, evaluators in the Human Creativity Benchmark kept circling the same complaint: the work is technically fine, it just all looks the same.
May 5, 2026 · 4 min
Benchmark
Grok Imagine is the "Polisher" model. Hand off the early rounds, bring it in for refinement.
Contra Labs ran xAI's Grok Imagine through every phase of ad video production: ideation, mockup, refinement. It produced the most dramatic phase-over-phase improvement of any video model in the study.
April 28, 2026 · 5 min
Research
The creative process has 3 phases. AI performs very differently in each.
Contra Labs has been studying how working creatives integrate AI into their workflows. What emerged is a consistent 3-stage structure: ideation, mockup, refinement. The way creatives use AI shifts significantly at each one.
April 23, 2026 · 5 min

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings