Best Performing Models8 models
Phase
LeaderboardPairwise comparison
Contra Labs
1624
Seedance 2.5
H3 Max
Seedance 2.0
Veo 3.1
Grok Imagine
Gemini Omni Flash
Kling V3.0 Pro
Ray V3.2

General preference · Prompt adherence · Usability · Visual aesthetics

Seedance 2.5New entryCinema Video08/27/2026

Seedance 2.5 enters at the top of ad video, and gets stronger on more specific prompts

  • Seedance 2.5 is great at executing based on an established direction. It wins 82.3% of comparisons in the Mockup stage, when it starts from an approved frame.
  • In contrast, Seedance 2.5 only wins 58.7% in Ideation, when it has to ideate from the prompt alone.
  • Seedance 2.5 makes mistakes on prompt adherence: it tends to include elements not asked for or explicitly excluded in the prompt, and to leave out ones that were required. A brief that said no text and no logos came back with both, plus other elements, while another had the product missing from a shot.
  • Expert video creators also complained about colour quality in two of the three campaigns' outputs.
Win rate by design stage
Ideation
58.7%
Mockup
82.3%
Refinement
76.7%

Share of head-to-head comparisons won at each stage · Seedance 2.5 is strongest once it has a visual reference to work from.

Share
  1. 1Seedance 2.5New1624
  2. 2H3 Max1586
  3. 3Seedance 2.01577
  4. 4Veo 3.11511
  5. 5Grok Imagine1481
  6. 6Gemini Omni Flash1449
  7. 7Kling V3.0 Pro1410
  8. 8Ray V3.21360
Methods & standardsSee how we score these models → Methodology

The world's leading independent human data & creative evaluation lab.

Powered by Contra.

The world's leading independent human data & creative evaluation lab.

Powered by Contra.