Contra Labs ResearchUpdated weekly · Follow on X and LinkedIn

Structured human judgment for AI systems where quality resists metrics.

A living record of Contra Labs' methodology, benchmark results, and field notes on creative evaluation at scale.

In preparation · White Paper
Launching soon

The Human Creativity Benchmark

The first Contra Labs white paper. A framework for evaluating generative AI across the three phases of creative work: ideation, mockup, and refinement.

Structured human judgment. Professional designers. Identical briefs. A head-to-head evaluation of four leading AI models across every phase of the creative process. Full paper coming soon.

Coming soon
All research · 5Grouped by month · newest first
April 20265 articles
  1. Apr 23, 2026·5 min read
    ResearchThe creative process has 3 phases. AI performs very differently in each.Contra Labs has been studying how working creatives integrate AI into their workflows. What emerged is a consistent 3-stage structure: ideation, mockup, refinement. The way creatives use AI shifts significantly at each one.Read
    IDEATIONLoose gripMOCKUPNarrowedREFINEMENTFirm grip
    How tightly creatives hold control across phases · Qualitative
  2. Apr 22, 2026·6 min read
    BenchmarkVeo 3.1 is the "Creative Director" model. Use it early, but hand off before refinement.Contra Labs ran Google Veo 3.1 through every phase of ad video production: ideation, mockup, refinement. The data produced the clearest model profile we've recorded.Read
    0%25%50%75%100%61.1%IDEATIONPeak55.6%MOCKUP38.9%REFINEMENTLast placeWIN RATE
    Veo 3.1 win rate · −22.2pp drop from ideation to refinement
  3. Apr 21, 2026·5 min read
    ResearchSolo creatives are earning more with AI and staying independent.The majority of independent creatives surveyed report higher earning potential since adopting AI. They're taking on more projects, charging more, and hiring no one.Read
    66%
    of independent creatives report higher earning potential since adopting AI
    26% no · 8% other
    Survey · Independent creatives on Contra
  4. Apr 14, 2026·6 min read
    White PaperWe tested 4 AI models with professional web designers. Claude won, but not the way you'd expect.A structured design benchmark across four leading AI models. Each one built landing pages from identical prompts, judged by real designers across three distinct phases of the creative process.Read
    0%25%50%75%100%79.8%IDEATIONClaude leads68.9%MOCKUPGemini takes over60%REFINEMENTClaude narrows gapLEADING WIN RATE
    Per-phase leader shifts · Preview of the Human Creativity Benchmark
  5. Apr 08, 2026·6 min read
    ResearchAI isn't replacing creative professionals. It's making the best ones better.We surveyed some of the highest-earning independent creatives working today (designers, art directors, motion artists, UX specialists, brand strategists) and asked them one question most AI discourse refuses to sit with: how do you actually use creative AI tools in real work?Read
    <25%
    of AI output makes it to final deliverables
    The rest is stripped, reworked, or scrapped
    Dominant survey response · Independent creatives

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings

Connecting with the missing signal: taste

Contra connects top creative minds with AI teams training models to understand taste. This is expert input, not crowd labor. It's the creative layer powering the next generation of AI.

Designers

Writers

Marketers

Engineers

Social Media Experts

Video Editors & Animators

Music & Audio Engineers

1.5M+

creative experts

400+

Skills and tools represented

$250M+

verified expert earnings

Creative Human Data

Creative Human Data

Human Creativity Benchmark

Human Creativity Benchmark

Research

Research

Jobs

Jobs

Creative Human Data

Creative Human Data

Human Creativity Benchmark

Human Creativity Benchmark

Research

Research

Jobs

Jobs

Creative Human Data

Creative Human Data

Research

Research

Jobs

Jobs

The world's leading independent

human data & creative evaluation lab

Creative Human Data

Creative Human Data

Human Creativity Benchmark

Human Creativity Benchmark

Research

Research

Jobs

Jobs

The world's leading independent

human data & creative evaluation lab

Creative Human Data

Creative Human Data

Human Creativity Benchmark

Human Creativity Benchmark

Research

Research

Jobs

Jobs

The world's leading independent

human data & creative evaluation lab

Creative Human Data

Creative Human Data

Human Creativity Benchmark

Human Creativity Benchmark

Research

Research

Jobs

Jobs

The world's leading independent

human data & creative evaluation lab

Creative Human Data

Creative Human Data

Research

Research

Jobs

Jobs