Advertising Industry Associations Partner to Launch World’s First LLM Benchmark for Creativity

June 10, 2025
Media

An independent industry-led initiative, backed by Springboards and including 4As, ACA, APG, D&AD, IAA, IPA and The One Club for Creativity, aims to set new standards for evaluating LLM performance on real-world creative tasks

New York, NY — June 10, 2025 — Today, Springboards, an AI platform accelerating creativity in advertising, and a collective of global advertising and marketing associations, creative leaders, and AI experts – including 4As (American Association of Advertising Agencies), ACA (Advertising Council Australia), APG, D&AD, IAA (International Advertising Association), IPA, and The One Club for Creativity – announced an initiative to establish the first comprehensive Creativity Benchmark designed to evaluate the creative instincts of large language models (LLMs) in the context of advertising and creativity.

Read more about the initiative in Ad Age.

The initiative seeks to answer a critical question: Which LLMs are most useful for creative inspiration, variation, and problem-solving across the advertising process? At a time when AI tools are increasingly embedded in the workflows of strategists and creatives, this benchmark fills a crucial gap in industry knowledge.

“Existing AI benchmarks test logic, accuracy, and comprehension,” said Pip Bingemann, CEO/Cofounder at Springboards. “But advertising isn’t about right answers, it’s about originality, insight, and impact. This will be the first benchmark designed around the real creative instincts we value in agencies and brands so that people in creative industries can understand what models are good for the work they do.”

An Industry-Wide Effort to Set New Standards

The initiative is supported by a technical and research team that includes PhDs in machine learning, AI engineers, and former researchers from Google. Together, they’ve designed a system that blends data analysis with human taste to reveal which models excel across various types of creative thinking.

The evaluation departs from traditional AI testing methods by focusing on creative instincts, not coached outputs. Key criteria include:

  • Human judgment of insight, idea, and “wild” idea quality
  • Creative variance (how different or repetitive model responses are)
  • AI versus human judging comparisons to assess alignment with human taste
  • Creative problem-solving tests to measure the ability to think outside the box

Participants globally will judge outputs in a "Tinder for Ideas" style experience, receiving personal insights about their creative preferences and the LLMs that best match them.

Fueling Creativity and Bridging the Knowledge Gap

"The 4As is excited to help support this important research initiative,“ said Jeremy Lockhorn, SVP, Creative Technologies & Innovation at 4As. “Our members are rapidly adopting generative AI across many aspects of their business, and actively seeking guidance on which platforms can help achieve the most innovative and impactful work for their clients."

“There's a ton of stuff about how good different LLMs are at solving maths problems, coding and logic-based tasks and tests—but that's not much use for the creative industries,” said Tom Roach, VP Brand Strategy at Jellyfish/Brandtech, on behalf of the APG. “We need to know which models are best at generating new and original creative ideas, but at the moment we're all flying blind on that. It's exciting to be involved in a project that can help us be more creative with this incredible new technology and help the industry as a whole make better informed decisions on the AI tech we use to drive better results for our clients.” 

“We’re at a crossroads in the creative industries,” said Zoe Scaman, Founder of Bodacious. “AI is already embedded in our workflows, shaping ideas and generating outputs, but we’ve had no meaningful way to assess its contribution to creativity itself. This benchmark changes that. It’s not about pitting machines against humans, but about understanding which tools can genuinely elevate our thinking, unlock new directions, and push creative boundaries. If we want to harness AI not just for efficiency but for originality, we need standards rooted in real creative instincts, not just logic and grammar. That’s what this initiative delivers. And that’s why it’s vital, especially now.”

“The future of creativity is human – but AI’s ability to stimulate human creativity is exciting. Especially when we can learn which models produce the kind of interesting, divergent, and sometimes bonkers provocations that trigger our own individual creative brains in just the right way.” said James Hurman, Founding Partner of Previously Unavailable.

The study is currently accepting participants. Interested individuals can vote on LLM outputs at CreativityBenchmark.ai

Read more about it here.

Media Inquiries

Kite Hill for Springboards

springboards@kitehillpr.com 

We've got more like this

View All
Media

Springboards Secures Backing from Industry Powerhouse Names

Springboards, AI-powered platform, has announced the addition of a number of investors. These new partnerships follow adoption by over 200 agencies of the platform and the growing use of AI.

Read
Media

Brand Creative in the Age of AI Conversation with Peregian Digital Hub

What happens when two laid-off ex-agency folks tinker with AI during a global pandemic? You get Springboards—an idea accelerator now used by 120+ agencies to fight creative sameness and win more pitches. In this convo with Peregian Digital Hub Director Chris Boden, Pip and Amy share how they built a startup from scratch, why AI should fuel creativity—not replace it—and how they’re helping agencies fall in love with bold ideas again.

Read
Events

Breaking Free from the “Age of Average” – Why Springboards is Here to Revitalize Creativity

Obviously sharing a deck without the commentary leaves lots of room for misinterpretation but TLDR this is a biased opinion on the NEED for the industry to change the way we operate and to not look at AI as doom but an opportunity for rebirth.

Read

Let’s Break the Boring

Step right up,
request a demo

Thanks - you're in the queue!
We’ll be in-touch soon.
Oops! Something went wrong while submitting the form.