Latest News
View All
Fast Five with Eleanor Rogers
Fast Five is our rapid-fire interview series, capturing quick takes from the industry on creativity and AI. 5 questions, 5 minutes, unfiltered.
Name
Eleanor Rogers, former Sales Director at Snap
How do you define creativity?
The true sign of intelligence is not knowledge, but imagination.” —Albert Einstein
Is AI a friend or a foe?
It depends who is in the driving seat and who is the back seat. If it helps you detect early disease and shares a personalised treatment plan to help heal you then it’s a saviour. If you just lost your job as AI has taken over then it’s the devil.
Name a piece of work that AI could never have come up with?
John Lewis Christmas Advert 2011 - The Long Wait
One of my all time English favourites that soothes the soul for all parents who worry about their kids and the damage of consumerism. Honestly though there isn’t a creative in history that AI couldn’t have a helping hand in to make the process shorter & smoother.
What’s the weirdest place you’ve ever found a great idea?
Pain. Pain is the place where you meet a new version of yourself and is a catalyst for thinking and seeing the world in a different way.
Favourite AI hack or use case? What do you think it is good for?
Uploading medical reports on a damaged knee to find out absolutely everything I can do to get back on the black runs one day.
World’s First LLM Benchmark for Creativity Finds AI Tools Are More Similar Than You Think
The 4As, IAA and more leading industry groups teamed up with Springboards to compare how top AI tools like ChatGPT, Gemini and Claude perform on creative tasks
New York, NY – October 21, 2025 – A comprehensive new study by Springboards, an AI platform inspiring creativity in advertising, found that popular AI tools like ChatGPT, Gemini, Claude and others perform much more similarly on creative tasks than many people think. Creativity Benchmark, conducted in collaboration with the 4As, ACA, APG, D&AD, IAA, IPA, and The One Club for Creativity, challenges the idea that there's a single "best" AI tool for creative work and shows agencies need more efficient ways to test AI tools for their specific needs.
Sixteen different AI systems – from OpenAI, Google, Anthropic, Meta, DeepSeek, Alibaba and others – were tested on real marketing challenges across 100 notable brands. Over 600 creative professionals from ad agencies, marketing teams, and strategy firms made over 11,000 comparisons to see which ones worked best. The biggest surprise? There was no clear winner. The differences between the "best" and "worst" AI tools were much smaller than expected.
"Everyone assumes some AI tools are way better than others for creative work," said Pip Bingemann, CEO and co-founder of Springboards. "But our tests showed the results were pretty close. Why? Because these models are machines designed to recognize patterns and give you the most probable answer—and 'probable' has never been called 'creative.' Keeping humans in the loop and optimizing for a wider range of varied ideas is crucial.”
The study looked at three types of creative challenges: finding surprising insights about consumers, creating big campaign ideas, and coming up with bold, attention-grabbing concepts.
Key Findings:
- Different AI Tools Win at Different Tasks: No single AI system was best at everything. Some were better at strategic thinking, others at wild, creative ideas. This means agencies might want to use different tools for different jobs.
- Variety of Ideas Matters Most: Some AI tools generated lots of different creative options for the same brief. Others kept suggesting similar ideas over and over. For real creative work, having many different options is just as important as having good ones.
- AI Can't Judge Creative Work Well: When researchers had AI systems evaluate creative ideas, they gave very different scores than human experts. This means agencies can't rely on AI to pick the best creative concepts – they still need human judgment.
- Standard Creativity Tests Don't Work for Marketing: Traditional creativity tests used in psychology don't predict which AI will be better at marketing-specific creative tasks. Brand work requires its own way of measuring creativity.
- Creative Preferences Vary by Location: Interestingly, creative professionals in different countries preferred different AI tools, suggesting that cultural differences affect what people consider good creative work.
“LLMs aren’t a one-size-fits-all solution—they're general purpose tools that require human creativity to unlock breakthrough outcomes," said Jeremy Lockhorn, SVP, Creative Technologies & Innovation, 4As. "These findings suggest agencies and brands should continue to evaluate which models are best suited for creative work - and that a multi-model approach may well be the best path forward."
“This study highlights that creativity isn’t about which AI you use, it’s about how you use it,” remarked Tony Hale, CEO, Advertising Council Australia. “The results reinforce what we see across the industry: the human spark remains essential to transforming good ideas into great ones. For agencies, the real opportunity is learning how to collaborate with these systems to expand, not replace, creative thinking.”
Methodology
The study involved 678 advertising professionals of diverse backgrounds, who participated in blind A/B idea judgments, likened to a "Tinder for Ideas." The data, collected over four weeks starting June 10, 2025, comprised 11,012 human comparisons across various brands, prompts, and models. This was analyzed using Bradley-Terry modeling and cosine distance for diversity scoring.
The research used four different ways to test AI creativity:
- Real Creative Professionals Made the Calls: Nearly 700 people working in advertising, marketing, and strategy compared AI-generated ideas side-by-side. They didn't know which AI created which idea, so they couldn't play favorites. The study covered ideas for 100 major brands across 12 different business categories.
- Tested How Many Different Ideas AI Can Create: Researchers asked each AI system to create 10 different responses to the same creative brief, then measured how different those responses were from each other. Some AI tools generated very similar ideas every time, while others came up with lots of variety.
- Checked If AI Can Judge Its Own Work: The team had three leading AI systems evaluate the same creative ideas that humans had already scored, to see if AI judges agreed with human experts. They didn't.
- Tried Standard Creativity Tests: The AI systems took adapted versions of creativity tests that psychologists use on humans, measuring things like how many ideas they generate and how original those ideas are.
All tests used the same settings and compared current AI systems from companies like OpenAI, Google, Anthropic, and Meta.
To access the full research white paper, visit https://arxiv.org/abs/2509.09702.
If you'd like to learn more about the results, visit this page. To access the original research, visit creativitybenchmark.ai
About Springboards
Springboards is an AI-powered platform built to inspire creativity in advertising. The platform empowers teams to explore more ideas, without sacrificing the craft of great work. Founded by industry veterans Pip Bingemann, Amy Tucker, and Kieran Browne, Springboards has already partnered with 150+ agencies globally and secured $3 million USD in seed funding from Blackbird Ventures. For more information, visit Springboards or contact hello@springboards.ai.
Fast Five with Reuben Halper
Fast Five is our rapid-fire interview series, capturing quick takes from the industry on creativity and AI. 5 questions, 5 minutes, unfiltered.
Name
Reuben Halper, Head of YouTube, Google New Zealand
How do you define creativity?
I'm a bit of a cynic in this space and think the idea of creativity as something truly original is actually overrated, given "humans abhor the new" . With that in mind my definition of creativity tends to be around combinatorial creativity where you combine existing ideas, insights, tech, etc. to develop something novel yet familiar. Or to quote Kirby Ferguson "Everything Is A Remix"
Is AI a friend or a foe?
Neither, it's a tool. In the same hands a hammer can be both a tool and a weapon. I feel the same way about AI.
Name a piece of work that AI could never have come up with?
I bet half the respondents will say Cadbury Gorilla and frankly I want to punch them in the face. I honestly don't think there's any idea that an AI could never have come up with as the space is evolving so rapidly and so much of the output comes down to the input and the prompting. I also want to include a non-advertising piece of creativity that an AI expressed in the form of the move that AlphaGo made in the second game vs Lee Sedol.
What’s the weirdest place you’ve ever found a great idea?
A bar in deep Alabama where a hardcore NASCAR fan asked why we couldn't visualise the effects of drafting. That became a massive project involving wind tunnels and patents.
Favourite AI hack or use case? What do you think it is good for?
NotebookLM is the shit for so many things both personal and professional. Probably my favourite general use case for GenAI is using it as a sparring partner and adversary to challenge my thinking.