Success stories

FanDuel Optimizes Spend Levels on YouTube via 3-Cell Diminishing Returns Test

Jan 23, 2024

The Challenge

FanDuel knew that YouTube was a key channel for their business and wanted to understand the optimal level of investment in YouTube. They specifically wanted to understand where their business-as-usual spend fell on a diminishing marginal returns curve, and whether they had room to spend more on YouTube efficiently.

The Solution

FanDuel designed a 3-cell, no holdout test in the Haus app - treating 1/3 of their eligible Sportsbook markets with ‘low’ spend levels, reaching 20% of their target audience, 1/3 with medium spend, reaching 40% of their target audience, and 1/3 with high spend, reaching 60% of their target audience.

The Results

After running this test for 3 weeks, FanDuel learned that the medium spend tier was the optimal spend level in Youtube to efficiently maximize activations. There was no observed lift between the medium spend level and high spend level, indicating that 40-60% reach is where they might be hitting diminishing returns.

It is important to note, however, that the media buying tactics within each of the cells was different based on the target reach %. Cell C had the highest budget allocation towards YouTube’s direct response product Video Action Campaigns but produced the least efficient cost per incremental activation. Cell B favored an upper funnel optimization approach with only 20% of budget allocated towards Video Action Campaigns and drove the greatest efficiency and lift in new customer acquisition.

These results suggest that diversifying media buying objectives on YouTube may lead to better results. However, since these media buying tactics were not isolated with equal spend, target reach, and saturation levels between cells–the brand can’t say for certain whether the same results would hold across consistent spend levels in all three cells. For example, it may have been the case that 50% allocation towards Video Action Campaigns in high spending cell C could have exhausted the pool of conversion optimized impressions available and led to decreasing efficiency from oversaturating the audience.

No items found.

Next Steps

FanDuel is eager to dive deeper into YouTube and isolate different reach and spend levels with equivalent media buying strategies across all 3 cells. This is in an effort to ensure that conclusions regarding diminishing marginal returns in spend levels from this test were not impacted by the unique media buying approaches in each cell.

Concurrently, FanDuel is going to test further into intra-YouTube media mix allocations to further investigate the optimal budget split between direct response and non direct response objectives at equal spend levels across cells.

Other success stories

Upper Funnel Tests on Meta and TikTok Reveal New, Incremental Audiences for Lalo

Learn how Lalo gained the confidence to layer in upper funnel tactics to their evergreen Meta and TikTok strategies.

How Haus Helped Jameson Measure One of the Largest OOH Activations in Brand History: The Sphere in Las Vegas

Haus measured the sales impact of Pernod Ricard's largest OOH buy for Jameson whiskey.

Early AppLovin Results Are In

AppLovin is all the rage right now — and many marketers are wondering if this channel is as impactful as the platform claims. Let's dive into 4 early test results here at Haus.

Top-of-Funnel Creative Drives 13X the Lift of Lower-Funnel Creative for Javvy Coffee

Javy Coffee used Haus GeoTests to understand how their Meta creative impacted all sales channels. Their results were shocking and unexpected.

Hexclad Measures Meta's Incremental Impact for a High-AOV Product with a Long Consideration Phase

Hexclad observes a 67% decrease in Meta CPIA with a 3 week post-test window, confirming a long purchase cycle for this high AOV product.

Fresh Clean Threads Uncovers Meta's Incremental Impact on Amazon and DTC Sales

Fresh Clean Threads used Haus to provide comprehensive, actionable measurement of its marketing efforts across all their sales channels.

Inkbox Incrementality Testing Reveals Omni-Sales Impact Across Channels, Boosting Snap iROAS by 127%

Inkbox engaged with Haus to assess the impact on sales across DTC, Amazon, and Walmart.

Affiliate On/Off Test Reveals the Incrementality of Loyalty Sites for Global DTC Brand

This global enterprise brand wanted to understand if cash back and reward sites within their affiliate program were driving incremental revenue.

A/B/C Test Reveals the True Impact of Different Creative Strategies for Billion Dollar Brand

This test revealed that each creative variation is working hard for different business objectives and were effective for consumers at specific stages of their journey.

A Series of Three Incrementality Tests Prove Brand Search to Be Ineffective

This brand was spending a significant amount of money on Google brand search and wanted to understand if this tactic was driving incremental customer activations.

Thinking Beyond Dot-Com: How Newton Baby Uncovered the Halo Effects of TikTok Ads on Amazon Sales

Newton Baby measures the lift of both DTC and Amazon sales driven by TikTok ads for a clearer picture of total impact from the channel.

Caraway Cracks Upper-Funnel Campaigns on Meta

When measured outside of click based attribution, Meta upper funnel campaigns are efficient enough to become a part of Caraway’s evergreen, always-on strategy.

Ritual Maximizes ROI on TikTok via Series of Incrementality Tests

Ritual optimizes TikTok strategy to drive 8% lift in incremental subscriptions.

Brand Increases Revenue by 200% by Optimizing Spend across the Google Universe

Multi-billion dollar omnichannel brand uses incrementality to calibrate MMM and last-click signals.

Jones Road Beauty Doubles New Customer Orders in YouTube

JRB theorized that YouTube was driving more value than could be measured by clicks so they decided to test it with Haus.

Caraway Maximizes PMax via 3-Cell Incrementality Test

Caraway tests PMax with brand terms and without brand terms in 3-Cell experiment to optimizing their buying strategy.

Ritual Increased Customer Retention by 2% in Two Days

Ritual uses a test and roll strategy to test 5 email variants in 45 days unlocking huge incremental customer billings.

FanDuel Supercharges Marketing Experimentation and Increases Sportsbook Activations by 11%

FanDuel uses a "test and roll" approach to quickly test into new channels, media mixes, flighting strategies, and bid types.

Tally Finds An Incrementality Platform They Can Trust

Tally accelerates testing velocity through Haus, and redistributes millions of dollars to drive a significant increase in borrowers.