Success stories

A Series of Three Incrementality Tests Prove Brand Search to Be Ineffective

Feb 26, 2024

The Challenge

This brand was spending a significant amount of money on Google brand search and wanted to understand if this tactic was driving incremental customer activations. They also wanted to understand if these results changed due to seasonality or if brand search was more effective in new expansion markets.

The Solution

The brand decided to run a series of 3 incrementality tests - one during slow season with all markets, one during peak season with all markets, and one specifically for new markets where they had not yet launched their product. They designed the tests to be 2-cell experiments with a holdout with the structure listed below:

Test 1: Slow Season

Test 2: Peak Season

Test 3: New Market Launch

The Results

The initial test ran for 2 weeks and showed the slightest bit of lift - 1% lift at a CPA that is highly inefficient for the brand. The second test ran during peak season and resulted in no lift to the business at all. Finally, the third test ran in new markets with less established awareness and also resulted in no lift. After this series of tests the brand felt comfortable turning brand search off entirely and reallocating those media dollars to other incremental channels.

No items found.

See Haus in action

Discover if you're over-investing in brand search or other campaigns.

Get a Demo

Other success stories

Upper Funnel Tests on Meta and TikTok Reveal New, Incremental Audiences for Lalo

Learn how Lalo gained the confidence to layer in upper funnel tactics to their evergreen Meta and TikTok strategies.

How Haus Helped Jameson Measure One of the Largest OOH Activations in Brand History: The Sphere in Las Vegas

Haus measured the sales impact of Pernod Ricard's largest OOH buy for Jameson whiskey.

Early AppLovin Results Are In

AppLovin is all the rage right now — and many marketers are wondering if this channel is as impactful as the platform claims. Let's dive into 4 early test results here at Haus.

Top-of-Funnel Creative Drives 13X the Lift of Lower-Funnel Creative for Javvy Coffee

Javy Coffee used Haus GeoTests to understand how their Meta creative impacted all sales channels. Their results were shocking and unexpected.

Hexclad Measures Meta's Incremental Impact for a High-AOV Product with a Long Consideration Phase

Hexclad observes a 67% decrease in Meta CPIA with a 3 week post-test window, confirming a long purchase cycle for this high AOV product.

Fresh Clean Threads Uncovers Meta's Incremental Impact on Amazon and DTC Sales

Fresh Clean Threads used Haus to provide comprehensive, actionable measurement of its marketing efforts across all their sales channels.

Inkbox Incrementality Testing Reveals Omni-Sales Impact Across Channels, Boosting Snap iROAS by 127%

Inkbox engaged with Haus to assess the impact on sales across DTC, Amazon, and Walmart.

Affiliate On/Off Test Reveals the Incrementality of Loyalty Sites for Global DTC Brand

This global enterprise brand wanted to understand if cash back and reward sites within their affiliate program were driving incremental revenue.

A/B/C Test Reveals the True Impact of Different Creative Strategies for Billion Dollar Brand

This test revealed that each creative variation is working hard for different business objectives and were effective for consumers at specific stages of their journey.

Thinking Beyond Dot-Com: How Newton Baby Uncovered the Halo Effects of TikTok Ads on Amazon Sales

Newton Baby measures the lift of both DTC and Amazon sales driven by TikTok ads for a clearer picture of total impact from the channel.

FanDuel Optimizes Spend Levels on YouTube via 3-Cell Diminishing Returns Test

FanDuel wanted to understand the optimal level of investment in YouTube so they ran a 3-cell diminishing marginal returns test.

Caraway Cracks Upper-Funnel Campaigns on Meta

When measured outside of click based attribution, Meta upper funnel campaigns are efficient enough to become a part of Caraway’s evergreen, always-on strategy.

Ritual Maximizes ROI on TikTok via Series of Incrementality Tests

Ritual optimizes TikTok strategy to drive 8% lift in incremental subscriptions.

Brand Increases Revenue by 200% by Optimizing Spend across the Google Universe

Multi-billion dollar omnichannel brand uses incrementality to calibrate MMM and last-click signals.

Jones Road Beauty Doubles New Customer Orders in YouTube

JRB theorized that YouTube was driving more value than could be measured by clicks so they decided to test it with Haus.

Caraway Maximizes PMax via 3-Cell Incrementality Test

Caraway tests PMax with brand terms and without brand terms in 3-Cell experiment to optimizing their buying strategy.

Ritual Increased Customer Retention by 2% in Two Days

Ritual uses a test and roll strategy to test 5 email variants in 45 days unlocking huge incremental customer billings.

FanDuel Supercharges Marketing Experimentation and Increases Sportsbook Activations by 11%

FanDuel uses a "test and roll" approach to quickly test into new channels, media mixes, flighting strategies, and bid types.

Tally Finds An Incrementality Platform They Can Trust

Tally accelerates testing velocity through Haus, and redistributes millions of dollars to drive a significant increase in borrowers.