Success stories

Caraway Cracks Upper-Funnel Campaigns on Meta

Dec 15, 2023

We’re big believers that the platforms with the broadest reach deserve the highest attention and experimentation efforts from us. We have never bought non-conversion optimized media on Meta due to measurement limitations even though it always felt intuitive to us. Thanks to Haus we were able to view the impact of upper funnel media on the business as a whole and have now made those efforts part of our evergreen strategy.
Connor Dault
VP Growth, Caraway
Connor Dault
VP Growth, Caraway

About Caraway

Caraway is a kitchenware company on a mission to craft well-designed home goods that thoughtfully raise the standards of what you cook with. Their products are designed to make your life easier and healthier as their cookware is made without Teflon or other toxic materials that can leach into your food. Caraway products are eco-friendly and come in sustainable packaging, ethically manufactured, and their sleek design complements any home. Caraway began as a direct to consumer company, but has recently expanded into third-party retailers like Amazon and Target.

The Challenge

Platforms like Meta have world-class machine learning capabilities, and their ad serving systems are very good at finding ways to optimize for the goals that a marketer sets. If the goal is to  optimize campaigns for lower funnel conversions or revenue, this often means that they are finding users who are already in-market to purchase. The risk that poses is that there is a limited number of users in-market, and they may be overserved with ads.

At a certain point, it is essential to create demand for the product as well as effectively capitalize on that demand. One way to do this is to diversify into new channels. Before you try a new channel, it is important to keep in mind that Meta still has unmatched scale, and they have a whole suite of upper funnel products to help create demand. The only challenge is that because these campaigns are not explicitly designed to directly affect sales, the effects of upper funnel campaigns are very hard to measure using traditional attribution methods.

The Solution

Caraway was keen to understand whether spending on upper funnel Meta campaigns could help ‘fill the funnel’ before their important holiday season, and ultimately drive the business metrics that they care about. 

The Caraway team decided to add a new campaign on top of their existing media, optimized toward a shallower KPI of site visits. The campaign was targeted to 50% of the US, and held out from the other half. The Haus app analyzed Caraway’s historical sales data to ensure that region groupings were split in a way where the markets behave in the same way, ensuring an ideal testing environment to introduce a new marketing treatment.

No items found.

The Results

By analyzing the divergence in sales and revenue between the treatment regions and the holdout regions, Caraway observed what in-platform reporting could not show: that these upper funnel campaigns were driving significant and efficient downstream activity. 

Meta upper funnel campaigns were responsible for driving ~4% of Caraway’s new customer revenue during the test period. Put another way, if Caraway was not running this tactic, their overall new customer revenue would have fallen by 4%. 

The incremental ROAS generated from the upper funnel campaign made it as efficient as many of their performance channels specifically designed to drive conversions.

Caraway iROAS across marketing channels

Other success stories

Upper Funnel Tests on Meta and TikTok Reveal New, Incremental Audiences for Lalo

Learn how Lalo gained the confidence to layer in upper funnel tactics to their evergreen Meta and TikTok strategies.

How Haus Helped Jameson Measure One of the Largest OOH Activations in Brand History: The Sphere in Las Vegas

Haus measured the sales impact of Pernod Ricard's largest OOH buy for Jameson whiskey.

Early AppLovin Results Are In

AppLovin is all the rage right now — and many marketers are wondering if this channel is as impactful as the platform claims. Let's dive into 4 early test results here at Haus.

Top-of-Funnel Creative Drives 13X the Lift of Lower-Funnel Creative for Javvy Coffee

Javy Coffee used Haus GeoTests to understand how their Meta creative impacted all sales channels. Their results were shocking and unexpected.

Hexclad Measures Meta's Incremental Impact for a High-AOV Product with a Long Consideration Phase

Hexclad observes a 67% decrease in Meta CPIA with a 3 week post-test window, confirming a long purchase cycle for this high AOV product.

Fresh Clean Threads Uncovers Meta's Incremental Impact on Amazon and DTC Sales

Fresh Clean Threads used Haus to provide comprehensive, actionable measurement of its marketing efforts across all their sales channels.

Inkbox Incrementality Testing Reveals Omni-Sales Impact Across Channels, Boosting Snap iROAS by 127%

Inkbox engaged with Haus to assess the impact on sales across DTC, Amazon, and Walmart.

Affiliate On/Off Test Reveals the Incrementality of Loyalty Sites for Global DTC Brand

This global enterprise brand wanted to understand if cash back and reward sites within their affiliate program were driving incremental revenue.

A/B/C Test Reveals the True Impact of Different Creative Strategies for Billion Dollar Brand

This test revealed that each creative variation is working hard for different business objectives and were effective for consumers at specific stages of their journey.

A Series of Three Incrementality Tests Prove Brand Search to Be Ineffective

This brand was spending a significant amount of money on Google brand search and wanted to understand if this tactic was driving incremental customer activations.

Thinking Beyond Dot-Com: How Newton Baby Uncovered the Halo Effects of TikTok Ads on Amazon Sales

Newton Baby measures the lift of both DTC and Amazon sales driven by TikTok ads for a clearer picture of total impact from the channel.

FanDuel Optimizes Spend Levels on YouTube via 3-Cell Diminishing Returns Test

FanDuel wanted to understand the optimal level of investment in YouTube so they ran a 3-cell diminishing marginal returns test.

Ritual Maximizes ROI on TikTok via Series of Incrementality Tests

Ritual optimizes TikTok strategy to drive 8% lift in incremental subscriptions.

Brand Increases Revenue by 200% by Optimizing Spend across the Google Universe

Multi-billion dollar omnichannel brand uses incrementality to calibrate MMM and last-click signals.

Jones Road Beauty Doubles New Customer Orders in YouTube

JRB theorized that YouTube was driving more value than could be measured by clicks so they decided to test it with Haus.

Caraway Maximizes PMax via 3-Cell Incrementality Test

Caraway tests PMax with brand terms and without brand terms in 3-Cell experiment to optimizing their buying strategy.

Ritual Increased Customer Retention by 2% in Two Days

Ritual uses a test and roll strategy to test 5 email variants in 45 days unlocking huge incremental customer billings.

FanDuel Supercharges Marketing Experimentation and Increases Sportsbook Activations by 11%

FanDuel uses a "test and roll" approach to quickly test into new channels, media mixes, flighting strategies, and bid types.

Tally Finds An Incrementality Platform They Can Trust

Tally accelerates testing velocity through Haus, and redistributes millions of dollars to drive a significant increase in borrowers.