Skip to main content
    Updated 3 min read

    How to measure digital campaign incrementality

    In short: Measuring incrementality means estimating a credible counterfactual and translating lift into net economics. Without a counterfactual, every campaign report is really just a description of what already happened.

    Written for: Ecommerce, CRO, analytics, CRM, data, personalisation and digital product leaders.

    Cover: How to measure digital campaign incrementality

    Measuring incrementality means estimating a credible counterfactual and translating lift into net economics.

    What is incrementality and why does it matter in digital marketing?

    A campaign may show many attributed conversions while creating little additional growth. The difference depends on how many customers would have purchased anyway, cross-channel cannibalisation and the effect on margin and recurrence. In service businesses, the decision does not end when a customer clicks “buy”: the digital promise must connect with operations, service delivery, data and profitability. This is why the topic should be treated as a business decision rather than an isolated marketing or technology enhancement.

    What do you need to measure incrementality?

    A sound approach combines four dimensions. Reviewing them separately helps expose friction; managing them as a system allows the direct channel to grow without transferring complexity to customers or the organization.

    1. Question and causal unit

    Define whether the goal is to measure an audience, channel, campaign, creative, market or investment level. The assignment unit should prevent contamination between control and treatment. The starting point is a concrete decision: which signal will be used, for whom, with which action and which outcome should change. Collecting more data does not replace this definition.

    2. Control design

    Use user holdouts, geo experiments, switchbacks or suppression according to coverage and operations. The control must be comparable and remain free from the relevant treatment. The signal needs quality, identity, consent, freshness and a fallback when confidence is insufficient. Without these conditions, automation amplifies errors.

    3. Measurement and power

    Choose outcome, horizon, baseline, sample and duration before launch. Small effects need volume and stability; not every test can read final sales. Instrumentation should record exposure, response, outcome and guardrails. Only then can the organisation distinguish correlation, attribution and incremental effect.

    4. Economics and scaling

    Translate incremental sales into margin after discounts, media, payments, cancellations and service. The answer should inform the next investment level, not only validate the past. The capability requires ownership, data contracts, QA, monitoring and a learning cadence. Without operations, the use case degrades after launch.

    How do you measure a campaign's incrementality step by step?

    Sequence matters. Starting with a tool or a feature list usually creates an expensive project that is difficult to govern. The following roadmap forces the business decisions first and the implementation second.

    1. Prioritise material decisions. Choose campaigns with meaningful spend, uncertainty or cannibalisation.

    2. Select design and population. Agree the unit, control, exclusions and period.

    3. Pre-specify analysis. Set metrics, MDE, segmentation and stopping rules.

    4. Execute and monitor. Control exposure, spillover, balance and anomalies.

    5. Translate into budget. Estimate iROAS, marginal margin and confidence range.

    How do you interpret incrementality test results?

    A useful dashboard does not accumulate indicators: it connects behaviour, economics and execution. Metrics should be reviewed by segment, device, market and journey stage so that averages do not hide the actual problem.

    • Incremental conversions: Difference in sales caused by the treatment.

    • Incremental revenue: Additional value adjusted for cancellations and refunds.

    • iROAS: Incremental revenue or margin per campaign cost.

    • Incremental customer cost: Spend over causally acquired new customers.

    • Spillover and cannibalisation: Effect on other channels, products or periods.

    Which mistakes invalidate an incrementality measurement?

    • Creating a control that is too small or exposed to the same campaign.

    • Selecting markets after observing performance.

    • Reading results before the agreed duration.

    • Applying average lift to any level of investment.

    Conclusion

    Incrementality does not remove all uncertainty, but it improves decision quality. When embedded in planning, it turns marketing from an attribution dispute into a capital-allocation discipline.

    Sources and further reading

    Consumer Services Hub designs measurement, CRO and personalisation programmes connected to business outcomes and real execution capacity.

    Consumer Services Hub - Strategic ecommerce consultancy for B2C service companies

    consumerserviceshub.com

    Rodrigo Maroto

    Written by

    Founder of Consumer Services Hub. Consultant and strategist with 15+ years of experience in ecommerce, digital product management, and consumer services.

    View LinkedIn profile

    If you enjoyed, share this article:

    Build a conversion programme

    Experimentation and personalisation with governance, not one-off tests.

    Talk to us

    Whether you're launching a new digital channel, optimizing an existing one, or unlocking the next stage of growth — we're ready to help.

    Financiado por la Unión Europea - NextGenerationEUGobierno de España - Ministerio para la Transformación DigitalRed.esPlan de Recuperación, Transformación y ResilienciaKit Digital