Incrementality Testing
Incrementality testing measures the additional conversions a marketing campaign actually caused, beyond what would have happened without it.
In depth
Incrementality tests work by comparing a treatment group exposed to a campaign against a holdout or control group that is not, then attributing the difference in outcomes to the campaign itself. This is a stronger signal than standard attribution because it controls for demand that would have converted organically, which last-click and even multi-touch models routinely overcredit to paid channels. A common pitfall is contaminating the control group, for example when the holdout audience still sees the brand through another channel, which shrinks the measured lift and makes a genuinely effective campaign look worthless.
In a quiz-funnel and lead-qualification workflow, incrementality testing answers whether your ads truly generate net-new qualified leads or merely intercept people who would have found the scorecard anyway. By holding out a randomized share of a target audience and comparing high-scoring lead volume between groups, you can quantify the real lift per channel and reallocate budget with confidence. The mistake to avoid is running tests too short to reach statistical significance; with long B2B cycles, an underpowered test produces noisy results that lead teams to cut channels that were actually incremental.
Example in practice
Frequently asked questions
How is incrementality testing different from attribution?
Attribution credits conversions to touchpoints based on rules like last click, while incrementality testing uses a holdout group to isolate the conversions a campaign actually caused. Incrementality controls for demand that would have converted anyway, which attribution typically overcredits.
What is a holdout group?
A holdout group is a randomized portion of your target audience deliberately not exposed to a campaign, used as a control. Comparing outcomes between the exposed group and the holdout reveals the true lift the campaign produced.
Why do B2B incrementality tests often fail?
Long sales cycles and low weekly conversion volumes make it hard to reach statistical significance, so underpowered tests produce noisy, misleading results. Running the test long enough and protecting the control from contamination are essential for a valid read.