Matched markets
A stable historical cousin.
Compare the treatment geography with one or more places that behaved similarly over time. The fit must be stable, not merely similar on average after large swings.
Incrementality testing for DTC & ecommerce
Causal evidence for media allocation
Find out whether a channel is adding sales—or simply claiming them.
When reports add up to more sales than the business made, use a credible test to decide what deserves the next dollar.
Talk with EricClient-owned workDecision-first scopeUncertainty made visible
The question
Every channel can claim the sale. The business still has to allocate the next dollar.
Testing is for a genuine dispute: two or three channels claiming the same sale, a view-through channel whose credit feels too far from the conversion, or a budget decision that click reporting cannot settle.
The useful question is not whether a dashboard is “right.” It is whether a strategy is adding to the business—and what changes if you spend less, hold steady, or scale it.
01
Keep or add?
Does this channel create incremental demand, or mostly record demand created somewhere else?
02
How much?
When a channel belongs in the mix, what can a levels test teach about marginal response and scale?
03
What changed?
Did the intervention cause a meaningful business outcome under the conditions tested?
A strong fit
Enough signal to make a decision.
- Several meaningful sources of demand with competing claims on sales
- A real allocation decision: keep, add, reduce, or scale a channel
- About 12 months of outcome and media history, ideally with geographic detail
- A decision owner willing to reconcile different measurement perspectives
Multi-million-dollar scale and multiple meaningful channels are useful heuristics—not universal gates. The test should follow the decision and the available signal.
Better to start elsewhere
When a test cannot answer usefully yet.
- One paid channel drives nearly all meaningful demand, with no organic or other meaningful baseline
- Too little history, variation, or volume for a credible comparison
- A requirement that every report agree or that one dashboard must be the only answer
The next step may be cleaner data, a narrower attribution question, or waiting for a credible learning opportunity.
The comparison design
A geo holdout changes exposure. The real work is building the right comparison.
A treatment market is where media is introduced, paused, or changed. The question is what would have happened there otherwise.
01
Historical fit
Use prior sales to assess candidate markets before launching the test.
02
Treatment
Change media exposure in selected geographies while protecting the test conditions.
03
Comparison
Measure the outcome against a credible counterfactual—not a convenient dashboard read.
04
Decision
Translate the result, uncertainty, and next test into a bounded allocation move.
Synthetic control
A weighted counterfactual.
Combine multiple geographies into a comparison designed to resemble the treatment market’s historical behavior. It can be powerful, but may require more of the country and limit concurrent tests.
The practical answer
Let the data choose.
Back-test both approaches against history. When volume and capacity allow, more than one credible comparison can increase confidence in a result.
The engagement
From a contested claim to a documented decision.
- 01
Discovery & feasibility
Clarify the decision, KPI, available data, current reports, seasonality, promotions, channel definitions, and the feasible learning path.
- 02
Test design
Validate candidate comparisons, define treatment and control conditions, assess what the test can detect, and establish the decision rule before launch.
- 03
Execution support
Check that media is running—or withheld—where intended. Identify exposure bleed, related-channel effects, and signals that need explanation while the test is in flight.
- 04
Analysis & handoff
Deliver a decision-ready readout, understandable charts, underlying documentation, uncertainty, and the next action or learning plan.
Practical expectations
Rigor takes time. Fragmented data takes more.
The fastest work starts with accessible, consistently labeled data. Foundation work is sometimes the project—not an administrative prelude.
About one weekFocused measurement triage: decision, available evidence, likely method, and data gaps.
2–3 weeksFeasibility and test design once relevant data access is available.
Often 4–6 weeksIn-market runtime for sales or revenue; longer when the consideration cycle or intended effect is longer.
1–2 weeksAnalysis and handoff after the observation window closes.
Questions before committing
Do we need incrementality testing if platform reporting looks good?
Maybe. A platform can accurately report the conversions it observed while still being unable to answer how many would have happened without the advertising. Testing is most valuable when that difference would change a material allocation decision.
Can we test an established channel instead of turning it off?
Yes. When a channel clearly belongs in the mix, a levels test can be more useful: intentionally testing a lower, normal, or higher level of spend to learn about marginal response and possible diminishing returns.
Should we use matched markets or synthetic control?
Start with historical data. The right answer depends on which comparison is the more stable predictor for the proposed treatment markets and whether the business has enough volume and test capacity to support one or both approaches.
Will the test make every report agree?
No. Last click, MTA, MMM, and lift tests observe different evidence and answer different questions. The benefit is a clearer explanation of the disagreement and a more defensible decision—not a forced single number.
A practical first conversation
Resolve the next media-allocation question with evidence you can explain.
Bring the channels, reports, and decision in front of you. We’ll determine whether a readiness diagnostic, a scoped incrementality test, or another measurement step is the practical next move.
Talk with Eric about incrementality testing