Paid Media · Measurement

Marketing Measurement & Incrementality

Every ad platform grades its own homework and gives itself an A. Measurement is the discipline of ignoring the self-graded report and asking the only question that matters: what would have happened if the spend had never run? Answer that honestly and half of a mature media plan reorganizes itself.

The report is graded by the thing being tested

Platform-reported ROAS is the most confidently wrong number in marketing, and it isn’t fraud — it’s structural. Each platform can only observe the conversions it touched, so it reports those and stays silent about the counterfactual. Run the simple exercise of summing reported revenue across every channel and comparing it to the P&L. The gap is the double-counting baked into every optimization decision you’ve been making.

The damage isn’t academic. Budget flows toward whichever channel is best at observing conversions — typically branded search and retargeting, which mostly intercept demand that already exists — and away from the channels that created the demand. The dashboard improves. The business doesn’t. Measurement is the discipline that breaks that loop.

The three tools, and what each is actually for

Teams argue about attribution versus incrementality versus media mix modeling as if they had to pick one. They answer different questions and work best stacked.

Attribution is a fast, directional read for steering in-flight. It’s fine for “which ad is fatiguing this week” and dangerous as the basis for a budget decision, because it inherits every observation bias the platforms have.

Incrementality testing is causal truth about one channel over one window. A holdout, a geo test, a matched-market design, an audience suppression — you build the comparison the platform will never hand you and read the lift. It’s the ground truth everything else gets calibrated against.

Media mix modeling is the top-down view across the whole plan, including the channels that can’t be clicked. It’s the only way to allocate across CTV, video, audio, and out-of-home alongside the trackable channels without pretending the un-clickable ones don’t exist.

The structure that works: use tests to calibrate the model, use the model to allocate, and keep attribution in its lane as a daily steering instrument.

Reported ROAS answers “what did the platform observe?” Incrementality answers “what did the spend cause?” Those are different questions, and only one of them is safe to put in front of a CFO.

Measurement is the referee for the intent argument

The Intent lane makes the case that demand generation and demand capture are one system, and that capture channels quietly take credit for demand generation created. Measurement is what settles it. A holdout on branded search or retargeting routinely shows that a large share of that reported revenue would have arrived anyway — the channel was standing where demand was already going to land. That’s not an argument you can win with a dashboard; it’s an experiment. Incrementality is the only method that separates the spend that created demand from the spend that merely observed it, which is why the whole full-funnel case ultimately rests here.

What I do

Establish causality before allocating. Holdouts and geo tests are cheap relative to the budgets they govern. A test that costs a fraction of a quarter’s spend and reveals a channel is half as productive as reported pays for itself immediately.

Allocate on contribution, not revenue. Revenue-based ROAS targets quietly push spend toward high-revenue, low-margin products. Allocating on contribution margin changes which campaigns look like winners — sometimes dramatically.

Model the whole mix, including what can’t be clicked. CTV, video, audio, and out-of-home do real work that click-based systems can’t see. Modeling them alongside the trackable channels is the only way to stop underfunding the top of the funnel by default.

Keep every read executable. Measurement that doesn’t change a buying decision is a research project. Every read should terminate in an action: shift this budget, kill this line item, extend this test, raise this bid floor.

How I use AI here without handing over the keys

I build agents to do the labor — pulling and normalizing reporting, flagging anomalies, running forecast scenarios, preparing modeling inputs — each with guardrails and defined parameters. What they don’t do is decide. There’s always a human on top with the context to catch drift before a dashboard reports it. Measurement is where a wrong automated call compounds fastest, so it’s the last place I’d remove the person.

Further reading

Where this fits

Further reading

Posts from this lane. Browse the full archive by category: Paid Media

Frequently asked questions

Why is platform-reported ROAS misleading?

Because it reports correlation as if it were cause. A platform can only count conversions it was able to associate with an impression or click it served, so it takes credit for demand that already existed, for buyers who would have purchased anyway, and often for the same conversion a second platform is also claiming. Sum the platform-reported revenue across a mature account and it routinely exceeds what the business actually booked. That overcount is the tell: reported ROAS measures observation, not impact.

What is incrementality and how do you measure it?

Incrementality is the revenue that would not have happened without the spend — the true causal contribution. You measure it by building a comparison the platform can’t give you: a geographic holdout, a matched-market test, an audience suppression, or a platform lift study, reading the difference between an exposed group and an unexposed one. It’s more work than opening a dashboard, and it’s the only figure that survives a conversation with a CFO, because it answers what changed rather than what was observed.

Do I need attribution, incrementality testing, or media mix modeling?

All three, layered, because they answer different questions. Attribution is a fast, directional read for in-flight optimization and should never be the sole basis of a budget decision. Incrementality testing gives causal truth about a specific channel over a specific window. Media mix modeling gives a top-down allocation view across everything — including channels with no click at all, like CTV and out-of-home. The right structure uses tests to calibrate the model and the model to allocate, with attribution only for day-to-day steering.

How do you measure upper-funnel channels like CTV and out-of-home?

With geo-based testing and modeling, because those channels have no click to hide behind. You hold a set of matched markets dark, run the channel in the rest, and read the difference in outcomes — or you fold the channel into a media mix model that estimates its contribution alongside the trackable channels. Brands that can measure the upper funnel properly usually discover they were underfunding it, because the channels that generate demand rarely get credit from systems designed to observe the moment demand converts.

How should AI be used in measurement without letting it run the budget?

Use it for the labor, not the decision. Agents are good at pulling and normalizing reporting, flagging anomalies, running forecast scenarios, and preparing modeling inputs — each with guardrails and defined parameters. What they don’t do is decide. There’s always a human on top with the context to catch drift before a dashboard reports it, using the agents to validate a decision chain rather than outsource it. Measurement is where a wrong automated call compounds fastest, so it’s the last place to remove the human.

What does incrementality reveal about demand generation vs demand capture?

Usually that the capture channels are over-credited and the generation channels are under-credited. Branded search and retargeting report huge ROAS because they observe conversions well, but a holdout often shows much of that revenue would have arrived anyway — it was intercepting demand something upstream created. Incrementality is the referee for the whole intent argument: it’s the only method that can separate the spend that created demand from the spend that merely stood where the demand was going to land.

Want a measurement design that tells you which line items are actually earning their keep? Connect on LinkedIn  ·  Email me