Assessing whether data can support MMM yet

The short answer

Sometimes, not yet. MMM needs enough channel history and real variation in spend to separate signal from noise, and thin, volatile, or badly tracked data returns a confident-looking model that is wrong. The honest answer is a go or no-go check first, run in Cassandra, with a staged path when the data is not there yet.

Applies to

B2B/SaaSEcommerceAgencyBrand
Assessing data readiness before committing to MMMopenassumptionspriorspredictionsNOTHING HIDDEN INSIDE
Assumptions, priors and every past prediction stay visible, so anyone who asks can check the work.

Fitting a model to history that just reversed by market

Growth has swung sharply within the same year, with markets moving in opposite directions at once. A model trained on that history would read the swings as a stable pattern and hand back a confident answer describing a moment that already ended. Whoever brought that tool in becomes the one holding it if it is wrong, and the mistake stays silent until spend has already gone against it. Waiting feels like falling behind, but building on a wrong pattern feels worse, because someone signed off on it.

An honest read on whether the history is stable enough to model yet comes before anyone commits budget to acting on it. A staged path follows when it is not: which signals to start collecting now, and what the data needs to look like before a model earns trust. A method gets brought in once it earns its own credibility, not once its confidence outruns the evidence behind it.

Building on a tracking history with a known gap in it

Part of the account's own transaction history is unusable, because a past platform change broke tracking for a stretch of time before anyone noticed. A model built across that gap would return numbers that look precise while resting on data that was never actually collected. Whoever already repaired one measurement failure at this account risks the exact credibility spent months rebuilding by sponsoring a second one, even accidentally. The decision is not fully anyone's to make alone, which means a wrong call also lands on whoever approved it.

A clear answer on whether the usable history is enough to build on gets checked before anyone stakes a recommendation on it. The option to model only the clean period replaces pretending the gap does not exist. A method gets brought in on evidence that can stand up in front of the people who already watched the last one fail.

Recommending MMM across a client book where data maturity varies by client

A book where client data maturity varies widely means the method that works cleanly for the best-resourced accounts can return a number nobody can defend for a thinner client. Whatever number reaches that client comes from the agency, not a vendor, so the risk of a data-hungry method past what the account can support sits on the agency's side of the relationship. Having already been burned once by over-promising on a thin dataset, qualifying a client's readiness first matters more than vouching for an output nobody can stand behind. Over-promising to one client on the book puts every other relationship at risk too.

A readiness check run before any recommendation goes to the client matches the method to what their data can support. A staged option for thinner accounts replaces one method forced onto every client regardless of scale. And vouching for numbers stays possible across the whole book, not just the cleanest accounts.

Weighing MMM against a long sales cycle with too few conversions to test

A long sales cycle, sparse conversions, and most of the history sitting in one dominant channel with little variation to learn from leave little for a model to work with. A model asked to explain outcomes from that little movement returns a confident-looking answer built on almost nothing, and jumping straight into it stakes credibility on exactly that gap. Earlier attempts at this kind of modeling inside the same company already stalled on this exact data and maturity gap, before the current owner was accountable for it. Delay beats sponsoring a method whose weak point can already be named in advance.

An honest assessment of whether conversion volume and channel variation are enough to model credibly comes before anyone stakes a name on the attempt. A staged path built around creating more usable variation first replaces a method forced onto data that cannot support it yet. A documented failure stops repeating under the same name, on a chosen timeline.

What changes

The decision to model or wait gets made on an honest read of the account's own data, before anyone stakes credibility on the answer it gives.

What this does not do

This is a go or no-go read on the account's data, not a promise that a model gets built regardless of what it finds. It needs enough history behind each channel, and enough movement in that spend to read against, rather than a large budget. In our own fleet a channel on under 2% of the budget with two years of history read almost every time, while a channel of any size with under three months did so about seven times in ten. Below that, the honest answer is a staged path, not a model run anyway. It does not replace incrementality tests already in motion; it decides how much weight the existing data can carry before those tests are designed.

Who this is for

This applies most to eCommerce brands with volatile or gap-ridden spend histories already burned by one wrong number, B2B SaaS teams running long, sparse-conversion cycles concentrated in one channel, and full-service agencies vouching for a single method across a book of clients with uneven data maturity.

Questions

What does data readiness for MMM mean?

Data readiness means a channel has run long enough, and its spend has moved enough, for a model to tell a genuine pattern from noise. Length of history matters more than size of budget. Without it, a model can still run and still return a confident-looking number, but that confidence would not be earned by the data underneath it.

How does a readiness check for MMM work?

By reviewing the history actually on hand: how long each channel has been running, how much its spend has genuinely varied, how much volume flows through it, and where tracking gaps or platform migrations may have broken continuity. That review produces a go or no-go answer plus a staged plan if the answer is not yet.

Can MMM work with long sales cycles and sparse conversions?

Sometimes, and the honest way to find out is the same readiness check: whether enough usable variation exists across a long cycle to separate a channel's effect from everything else moving at the same time. Where conversions are too sparse and concentration in one channel too high, building variation first is often the more honest starting point.

When is data not ready for MMM?

When history is too short, too volatile, or interrupted by a tracking gap or platform change, when almost all spend and conversion volume sits in one channel with no real variation, or when the account is too new to have lived through a full cycle. In those cases, the honest recommendation is to wait or build variation first, not to model anyway.

What happens when MMM runs before the data is ready?

The model still returns a number, and that number can look confident even when the underlying data cannot support it, which is the failure mode that costs the most because it stays silent until someone has already acted on it. A readiness check catches this before the number reaches a decision.

The product behind it