MUD\WTR
Internal Analysis
Meta · same season, three years · CPM · CTR · CPO

Did the delivery event
actually hurt efficiency?

The fairest possible test: hold the season constant and vary the year. April–June ran on Website Purchase in 2024 and 2025, but on the custom Purchase – New Customer event in 2026. If the event hurts efficiency, 2026's Apr–Jun should look clearly worse than the prior two years. It doesn't. On CPM, CTR, and cost-per-order, the all-New-Customer quarter lands right in the normal range.

The verdict
Event not supported as an efficiency driver — on these metrics

Holding season constant, the all-New-Customer quarter is as efficient as the all-Website-Purchase quarters before it.

Apr–Jun cost-per-order: 2024 (Website Purchase) $125 → 2025 (Website Purchase) $108 → 2026 (New Customer) $122. The New-Customer quarter sits between the two Website-Purchase quarters — essentially tied with 2024.

The CPM step-up predates the event. CPM roughly doubled from $21 (2024) → $39 (2025) — both years running 100% Website Purchase. 2026 ($38) is flat vs 2025. So the expensive-impressions story is auction inflation over time, not the delivery event.

CTR is the best of the three years in 2026 (1.01% vs 0.58% / 0.93%). Three independent methods — the 2-year correlation report, the within-month head-to-head, and now this seasonal isolation — all land in the same place.

The one caveat that keeps your hypothesis alive: this measures cost per order. The New-Customer event's whole job is the new-customer mix, and the original symptom was new-customers/day (600→400). If the custom event finds orders but not genuinely new customers, the damage would live in cost-per-new-customer — invisible to everything here. That's the test that could still convict the event (see bottom).

ConfidenceModerate–high (for CPM/CTR/CPO)
MethodSame-season (Apr–Jun) across 3 years
Not testedCost per new customer
01 · Same season, three years

Apr–Jun isolated, by year

The cleanest cut: April through June only, compared across 2024, 2025, and 2026. The event regime is the big thing that changed in 2026. Account-level (matches the figures the audit cited); a purchase-campaigns-only cut is within a dollar or two and tells the same story.

Read it: if the custom event were structurally inefficient, 2026 would break away from the pack. Instead its CPO ≈ 2024, its CPM ≈ 2025, and its CTR is the strongest of the three.

02 · Full-year overlay

Each metric, three years stacked on the calendar

X-axis is month of the year; the three lines are 2024, 2025, 2026. The shaded band is Apr–Jun — the event-isolation window (2026 = New Customer; prior years = Website Purchase). Look at whether the purple (2026) line breaks away from the others inside the band. It tracks them.

2024 (Website Purchase) 2025 (Website Purchase) 2026 (New Customer in Q2)
CPM
cost per 1,000 impressions ($)
Link CTR
%
CPO
cost per order ($)
03 · The "+32%" that looked damning

Why the Q1→Q2 jump is a mirage

Earlier the standout signal was that 2026's cost-per-order rose +32% from Q1 to Q2 — steeper than prior years — right as New Customer went all-in. But the seasonal view shows that's driven by an unusually efficient Q1 2026 (the Website-Purchase "pullback" quarter), not an abnormally bad Q2.

Q2 cost-per-order is ~$122 in 2026 vs $125 in 2024 — flat. The big "+32%" is the low Q1 base ($93, the best Q1 of the three years), so it's mean-reversion to a normal Q2, not event damage.

04 · The test that could still convict the event

Cost per NEW customer, same seasonal method

Why this one matters

Everything above is cost per order. MUD\WTR's real KPI — and the audit's original symptom — is new customers (600→400/day) and blended new-customer CAC. A custom "new customer" event could keep cost-per-order flat while quietly degrading the share of orders that are genuinely new (e.g., the Elevar signal misfiring). That damage is invisible here.

What I'd run next

  • Pull monthly new-customer count + blended new-customer CAC (Daily Spend Tracker / Northbeam / Shopify) for 2024–2026.
  • Run the same Apr–Jun seasonal isolation on new-customer CAC instead of cost-per-order.
  • If 2026 Apr–Jun new-customer CAC breaks clearly worse than 2024/2025 — the event (or its all-in scaling) is implicated after all.
  • The definitive version remains a live holdout test (Website Purchase + native "Acquire New Customers" vs the custom event), judged on new-customer CAC.