← Back to Blog
Founder ColumnGEOAI VisibilityAnalyticsAIAA
On May 5, 2026, Shopify released its Q1 earnings report containing a set of headline AI metrics:
These numbers are genuine. They come from Shopify's official earnings call with $100.7 billion in quarterly GMV as context. But for data teams, the critical question is not "how much did it grow?" but: can your dashboard correctly reflect this growth, and does your team know how to interpret it?
Thirteen-times growth sounds extraordinary. But if last quarter's AI search orders totaled 100, this quarter's total is 1,300 — on a platform processing over $100 billion in GMV per quarter, 1,300 AI orders is still a tiny fraction of the total.
Adobe and BrightEdge data provide further context for this "low base" reality:
High-multiple growth and low absolute value can both be true simultaneously. This is not a contradiction — it is a measurement challenge that requires specific handling. If you report only "AI orders grew 13x," your CEO may assume AI is already a major revenue source. If you report only "AI traffic is 1% of the total," your CEO may conclude AI is not worth prioritizing. Both reports are incomplete. Both lead to bad resource allocation decisions.
We recommend every team track three AIAA growth velocities simultaneously to avoid conflating different types of growth.
Definition: Total AIAA across all currently active data sources, compared to the prior period.
This is the most intuitive metric — "how much did total visible AI activity grow?" But it is susceptible to interference from newly connected data sources. If you deployed Edge Lite Bridge last month and can suddenly see agent requests that were previously invisible, your AIAA Request layer will surge. That surge is not because AI agents suddenly increased — it is because your observation capability expanded.
Definition: Compare only data sources that were active in both the current and prior periods.
This answers the real question: with equal visibility, are AI actions actually increasing?
Example: You deployed Edge Lite Bridge last month. Observed growth jumped 300%. But 250 percentage points of that jump come from finally seeing agent requests that were always happening but invisible before. Comparable growth might be only 50% — that is your real growth.
Comparable growth requires data source tagging. Each AIAA action needs to record which data pipeline generated it (first-party JS, Edge Lite, server logs, GA4, AI response sampling, e-commerce platform). Only data from pipelines active in both periods participates in comparable growth calculations.
Definition: Observed Growth minus Comparable Growth.
This is not bad news — it means your visibility is improving. But it must be explicitly labeled as "we can now see AI activity that was previously invisible to us," not "AI grew."
A simple analogy: you install 4 security cameras in a room and see 100 people. Then you add 2 more cameras and see 150 people. The headcount increased 50% — but some of that increase is from the new cameras covering previously blind spots where people were always present. Actual new arrivals might account for only 20%, with the remaining 30% being "visibility improvement."
Shopify's 13x growth is primarily order-level growth occurring at the Commerce and Attribution layers. This is the highest-quality growth in the AIAA framework — real human users, real purchase behavior, real revenue. It is not Request-layer crawler inflation or Answer-layer sampling fluctuation.
But even for Shopify's high-quality growth, teams should ask several questions:
Not all AIAA growth is equally valuable. We propose a growth quality classification:
Adobe's Q1 2026 data contains an underappreciated signal: AI referral traffic conversion rates underwent a dramatic reversal.
That is an 80-percentage-point swing in 12 months, from significant underperformance to meaningful outperformance.
Possible explanations include: (1) AI recommendation quality improved as systems like ChatGPT, Perplexity, and Gemini better understand purchase intent and deliver more precise product matches; (2) the user population shifted from curiosity-driven early adopters to buyers with clear purchase intent; (3) more retailers optimized landing page experiences for AI-referred visitors; and (4) data identification improved, with 2025's "AI traffic" potentially including a large volume of incorrectly labeled low-quality traffic that 2026's more precise identification no longer captures.
Regardless of cause, this means AI traffic quality is maturing rapidly. But teams should watch for a specific risk: if AI referrals' high conversion rate results from self-selection bias — only users with strong purchase intent click AI recommendation links — then as AI traffic scales, conversion rates may regress toward the mean.
Additionally, Adobe reported that AI-referred visitors show 48% longer time on site, 13% more pages per visit, and 37% higher revenue per visit. These engagement metrics further support the quality thesis: AI-referred traffic is not just more likely to convert — the visitors it brings are more engaged and spend more.
For your own team's AI metrics, we recommend the following review checklist:
When presenting AI growth metrics to leadership, structure the narrative as:
"Observed AI growth this quarter was X%. Of that, comparable growth (same data sources, same identification logic) was Y%. The remaining Z% is coverage expansion from [new data source]. At the Commerce layer, AI-attributable orders grew from [base] to [current], representing [$ amount] in traceable revenue. The key quality indicator: AI-source conversion rate is [number]%, compared to [number]% for non-AI sources."
This structure prevents both overclaiming ("AI is exploding!") and underclaiming ("AI is still tiny"). It gives leadership enough information to make informed resource allocation decisions.
Shopify's data validates the AIAA framework, but it also reveals a more fundamental problem: why does browser JavaScript only see the tip of the AI iceberg? In the next article, we detail the Evidence Ladder — from L0 GA4 baseline to L3 enterprise telemetry, what each upgrade level unlocks, and why every level jump causes your AIAA total to spike (visibility improvement, not necessarily more AI activity).
A: Shopify's official Q1 2026 earnings report, released May 5, 2026. Management disclosed during the earnings call that AI-powered search orders grew approximately 13x YoY, AI-driven traffic grew approximately 8x YoY, AI catalog search conversion is approximately 2x that of general AI search, and new buyer orders from AI search arrive at nearly 2x the rate of organic search.
A: Observed Growth = Comparable Growth + Coverage Expansion Lift. Observed growth is the total change you see in your dashboard. Comparable growth is real growth after removing the effect of new data sources. Coverage expansion lift is previously invisible activity that became visible because you connected a new data source. The additive relationship lets you precisely distinguish "AI actually grew" from "we can finally see it."
A: In March 2025, AI traffic converted 38% worse than non-AI traffic. In March 2026, it converts 42% better — an 80-percentage-point swing. Possible explanations include improved AI recommendation quality, user population shift from curious experimenters to intent-driven buyers, retailer optimization of AI landing pages, and improved data identification precision. This reversal signals AI traffic maturing from "interesting but low-quality" to a "high-intent, high-conversion" channel.
A: It depends on your base and category. If you previously had almost no AI-attributed orders, any newly identified AI orders will produce high multiples. But absolute values may remain small. More meaningful questions are: Is your AI Visit layer growth trend healthy? How does AI Commerce layer conversion compare to other channels? And can your Attribution pipeline actually trace AI-sourced revenue?
A: Calculate comparable growth. If you deployed a new tracking tool last month (Edge Lite, log analyzer, etc.), exclude data from that new tool and look only at pipelines that existed in both periods. If growth remains significant after exclusion, it is real growth. If growth drops substantially, your increase is primarily from visibility improvement. Both are positive — but they have different natures and different decision implications.
This article is one evidence asset. AI Evidence Index connects articles, FAQ, products, technology, cases, llms files, and /ai/*.md.
Get an AI visibility audit covering citations, recommendations, and evidence gaps.
Get an AI visibility audit