A KPI name is not a definition. “On-time shipping,” “fill rate” and “return rate” can produce different answers from the same orders depending on the event, denominator, clock and exclusions. A metric dictionary makes the operational decision reproducible.
Document seven elements
For each KPI, record:
- business question;
- numerator;
- denominator;
- time basis and time zone;
- inclusions and exclusions;
- authoritative source and field/event;
- owner, refresh cadence and known limitations.
Add dimensions used for segmentation—channel, facility, carrier, product or customer type—and the minimum grain. Preserve version dates when a definition changes.
Examples that expose ambiguity
Order cancellation rate might be canceled accepted orders divided by accepted orders for an order-date cohort. State whether customer-requested, fraud, test and partially canceled orders are included.
On-time carrier handoff might be eligible shipments with physical carrier acceptance by the promised handoff timestamp divided by eligible due shipments. A generated label is not physical acceptance. Define split shipments, weekends and carrier-event gaps.
Return rate might be returned units divided by delivered units for a mature delivery cohort. A request-date report answers a different question. Define exchanges, partial returns and the maturation window.
Hypothetical example: 20 returns requested this month against 1,000 orders placed this month yields 2%, but many returns belong to earlier orders and recent orders have not matured. The calculation is arithmetically valid but may be unsuitable for product comparison.
Reconcile before publishing
Trace a sample from dashboard total to source records. Confirm uniqueness, status transitions, currency conversion and timestamp handling. Compare source completeness by channel. If a provider is delayed or a field is unavailable, label the KPI partial rather than presenting it as complete.
Avoid silently restating the historical series after a definition change. Backfill only when inputs support the new method and disclose the revision. Keep operational targets separate from provider or marketplace rules; a target is not a guarantee.
Use metrics for decisions
Pair lagging outcomes with leading controls. Cancellation rate may be paired with inventory mismatch and aged-release queues; delivery performance with carrier acceptance and stalled movement. Assign an owner to investigate variance and a threshold for deeper review.
If systems disagree, preserve the conflict, identify the authoritative record for the question and open a data-quality action. Do not average incompatible values.
Use the fulfillment KPI dictionary, channel contribution article, and managed commerce hub. 1Commerce analytics can connect selected commerce data; field availability, refresh behavior and coverage depend on configured sources.