How to Review Holiday Promotion Results After Returns and Cancellations
By Evan Weber · 2026-10-12
Review a holiday promotion by defining its original order cohort, reconciling later refunds and cancellations, checking payment status separately and comparing retained sales with documented costs. State the review date and unresolved cases. The first dashboard total is an initial view, not the final economics of the promotion.
This process helps ecommerce teams make a practical repeat, revise or stop decision. It is especially useful when adjustments arrive after the sale period and several reporting tools show different totals. The goal is a reproducible account of what happened to the orders, with a clear boundary between measured values and estimates.
Define the promotion cohort before comparing results
Write down the order dates, store time zone, qualifying offer and included products. Decide how an order qualifies when a code is used outside the intended placement or several promotions run together. Keep that rule with the report so someone else can reproduce the selection.
A promotion cohort is a group of orders selected under those rules. It differs from all activity recorded during a calendar week. A refund processed in January may relate to a November order. If you review only January activity, you can miss what happened to the original holiday cohort.
Save a dated export or another reproducible view using your approved reporting process. Record when you refreshed it. Keep personal customer data inside the systems and access controls your business already uses; a campaign summary usually needs totals and identifiers for reconciliation, not a shared spreadsheet of private customer details.
Separate sales, adjustments and payments
Start with the store’s order records and their current financial status. Keep pending, unpaid, canceled and paid orders identifiable. Then reconcile the values using the definitions of the report you selected. Do not assume that an order count is a paid-order count.
Shopify’s current sales-report documentation defines net sales as gross sales less discounts and sales reversals. Reversals cover more than physical returns, including cancellations and edits. Its sales reports can include pending, unpaid and canceled orders, and they do not establish payment received. Check payment records separately when cash collection matters.
Keep the provider terminology in the worksheet notes. If you use another ecommerce platform, check that platform’s current definitions. A field called revenue can mean something different in the store, an advertising dashboard and a finance export. Changing the label without checking the underlying calculation will not resolve the difference.
Follow later changes back to the original order
For the orders in the cohort, identify refunds, cancellations, exchanges and other adjustments using stable order and line-item identifiers. Keep the adjustment date alongside the original order date. That gives you both an activity view and a cohort view without pretending they answer the same question.
Check whether your chosen report already includes each adjustment. Deducting a refund from net sales again understates the result. Mixing an original order export with a current net-sales export can create the same error. Write down which figure is before or after adjustments and reconcile a few individual orders before trusting the total.
Keep physical returns separate from monetary changes when diagnosing the cause. A canceled order, a goodwill shipping refund and a returned item may have different operational explanations. Use the available records to investigate rather than assigning every reversal to product dissatisfaction.
Use an explicit maturity date
Publish an initial view during the promotion, then refresh it after customers have had a realistic opportunity to receive and evaluate their orders. Choose review dates using your actual delivery and return policies. There is no single waiting period that makes every holiday promotion final.
Mark the current view as provisional when substantial follow-up time remains. Compare cohorts with similar time since their orders and delivery, not simply similar calendar labels. A recent promotion should not be judged as though its return window has already closed.
Track unresolved cases separately. A return requested but not completed, a pending refund or an open payment dispute can change the result. State the count and known value where available, and avoid presenting uncertain amounts as settled losses or guaranteed retained sales.
Build a cost view without double counting
Once order values are reconciled, gather the costs your business associates with serving those orders: product cost under your chosen accounting treatment, fulfillment, shipping subsidy, payment fees, media, partner compensation and return handling. Confirm how refunded fees, recovered inventory and other adjustments are treated with the appropriate finance owner.
Keep fixed overhead separate if the decision is about contribution before overhead. Label that scope clearly. An operating scorecard is useful for deciding what to investigate or repeat; it is not a substitute for the business’s financial statements.
Our contribution-margin planning guide covers the model before an offer launches. Use this review to replace its assumptions with observed costs where you have them. Keep estimates labeled and show what is still unavailable instead of entering zero for missing information.
A small illustrative reconciliation
Consider a hypothetical promotion cohort with $10,000 of merchandise value before discounts. Discounts reduce that by $1,000, and recorded sales reversals reduce it by another $800. Under this simplified definition, net merchandise sales are $8,200. Taxes and shipping are outside this example. These are invented teaching numbers, not BoostQ4 results or an ecommerce benchmark.
Suppose your documented cost view then assigns $3,000 of product costs, $700 of fulfillment and shipping subsidy, $250 of payment fees, $1,500 of acquisition spending and $200 of additional return-handling costs. The remaining contribution is $2,550 before fixed overhead and any unresolved adjustments.
The example deliberately separates the $800 sales reversal from the additional $200 handling cost. It does not subtract the refund twice. Your real treatment may differ for exchanged goods, recovered stock, taxes, fees or shipping refunds. Reconcile those items with the records and definitions used by your finance team before comparing offers.
Compare offers using both economics and customer experience
Break out the offer or product groups that change your next decision. Compare retained sales, documented costs, new versus returning customers and relevant support issues. Keep the sample counts visible. A tiny group with no returns so far is not evidence that the offer produces better customers.
Review reasons for cancellations and returns where your records support them. Stock shortages may point to merchandising or availability controls. Unclear sizing may point to product information. Delivery complaints may require a better fulfillment plan. A deeper discount does not fix every problem.
Use channel attribution as a reporting lens, and record its model and window. Several platforms can claim credit for the same order. An attributed order is not proof that a particular campaign caused an incremental sale. When that causal question matters, plan an appropriate experiment rather than inferring it from the reconciliation alone.
Make the next review easy to repeat
Keep a compact worksheet with the cohort definition, export time, original order dates, adjustment dates, report definitions, costs, unresolved cases and review owner. Save the reconciliation method alongside the summary. The next person should be able to explain why the numbers changed between the initial and updated views.
For the next promotion, choose a few changes supported by the evidence: clarify a product detail, adjust the offer economics, fix a fulfillment problem or improve the post-purchase experience. Give each action an owner and check date. If the report does not support a decision yet, state what information would resolve it.
A useful next step today is to review five orders from a completed promotion, including at least one adjusted order if available. Confirm that the store report, payment record and cost worksheet tell a consistent story. Then expand the process to the complete cohort.
Conclusion
A useful holiday review follows the order through later changes and records what the business actually knows. Keep the cohort, timing, payment status and costs consistent. Use the findings to improve the next offer and customer experience, and refresh provisional results as unresolved cases settle.
Connect the Review to Your Next Holiday Plan
Use Evan Weber’s free BFCM guide to organize the acquisition, conversion, service and measurement work around your next promotion.
Get the Free BFCM Guide