Skip to main content

Shipping Testing Depreciation

Shogun retired Shipping Testing on October 1, 2026. Learn what happens to existing Shipping Tests, what changes in your Shopify store, and other ways to test shipping offers.

Written by James Power

As of October 1, 2026, Shipping Testing is no longer available in Shogun A/B Testing. We removed the Shipping Test option from the create test screen, so you can no longer create, start, resume, or re-run Shipping Tests in the app or through the Shogun MCP.

All other test types, including Page, Template, Theme, Split URL, Price, Product Details, and Checkout tests, are unaffected.

What happens to my existing Shipping Tests?

  • Past tests stay in your dashboard. Your paused and finished Shipping Tests remain visible, and you can still open them to view their results and analytics.

  • Paused tests can no longer be resumed.

  • Running tests have been ended. All customers now see your standard Shopify shipping rates. Shipping Tests never permanently changed your shipping configuration, so there's nothing to restore.

  • Winning variants were never applied automatically. If you want to keep a shipping configuration you tested, update your rates in Shopify Admin → Settings → Shipping and delivery.

What changes in my Shopify store

  • Carrier service removed. Shogun has removed the Shogun A/B Shipping Testing (Rates provided by app) carrier service from your shipping zones. You don't need to do anything.

  • Fewer app permissions. Shogun A/B Testing no longer requests access to your shipping settings. Shopify removes this permission automatically the next time you open the app, and you won't be asked to approve anything.

  • New installs no longer add a carrier service to your store.

If you still see Shogun A/B Shipping Testing (Rates provided by app) in your shipping zones after October 1, 2026, you can safely delete it:

  1. In Shopify Admin, go to Settings → Shipping and delivery.

  2. Open each shipping zone where the service appears.

  3. Click the ⋯ (three-dot menu) next to the service.

  4. Select Delete.

Removing it doesn't affect your other shipping rates, your other tests, or your test history.

Other ways to test shipping offers

You can still test how you present shipping to shoppers with other test types. For example:

  • A free-shipping banner in your header, using a Theme Test

  • A free-shipping progress bar on your cart page, using a Page Test

  • Shipping guarantees or delivery messaging at checkout, using a Checkout Blocks test (Shopify Plus)

These tests change what shoppers see, not the shipping rates they're charged. See Test Types & Use Cases and How to Come Up with Good Test Ideas for more.

Frequently asked questions

Can I still see results from my old Shipping Tests?

Yes. Paused and finished Shipping Tests stay in your dashboard with their full analytics. You just can't resume, restart, or re-run them.

Will my customers be charged different shipping rates?

No. With Shipping Testing retired, all customers see your standard Shopify shipping rates.

Will Shipping Testing come back?

We have no plans to bring it back right now, but we'll let you know in the app and update this article if that changes.

Does this change my plan or pricing?

No. Your plan and pricing stay the same.

Who can I contact with questions?

Reach out to Shogun Support through the chat in the app, and we'll be happy to help.

Did this answer your question?