Hi mhigbee,
Thanks for the question!
Once you stop an experiment, new customers aren’t enrolled and existing experiment users fall back to your Default Offering if they hit a paywall again. That means they won’t automatically be part of any new experiment—you’ll see their renewals in your original results for up to 400 days, but any new subscriptions they start post-experiment won’t feed into a fresh test.
Experiments only enroll new users while running, so there’s no built-in switch to “roll” old cohort members into another experiment. This is done to protect the statistical integrity of your A/B test by keeping cohorts clean and comparable.
Hope this helps! Let me know if you have any other questions.
Best,
Hussain
Hi mhigbee,
Thanks for the question!
Once you stop an experiment, new customers aren’t enrolled and existing experiment users fall back to your Default Offering if they hit a paywall again. That means they won’t automatically be part of any new experiment—you’ll see their renewals in your original results for up to 400 days, but any new subscriptions they start post-experiment won’t feed into a fresh test.
Experiments only enroll new users while running, so there’s no built-in switch to “roll” old cohort members into another experiment. This is done to protect the statistical integrity of your A/B test by keeping cohorts clean and comparable.
Hope this helps! Let me know if you have any other questions.
Best,
Hussain
What would you recommend if I still want to run experiments with those users, even if it break the integrity of the experiment? Do we need to implement some custom logic with another platform like Firebase A/B testing?