Hi, we both have a Live Targeting and a running Experiment at the same time. So the expected behavior would be the Experiment to override Live Targeting, since we’ve set the audience of both the Experiment and Targeting as all new users.
However, we found out that the new users -- who signed up after the Experiment was set live -- are still seeing offerings assigned in Live Targeting. Their history clearly says they’ve been enrolled to the Experiment. (please see the screenshot below)
Two findings in case it helps:
- According to the details, the ‘offering_id’ of a user enrolled in the new Experiment is “null”
- According to the details, the ‘experiment_id’ starts with “exp”, while all the past experiments’ started with “prexp”.
<Things we can confirm>
- We’ve already run numerous Experiments in the past and this never happened. We just simply duplicated a past Experiment to start the new one.
- We’ve tried re-installing the app, restarting the Experiment, but the issue still remains.
- There haven’t been any changes in the app (as well as SDKs or configurations) for a while.
- The Experiment and Live Targeting share the same placement keys.
What would be the cause of this problem?
Thank you.
