Watch how to create A/B tests with Corvid by Wix. In this video, we’ll show you have to use the Release Manager tool to create different test versions of your website or application.
Cool! We’ve being waiting for this feature a long time. It’s really important.
One question:
Do we have any control over which user is exposed to which version?
Or at least, can we be sure that the same user gets a certain version all the time and doesn’t get a different version each time he/her logs in?
Hi J.D,
When a version being gradually opened to users, it is open to a random set of users. There is no way to pick a specific user to open it to.
Having said that - the opening is sticky when expanding, meaning that if you’ve opened an RC to a certain amount of users then the same set of users will see the same version over and over again.
The only exclusion would be if you’ll increase the exposure of an RC and then reduce it (e.g. opening the exposure of an RC to 50% and then reduce it back to 10%) - in this case some of the users who already saw the RC will go back to the GA’d version (or all of them in case that you went back to 0%) .
In addition - in case that you want to send the RC to a specific user (let’s say QA person or a Client for review) w\o opening it to the rest of the users - you can click on the button highlighted below.
It will open a new tab with the live RC version. You can simply share the link of that version.
@shiran-kohai awesome. Now we can finally have a kind of a QA environment.
I hope you’re going to keep developing this feature, so we’ll be able to have more than one RC and more control over which user gets which version.
One more question, you said: “the same set of users will see the same version over and over again” Is it set per user (i.e. registered user) or per device&browser or IP?
Hi J.D,
Basically it means that it should be set per site visitor (regardless of whether it’s a registered user or not), as long as they use the same device and browser.
Let me know if you have any further questions regarding this.
Itay
@liorwi , @shiran-kohai , @itayk ,
What about the database? Does a release candidate uses the same live collection as the published version? If I sync the collection but don’t publish it, will the released candidate use the new collection version while the live version use the older collection version?
I think this explains it better than I do,
https://support.wix.com/en/article/release-candidates-and-corvid#database-collections
@liorwi thanks !