I wanted to see if anyone on here oversees in store A/B testing? How do you currently test and do you find it effective? Should everyone do it?
Tech Industry
12h
1252
Why doesn't OpenAI offshore and reduce expense by 80%
Work Visa
Yesterday
1145
Hypocrisy of Indians
Software Engineering Career
Yesterday
1357
Principal Software Engineer TC~300K at Microsoft vs 600K at Meta. Is 300k pretty low for Principal scope?
India
Yesterday
713
A list of ethnic slurs on Indians that should be banned on Blind
Software Engineering Career
5h
1626
L4 Google -> 45 interviews, 5 offers, AMA
A/B in 2 identical or similar but sperate stores right? Otherwise curious how would one do a/b testing in single physical store?
You would need a treatment and control to compare.
Day1: A, Day2: B I guess
Rename one aisle to aisle “A” and the other one to aisle “B”. There you have it
Man I knew they hired smart people at PwC
They actually fired me :(
It's ambiguous. A/B testing in Stores doesn't always support you hypothesis even if it logically proven. Have done many with stores.
Yes. Absolutely critical to our insights and decision making. At any one point we have 5-10 in store tests running. Sometimes for days, and other times for months.
How do you separate the treatment and control groups?
Lots of stores do it. They test new things in only a handful of stores before rolling things out nationwide
You are confusing a/b with pilot testing
That is as close it can get to ab testing in physical store, and with good matching techniques you can make inferential claims
There are a lot of ways to test things in physical stores. A/B is one way to test, and kinda means a specific thing - controls, set audience percentages, and such. You can design experiments in stores. Find a UX researcher in your company? Find a researcher on LinkedIn? In-store testing is usually a pilot, concept, or prototype test. But, it doesn’t fit the online A/B structure you’re suggesting with that specific label.
Thanks for the info and the clarification
Yea run one universe with store A and a parallel universe with store B
Do it