Go to any product, swipe down to reciwes and you see the search bar for reviews. The amazon mobile app just plugged in a raw LLM to answer reviews, any sde and team with 2 brain cells would have designed to eliminate this and catch this. What are the Senior SDEs, PMs, Test engineers, managers doing ? Product Bar is 🤮 Update: Its powered by alexa. Look at the screenshot.
Totally agree burnt out engineers, over zealous TPMs, power hungry top level management and left out of the loop QA.
Who tf is going to open amazon app and ask a programming question?
This is the top comment here. It's not a problem at all. No one's going to do this.
Lol, this is the hiring bar we have folks!! Customer isn't supposed to poke things around. Customer should learn how the features are developed and work within the rules. 🤦🏻♂️ If not a programming question, there would be something else customers would ask. Dev teams should make sure the products are not broken and work in all conditions or else atleast fail gracefully. Not question the users about how tf they try to use the product.
How you reach this screen? On the app
Go to any product, swipe down to reviews and you see the search bar for reviews.
Found the feature , but doesn't do the gpt answer shown in your screenshot anymore. Maybe they reversed it. I just see keyword based search..
What is your proposal to fix it?… And day 1 is also speed … day a 1000 would be to wait forever…
Can provide specific instructions to not answer questions outside the context of the role it's assigned
I would be surprised if those guardrail instructions are not already there, and just ignored by the LLM.
Lazy for sure but they definitely need guardrails. This has potential to lead to very bad UX from a trust and safety pov if the guardrails are completely off. Good to move fast, but experience should’ve been prioritized more…
😮 this needs to be fixed
lol! What else can you get it to do? Does anyone know what’s the model used in this?
Interesting. People are using LLM for site search. "Powered by Google" maybe a thing of past
Ask Blinders
15h
620
Why Pronouns shit captured US ? I don’t see this anywhere else
Cars
Yesterday
1655
Cyber truck killer: Chinese version of EV truck
India
Yesterday
950
Any Indians Think Kashmir Should be Independent?
Health & Wellness
9h
694
Issues with sleep
India
11h
2508
Why is it so G*damn difficult to move money out of India
This is just what you get when you optimize for dates, or when you try to fail fast. The experience isn’t the worst thing in the world, it’s silly more than anything else. Team probably either knew about this, or was so burned out they didn’t care.
Moving fast is cool, but how would someone miss this basic test case ? What you mentioned is true. Deadlines are everything and pushing half baked features out is the only priority these days.
I agree with OP here. May not be harmful but so amateurish for a high visibility part of the app.