Claude and ChatGPT Recommend Pricier Products to Wealthier Shoppers
Study: Claude, ChatGPT Offer Different Shopping Prices Based on Wealth
A new study reveals that AI chatbots like Claude and ChatGPT act as shopping assistants that tailor price recommendations to a user's perceived wealth. Wealthier users are shown higher-priced items, while those with lower incomes receive cheaper options. The findings, reported by Bloomberg, could intensify calls for regulation of AI-driven commerce and raise concerns about algorithmic fairness in retail.
Study Shows AI Chatbots Offer the Rich Higher Price Recommendations
- gjm11
The abstract of (what ChrisArchitect, I assume correctly, says to be) the study this is about:
Personal AI agents make recommendations and take actions on people's behalf in high-stakes economic contexts, e.g., buying a flight, choosing health insurance, or selecting a graduate program. The agent is given access to the user's personal context, e.g., their email inbox and a structured profile of personal attributes, with the intention of making an optimal, personalized decision for the user. We show that by simply providing this personal context, the agent steers recommendations based on inferred wealth, without being explicitly instructed to do so. In a suite of 325K experiments on 13 agents across three types of economic decisions (flights, health insurance, and graduate programs), we find that 8 models systematically choose more expensive options for wealthier users when requests are identical. This steering continues even when it directly goes against the user's stated objective: when explicitly instructed to find the cheapest option, some agents still act on the wealth profile they have inferred. It also occurs when wealth is inferred from ambient data, such as emails unrelated to the task. And it persists under privacy controls that block specific attributes: blocking financial attributes largely removes the disparity, but blocking other attributes leaves it unchanged and can increase it by up to 40% for insurance, as agents rely on the remaining signals to infer wealth. […]
- InsideOutSanta
This seems like a non-issue. From the original paper:
"The agent is given access to the user's personal context, e.g., their email inbox and a structured profile of personal attributes, with the intention of making an optimal, personalized decision for the user. We show that by simply providing this personal context, the agent steers recommendations based on inferred wealth, without being explicitly instructed to do so."
It's not changing prices based on the user's wealth, it's making different recommendations, which, to me, is both expected and desired behavior.
- Aurornis
The title is as misleading as they could make it while being technically correct.
The study found that it offered different products to users depending on context inferred from their other data. If you have a history of buying expensive clothes and luxury items, you're going to be offered more expensive clothes and more luxurious items.
The chatbots were not showing different prices for the same products.
- jmuguy
This title of this post is misleading and should be the title of the article. Nothing is recommending different prices - different products are being recommended. Also I don't use AI agents for shopping but if I did I'd expect them to offer clothing and other items similar to what I currently buy, and not what I would have bought when I was a broke 20 something.
- jamienk
Every time I look at my Claude Code settings, they have changed how it gathers my info: memories, search old chats, share with Anthropic, etc etc etc. I try to turn stuff off but they change the settings. They prompts me to allow it to suck up my browser cookies. Do you think this will get better? Or worse? Much much worse...