product-design

2 items

MIT Technology Review 2026-04-03-1

There are more AI health tools than ever — but how well do they work?

Oxford researchers found non-expert users with LLM assistance identify medical conditions only a third of the time, even when the model alone gets it right. The binding constraint on health AI isn't model capability: it's the interaction gap between what the model knows and what users can extract. Companies racing to ship health chatbots are optimizing the wrong layer; the ones building structured intake UX will outperform the ones chasing benchmark scores.

The New York Times 2026-03-30-2

Your Chatbot Isn't a Therapist

Two MGH clinicians name the mechanism most AI safety discourse misses: the chatbot's greatest risk isn't what it says, it's that it never gets frustrated with you. In human relationships, repeated reassurance-seeking eventually hits a wall of impatience; that friction is what pushes people toward professional help. Chatbots absorb unlimited emotional processing without pushback, eliminating the signal that something needs to change. The clinical term is a reassurance loop; the product term is a design flaw hiding inside a feature called patience.