In the moment, it looked like a grand success. The OpenAI team’s demonstration of a warmer, more emotional chatbot last week was one of the most impressive tech demos I’ve seen. In the end, I found its aggressive flirting unsettling, and seemingly at odds with Altman’s previous statements to me that the company would not pursue AI tools that doubled as romantic companions. But the demo unquestionably succeeded in captivating the tech world — and stealing thunder from Google on the eve of its annual developer conference.

It honestly disturbed me. People already trust AI despite all the hallucinations. This just makes it seem more trustworthy because of simulated emotional reactions.