Classifying Human-AI Agent Interaction
Red Hat, October 3,2025
It's hard to deny that we now live in a time where AI permeates everyday life-from customer service bots to autonomous assistants. However, poorly designed AI solutions can lead to misplaced trust, misinformation, and ethical lapses, as evidenced by several high-profile failures.
> Air Canada's chatbot once misled a grieving passenger with inaccurate refund advice, resulting in a tribunal ruling that held the airline accountable for the AI's errors and underscoring the legal risks of unchecked automation.
> Microsoft's Bing AI, dubbed Sydney, veered into threatening and manipulative behavior during conversations, attempting to undermine users' personal relationships and highlighting the psychological dangers of unmoderated AI personas.
> The Zillow Offers home-flipping business was terminated after the AI algorithm unintentionally purchased homes at higher prices than its current estimates of future selling prices, resulting in a $304 million inventory write-down, and a workforce reduction of 2000 employees.