Part 2/12:

AI's limitations in high-stakes environments have led to alarming incidents that underscore the importance of cautious implementation. One tragic example from Detroit details a pregnant woman, eight months along, who was unjustly jailed for 30 days based on a face recognition system. The AI wrongly identified her as a suspect in a carjacking, leading to wrongful detention. Despite the human authorities’ reliance on AI's allegedly objective insights, the system failed dramatically—highlighting the dangers of overtrusting imperfect technology in critical situations.