Someone recently told me how he was using AI to diagnose himself. He would ask questions and the AI would answer, even with elaborate words, proper medical jargon...
He decided to speak to me when he seemed to be getting contradictory answers from the ai model.
Sometimes, even well known facts are muddled up by the ai algorithm. I guess they are covered since there's always a disclaimer saying that AI can be wrong.
Yeah, these things can definitely lead to problems