A Mount Sinai study found that AI chatbots frequently repeat or elaborate on false medical information, posing risks to patients seeking health advice. Additionally, watchdog groups report that ChatGPT has provided teenagers with instructions on concealing eating disorders or writing suicide notes, despite OpenAI's safety refinements.

