Yeah don’t ask chat gpt medical questions, it’s pretty bad at those. Better than someone off the street maybe, but still bad. And apparently using outdated racially biases stuff too.
It is good at writing insurance appeals letters though, cause it can fill in all the vapid fluff and make the letter writing fast. It needs the doctor to heavily guide it still though and put in the arguments for why the insurance company is wrong. Also if asked to put in citations it will sometimes make up really convincing fakes. So you really need to give it real references yourself so it doesn’t do that. It basically a fancy Microsoft office clippy in practice right now.
I saw an article recently about using chatgpt to write tailored patient handouts and I think that was a good one. Eg “please write an empathetic and gently persuasive explanation of why it can be dangerous to give antibiotics to a person with stomach upset and a history of c difficile infection. Use simple language.”