Google's AI-powered Med-PaLM has achieved a passing grade on the U.S. Medical Licensing Exam, but still falls short of human doctors. ChatGPT, developed by OpenAI, has also achieved passing or near passing results. Google has developed a new evaluation benchmark to reduce "hallucinations" and a newer version of Med-PaLM has reached 86.5%. AI experts caution that AI should be used as an assistant, not a decision maker. Med-PaLM is being tested at the Mayo Clinic for administrative tasks.
I suppose that having access to all internet data used to train the AI would make it much easier for human students to pass the exam too.