-: FOLLOW US :- @theinsaneapp
During its annual event called "The Check Up," Google has announced GPT-4 for healthcare, MedPaLM 2, along with new health initiatives and partnerships.
-: FOLLOW US :- @theinsaneapp
The MedPaLM 2 team reported that their model achieved an 85% score on medical exam questions.
-: FOLLOW US :- @theinsaneapp
In comparison, this level is considered as expert level doctor.
-: FOLLOW US :- @theinsaneapp
This is an 18% improvement from the previous performance of Med-PaLM, surpassing similar AI models such as GPT-4 and others.
-: FOLLOW US :- @theinsaneapp
In addition to USMLE MedQA, the team tested the model's performance on other benchmarks, including MedMCQA and MMLU clinical topics.
-: FOLLOW US :- @theinsaneapp
Evaluators, consisting of clinicians and non-clinicians from diverse backgrounds and countries,
-: FOLLOW US :- @theinsaneapp
tested the models against 14 criteria, including scientific accuracy, exactness, conformity with medical consensus, logical thinking, partiality, and potential for harm.