New article published! We studied LLMs answering medical questions in different Swiss languages

Which Swiss language are LLMs better at answering medical questions in? The answer is - it depends!

:lightbulb: We studied how large language models perform on medical multiple-choice questions in three languages — German, French, and Italian.

Overall, models performed quite well, but we saw variability that should not be ignored: the model you choose, how you write the prompt, and the language you ask the question in all make a difference to the eventual performance. This is something to consider carefully before integrating these tools into medical education and clinical settings.

To learn more, read the paper: Performance Evaluation of Large Language Models in Multilingual Medical Multiple-Choice Questions: Mixed Methods Study