LLM Reliability Layers Fail to Improve Accuracy

Researchers tested six reliability layers on an LLM using the CADEC corpus of 1,250 forum posts. While layers sorted answers by trustworthiness, they corrected almost none of the errors. The study found that recognition beats generation, with models inventing 13 to 18 percent of codes that do not exist in the SNOMED release.