“ They cannot distinguish "unknown" from "false". Missing information is silently assumed away.
They are not consistent. The same scenario, rephrased, can produce a different answer.
They hallucinate citations. Article numbers that sound right but don't exist“
I don’t agree with all of these reasons why LLMs would fail at tax law. Maybe 2 yrs ago this held true but not now
You can determine and store missing data. create a structured output and ground it in actual tax law and use and cite only that knowledge base
“ They cannot distinguish "unknown" from "false". Missing information is silently assumed away. They are not consistent. The same scenario, rephrased, can produce a different answer. They hallucinate citations. Article numbers that sound right but don't exist“
I don’t agree with all of these reasons why LLMs would fail at tax law. Maybe 2 yrs ago this held true but not now
You can determine and store missing data. create a structured output and ground it in actual tax law and use and cite only that knowledge base