r/LangChain • • 21h ago

Discussion Does a second model catch citation errors the first model misses

2 Upvotes

When an assistant cites the wrong policy and the citation looks clean no reader spots the error until the policy gets enforced. For instance one builder in a LangChain thread today said the same model checking its own work found nothing real in his experience. However a second call from the same model may share the same blind spot because it read the same chunks and learned the same shortcut. That is why I want to know whether a different model is the only honest check or whether a cheaper test catches the same errors. If you can tell me what your citation check looks like in practice I would learn more from that than from another eval number.