r/LangChain • u/MemStrata • 21h ago
Discussion Does a second model catch citation errors the first model misses
When an assistant cites the wrong policy and the citation looks clean no reader spots the error until the policy gets enforced. For instance one builder in a LangChain thread today said the same model checking its own work found nothing real in his experience. However a second call from the same model may share the same blind spot because it read the same chunks and learned the same shortcut. That is why I want to know whether a different model is the only honest check or whether a cheaper test catches the same errors. If you can tell me what your citation check looks like in practice I would learn more from that than from another eval number.