r/ResearchML • u/FrequentPosition1279 • 5h ago
[D] ICLR reviewer raised confidence from 2 to 4 after the discussion closed, without changing the review. Is this normal?
A reviewer gave my ICLR 2027 submission a 1 (clear reject) with confidence 2 ("I have broad familiarity with this field but little or no direct research experience on this topic"). After the author-reviewer discussion closed, they changed their confidence to 4 ("I have substantial direct research experience on this topic"). Their rating and review text were not changed.
For context, the other two reviewers gave 3 (weak accept). One confirmed our rebuttal addressed their main concerns, while the other did not respond.
For the reviewer who gave a 1, we added their requests to the revised manuscript (a summary table, ablations, and additional baselines). They replied by restating their original concerns without engaging with our responses or the changes to the paper.
This looks very odd to me, since I believe we addressed their concerns. Is a 2→4 confidence change like this reasonable, or does it look like bad faith? I guess it is unlikely that the reviewer became an expert in this topic over night... Is there anything I can or should do, e.g., ask the PCs to inform the AC? OpenReview no longer allows authors to add or edit comments, and it doesn't show the confidence change in the revision history.