Our new paper is available on arXiv!

Our paper entitled Are Non-English Papers Reviewed Fairly? Language-of-Study Bias in NLP Peer Reviews is available on arXiv. Across 15,645 peer reviews from major NLP venues, we find that papers focused on non-English languages face up to 40x higher language-of-study bias rates than English-focused work.

We release LOBSTER, a human-annotated dataset for language-of-study bias, and show that LLMs can detect this bias with 87.4 Macro F1, making automated screening a realistic step toward fairer peer review.