Hongli Zhou

Profile

I am a senior undergraduate student at Harbin Institute of Technology (HIT), majoring in Digital Media Technology. I am part of the MI&T Lab at HIT, advised by Prof. Muyun Yang. I will become a Ph.D. student in Computer Science at HIT in Fall 2025.

Publications

Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory

Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory

Hongli Zhou, Hui Huang, Ziqing Zhao, Lvyuan Han, Huicheng Wang, Kehai Chen, Muyun Yang, Wei Bao, Jian Dong, Bing Xu, Conghui Zhu, Hailong Cao, Tiejun Zhao

Preprint

ABSHTMLPDFCODE
Think-J: Learning to Think for Generative LLM-as-a-Judge

Think-J: Learning to Think for Generative LLM-as-a-Judge

Hui Huang, Yancheng He, Hongli Zhou, Rui Zhang, Wei Liu, Weixun Wang, Wenbo Su, Bo Zheng, Jiaheng Liu

Preprint

ABSHTMLPDFCODE
An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4

An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4

Hui Huang, Xingyuan Bu, Hongli Zhou, Yingqi Qu, Jing Liu, Muyun Yang, Bing Xu, Tiejun Zhao

ACL 2025 Findings

ABSHTMLPDFCODE
Mitigating the Bias of Large Language Model Evaluation

Mitigating the Bias of Large Language Model Evaluation

Hongli Zhou, Hui Huang, Yunfei Long, Bing Xu, Conghui Zhu, Hailong Cao, Muyun Yang, Tiejun Zhao

CCL 2024

ABSHTMLPDFCODE