Bingchen Zhao

I am a Ph.D student at the University of Edinburgh, supervised by Dr Oisin Mac Aodha.
I am interested in Concept/Category Discovery, Self-Supervised Learning, and Interpretable AI.
Please feel free to drop me an email if you are interested in what I do and looking for possible collaborations.

Contact: zhaobc.gm@gmail.com

News

03/2023	Our 2nd OOD-CV workshop is accepted at ICCV, stay tuned for more details, see you in Paris!
10/2022	Recognised as a Top Reviewer for NeurIPS 2022!.
07/2022	Two papers accepted by ECCV 2022 with one selected as Oral!.
04/2022	We are organizing a workshop at ECCV 2022, check it out here.
09/2021	One paper accepted into NeurIPS 2021!
07/2021	One paper accepted into ICCV 2021 as Oral!
09/2019 - 05/2022	I am working as a teaching assistant for Prof. Yin Wang's Deep Learning Course at Tongji University.

Publications

Preprints

	How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs Haoqin Tu, Chenhang Cui, Zijun Wang*, Yiyang Zhou, Bingchen Zhao, Junlin Han, Wangchunshu Zhou, Huaxiu Yao, Cihang Xie arXiv / Code Preprint TL;DR: We provide the first comprehensive safety benchmark for VLLMs, including OOD scenarios and Redteaming attacks.
	Vision Learners Meet Web Image-Text Pairs Bingchen Zhao, Quan Cui, Hao Wu, Osamu Yoshie, Cheng Yang, Oisin Mac Aodha arXiv / Website Preprint TL;DR: We present a visual representation pre-training method for scalable web image-text data and it achieves state-of-the-art performance on various tasks with promising scaling behavior.
	Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics Haoqin Tu, Bingchen Zhao, Chen Wei, Cihang Xie arXiv / Code Preprint TL;DR: We present a surprising finding that multi-modal tuning improves LLMs in truthfulness and ethical behaviors.
	Fool Your (Vision and) Language Model With Embarrassingly Simple Permutations Yongshuo Zong, Tingyang Yu, Bingchen Zhao, Ruchika Chavhan, Timothy Hospedales arXiv / Code Preprint TL;DR: We observed that a surprisingly simple answer permutation degrades performance of LLMs.
	What If the TV Was Off? Examining Counterfactual Reasoning Abilities of Multi-modal Language Models Letian Zhang, Xiaotong Zhai, Zhongkai Zhao, Yongshuo Zong, Xin Wen, Bingchen Zhao arXiv / Code / Page Preprint TL;DR: Vision-Language Models cannot handle counterfactual questions very well.

Conference Papers

	Incremental Generalized Category Discovery Bingchen Zhao, Oisin Mac Aodha arXiv Code \ Page ICCV 2023 TL;DR: We propose a new setting named incremental generalized category discovery that requires the model to learn to discover novel categories at each new incremental stages, a simple baseline model is also proposed based on non-parametric classifiers.
	Learning Semi-supervised Gaussian Mixture Models for Generalized Category Discovery Bingchen Zhao, Xin Wen, Kai Han arXiv \ Code ICCV 2023 TL;DR: We tackle GCD without knowing the class number, propose a semi-supervised variant of GMM with stochastic splitting and merging to dynamically determine prototypes, and leverage PCL for representation learning on partially labelled data.
	Parametric Classification for Generalized Category Discovery: A Baseline Study Xin Wen, Bingchen Zhao, Xiaojuan Qi arXiv / Code ICCV 2023 TL;DR: We revisit the reason that makes previous parametric classifiers fail to recognise new classes for GCD, identify the prediction biases between and within seen and novel classes as the key issue, and propose a simple yet strong framework that addresses these limitations and achieves state-of-the-art performance in this field.
	XCon: Learning with Experts for Fine-grained Category Discovery Yixin Fei, Zhongkai Zhao, Siwei Yang, Bingchen Zhao arXiv / Slides / Code BMVC 2022 Oral (34/770=4.4%) TL;DR: Learning to do category discovery within a fine-grained dataset is challenging, we present a method that learn to do that by partition the dataset into k sub-groups, and show improved performance on several fine-grained datasets.
	Self-Supervised Visual Representation Learning with Semantic Grouping Xin Wen, Bingchen Zhao, Anlin Zheng, Xiangyu Zhang, Xiaojuan Qi arXiv / Website / Code NeurIPS 2022 TL;DR: Our model can do scene decomposition and representation learning at the same time and shows strong generalization ability pretrained on scene-centric data.
	OOD-CV: A Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images Bingchen Zhao, Shaozuo Yu, Wufei Ma, Mingxin Yu, Shenxiao Mei, Angtian Wang, Ju He, Alan Yuille, Adam Kortylewski. arXiv / Website / Download / Slides ECCV 2022 Oral (158/5803=2.7%) TL;DR: We collected a dataset where we have the control over the individual OOD attribute in the test examples.
	Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui, Bingchen Zhao, Zhao-Min Chen, Borui Zhao, Renjie Song, Jiajun Liang, Boyan Zhou, Osamu Yoshie. arXiv / Code / Slides ECCV 2022 TL;DR: We study the transferability and the discriminability of deep representations and found a trade-off between these two properties.
	Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation Bingchen Zhao, Kai Han. arXiv / Code / Slides NeurIPS 2021 TL;DR: We extend novel category discovery to discover fine-grained classes by leverging information from image parts.
	Improving Contrastive Learning by Visualizing Feature Transformation Rui Zhu, Bingchen Zhao, Jingen Liu, Zhenglong Sun, Chang Wen Chen. arXiv / Code / Slides ICCV 2021 Oral (210/6236=3.4%) TL;DR: We explore the training dynamics of self-supervised contrastive learning, and proposed two simple method for improving the performance of the model.
	Temporal Context Aggregation for Video Retrieval with Contrastive Learning Jie Shao, Xin Wen, Bingchen Zhao, Xiangyang Xue. arXiv / Code / Slides WACV 2021 TL;DR: Video retrieval methods can be improved by modeling long-range temporal information with transformer and contrastive learning.

Workshop Papers

One Venue, Two Conferences: The Separation of Chinese and American Citation Networks
Bingchen Zhao*, Yuling Gu*, Jessica Zosa Forde, Naomi Saphra
arXiv
NeurIPS 2022 AI Cultures Workshop
TL;DR: At NeurIPS, American and Chinese institutions cite papers from each other's regions substantially less than they cite endogamously. We build a citation graph to quantify this divide, compare it to European connectivity, and discuss the causes and consequences of the separation.

Distilling Visual Priors from Self-Supervised Learning
Bingchen Zhao, Xin Wen
arXiv / Code / Slides
ECCV 2020 VIPriors Workshop
TL;DR: Learning a model self-supervisedly and then do self-distillation helps in the data-deficient domain.

Awards

2022	Top-Reviewer for NeurIPS 2022.
2020	First-place in the FGVC7 workshop iWildcam challenge track.
2020	Second-place in the ECCV 2020 VIPrior workshop image classification challenge track.
2020	Best Undergraduate Prize in the NeurIPS 2020 SpaceNet 7 challenge.
2016	Bronze medal in the Asia-Pacific Informatics Olympiad.
2015	First Prize in the National Olympiad in Informatics in Provinces.

Professional Services

I have been a reviewer for ICLR, NeurIPS, CVPR, ICCV, ECCV, WACV, FGVC, and SIGSPATIAL.