SCHOLARLY OUTPUT

Publications

Selected journal and conference papers from HMI Lab.

2025
2024
JournalNature Methods

EfficientBioAI: making bioimaging AI models efficient in energy and latency

Yu Zhou, Jiajun Cao, Justin Sonneck, Sweta Banerjee, Stefanie Dörr, Anika Grüneboom, Kristina Lorenz, Shanghang Zhang, Jianxu Chen

JournalIEEE Transactions on Geoscience and Remote Sensing

DECOR: Dynamic Decoupling and Multi-Objective Optimization for Long-tailed Remote Sensing Image Classification

Jianlin Xie, Guanqun Wang, Yin Zhuang, Can Li, Tong Zhang, He Chen, Liang Chen, Shanghang Zhang

ConferenceAdvances in Neural Information Processing Systems 2024

Unveiling the Tapestry of Consistency in Large Vision-Language Models

Yuan Zhang, Fei Xiao, Tao Huang, Chun-Kai Fan, Hongyuan Dong, Jiawen Li, Jiacong Wang, Kuan Cheng, Shanghang Zhang , Haoyuan Guo

ConferenceFindings of the Association for Computational Linguistics: EMNLP 2024

Learning from Mistakes: Iterative Prompt Relabeling for Text-to-Image Diffusion Model Training

Xinyan Chen, Jiaxin Ge, Tianjun Zhang, Jiaming Liu, Shanghang Zhang

ConferenceProceedings of the 32nd ACM International Conference on Multimedia

VeCAF: Vision-language Collaborative Active Finetuning with Training Objective Awareness

Rongyu Zhang, Zefan Cai, Huanrui Yang, Zidong Liu, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Baobao Chang, Yuan Du, Li Du, Shanghang Zhang

ConferenceEuropean Conference on Computer Vision 2024

LLM as dataset analyst: Subpopulation structure discovery with large language model

Yulin Luo, Ruichuan An, Bocheng Zou, Yiming Tang, Jiaming Liu, Shanghang Zhang

Conference2024 IEEE International Conference on Multimedia and Expo

Enhanced Blind Watermarking Against Black-Box Noise: Leveraging CIN Framework

Rui Ma, Mengxi Guo, Peidong Jia, Chenxuan Li, Yi Hou, Yuan Li, Xiaodong Xie, Shanghang Zhang

Conference2024 IEEE International Conference on Multimedia and Expo

VLUReID: Exploiting Vision-Language Knowledge for Unsupervised Person Re-Identification

Dongmei Zhang, Ray Zhang, Fan Yang, Yuan Li, Huizhu Jia, Xiaodong Xie, Shanghang Zhang

Conference2024 IEEE International Conference on Multimedia and Expo

VLUReID: Exploiting Vision-Language Knowledge for Unsupervised Person Re-Identification

Yijia Zhang, Lingran Zhao, Shijie Cao, Sicheng Zhang, Wenqiang Wang, Ting Cao, Fan Yang, Mao Yang, Shanghang Zhang , Ningyi Xu

Conference2024 IEEE International Conference on Robotics and Automation

BEVUDA: Multi-geometric space alignments for domain adaptive BEV 3D object detection

Jiaming Liu, Rongyu Zhang, Xiaoqi Li, Xiaowei Chi, Zehui Chen, Ming Lu, Yandong Guo, Shanghang Zhang

Conference2024 IEEE International Conference on Robotics and Automation

Unsupervised spike depth estimation via cross-modality cross-domain knowledge transfer

Jiaming Liu, Qizhe Zhang, Xiaoqi Li, Jianing Li, Guanqun Wang, Ming Lu, Tiejun Huang, Shanghang Zhang

Conference2024 IEEE International Conference on Robotics and Automation

Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentation

Jiayi Ni, Senqiao Yang, Ran Xu, Jiaming Liu, Xiaoqi Li, Wenyu Jiao, Zehui Chen, Yi Liu, Shanghang Zhang

Conference2024 IEEE International Conference on Robotics and Automation

Renderocc: Vision-centric 3d occupancy prediction with 2d rendering supervision

Mingjie Pan, Jiaming Liu, Renrui Zhang, Peixiang Huang, Xiaoqi Li, Hongwei Xie, Bing Wang, Li Liu, Shanghang Zhang

ConferenceProceedings of the AAAI Conference on Artificial Intelligence 2024

Exploring sparse visual prompt for domain adaptive dense prediction

Senqiao Yang, Jiarui Wu, Jiaming Liu, Xiaoqi Li, Qizhe Zhang, Mingjie Pan, Yulu Gan, Zehui Chen, Shanghang Zhang

ConferenceProceedings of the AAAI Conference on Artificial Intelligence 2024

Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation

Rongyu Zhang, Yulin Luo, Jiaming Liu, Huanrui Yang, Zhen Dong, Denis Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Yuan Du, Shanghang Zhang

ConferenceProceedings of the AAAI Conference on Artificial Intelligence 2024

FM-OV3D: Foundation Model-Based Cross-Modal Knowledge Blending for Open-Vocabulary 3D Detection

Dongmei Zhang, Chang Li, Renrui Zhang, Shenghao Xie, Wei Xue, Xiaodong Xie, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

NTO3D: Neural Target Object 3D Reconstruction with Segment Anything

Xiaobao Wei, Renrui Zhang, Jiarui Wu, Jiaming Liu, Ming Lu, Yandong Guo, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation

Jiaming Liu, Ran Xu, Senqiao Yang, Renrui Zhang, Qizhe Zhang, Zehui Chen, Yandong Guo, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

FreeKD: Knowledge Distillation via Semantic Frequency Prompt

Yuan Zhang, Tao Huang, Jiaming Liu, Tao Jiang, Kuan Cheng, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

PromptCoT: Align Prompt Distribution via Adapted Chain-of-Thought

Junyi Yao, Yijiang Liu, Zhen Dong, Mingfei Guo, Helan Hu, Kurt Keutzer, Li Du, Daquan Zhou, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

Cloud-Device Collaborative Learning for Multimodal Large Language Models

Guanqun Wang, Jiaming Liu, Chenxuan Li, Yuan Zhang, Junpeng Ma, Xinyu Wei, Kevin Zhang, Maurice Chong, Renrui Zhang, Yijiang Liu, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024

Gradient-based Parameter Selection for Efficient Fine-Tuning

Zhi Zhang, Qizhe Zhang, Zijun Gao, Renrui Zhang, Ekaterina Shutova, Shiji Zhou, Shanghang Zhang

ConferenceThe Twelfth International Conference on Learning Representation 2024

Vida: Homeostatic visual domain adapter for continual test time adaptation

Jiaming Liu, Senqiao Yang, Peidong Jia, Renrui Zhang, Ming Lu, Yandong Guo, Wei Xue, Shanghang Zhang

Conference2023 IEEE International Geoscience and Remote Sensing Symposium

Uncertainty-Aware Dynamic Learning for Cross-Domain Few-Shot Scene Classification from Remote Sensing Imagery

Can Li, He Chen, Yin Zhuang, Shanghang Zhang

Conference2023 60th ACM/IEEE Design Automation Conference

Csq: Growing mixed-precision quantization scheme with bi-level continuous sparsification

Lirui Xiao, Huanrui Yang, Zhen Dong, Kurt Keutzer, Li Du, Shanghang Zhang

ConferenceProceedings of the 33rd Workshop on Network and Operating System Support for Digital Audio and Video 2023

RepCaM: Re-parameterization Content-aware Modulation for Neural Video Delivery

Rongyu Zhang, Lixuan Du, Jiaming Liu, Congcong Song, Fangxin Wang, Xiaoqi Li, Ming Lu, Yandong Guo, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Bev-san: Accurate bev 3d object detection via slice attention networks

Xiaowei Chi, Jiaming Liu, Ming Lu, Rongyu Zhang, Zhaoqing Wang, Yandong Guo, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Q-diffusion: Quantizing diffusion models

Xiuyu Li, Yijiang Liu, Long Lian, Huanrui Yang, Zhen Dong, Daniel Kang, Shanghang Zhang , Kurt Keutzer

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Open-vocabulary point-cloud object detection without 3d annotation

Yuheng Lu, Chenfeng Xu, Xiaobao Wei, Xiaodong Xie, Masayoshi Tomizuka, Kurt Keutzer, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Pimae: Point cloud and image interactive masked autoencoders for 3d object detection

Anthony Chen, Kevin Zhang, Renrui Zhang, Zihan Wang, Yuheng Lu, Yandong Guo, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Cloud-device collaborative adaptation to continual changing environments in the real-world

Yulu Gan, Mingjie Pan, Rongyu Zhang, Zijian Ling, Lingran Zhao, Jiaming Liu, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Noisyquant: Noisy bias-enhanced post-training activation quantization for vision transformers

Yijiang Liu, Huanrui Yang, Zhen Dong, Kurt Keutzer, Li Du, Shanghang Zhang

ConferenceProceedings of the IEEE/CVF International Conference on Computer Vision 2023

QD-BEV: quantization-aware view-guided distillation for multi-view 3D object detection

Yifan Zhang, Zhen Dong, Huanrui Yang, Ming Lu, Cheng-Ching Tseng, Yuan Du, Kurt Keutzer, Li Du, Shanghang Zhang

ConferenceInternational Conference on Machine Learning 2023

Split-Ensemble: Efficient OOD-aware Ensemble via Task and Model Splitting

Anthony Chen, Huanrui Yang, Yulu Gan, Denis A Gudovskiy, Zhen Dong, Haofan Wang, Tomoyuki Okuno, Yohei Nakata, Shanghang Zhang , Kurt Keutzer

ConferenceEuropean Conference on Computer Vision 2022

Efficient Meta-Tuning for Content-aware Neural Video Delivery

Xiaoqi Li, Jiaming Liu, Shizun Wang, Cheng Lyu, Ming Lu, Yurong Chen, Anbang Yao, Yandong Guo, Shanghang Zhang

ConferenceInternational Joint Conference on Artificial Intelligence 2022

Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data

Tian Li, Xiang Chen, Zhen Dong, Kurt Keutzer, Shanghang Zhang

ConferenceInternational Joint Conference on Artificial Intelligence 2022

Prototypical Supervised Contrastive Learning for LiDAR Point Cloud Panoptic Segmentation

Minzhe Liu, Qiang Zhou, Hengshuang Zhao, Jianing Li, Yuan Du, Li Du, Shanghang Zhang

2023
JournalIEEE Transactions on Intelligent Vehicles

BEV-LGKD: A Unified LiDAR-Guided Knowledge Distillation Framework for Multi-View BEV 3D Object Detection

Jianing Li, Ming Lu, Jiaming Liu, Yandong Guo, Yuan Du, Li Du, Shanghang Zhang

2021
Publications · HMI Lab