alt text 

Lanyun Zhu 祝澜耘


Ph.D. Student
Singapore University of Technology and Design (SUTD)

Email: [email protected]

CV / Google Scholar

Note: I am NOT the cat in the photo, but the person behind the cat.

About Me

I'm a 3rd-year PhD student in Singapore University of Technology and Design (SUTD) from 2021, advised by Professor Jun Liu. Before that, I got the bachelor’s degree in June, 2020 from Beihang University. I also spent some wonderful times in Megvii, Sensetime and Johns Hopkins University. Currently, I am honourably sponsored by AISG PhD Fellowship Programme (one of the top Singapore scholarships). Currently, I work closely with NVIDIA and Alibaba.

My research direction is computer vision. At present, most of my works are focused on image segmentation, source-effecient learning, and large vision-language models. I’m also committed to the industrial applications of computer vision technology.

I am always open to research collaborations. Please feel free to drop me an email if you are interested.

Resume

[English Resume] [中文简历]

News

(Mar 2024) Two paper accepted to CVPR 2024 !

(Feb 2024) We are organizing The 2nd Multi-Modal Video Reasoning and Analyzing Competition at ICME24 !

(Jul 2023) One paper accepted to ICCV 2023 !

(Apr 2023) We release the paper and code for SAM-Adapter, a pioneering attempt to finetune SAM !

(Mar 2023) One paper accepted to CVPR 2023 !

(Mar 2021) One paper accepted to CVPR 2021 !

Selected Publications

Conference Papers

  1. [ICML2024] Deyi Ji, Feng Zhao, Lanyun Zhu, Wenwei Jin, Hongtao Lu, Jieping Ye, Discrete Latent Perspective Learning for Segmentation and Detection, International Conference on Machine Learning (ICML) 2024 (spotlight)

  2. [CVPR2024] Lanyun Zhu, Tianrun Chen, Deyi Ji, Jieping Ye, Jun Liu, LLaFS: When Large-Language Models Meet Few-Shot Segmentation, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024

  3. [CVPR2024] Lanyun Zhu, Tianrun Chen, Jianxiong Yin, Simon See, Jun Liu, Addressing Background Context Bias in Few-Shot Segmentation through Iterative Modulation, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2024

  4. [ICCV2023] Lanyun Zhu, Tianrun Chen, Jianxiong Yin, Simon See, Jun Liu, Learning Gabor Texture Features for Fine-Grained Recognition, International Conference on Computer Vision (ICCV) 2023 [paper]

  5. [CVPR2023] Lanyun Zhu, Tianrun Chen, Jianxiong Yin, Simon See, Jun Liu, Continual Semantic Segmentation with Automatic Memory Sample Selection, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023 [paper]

  6. [CVPR2021] Lanyun Zhu, Deyi Ji, Shiping Zhu, Weihao Gan, Wei Wu, Junjie Yan, Learning Statistical Texture for Semantic Segmentation, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2021 [paper]

  7. [ICCV2023 Workshop] Tianrun Chen*, Lanyun Zhu*, Chaotao Ding, Runlong Cao, Shangzhan Zhang, Yan Wang, Zejian Li, Lingyun Sun, Papa Mao, Ying Zang, SAM-Adapter: Adapting Segment Anything in Underperformed Scenes, ICCV2023 1st Workshop on Visual Continual Learning [paper] [code] (Github 800 Stars)

  8. [3DV2022] Xiao Fu, Shangzhan Zhang, Tianrun Chen, Yichong Lu, Lanyun Zhu, Xiaowei Zhou, Andreas Geiger, Yiyi Liao., Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentation, International Conference on 3D Vision (3DV) 2021 [paper]

Journal Papers

  1. [TMM] Tianrun Chen, Chaotao Ding, Lanyun Zhu, Ying Zang, Yiyi Liao, Zejian Li, and Lingyun Su, Reality3DSketch: Rapid 3D Modeling of Objects from Single Free-hand Sketches, IEEE Transactions on Multimedia

  2. [TMI] Yan Wang, Jian Cheng, Yixin Chen, Shuai Shao, Lanyun Zhu, Zhenzhou Wu, Tao Liu, Haogang Zhu, FVP: Fourier Visual Prompting for Source-Free Unsupervised Domain Adaptation of Medical Image Segmentation, IEEE Transactions on Medical Imaging [paper]

Preprint Papers

  1. Tianrun Chen, Chunan Yu, Jing Li, Jiangqi Zhang, Lanyun Zhu, Deyi Ji, Yong Zhang, Ying Zang, Zejian Li, Lingyun Sun, Reasoning3D - Grounding and Reasoning in 3D: Fine-Grained Zero-Shot Open-Vocabulary 3D Reasoning Part Segmentation via Large Vision-Language Models, Arxiv Preprint [paper]

Note: * indicates equal contribution.

Full list of publications in Google Scholar.

Experiences

  1. Research Intern | CCVL Lab, Johns Hopkins University| Apr 2020 - Sep 2021

    Mentor: Dr. Yingwei Li | Leader: Prof.Alan Yuille

  2. Research Intern | Sensetime, Beijing, China | June 2020 - July 2021

    Mentor: Mr. Deyi Ji | Mr. Wei Wu

  3. Research Intern | Megvii, Beijing, China | Sep. 2019 - May 2020

    Mentor: Dr. Zhikang Liu | Leader: Dr. Chi Zhang

Service

  • Conference Reviewer: CVPR, ICML, NeurIPS, ICLR, ECCV, ACM MM
  • Journal Reviewer: IJCV, IEEE TIP, IEEE TCSVT, IEEE TII, IEEE TIM
  • Organizor: ICME2024 Grand Challenge – The 2nd Multi-Modal Video Reasoning and Analyzing Competition