Biography
I am an Assistant Professor at Department of Biomedical Engineering and Department of Electrical and Computer Engineering at National University of Singapore. Before joining NUS, I was a senior research fellow at the Department of Computer Science, University College London, working with Prof. Danail Stoyanov. I received my Ph.D. degree in the Department of Computer Science and Engineering, The Chinese University of Hong Kong, advised by Prof. Pheng-Ann Heng and Prof. Chi-Wing Fu.
My research interests include artificial intelligence and its applications on healthcare, with an emphasized application to medical image computing and robotic surgical data science. I recently work on multi-modality medical foundation model, video-language learning in surgery, resource efficient learning, and smart agent for robotic surgery with 3D reconstruction.
*Opening!* I am looking for PhD(2025Spring&Fall)/Postdoc/RA/Interns/Visiting students supported by CSC, who are interested in machine learning, medical image analysis, surgical 2D/3D vision, surgical robotic intelligence. Students with strong self-motivation and publication record are preferred. Welcome to email me after reading the details.
If you are an NUS student interested in doing research with me, also feel free to drop me an email!
News
-
[06/2024] Invited talk about intelligent surgical vision at VALSE Webinar, China [Record in Chinese].
-
[06/2024] One paper about video-text learning in surgery accepted to IEEE TMI; one paper accepted to ECCV 2024; four papers accepted to MICCAI 2024.
-
[05/2024] Excited to share that I have been selected in Forbes 30 Under 30 Asia List, Class 2024.
-
[05/2024] Paper about Gaussian Splitting for Fast Surgical Scene Reconstruction is early accepted to MICCAI 2024.
-
[05/2024] Invited talk at ICRA C4SR+ workshop.
-
[04/2024] One paper accepted to IEEE TMI and one paper accepted to CVPR 2024.
-
[01/2024] Serve as Area Chair of MICCAI 2024.
-
[01/2024] One paper about LLM-assisted continual learning for surgical VQA is accepted to ICRA 2024.
-
[12/2023] Two papers are accepted to AAAI 2024.
-
[12/2023] Serve as Associate Editor of Machine Learning for Biomedical Imaging Journal (MELBA).
-
[11/2023] Invited talk at BII-AI3 Special Interest Group of Digital Health, A*STAR.
-
[09/2023] One paper is accepted to Nature Communications.
-
[08/2023] Invited talk at Cancer Neuroscience Symposium, organized by National Neuroscience Institute (NNI), SingHealth.
-
[07/2023] One paper accepted to IEEE TMI and one paper accepted to ACM MM 2023.
-
[06/2023] Four papers are accepted to MICCAI 2023 (Two early accepted).
-
[06/2023] We are organizing a Special Issue on Trustworthy Machine Learning for Health Informatics in IEEE-JBHI and welcome to submit your manuscripts.
-
[06/2023] Our 2nd MICCAI Workshop on Cancer Prevention through Early Detection (CaPTion) call for papers.
-
[05/2023] Our paper on joint workflow recognition and anticipation won 1st Prize of IJCARS-MICCAI 2021 Best Paper Award!
-
[01/2023] Serve as Area Chair of MICCAI 2023.
-
[01/2023] Two papers are accepted to ICRA and RAL about surgical skill assessment and report generation.
-
[11/2022] Serve as Area Chair of IPCAI 2023.
-
[09/2022] Our invited paper on joint workflow recognition and anticipation is accepted to IJCARS.
-
[07/2022] Invited talk at WiMIUA, University of Cambridge.
-
[07/2022] One paper on personalized FL on medical image segmentation is accepted to ECCV.
-
[06/2022] One paper is accepted to IROS.
-
[05/2022] One paper on surgical scene segmentation is accepted to IEEE TMI.
-
[01/2022] One paper on Transformer for tool tracking of robotic surgery was accepted to ICRA 2022.
-
[12/2021] One paper on landmark detection in ESD surgery was accepted to MedIA.
-
[10/2021] We won the first place of 2021 MICCAI SimSurgSkill-Skill Assessment Challenge. Congrats to Ema and Dimi.
-
[09/2021] One paper on adaptive segmentation from general videos to surgical videos was accepted to MedIA.
-
[07/2021] One paper on video corresponding learning was accepted to ICCV 2021.
-
[06/2021] One paper on semi-supervised surgical workflow recognition was accepted to MedIA.
-
[06/2021] Two papers on future frame prediction and DA in robotic action recognition were accepted to IROS 2021.
-
[06/2021] Our paper on multi-modality graph learning won ICRA 2021 Best Paper Award in Medical Robotics!
-
[05/2021] Three papers were early accepted to MICCAI 2021 with one oral.
-
[05/2021] I was invited as the Session Chair of ICRA 2021.
-
[03/2021] Our paper on relating temporal cues for workflow recognition is accepted to IEEE TMI.
-
[03/2021] Two papers accepted to ICRA 2021.
-
[02/2021] Our paper on future scene prediction for robotic surgery is accepted to IPMI 2021 with oral.
-
[01/2021] Our ROBUST-MIS 2019 challenge paper is accepted to MedIA.
Selected Publications [Find full list at Google Scholar]
* indicates equal contribution; † indicates corresponding authorship.
Selected Awards
Forbes 30 Under 30 Asia List, Class 2024 [NUS press coverage] |
1st Prize of Best Paper Award of IJCARS-MICCAI 2021 [NUS press coverage] |
Best Paper Award in Medical Robotics at ICRA 2021 |
Best Paper Award of MedIA-MICCAI 2017 , 2017 |
Young Scientist Publication Impact Award Finalist at MICCAI, 2021 |
Young Scientist Award Runner Up at MICCAI, 2016 |
NIH Awards at MICCAI 2020 |
Champion, SimSurgSkill Challenge on Objective Surgical Skills Assessment (MICCAI 2021) |
Champion, ROBUST-MIS Challenge on Multi-instance Segmentation (MICCAI 2019) |
Champion, EndoVis Surgical Workflow Challenge on Phase Segmentation (MICCAI 2019) |
Champion, Surgical Workflow Challenge (MICCAI M2CAI 2016) |
Teaching Assistant of Merit, 2016 |
Hong Kong PhD Fellowship, 2015-2019 |
Team
Current Students:
Qian Li (B.E., Ph.D., HIT)(Research Fellow) |
Haofeng Liu (M.S. SUSTech)(PhD Student, 2024 Spring) |
Shuojue Yang (M.S. JHU)(PhD Student, 2024 Spring) |
Junde Wu (M.S. HIT)(Research Assistant) |
Xiaoming Qi (Ph.D. SEU)(Visiting PhD Student, 2023-) |
Shi Yin (Ph.D. CSU)(Visiting PhD Student, 2023-) |
Mingxuan Hong (B.E. CUHK)(MEng Student, 2023-) |
Yunpeng Zhao (B.E. Beihang)(MEng Student, 2023-) |
Zheng Fang (B.E. ZJU-UIUC)(MEng Student, 2023-) |
Zhang Jiaan (B.E. ZJU)(3+1+1 Program, 2023-) |
Alumni:
Zhimin Shao (2023 Summer Intern) (B.E. M.S. at THU -> PhD at JHU) |
KinHei Lee (2024 Intern), (B.E. at CUHK -> Mres at ICL) |
Previous Mentees:
Dimitrios Anastasiou (Ph.D. UCL) |
Zixu Zhao (2022 Ph.D. CUHK), Current: Amazon |
Xueying Shi (2021 Ph.D. CUHK), Current: Huawei |
Professional Services
Conference Services:
* Area Chair of MICCAI 2023, 2024, IPCAI 2023
* Publicity Chair of IEEE-RAS RoboSoft 2023
* Session Chair of ICRA 2021
* Organization Committee:
IJCAI Workshop on Trustworthy Machine Learning in Healthcare, 2024
ICLR Workshop on Trustworthy Machine Learning in Healthcare, 2023
MICCAI Workshop on Cancer Prevention through early detecTion, 2022, 2023, 2024
MICCAI Challenge on 3D Reconstruction During Colonoscopy, 2022
MICCAI Challenge on Pre-operative to Intra-operative Laparoscopy Fusion, 2022
* Regular Conference reviewer:
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
IEEE International Conference on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)
IEEE International Conference on Robotics and Automation (ICRA)
IEEE International Conference on Intelligent Robots and Systems (IROS)
Association for the Advancement of Artificial Intelligence (AAAI)
Medical Image Computing and Computer Assisted Intervention (MICCAI)
ACM International Conference on Multimedia (ACM MM)
Regular Journal Reviewer:
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
IEEE Transactions on Medical Imaging (TMI)
Medical Image Analysis (MedIA)
Nature Communications Medicine
International Journal of Surgery
IEEE Journal of Biomedical and Health Informatics (JBHI)
IEEE Robotics and Automation Letters (RA-L)
Medical Physics
Neurocomputing
International Journal of Computer Assisted Radiology and Surgery (IJCARS)
Computer Methods and Programs in Biomedicine (CMPB)
Selected Talks
Towards AI-powered Robotic Surgical Vision.
Woman in Medical Image Understanding and Analysis, University of Cambridge, UK, Jul. 2022.
Towards AI-powered Robotic Surgical Vision.
IUPESM World Congress, Singapore, Jun. 2022.
Dynamic Surgical Video Analysis for Intelligent Robotic Surgery.
CMIC Seminar at University College London (UCL), Sep. 2021.
Dynamic Surgical Video Analysis for Intelligent Robotic Surgery.
The Hong Kong Polytechnic University (PolyU), Nov. 2020.
Towards Intelligent Surgery: Dynamic Surgical Visual Perception with Deep Learning.
Theme-based Research Scheme Symposium on Image-guided Robotic Surgery, CUHK, Nov. 2019.
Towards Intelligent Surgery: Dynamic Surgical Video Analysis with Deep Learning.
The 5th World Chinese Microbial Ecology and Intelligent Endoscopy Summit, Xiamen, Nov. 2019.
Teaching
2023-2024 | Spring | EE2211 Introduction to Machine Learning |
2023-2024 | Fall | BN5211 Medical Robotics |
2015-2016 | Fall | ESTR1934 Digital Logic and Systems |
2015-2016 | Spring | CSCI1930 Data Structures |
2016-2017 | Fall | CSCI3260 Principles of Computer Graphics |
2016-2017 | Spring | CSCI1930 Data Structures |
2017-2018 | Fall | CSCI3260 Principles of Computer Graphics |
© Yueming Jin | Last updated: Dec 2022