Yueming Jin

Assistant Professor

Department of Biomedical Engineering
Department of Electrical and Computer Engineering
National University of Singapore (NUS)

Office: Block E7, #05-01H, NUS, Singapore 119276
Email: ymjin AT nus.edu.sg

Biography

I am an Assistant Professor at Department of Biomedical Engineering and Department of Electrical and Computer Engineering at National University of Singapore. Before joining NUS, I was a senior research fellow at the Department of Computer Science, University College London, working with Prof. Danail Stoyanov. I received my Ph.D. degree in the Department of Computer Science and Engineering, The Chinese University of Hong Kong, advised by Prof. Pheng-Ann Heng and Prof. Chi-Wing Fu.

My research interests include artificial intelligence and its applications on medical image computing, robotic surgical data science. I recently work on spatial-temporal representation learning, data efficient learning, and multi-modality learning.

*Opening!* I am looking for PhD(2024Spring&Fall)/Postdoc/RA/Interns, who are interested in machine learning, medical image analysis, surgical 2D/3D vision, surgical robotic intelligence. Students with strong self-motivation and publication record are preferred. Welcome to email me after reading the details.

If you are an NUS student interested in doing research with me, also feel free to drop me an email!

News

[08/2022] Invited talk at Cancer Neuroscience Symposium, organized by National Neuroscience Institute (NNI), SingHealth.
[06/2023] Four papers are accepted to MICCAI 2023 (Two early accepted).
[06/2023] We are organizing a Special Issue on Trustworthy Machine Learning for Health Informatics in IEEE-JBHI and welcome to submit your manuscripts.
[06/2023] Our 2nd MICCAI Workshop on Cancer Prevention through Early Detection (CaPTion) call for papers.
[05/2023] Our paper on joint workflow recognition and anticipation won 1st Prize of IJCARS-MICCAI 2021 Best Paper Award!
[01/2023] Serve as Area Chair of MICCAI 2023.
[01/2023] Two papers are accepted to ICRA and RAL about surgical skill assessment and report generation.
[11/2022] Serve as Area Chair of IPCAI 2023.
[09/2022] Our invited paper on joint workflow recognition and anticipation is accepted to IJCARS.
[07/2022] Invited talk at WiMIUA, University of Cambridge.
[07/2022] One paper on personalized FL on medical image segmentation is accepted to ECCV.
[06/2022] One paper is accepted to IROS.
[05/2022] One paper on surgical scene segmentation is accepted to IEEE TMI.
[01/2022] One paper on Transformer for tool tracking of robotic surgery was accepted to ICRA 2022.
[12/2021] One paper on landmark detection in ESD surgery was accepted to MedIA.
[10/2021] We won the first place of 2021 MICCAI SimSurgSkill-Skill Assessment Challenge. Congrats to Ema and Dimi.
[09/2021] One paper on adaptive segmentation from general videos to surgical videos was accepted to MedIA.
[07/2021] One paper on video corresponding learning was accepted to ICCV 2021.
[06/2021] One paper on semi-supervised surgical workflow recognition was accepted to MedIA.
[06/2021] Two papers on future frame prediction and DA in robotic action recognition were accepted to IROS 2021.
[06/2021] Our paper on multi-modality graph learning won ICRA 2021 Best Paper Award in Medical Robotics!
[05/2021] Three papers were early accepted to MICCAI 2021 with one oral.
[05/2021] I was invited as the Session Chair of ICRA 2021.
[03/2021] Our paper on relating temporal cues for workflow recognition is accepted to IEEE TMI.
[03/2021] Two papers accepted to ICRA 2021.
[02/2021] Our paper on future scene prediction for robotic surgery is accepted to IPMI 2021 with oral.
[01/2021] Our ROBUST-MIS 2019 challenge paper is accepted to MedIA.

Selected Publications [Find full list at Google Scholar]

SimCol3D -- 3D Reconstruction during Colonoscopy Challenge
Anita Rau†, Sophia Bano†, Yueming Jin†, Pablo Azagra, Javier Morlana, Edward Sanderson, Bogdan J. Matuszewski, Jae Young Lee, Dong-Jae Lee, Erez Posner, Netanel Frank, Varshini Elangovan, Sista Raviteja, Zhengwen Li, Jiquan Liu, Seenivasan Lalithkumar, Mobarakol Islam, Hongliang Ren, José M.M. Montiel, Danail Stoyanov
(Summarization report for 3D Reconstruction during Colonoscopy MICCAI 2022 Challenge)
Preprint, 2023.

Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentation
Junde Wu, Yu Zhang, Rao Fu, Huihui Fang, Yuanpei Liu, Zhaowei Wang, Yanwu Xu, Yueming Jin
(We present a simple yet effective adaptation technique, to extend SAM to medical domain)
Preprint, 2023.

FedDP: Dual Personalization in Federated Medical Image Segmentation
Jiacheng Wang, Yueming Jin, Danail Stoyanov, Liansheng Wang.
IEEE Transactions on Medical Imaging (TMI), 2023.

Keep Your Eye on the Best: Contrastive Regression Transformer for Skill Assessment in Robotic Surgery
Dimitrios Anastasiou, Yueming Jin, Danail Stoyanov, Evangelos Mazomenos.
IEEE Robotics and Automation Letters (RA-L), 2023.

Trans-SVNet: Hybrid Embedding Aggregation Transformer for Surgical Workflow Analysis
Yueming Jin, Yonghao Long, Xiaojie Gao, Danail Stoyanov, Qi Dou, Pheng-Ann Heng.
International Journal for Computer Assisted Radiology and Surgery (IJCARS), 2022.
(1st Prize of Best Paper Award of IJCARS-MICCAI 2021)

[code][award] [press coverage]

Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentation
Yueming Jin, Yang Yu, Cheng Chen, Zixu Zhao, Pheng-Ann Heng, Danail Stoyanov.
IEEE Transactions on Medical Imaging (TMI), 2022.

[code][video]

Personalizing Federated Medical Image Segmentation via Local Calibration
Jiacheng Wang*, Yueming Jin*, Liansheng Wang.
European Conference on Computer Vision (ECCV), 2022.

[code]

Temporal Memory Relation Network for Workflow Recognition from Surgical Video
Yueming Jin, Yonghao Long, Cheng Chen, Zixu Zhao, Qi Dou, Pheng-Ann Heng.
IEEE Transactions on Medical Imaging (TMI), 2021.

[code]

Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learning
Zixu Zhao, Yueming Jin†, Pheng-Ann Heng.
International Conference on Computer Vision (ICCV), 2021.

[video][poster]

Real-time Landmark Detection for Precise Endoscopic Submucosal Dissection via Shape-aware Relation Network
Jiacheng Wang*, Yueming Jin*, Shuntian Cai, Hongzhi Xu, Pheng-Ann Heng, Jing Qin, Liansheng Wang.
Medical Image Analysis (MedIA), 2021.

One to Many: Adaptive Instrument Segmentation via Meta Learning and Dynamic Online Adaptation in Robotic Surgical Video
Zixu Zhao, Yueming Jin†, Bo Lu, Chi-Fai Ng, Qi Dou, Yun-Hui Liu, Pheng-Ann Heng.
IEEE International Conference on Robotics and Automation (ICRA), 2021.

[video]

Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysis
Yueming Jin, Huaxia Li, Qi Dou, Hao Chen, Jing Qin, Chi-Wing Fu, Pheng-Ann Heng.
Medical Image Analysis (MedIA), 2020.
(Ranked 1st place in MICCAI 2019 EndoVis Surgical Workflow Challenge on phase segmentation)

[code]

Automatic Gesture Recognition in Robot-assisted Surgery with Reinforcement Learning and Tree Search
Xiaojie Gao, Yueming Jin, Qi Dou, Pheng-Ann Heng.
International Conference on Robotics and Automation (ICRA), 2020.

Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Video
Yueming Jin, Keyun Cheng, Qi Dou, Pheng-Ann Heng.
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2019. (Oral)

[code]

SV-RCNet: Workflow Recognition from Surgical Videos using Recurrent Convolutional Network
Yueming Jin, Qi Dou, Hao Chen, Lequan Yu, Jing Qin, Chi-Wing Fu, Pheng-Ann Heng.
IEEE Transactions on Medical Imaging (TMI), 2018.
(Ranked 1st place in MICCAI M2CAI 2016 Surgical Workflow Challenge)

[code]

Reconfigurable Interlocking Furniture
Peng Song, Chi-Wing Fu, Yueming Jin, Hongfei Xu, Ligang Liu, Pheng-Ann Heng, Daniel Cohen-Or.
ACM Transactions on Graphics (ACM TOG), SIGGRAPH Asia, 2017.
(Results were selected to be included in the technical papers trailer)

[project]

3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes
Qi Dou, Hao Chen, Yueming Jin, Lequan Yu, Jing Qin, Pheng-Ann Heng.
Medical Image Computing and Computer Assisted Intervention (MICCAI), 2016.
(Young Scientist Award Finalist)

* indicates equal contribution; † indicates corresponding authorship.

Selected Awards

1st Prize of Best Paper Award of IJCARS-MICCAI 2021

Best Paper Award in Medical Robotics at ICRA 2021

NIH Awards at MICCAI 2020

MedIA-MICCAI'17 Best Paper Award, 2017

Champion, SimSurgSkill Challenge on Objective Surgical Skills Assessment (MICCAI 2021)

Champion, ROBUST-MIS Challenge on Multi-instance Segmentation (MICCAI 2019)

Champion, EndoVis Surgical Workflow Challenge on Phase Segmentation (MICCAI 2019)

Champion, Surgical Workflow Challenge (MICCAI M2CAI 2016)

Teaching Assistant of Merit, 2016

Hong Kong PhD Fellowship, 2015-2019

Team

Current Students:

Haofeng Liu (M.S. SUSTech)(RA, incoming PhD Student, 2023-)

Junde Wu (M.S. HIT)(RA, incoming PhD Student, 2023-)

Shuojue Yang (M.S. JHU)(RA, incoming PhD Student, 2023-)

Xiaoming Qi (Ph.D. SEU)(Visiting PhD Student, 2023-)

Mingxuan Hong (B.E. CUHK)(MEng Student, 2023-)

Yunpeng Zhao (B.E. Beihang)(MEng Student, 2023-)

Zheng Fang (B.E. ZJU-UIUC)(MEng Student, 2023-)

Previous Mentees:

Dimitrios Anastasiou (Ph.D. UCL)

Zixu Zhao (2022 Ph.D. CUHK), Current: Amazon

Xueying Shi (2021 Ph.D. CUHK), Current: Huawei

Professional Services

Conference Services:
* Area Chair of MICCAI 2023, IPCAI 2023
* Publicity Co-Chair of IEEE-RAS RoboSoft 2023
* Session Chair of ICRA 2021
* Organization Committee:
ICLR Workshop on Trustworthy Machine Learning in Healthcare, 2023
MICCAI Workshop on Cancer Prevention through early detecTion, 2022, 2023
MICCAI Challenge on 3D Reconstruction During Colonoscopy, 2022
MICCAI Challenge on Pre-operative to Intra-operative Laparoscopy Fusion, 2022
* Regular Conference reviewer:
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
IEEE International Conference on Computer Vision (ICCV)
European Conference on Computer Vision (ECCV)
IEEE International Conference on Robotics and Automation (ICRA)
IEEE International Conference on Intelligent Robots and Systems (IROS)
Association for the Advancement of Artificial Intelligence (AAAI)
Medical Image Computing and Computer Assisted Intervention (MICCAI)
ACM International Conference on Multimedia (ACM MM)

Regular Journal Reviewer:
Medical Image Analysis (MedIA)
IEEE Transactions on Medical Imaging (TMI)
Nature Communications Medicine
IEEE Journal of Biomedical and Health Informatics (JBHI)
IEEE Robotics and Automation Letters (RA-L)
Medical Physics
Neurocomputing
International Journal of Surgery
International Journal of Computer Assisted Radiology and Surgery (IJCARS)
Computer Methods and Programs in Biomedicine (CMPB)

Selected Talks

Towards AI-powered Robotic Surgical Vision.
Woman in Medical Image Understanding and Analysis, University of Cambridge, UK, Jul. 2022.

Towards AI-powered Robotic Surgical Vision.
IUPESM World Congress, Singapore, Jun. 2022.

Dynamic Surgical Video Analysis for Intelligent Robotic Surgery.
CMIC Seminar at University College London (UCL), Sep. 2021.

Dynamic Surgical Video Analysis for Intelligent Robotic Surgery.
The Hong Kong Polytechnic University (PolyU), Nov. 2020.

Towards Intelligent Surgery: Dynamic Surgical Visual Perception with Deep Learning.
Theme-based Research Scheme Symposium on Image-guided Robotic Surgery, CUHK, Nov. 2019.

Towards Intelligent Surgery: Dynamic Surgical Video Analysis with Deep Learning.
The 5th World Chinese Microbial Ecology and Intelligent Endoscopy Summit, Xiamen, Nov. 2019.

Teaching

2023-2024	Fall	BN5211 Medical Robotics
2015-2016	Fall	ESTR1934 Digital Logic and Systems
2015-2016	Spring	CSCI1930 Data Structures
2016-2017	Fall	CSCI3260 Principles of Computer Graphics
2016-2017	Spring	CSCI1930 Data Structures
2017-2018	Fall	CSCI3260 Principles of Computer Graphics