Yueming Jin

Assistant Professor

Department of Biomedical Engineering
Department of Electrical and Computer Engineering
National University of Singapore (NUS)

Office: Block E7, #05-01H, NUS, Singapore 119276
Email: ymjin AT nus.edu.sg

Biography

I am an Assistant Professor at Department of Biomedical Engineering and Department of Electrical and Computer Engineering at National University of Singapore. Before joining NUS, I was a senior research fellow at the Department of Computer Science, University College London, working with Prof. Danail Stoyanov. I received my Ph.D. degree in the Department of Computer Science and Engineering, The Chinese University of Hong Kong, advised by Prof. Pheng-Ann Heng and Prof. Chi-Wing Fu.

My research interests include artificial intelligence and its applications on medical image computing, robotic surgical data science. I recently work on spatial-temporal representation learning, data efficient learning, and multi-modality learning.

*Opening!* I am looking for self-motivated PhD/Postdoc/RA/Interns, who are interested in machine learning, medical image analysis, surgical 2D/3D vision, surgical robotic intelligence (details). Welcome to drop me an email with your CV. Remote collaboration is also welcome!

If you are an NUS student interested in doing research with me, feel free to drop me an email!

News

[01/2023] Serve as Area Chair of MICCAI 2023.
[01/2023] Two papers are accepted to ICRA and RAL about surgical skill assessment and report generation.
[01/2023] Our 1st ICLR Workshop on Trustworthy Machine Learning in Healthcare (TML4H) call for papers.
[11/2022] Serve as Area Chair of IPCAI 2023.
[10/2022] Our IEEE-RAS RoboSoft 2023 on “Soft Robotics for Sustainable Development” call for papers.
[09/2022] Our invited paper on joint workflow recognition and anticipation is accepted to IJCARS.
[07/2022] Invited talk at WiMIUA, University of Cambridge.
[07/2022] One paper on personalized FL on medical image segmentation is accepted to ECCV.
[06/2022] One paper is accepted to IROS.
[05/2022] One paper on surgical scene segmentation is accepted to IEEE TMI.
[05/2022] Welcome to participate in our MICCAI Challenge on Simulated Colonoscopy data for 3D (SimCol).
[05/2022] Our 1st MICCAI Workshop on Cancer Prevention through Early Detection (CaPTion) call for papers.
[05/2022] Welcome to participate in our MICCAI Challenge on Preoperative to Intraoperative Laparoscopy Fusion (P2ILF).
[01/2022] One paper on Transformer for tool tracking of robotic surgery was accepted to ICRA 2022.
[12/2021] One paper on landmark detection in ESD surgery was accepted to MedIA.
[10/2021] We won the first place of 2021 MICCAI SimSurgSkill-Skill Assessment Challenge. Congrats to Ema and Dimi.
[09/2021] One paper on adaptive segmentation from general videos to surgical videos was accepted to MedIA.
[07/2021] One paper on video corresponding learning was accepted to ICCV 2021.
[06/2021] One paper on semi-supervised surgical workflow recognition was accepted to MedIA.
[06/2021] Two papers on future frame prediction and DA in robotic action recognition were accepted to IROS 2021.
[06/2021] Our paper on multi-modality graph learning won ICRA 2021 Best Paper Award in Medical Robotics!
[05/2021] Three papers were early accepted to MICCAI 2021 with one oral.
[05/2021] I was invited as the Session Chair of ICRA 2021.
[03/2021] Our paper on relating temporal cues for workflow recognition is accepted to IEEE TMI.
[03/2021] Two papers accepted to ICRA 2021.
[02/2021] Our paper on future scene prediction for robotic surgery is accepted to IPMI 2021 with oral.
[01/2021] Our ROBUST-MIS 2019 challenge paper is accepted to MedIA.
[07/2020] Two papers accepted to MICCAI 2020. One paper accepted to IROS 2020.
[03/2020] One paper accepted to ICRA 2020. One paper accepted to IPCAI&IJCARS 2020.
[10/2019] Our team won the first place of 2019 MICCAI ROBUST-MIS Challenge on Multi-instance Segmentation.
[10/2019] Our team won the first place of 2019 MICCAI EndoVis Surgical Workflow Challenge on Phase Segmentation.
[07/2019] Two papers accepted to MICCAI 2019 with one oral (3%).

Selected Publications [Google Scholar]

	Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentation. Yueming Jin, Yang Yu, Cheng Chen, Zixu Zhao, Pheng-Ann Heng, Danail Stoyanov. IEEE Transactions on Medical Imaging (TMI), 2022. [paper][code][video]
	Personalizing Federated Medical Image Segmentation via Local Calibration. Jiacheng Wang, Yueming Jin*, Liansheng Wang. European Conference on Computer Vision* (ECCV), 2022. [paper][code]
	Temporal Memory Relation Network for Workflow Recognition from Surgical Video. Yueming Jin, Yonghao Long, Cheng Chen, Zixu Zhao, Qi Dou, Pheng-Ann Heng. IEEE Transactions on Medical Imaging (TMI), 2021. [paper][code]
	Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learning. Zixu Zhao, Yueming Jin†, Pheng-Ann Heng. International Conference on Computer Vision (ICCV), 2021. [paper][video][poster][project]
	Real-time Landmark Detection for Precise Endoscopic Submucosal Dissection via Shape-aware Relation Network. Jiacheng Wang, Yueming Jin*, Shuntian Cai, Hongzhi Xu, Pheng-Ann Heng, Jing Qin, Liansheng Wang Medical Image Analysis* (MedIA), 2021. [paper]
	One to Many: Adaptive Instrument Segmentation via Meta Learning and Dynamic Online Adaptation in Robotic Surgical Video. Zixu Zhao, Yueming Jin†, Bo Lu, Chi-Fai Ng, Qi Dou, Yun-Hui Liu, Pheng-Ann Heng. IEEE International Conference on Robotics and Automation (ICRA), 2021. [paper][video]
	Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysis. Yueming Jin, Huaxia Li, Qi Dou, Hao Chen, Jing Qin, Chi-Wing Fu, Pheng-Ann Heng. Medical Image Analysis (MedIA), 2020. (Ranked 1st place in MICCAI 2019 EndoVis Surgical Workflow Challenge on phase segmentation) [paper][code]
	Automatic Gesture Recognition in Robot-assisted Surgery with Reinforcement Learning and Tree Search. Xiaojie Gao, Yueming Jin, Qi Dou, Pheng-Ann Heng. International Conference on Robotics and Automation (ICRA), 2020. [paper]
	Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Video. Yueming Jin, Keyun Cheng, Qi Dou, Pheng-Ann Heng. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2019. (Oral) [paper][code]
	SV-RCNet: Workflow Recognition from Surgical Videos using Recurrent Convolutional Network. Yueming Jin, Qi Dou, Hao Chen, Lequan Yu, Jing Qin, Chi-Wing Fu, Pheng-Ann Heng. IEEE Transactions on Medical Imaging (TMI), 2018. (Ranked 1st place in MICCAI M2CAI 2016 Surgical Workflow Challenge) [paper] [code]
	Reconfigurable Interlocking Furniture. Peng Song, Chi-Wing Fu, Yueming Jin, Hongfei Xu, Ligang Liu, Pheng-Ann Heng, Daniel Cohen-Or. ACM Transactions on Graphics (ACM TOG), SIGGRAPH Asia, 2017. (Results were selected to be included in the technical papers trailer) [paper] [project] [video]
	3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes. Qi Dou, Hao Chen, Yueming Jin, Lequan Yu, Jing Qin, Pheng-Ann Heng. Medical Image Computing and Computer Assisted Intervention (MICCAI), 2016. (Young Scientist Award Finalist) [paper]

* indicates equal contribution; † indicates corresponding authorship.

Selected Awards

Best Paper Award in Medical Robotics at ICRA 2021

NIH Awards at MICCAI 2020

MedIA-MICCAI'17 Best Paper Award, 2017

Champion, SimSurgSkill Challenge on Objective Surgical Skills Assessment (MICCAI 2021)

Champion, ROBUST-MIS Challenge on Multi-instance Segmentation (MICCAI 2019)

Champion, EndoVis Surgical Workflow Challenge on Phase Segmentation (MICCAI 2019)

Champion, Surgical Workflow Challenge (MICCAI M2CAI 2016)

Teaching Assistant of Merit, 2016

Hong Kong PhD Fellowship, 2015-2019

National Scholarship in China, 2013,2014

Professional Services

Conference Services:
* Area Chair of IPCAI 2023
* Publicity Co-Chair of IEEE-RAS RoboSoft 2023
* Session Chair of ICRA 2021
* Organization Committee:
MICCAI Workshop on Cancer Prevention through early detecTion, 2022
MICCAI Challenge on 3D Reconstruction During Colonoscopy, 2022
MICCAI Challenge on Pre-operative to Intra-operative Laparoscopy Fusion, 2022
* Conference review:
IEEE Conference on Computer Vision and Pattern Recognition (CVPR’21-22)
IEEE International Conference on Computer Vision (ICCV’21)
European Conference on Computer Vision (ECCV’22)
IEEE International Conference on Robotics and Automation (ICRA'21-23)
IEEE International Conference on Intelligent Robots and Systems (IROS'21-22)
Association for the Advancement of Artificial Intelligence (AAAI’21-22)
Medical Image Computing and Computer Assisted Intervention (MICCAI’17-22)

Journal Reviews:
Medical Image Analysis (MedIA)
IEEE Transactions on Medical Imaging (TMI)
Nature Communications Medicine
IEEE Journal of Biomedical and Health Informatics (JBHI)
IEEE Robotics and Automation Letters (RA-L)
Medical Physics
Neurocomputing
International Journal of Surgery
International Journal of Computer Assisted Radiology and Surgery (IJCARS)
Computer Methods and Programs in Biomedicine (CMPB)

Selected Talks

Towards AI-powered Robotic Surgical Vision.
Woman in Medical Image Understanding and Analysis, University of Cambridge, UK, Jul. 2022.

Towards AI-powered Robotic Surgical Vision.
IUPESM World Congress, Singapore, Jun. 2022.

Dynamic Surgical Video Analysis for Intelligent Robotic Surgery.
CMIC Seminar at University College London (UCL), Sep. 2021.

Dynamic Surgical Video Analysis for Intelligent Robotic Surgery.
The Hong Kong Polytechnic University (PolyU), Nov. 2020.

Towards Intelligent Surgery: Dynamic Surgical Visual Perception with Deep Learning.
Theme-based Research Scheme Symposium on Image-guided Robotic Surgery, CUHK, Nov. 2019.

Towards Intelligent Surgery: Dynamic Surgical Video Analysis with Deep Learning.
The 5th World Chinese Microbial Ecology and Intelligent Endoscopy Summit, Xiamen, Nov. 2019.

Teaching

2015-2016	Fall	ESTR1934 Digital Logic and Systems
2015-2016	Spring	CSCI1930 Data Structures
2016-2017	Fall	CSCI3260 Principles of Computer Graphics
2016-2017	Spring	CSCI1930 Data Structures
2017-2018	Fall	CSCI3260 Principles of Computer Graphics