Toolnet: holistically-nested real-time segmentation of robotic surgical tools. García-Peraza-Herrera, L. C, Li, W., Fidon, L., Gruijthuijsen, C., Devreker, A., Attilakos, G., Deprest, J., Vander Poorten, E., Stoyanov, D., & Vercauteren, T. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017. IEEE.
abstract   bibtex   
Real-time tool segmentation from endoscopic \nvideos is an essential part of many computer-assisted robotic \nsurgical systems and of critical importance in robotic surgical \ndata science. We propose two novel deep learning architectures \nfor automatic segmentation of non-rigid surgical instruments. \nBoth methods take advantage of automated deep-learningbased \nmulti-scale feature extraction while trying to maintain \nan accurate segmentation quality at all resolutions. The two \nproposed methods encode the multi-scale constraint inside the \nnetwork architecture. The first proposed architecture enforces it \nby cascaded aggregation of predictions and the second proposed \nnetwork does it by means of a holistically-nested architecture \nwhere the loss at each scale is taken into account for the \noptimization process. As the proposed methods are for realtime \nsemantic labeling, both present a reduced number of \nparameters. We propose the use of parametric rectified linear νnits for semantic labeling in these small architectures to ∋ncrease the regularization of the network while maintaining \nthe segmentation accuracy. We compare the proposed architectures \nagainst state-of-the-art fully convolutional networks. \nWe validate our methods using existing benchmark datasets, ∋ncluding ex vivo cases with phantom tissue and different robotic \nsurgical instruments present in the scene. Our results show \na statistically significant improved Dice Similarity Coefficient \nover previous instrument segmentation methods. We analyze \nour design choices and discuss the key drivers for improving \naccuracy.
@inproceedings{Garcia-Peraza-Herrera2017a,
  author = {Garc{\'{i}}a-Peraza-Herrera, Luis C and Li, Wenqi and Fidon, Lucas and Gruijthuijsen, Caspar and Devreker, Alain and Attilakos, George and Deprest, Jan and {Vander Poorten}, Emmanuel and Stoyanov, Danail and Vercauteren, Tom},
  title = {Toolnet: holistically-nested real-time segmentation of robotic surgical tools},
  booktitle = {2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  year = {2017},
  publisher = {IEEE},
  semanticscholar = {https://www.semanticscholar.org/paper/58a1f8caa27bb7d5ec312491f841f87e63a2b7e1},
  research_field = {},
  data_type = {},
  dvrk_site = {UCL},
  isbn = {1538626829},
  abstract = {Real-time tool segmentation from endoscopic \nvideos is an essential part of many computer-assisted robotic \nsurgical systems and of critical importance in robotic surgical \ndata science. We propose two novel deep learning architectures \nfor automatic segmentation of non-rigid surgical instruments. \nBoth methods take advantage of automated deep-learningbased \nmulti-scale feature extraction while trying to maintain \nan accurate segmentation quality at all resolutions. The two \nproposed methods encode the multi-scale constraint inside the \nnetwork architecture. The first proposed architecture enforces it \nby cascaded aggregation of predictions and the second proposed \nnetwork does it by means of a holistically-nested architecture \nwhere the loss at each scale is taken into account for the \noptimization process. As the proposed methods are for realtime \nsemantic labeling, both present a reduced number of \nparameters. We propose the use of parametric rectified linear \nunits for semantic labeling in these small architectures to \nincrease the regularization of the network while maintaining \nthe segmentation accuracy. We compare the proposed architectures \nagainst state-of-the-art fully convolutional networks. \nWe validate our methods using existing benchmark datasets, \nincluding ex vivo cases with phantom tissue and different robotic \nsurgical instruments present in the scene. Our results show \na statistically significant improved Dice Similarity Coefficient \nover previous instrument segmentation methods. We analyze \nour design choices and discuss the key drivers for improving \naccuracy.},
}

Downloads: 0