Building large mosaics of confocal endomicroscopic images using visual servoing

Rosa, Benoît;Erden, Mustapha Suphi;Vercauteren, Tom;Herman, Benoît;Morel, Guillaume;et.al.
(2013) IEEE Transactions on Biomedical Engineering — Vol. 60, n° 4, p. 1041-1049 (2013)

Files

2012ACLI2722.pdf
  • Restricted Access
  • Adobe PDF
  • 6.41 MB

Details

Authors
  • Rosa, BenoîtUniversité Pierre et Marie Curie - CNRS
    Author
  • Erden, Mustapha SuphiUniversité Pierre et Marie Curie - CNRS
    Author
  • Vercauteren, TomMauna Kea Technologies
    Author
  • Author
  • Morel, GuillaumeUniversité Pierre et Marie Curie - CNRS
    Author
Show more
Abstract
Probe-based Confocal Laser Endomicroscopy (pCLE) provides real-time microscopic images of tissues contacted by a small probe that can be inserted in vivo through a minimally invasive access. Mosaicking consists in sweeping the probe in contact with a tissue to be imaged while collecting the video stream, and process the images to assemble them in a large mosaic. While most of the literature in this field has focused on image processing, little attention has been paid so far to the way the probe motion can be controlled. This is a crucial issue since the precision of the probe trajectory control drastically influences the quality of the final mosaic. Robotically controlled motion has the potential of providing enough precision to perform mosaicking. In this paper, we emphasize the difficulties of implementing such an approach. Firstly, probe-tissue contacts generate deformations that prevent from properly controlling the image trajectory. Secondly, in the context of minimally invasive procedures targeted by our research, robotic devices are likely to exhibit limited quality of the distal probe motion control at the microscopic scale. To cope with these problems visual servoing from real-time endomicroscopy images is proposed in this paper. It is implemented on two different devices (a high-accuracy industrial robot and a prototype minimally invasive device). Experiments on different kinds of environments (printed paper and ex vivo tissues) show that quality of the visually servoed probe motion is sufficient to build mosaics with minimal distortion in spite of disturbances.
Affiliations

Citations

Rosa, B., Erden, M. S., Vercauteren, T., Herman, B., Szewczyk, J., & Morel, G. (2013). Building large mosaics of confocal endomicroscopic images using visual servoing. IEEE Transactions on Biomedical Engineering, 60(4), 1041-1049. https://doi.org/10.1109/TBME.2012.2228859 (Original work published 2013)