You are on page 1of 7

Australas Phys Eng Sci Med

DOI 10.1007/s13246-012-0146-0

A robotic catheter system with real-time force feedback


and monitor
Nan Xiao • Jian Guo • Shuxiang Guo •

Takashi Tamiya

Received: 5 January 2011 / Accepted: 27 May 2012


Ó Australasian College of Physical Scientists and Engineers in Medicine 2012

Abstract This paper presents a robotic catheter system about 2 mm in the surgery. However, the contact force
with force sensors, monitor and a master–slave remote between the blood vessel and the catheter cannot be sensed.
control system. We developed micro force sensors and During the operation an X-ray camera is used, and long
applied them in the system to guarantee the operation time operation will cause damage to the patient. Although
safety in intravascular neurosurgery applications, and doctors wear protecting suits, it is very difficult to protect
employed a camera to monitor the operation. Two kinds of doctors’ hands and faces from the radiation of the X-ray.
force information are obtained through force sensors when There are dangers of mingling or breaking the blood ves-
the catheter contacted the blood vessel. The experiment sels. To overcome these challenges, we need better tech-
shows that the proposed force sensors-based catheter sys- nique and mechanisms to help and train doctors. Robotic
tem works well through force feedback and remote control. system has many advantages, such as higher precision, can
The system can facilitates the operation and avoid potential be controlled remotely etc. However, compared with hands
damages. of human being, none of a robotic system could satisfy all
of the requirements of an endovascular intervention. Not
Keywords Robotic catheter mechanism  Force sensor  only because the machine is not as flexible as hands of
Force monitoring human being but also lacks of touch. In any case, robotic
catheter manipulation system could provide assistant to
surgeons in the operation, but it has a long way to go to
Introduction replace human being.
A lot of products and researches are reported in this
Endovascular intervention is expected to become increas- area. One of the popular products is a robotic catheter
ingly popular in medical practice, both for diagnosis and placement system called Sensei robotic catheter system
for surgery. However, as a new technology, it requires a lot supplied by Hansen Medical [1–3]. The Sensei system
of skills in operation. In addition, the operation is carried provides the physician with more stability and more force
out inside the body, it is impossible to monitor it directly. in catheter placement with the Artisan sheath compared to
Much more skills and experience are required for doctors manual techniques, allows for more precise manipulation
to insert the catheter. In the operation, for example the with less radiation exposure to the doctor, and is com-
catheter is inserted through patients’ blood vessel. Mistakes mensurate with higher procedural complications to the
would hurt patients such as a serious vascular damage. An patient. Because of the sheath’s multiple degrees of free-
experienced neurosurgery doctor can achieve a precision dom, force detection at the distal tip is very hard. Catheter
Robotics Inc. has developed a remote catheter system
called Amigo [4]. This system has a robotic sheath to steer
N. Xiao (&)  J. Guo  S. Guo  T. Tamiya catheter which is controlled at a nearby work station, in a
Intelligent Mechanical Systems Engineering Department,
manner similar to the Sensei system. The first human trail
Kagawa University, 2217-20, Hayashi-cho, Takamatsu, Kagawa
761-0396, Japan of this system was in April, 2010 in Leicester, UK, where it
e-mail: xiao@eng.kangawa-u.ac.jp was used to ablate atrial flutter. Magnetecs Inc. produced

123
Australas Phys Eng Sci Med

AD/DA
IEEE 1394 Converter

position position Catheter


Phantom DSP manipulator
PC Communication
Omni & Sensors
force force

Remote control sub-system

Fig. 1 Schematic diagram of the system

their ‘catheter guidance control and imaging’ system [5]. (1) Stability movement of the catheter in blood vessel.
This system has four large magnets placed around the (2) The motion of catheter in the surgery.
table, with customised catheters containing magnets in the (3) Different speeds and step angle.
tip. The catheter is moved by the magnetic fields and is (4) Easiness of sterilization.
controlled at a nearby work station The Stereotaxis Inc. (5) Security of the operation.
developed a magnetic navigation system: the Stereotaxis
Niobe [6]. The system facilitates precise vector based
System design and configuration
navigation of magnetically enabled guide wires for percu-
taneous coronary intervention by using two permanent
Figure 1 shows the schematic diagram of the system. The
magnets located on opposite sides of the patient table to
system consists of two parts. One is the master side which
produce a controllable magnetic field. Thakui et al. [7]
is placed in the surgeon side. The master part is controlled
developed a kind of remote catheter navigation system.
by a PC, and a Phantom is used to get operator input and
This system allowed the user to operate a catheter manip-
display force feedback to the operator. The other part is the
ular with a real catheter. So surgeons’ operative skills
remote control system (slave). Surgeons get position of the
could be applied in this case. The disadvantage of this
catheter from monitors, and catheter manipulator is placed
system is lack of mechanical feedback. Fukuda and co-
in the slave side. Cameras are employed to monitor the
workers [8] at Nagoya University proposed a custom linear
status of the patient and DSA image will be sent to the
stepping mechanism, which simulates the surgeon’s hand
master side at the same time. Force sensors are installed at
movement. Regarding these products and researches, most
the end-tip of the catheter, force information will be sent to
concerns are still the safety. Force information of the
the master side in real-time. In the slave side a DSP is
catheter during the operation is very important to ensure
employed as the core controller, reference displacement
the safety of the surgery. However, measurement of the
will be send to the catheter manipulator and force will be
force on catheters is very hard to solve in these systems. A
get at the same time from sensors by using an AD con-
potential problem with a remote catheter control system is
verter. An internet based communication is built, therefore,
the lack of mechanical feedback that one would receive
in this case time delay between the master and slave should
from manually controlling a catheter [1, 9–15].
below 300 ms to keep the safety of the operation [18].
The remainder of the paper is organized as the follow-
Figure 2 shows the developed system.
ing. In ‘‘System development and implementation’’ section
system development and implementation will be intro-
duced. In ‘‘Simulations experiments and experimental
result’’ section simulation will be introduced and some
results will be provided. Finally, in the last section we draw
the conclusions.

System development and implementation

We developed a highly precise device which can achieve a


precision of 0.015 mm [16, 17], and more suitable in
configuration practical intravascular neurosurgery.
The concerns in the design are list as follows. Fig. 2 Photo of the developed system

123
Australas Phys Eng Sci Med

Fig. 3 Mechanism of the remote control sub-system, rotation support

Remote control sub-system

Figure 3 shows the remote control sub-system. In order to


insert a catheter two motions are demanded, one is axial
movement and the other one is radial movement. Figure 4
shows the catheter clamping and insertion mechanism of
the remote control sub-system. The catheter can pass
between the two wheels and the two wheels can be tight-
ened by the spring. The wheels are driven by a stepping
motor. Therefore, the catheter can be driven forward and
backward. Figure 3 shows the rolling support device. The
catheter can be rotated by the rotation gear which is driven
Fig. 4 Mechanism of the remote control sub-system, inserting
by a motor when the catheter is fixed by the two wheels. support: a front view and b rear view

Micro force sensors To measure the end-tip contact force of the catheter a
micro optical force sensor was used, meanwhile, the optical
Force information on the catheter is very important to fibre force sensor was served as guide wire to lead the
insure the safety of an operation. Doctors always want to catheter for inserting and rotating. The FOP-M optical fibre
manage any details of an operation. The contact force force sensor of FISO Technologies Inc. was used this time
between blood vessel and the catheter is a key detail. As in our research.
stronger contact may break the blood vessel, the method of
getting the contact force information between the blood f ¼ ci3 v3 þ ci2 v2 þ ci1 v þ ci0 ði ¼ 1; 2; 3Þ ð1Þ
vessel and the catheter is required. There are two kinds of where c is the coefficients as shown in Table 1, v is voltage
the contact force as shown in Fig. 5. One is generated when output by sensors.
the side of the catheter contacts to the blood vessel, and the
other one is generated when the end-tip contacts to the Controller
blood vessel. Both of them could cause damage during the
operation. In the research a Phantom Omni is employed as the con-
To measure the contact force in the side of the catheter, troller. Phantom Omni is a haptic device which can output
a force sensor is developed. The dimension of the force force under a three-dimensional coordinate system. The
sensor is 4 9 2 9 0.5 mm. Three sensors are installed in Phantom Omni has six joints. That means it has six degrees
the catheter as shown in Fig. 6. The sensors are made of the of freedom. However, the robotic catheter operating system
sensitive material. Calibration experiments were carried needs only two degrees of freedom to control its motions.
out to get the characteristic equations. The calibration In this research, the displacement along z axis of the handle
results and the curves were fitted by MATLAB curve fit- in the phantom is used to drive the catheter to go forward
ting tool box. Cubic polynomial which is described with and backward, the displacement along x axis of the handle
Eq. 1 is adopted to describe the curve and the coefficients in the phantom is used to drive the catheter to roll, and the
of the equation are given in Table 1. coordinate system is shown in Fig. 7. When force

123
Australas Phys Eng Sci Med

Fig. 5 Comparison of safety


between two situations (without
force sensors and with force
sensors)

Fig. 7 Coordinate system at the Phantom Omni

When catheter is rotating, the Phantom Omni output


Fig. 6 Force sensors installed on the catheter
force is as follows:
*
Table 1 Calibration results F ¼ Arot  i þ 0  j þ 0  k ð4Þ
Coefficient Sensor 1 Sensor 2 Sensor 3 fmax ¼ max ðf1 ; f2 ; f3 Þ ð5Þ

ci1 -0.4762 -0.1874 -0.03155 0 ðfmax \ C1 Þ
Ar ¼ ð6Þ
ci2 2.075 1.368 0.2049 G  fmax ðfmax [ C1 Þ
ci1 -2.97 -3.406 -1.15 *
where F is the output force of the Phantom Omni, Arot is
ci0 1.668 3.25 2.145
the amplitude of the output force in rotation direction and
which is defined by Eq. 6, f1 ; f2 ; f3 are force from side
sensor 1, 2 and 3, f4 is the force from the optic fiber sensor
information is sent to the Phantom, the Phantom will out-
G is the gain coefficient, and C1 is a defined threshold.
put a haptic feedback to the user. Equations 2–6 show the
force model which are used to output force to the user.
Safety considerations
When catheter is inserting, the Phantom Omni output
force is as follows:
Software was developed to monitor the force information.
*
F ¼ 0  i þ 0  j þ Ains k ð2Þ Figure 8 shows the interface of the software. In this study
 three force sensors are used, so there are three progress bars
0 ðf4 \C0 Þ
Ains ¼ ð3Þ placed on this panel. Each progress bar shows a force from
G  f4 ðf4 [ C0 Þ
a force sensor. Also a colour bar is used; it shows the
*
where F is the output force of the Phontom Omni, Ains is danger range of the force. If a force is in the range of green
the amplitude of the output force in insertion direction and (below 0.5 N), it means safe; if in the range of yellow
which is defined by Eq. 3, G is the gain coefficient and C0 (0.5–1 N), it means the force needs some attention; if in the
is a defined threshold. range of red (1–1.5 N), it means the force is too large that it

123
Australas Phys Eng Sci Med

Fig. 8 Force monitoring


program

Fig. 9 Process of the


simulation

hurt patient. At the same time, forces feedback is sent to the process of the simulation. At the beginning the catheter
the user through a haptic device. In our research, the haptic was inserted into the blood vessel. When the catheter got to
device is used as the controller so if the force exceeds the the corner as shown in Fig. 9a, the catheter should turn to the
safe limit the controller would be locked immediately. target but it missed. So the catheter returned and rolled then
Then safety of an operation is guaranteed. This system, not turned to the right direction as shown in Fig. 9b and c.
only allow users to see the force but also to feel it. Finally, the catheter reached the target Fig. 9d. The contact
force measured by sensors was displayed on the monitor and
felt through the handle of Phantom Omni.
Simulation experiments and experimental result
Results
Operating simulation
During the simulation of an operation, contact force between
A simulation experiment was carried out in vitro. In this the catheter and the tube was measured and displayed. There
paper, we locate two parts of the system in out laboratory; are three force sensors are installed on the catheter. Figure 10
communication between the controller and remote sub-sys- shows the contact force when the catheter through the branch
tem was realized by a LAN communication, time delay was of the tube. The yellow curve is the force measured by the
about 10 ms. A rubber tube was used to imitate a blood vessel sensor 1 which is placed on the most front of the catheter, the
which has a branch and an aneurysm which is shown in green line is the force measured by sensor 2 and gray line is
Fig. 6. The target of the operation is the aneurysm. A catheter the force measured by sensor 3. Sensor 1 contacted to the
should be driven to the target then break it. Figure 10 shows wall of the tube firstly. Sensor 2 contacted to the wall of the

123
Australas Phys Eng Sci Med

Fig. 10 Side contact force

Fig. 11 End-tip contact force

Fig. 12 Output force of the


Phantom Omni

catheter after sensor 1 through the branch, and then the Conclusions and future work
contact force was detected and displayed. The curves had got
fluctuations on the peak of the signal. Figure 11 shows the In this paper, a novel catheter system with monitor and
contact force measured by the optical fiber sensor. At the micro force sensors is presented. We developed a high
same time these force were sent to the doctor side, displayed precision remote catheter system to help doctor in intra-
on the screen and outputted by the Phantom Omni, the force vascular neurosurgery. In this system, two kinds of force
is shown in Fig. 12. sensors are used on the catheter, which monitor the force in
From the experiment and the results we could find that real-time while the catheter is in operation. We also sim-
the catheter can be sent to the place, and the contact force ulated in vitro to evaluate the operability of the developed
on the catheter can be measured through force sensors and catheter system. The experimental results show that the
outputted by using the haptic device. catheter with micro force sensors work well which can

123
Australas Phys Eng Sci Med

measure the contact force between the catheter and the 9. Willems S, Steven D, Servatius H, Hoffmann BA, Drewitz I,
blood vessel, and improve operability. Mullerleile K, Aydin MA, Wegscheider K, Salukhe TV, Meinertz
T, Rostock T (2010) Persistence of pulmonary vein isolation after
In the future, the force sensor will be improved both in robotic remote-navigated ablation for atrial fibrillation and its
precision and stability. And new kinds of materials will be relation to clinical outcome. J Interv Card Electrophysiol
adopted to develop new sensors. Additionally, mechanism 21:1079–1084
with good operability will be improved. 10. Saliba W, Reddy VY, Wazni O, Cummings JE et al (2008) Atrial
fibrillation ablation using a robotic catheter remote control sys-
tem: initial human experience and long-term follow-up results.
Acknowledgments This research is supported by Kagawa Univer- J Am Coll Cardiol 51:2407–2411
sity Characteristic Prior Research fund 2011. 11. Ikeda S, Arai F, Fukuda T, Negoro M, Irie K, Takahashi I et al
(2005) In vitro patient-tailored anatomaical model of cerebral
artery for evaluating medical robots and systems for intravascular
neurosurgery. Proceedings of IEEE/RSJ International Conference
References on Intelligent Robots and Systems. pp 1558–1563
12. Arai F, Fujimura R, Fukuda T, Negoro M (2002) New catheter
1. Kanagaratnam P, Koa-Wing M, Wallace DT, Goldenberg AS, driving method using linear stepping mechanism for intravascular
Peters NS, Wyn Davies D (2008) Experience of robotic catheter neurosurgery. Proceedings of the 2002 IEEE International Con-
ablation in humans using a novel remotely steerable catheter ference on Robotics and Automation. pp 2944–2949
sheath. J Interv Card Electrophysiol 21:19–26 13. Tercero C, Ikeda S, Uchiyama T et al (2007) Autonomous
2. Chun JK, Ernst S, Matthews S, Schmidt B, Bansch D, Boczor S catheter insertion system using magnetic motion capture sensor
et al (2007) Remote-controlled catheter ablation of accessory for endovascular surgery. Int J Med Robotics Comput Assist Surg
pathways: results from the magnetic laboratory. Eur Heart J 3(1):52–58
28(2):190–195 14. Ramcharitar S, Patterson MS, Geuns RJ et al (2008) Technology
3. Pappone C, Vicedomini G, Manguso F, Gugliotta F, Mazzone P, insight: magnetic navigation in coronary interventions. Nat Clin
Gulletta S, Sora N, Sala S, Marzi A, Augello G, Livolsi L, Pract Cardiovasc Med 5:148–156
Santagostino A, Santinelli V (2006) Robotic magnetic navigation 15. Fu Y, Liu H, Wang S et al (2009) Skeleton based active catheter
for atrial fibrillation ablation. J Am Coll Cardiol 47:1390–1400 navigation. Int J Med Robotics Comput Assist Surg 5(2):125–135
4. http://catheterrobotics.com/CRUS-main.htm 16. Guo J, Xiao N, Guo S, Tamiya T (2010) Development of a force
5. http://www.magnetecs.com/ information monitoring method for a novel catheter operating
6. http://www.stereotaxis.com/niobe.html system. Inf Int Interdiscip J 13(6):1999–2009
7. Thakui Y, Bax JS, Holdsworth DW, Drangova M (2009) Design 17. Fabrizio MD, Lee BR, Chan DY, Stoianovici D, Jarrett TW,
and performance evaluation of a remote catheter navigation Yang C, Kavoussi LR (2000) Effect of time delay on surgical
system. IEEE Trans Biomed Eng 56(7):1901–1908 performance during telesurgical manipulation. J Endourol 14:
8. Arai F, Fuji R, Fukuda T (2002) New catheter driving method 133–138
using linear stepping mechanism for intravascular neurosurgery. 18. Wang J, Guo S, Kondo H, Guo J, Tamiya T (2008) A novel
Proceedings of the 2002 IEEE International Conference on catheter operating system with force feedback for medical
Robotics and Automation, vol 3. pp 2944–2949 applications. Int J Inf Acquis 5:83–91

123

You might also like