Programul Operaional Sectorial Creterea Competitivitii Economice

Investiii pentru viitorul dumneavoastr

HapticMed Haptic Interfaces in Medical

Applications
Dorin Mircea Popovici
Faculty of Mathematics and Informatics
Ovidius University of Constanta

cofinanat prin Fondul European de Dezvoltare Regional

Outline

Introducing CERVA team

Background
Practice-based Learning Surgery
Haptic User Interfaces Architecture
Surgical Training Application
Acknowledgements

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Introducing CERVA team

UOC

CERVAs mission

Applying Virtual and Augmented

Reality technologies in virtual
environments dedicated to education,
training and cultural heritage

Education & Research

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Education

Undergraduate

Computer graphics
Programming languages
IA

Master

Virtual and Augmented reality

Human-Computer multimodal interfaces
MAS
Behavioral modeling and simulation in VE
Ubiquitous interfaces

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Research

HapticMed 2010 2013

Emulaction 2008-2010

TOMIS 2007 2010

VirDenT 2008 2011

Venus 2007 2008

EVE 1998 2005

INTUITION 2004 2008

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Technology insights

3DS Max, VRML Pad, Poser, Matlab

AReVi, Blender 3D

MAS, ontology, 3D, behaviors, speech recognition

6 infrared Motion Capture System (Motion Analysis)

Active stereoscopic System (projection + desktop), HMD
Phantom Omni, SpaceMouse
Color + Laser 3D scanning system handheld MicroScribe
arm

Handmade (Navoramique)
HapticMed @ CERV

http://www.cerva.ro

26.04.2012

CERVA team

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Partners

UTBV Brasov (RO)

ENIB - France
MINAC Constanta (RO)

CERV - France

SC.NR.TECH.SRL Brasov (RO)

SENSEGRAPHICS Sweden
UBISOFT (RO)

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Events

ICVL International Conference on

Virtual Learning (2006 - :)

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Collaboration means

VR Summer schools (august-september)

Human resources exchanges (students, masters,

PhD researchers, professors)

Research frameworks (PN, POSCCE, FP, NFS, )

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Programul Operaional Sectorial Creterea Competitivitii Economice

Investiii pentru viitorul dumneavoastr

HapticMed
Haptic Feedback in Medical Applications
Project Director: Felix G. Hamza-Lup
Armstrong Atlantic State University

Executive Director: Dorin M. Popovici

cofinanat prin Fondul European de Dezvoltare Regional

Background

Haptic - sense of touch bidirectional (I/O)

Has 2 components:

Tactile
Force/torque feedback

Haptic Devices simulate sense of touch

6 force/torque DOF feedback system offers:

3 force translations
3 torque rotations

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Practice-based Learning Surgery

Learning in a safe environment where mistakes can be

safely made

Force/torque feedback

can provide benefits (both passive and informational)

at little cost to cognitive demand because of its
intuitive nature

refine the required skills until the operator reaches a

target level of proficiency before commencing training
via the traditional apprentice model upon patients

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Haptic User Interfaces Architecture

Hard
ware

Softw
are

Output

Input

OpenGL

AReVi
GLUT

Graphic API

Haptic API

SpaceMouse SDK

HapticMed Prototype
Multimodal output

Multimodal input
Simulation engine
Persistence management
Database Management

HapticMed @ CERV

Input Driver

http://www.cerva.ro

26.04.2012

Haptic User Interfaces Visual Component

OpenGL

industrial standard
robust

X3D

open standard
MedX3D advancing fast
Web enabled

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Haptic User Interfaces Haptic Component

CHAI3D
ReachIn
OpenHaptics
SOFA
Gipsi

H3D
HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Surgical Training Application

Set of tools for basic surgical skill acquisition

First module

Liver Diagnostics through Palpation

Liver palpation can be used in diagnostics of:

increased diaphragmatic descent;

presence of a palpable caudate or Riedel's lobe;
presence of emphysema with an associated depressed
diaphragm;
thin body habitus with narrow thoracic cage;
fatty infiltration (enlarged with rounded edge);
active hepatitis (enlarged and tender);
cirrhosis (enlarged with nodular irregularity);
hepatic neoplasm (enlarged with rock-hard or nodular
consistency).

HapticMed @ CERV

http://www.cerva.ro

26.04.2012

Prepare your popcorn

Prepare your popcorn

Do you really have questions?

http://www.cerva.ro

Do you still have popcorn?