International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856

SURVEY ON MEDICAL IMAGE RETRIEVAL BASED ON SHAPE FEATURES AND RELEVANCE VECTOR MACHINE CLASSIFICATION
1
1&3

A.Ranjidha, 2A.Ramesh Kumar, 3M.Saranya

Assistant professor,Department of Computer Science And Engineering Tagore Institute Of Engineering And Technology, Affiliated to Anna University,Chennai Salem,Tamilnadu,India.

Assistant professor,Department of Computer Science And Engineering VMKV Engineering College, Vinayaka Missions University, Salem,Tamilnadu,India.

ABSTRACT This paper focus on Medical Image

Retrieval based on Feature extraction, Classification and Similarity Measurements which will aid for computer assisted diagnosis. The selected features are Shape(Edge Detection (ED) and Generic Fourier Descriptor (GFD)) that are extracted and classified as positive and negative features using a classification technique called Relevance Vector Machine (RVM) that provides a natural way to classify multiple features of images. The similarity model is used to measure the relevance between the query image and the target images based on Euclidean Distance(ED). This type of Medical Image Retrieval System framework is called CBMIR. The retrieval algorithm performances are evaluated in terms of precision and recall. The results show that the multiple feature classifier system yields good retrieval performance than the retrieval systems based on the individual features. The goal of this methodology is to provide a medical image retrieval system for further use of medical diagnosis purpose in the field of medical domain.

Keywords: CBMIR, Shape, Classification, Similarity Measurements

1. INTRODUCTION
The medical imaging systems are used to deliver the needed images to physicians at right time to diagnose and treat diseases. However, access or make use of particular image is not possible unless it is organized. Thus the need for systems that can provide efficient retrieval of images of particular interest from different modalities of medical images in the database is becoming very high. The examples of these modalities are the following: Ultrasound (US),Magnetic Resonance (MR),Positron Emission Tomography(PET), Computed Tomography(CT), Endoscopy(ENDO), Mammograms (MG), Digital Radiography (DR), Computed Radiography (CR), etc., The modalities of images are visual characteristic of images that can be used to assist the retrieval process and to detect the anatomical and functional information about different body parts for the Volume 2, Issue 3 May June 2013

purpose of diagnosis, medical research, and education. The radiology department of hospitals is equipped with Picture archiving and Communications Systems (PACS). The universal format for PACS [1] image storage, retrieval and transfer is DICOM (Digital Imaging and Communications in Medicine) format. The imaging modalities, body parts, orientations are available as textual information in the DICOM header. The PACS systems have limitations because the search for images is carried out based on the textual attributes of image headers (such as patient id name and other technical parameters describing body parts, orientations etc.,).There have also been reported errors in the accuracy of DICOM headings. On the other hand the medical department often does not enter appropriate or sufficient data into the systems. So it requires then to build automatic indexing by visual features of images such as texture, shape, color, etc., to provide sufficient information. This type of system is called Content based Medical Image Retrieval System (CBMIR). CBMIR systems are currently being integrated with PACS for increasing the overall search capabilities and tools available to radiologists.The main thing in visual features based image retrieval system is the gap between visual feature representations and semantic concepts of Images. Medical images are usually subject to high variation and composed of different minor structures. For efficient similar image retrieval and integration, the medical image should be processed systematically to extract are presenting feature vector for each member image. So there is a need for feature extraction and classification of images for effective retrieval. Texture and Shape features are essential for medical image retrieval system. The main objective of this work is to retrieve the images from medical image databases with high accuracy by performing feature extraction and classification process. As a result of a medical image retrieval system, the physician can gain more confidence in his/her decision for diagnosis. Page 333

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856
The organization of the paper is as follows. The existing method survey is presented in section 2. The proposed method and its related works are described in section 3. Experimental results and performance evaluation are specified in section 4 and finally conclusion is explained in section 5. Shape and Texture Features MIMS Medical Image Management System Plaque system[15] CBIR X ray ,CTs of the Head Images Plaque Images Text and Shape Features Shape and Texture Images

2. LITERATURE SURVEY
The reason for providing appropriate tools for easily managing medical images databases are: 1. When the Physicians or Radiologists manage several departments in the hospital, they are very often to search for an image for immediate diagnosis and effective treatments. 2. The medical students and teaching institutions are willing to get the required images effectively for further analysis of their research. For these reasons there was a lot of work in the last years for the construction of CBMIR systems [2] and represented in Table I. Table I CBMIR System CBMIR Images used HighResolution Computed Tomograph y (HRCT) of lung A variety of images from CT, MRI, and radiographs, to color photos Various imaging modalities Visual Features Texture, Shape, Edges, and Gray-scale Properties Global and Regional Color and Texture features

Medical image categorization, registration, feature extraction, Classification indexing and retrieval is performed over the entire image database in the above mentioned Image Retrieval Systems. Each method has its own advantages and disadvantages in their retrieval performance. Different authors has used different image features set and image classification methodology for their medical image retrieval applications. 2.1. Image Features: Feature extraction is the basis of content-based image retrieval. Within the visual feature scope, the features can be further classified as general features and domain specific features. The former include color, texture, and shape features while the latter is application-dependent and may include, for example, human faces and finger prints.General visual features such as Shape and Texture are most widely used in CBMIR [17][20] 2.2. Texture Features: Texture [11] refers to visual patterns with properties of Homogeneity and consists of basic primitives (texels or micro patterns) whose spatial distribution in the image creates the appearance of a texture. There are two basic classes of texture descriptors, namely, statistical modelbased and transform-based. The former one explores the grey-level spatial dependence of textures such as Gray Level Cooccurrence Matrix and then extracts some statistical features as texture representation. The latter approach is based on spatial frequency and Transform Domain Features such as Gabor Filter Features and Wavelet Features. 2.3. Shape Features: Shape [12] is an important feature for medical image retrieval. There are two types of approaches used in shape representation. One is the contour based shape method and the other is the region based method. Contour shape techniques only exploit shape boundary information and Region based methods consider all the pixels within a shape region. The contour based shape method can be represented by moment invariants, Generic Fourier descriptors, chain code, eccentricity, Shape signature etc., The region based shape method can be represented as Zernike Moments, Grid Method, Shape Matrix, Convex Hull etc., Page 334

ASSERT (Automatic Search and Selection Engine with Retrieval Tools)[16]

CasImage

IRMA (Image Retrieval in Medical Applications)[14] NHANES II (The Second National Health And Nutrition Examination Survey) ImageMap[16]

Global and Local Shape and Texture Features Shape Features

cervical and lumbar spine X-ray image

Multiple organs of Images

Individual Regions and Spatial Relationsips between Regions of

Volume 2, Issue 3 May June 2013

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856
2.4. Image Classification: The feature vectors computed in different points of a shape and texture image [10] are not identical. Training the classification systems with these features could increase the accuracy rate. Image classification is performed in which extracted features are given as input to the image classification tool in order to classify the images. Then the features are grouped into two parts positive and negative. In supervised learning, given a set of examples of input vectors {Xn}Nn=1 along with corresponding targets {tn}Nn=1,the latter of which might be real values (in regression) or class labels (classification). From this training set, learn a model of the dependency of the targets on the inputs with the objective of making accurate predictions of it. In real-world data, the presence of noise (in regression) and class overlap (in classification) implies that the principal modeling challenge is to avoid over-fitting of the training set. The Support Vector Machine (SVM) of Vapnik [13][14] has become widely established as one of the well-known approach for Image Classification. It expresses predictions in terms of a linear combination of kernel functions centered on a subset of the training data, known as support vectors. Even though its wide spread success, the SVM suffers from some important limitations [16] such as, 1. An SVM Classifier is unstable on a small-sized training set. 2. SVMs optimal hyper plane may be biased due to certain condition. 3. Over fitting happens because the number of feature dimensions is higher than the size of the training set. 4. It makes point predictions rather than generating predictive distributions. To overcome the difficulties of Support Vector Machines (SVMs), the proposed framework uses Relevance Vector Machines (RVMs) as a classical learning model.

Figure.1.Proposed CBMIR system 3.1. Feature Extraction 3.1.1. Edge Detection Shape information extracted using histogram of edge detection. In this method, the edge information in the image is obtained by using the edge detection. For detecting edges using Canny Edge Detection Algorithm Step 1: Smoothing: Smooth the image with a two dimensional Gaussian. In most cases the computation of a two dimensional Gaussian is costly, so it is approximated by two one dimensional Gaussians. Step 2: Finding Gradients: Take the gradient of the image this shows changes in intensity, which indicates the presence of edges. This actually gives two results, the gradient in the x direction and the gradient in the y direction. Step 3: Non-maximal suppression: Edges will occur at points where the gradient is at a maximum. The magnitude and direction of the gradient is computed at each pixel. Step 4: Edge Threshold: The method of threshold used by the Canny Edge Detector is referred to as hysteresis. It makes use of both a high threshold and a low threshold. Step 5: Thinning: Using interpolation to find the pixels where the norms of gradient are local maximum.

3. PROPOSED WORK
The Figure 1 represents the proposed CBMIR system consists of three major steps Step I: Medical Image as given as Input to the system. For a given query image, extract Shape Features using Generic Fourier Descriptor(GFD)andEdgeDetection(ED). Step II: Next image classification is performed in which extracted features are given as input to the image classification tool in order to classify the images then the features are grouped into two parts (positive, negative). The image classification process is applied using Relevance Vector Machine (RVM). Step III: Finally searching and retrieval process is performed using well known Similarity Measurement as Euclidean Distance(ED). Volume 2, Issue 3 May June 2013

Page 335

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856
angular frequencies selected. In the experiments 4 radial frequencies and 8 angular frequencies are selected (32 GFD features) for efficient shape representation. 3.2 Classification 3.2.1 Relevance Vector Machine: Tipping [15] has formulated the Relevance Vector Machine (RVM) as a probabilistic model whose functional form is equivalent to the SVM. It is proved to be faster than SVM since it yields an optimum solution with few training Samples. These are called relevance vectors. It achieves comparable recognition accuracy to the SVM, yet provides a full predictive distribution, and also requires substantially fewer kernel functions represented in Table II.

Figure.2.Edge detected Kidney Image 3.1.2. Generic Fourier Descriptor: The extraction of Generic Fourier Descriptor is performed in spectral domain by applying Two Dimensional Fourier Transform (FT) on polar raster sampled shape image. The extracted features from FT are not rotation invariant so a modified polar FT is proposed by taking the polar image in polar space as a normal Two Dimensional rectangular image in Cartesian space.

Table II Types of Kernel Functions Kernel Functions Polynomial Radial-basis Sigmoid Exp(-1/2 tan h ( decided by the user are Inner Product Kernel K( ,p=1,2

(a)

(b) Figure.3. (a) Polar space of image; (b) Cartesian space of polar image

For a given image f(x, y) the polar FT is defined in Equation 1 PF (, ) = f(r,)exp[j2 Where 0 ) 0 ( is the center of mass of the shape. 0 and T are the radial and angular resolutions. The shape determination of and are achieved by few lower frequencies but the acquired polar coefficients are translation invariant. By using the following normalization Equation (2), Rotation and Scaling invariance are achieved. GFD= Where, area is the area of the bounding circle in which shape exists. m is the number of maximum radial frequencies selected. N is the number of maximum Volume 2, Issue 3 May June 2013 )] (1)

Apply RVM classifier in order to reduce dimensionality of feature set and grouped as correctly classified feature set vectors by using small training samples of features. RVM use hyper planes in order to separate the two parts of the image classes such as positive, negative. Extend the relevance vector approach to the case of classification- i.e., where it is desired to predict the posterior probability of class membership given the input x. Generalize the linear model by applying the logistic sigmoid function ( y) 1/(1 ) to y (x) and writing the likelihood as P(t/w)=

(3)

A set of training samples Ti is given as input to the RVM. Let training samples are t1..tn, where, each sample belongs to a class labeled such as yi (+1(Positive),1(Negative)), then, the hyper plane decision function can be written as y( (4)

Where ( , ) n K t t is a kernel function, ti, i=1, 2N are the training samples and {wi} are the model weights. The kernel function is used to form expansion basis functions for RVM, and in theory, is not limited by the Mercer conditions as in the case of Support Vector Machine (SVM) or Kernel Fisher Discriminant (KFD). The Figure Page 336

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856
4 represents positive and negative feature vectors for specific classes. 4.1. Comparisons on retrieval performance Precision and Recall [18] are the most widely used retrieval performance measurement in literature. Precision measures the retrieval accuracy while recall measures the ability of retrieving relevant images from the database. Precision and recall are inversely related, i.e., precision normally degenerates as recall increases. The Precision (P) and Recall (R) are then defined as

Figure.4.Separation between Positive and Negative Class features. 3.3 Similarity Measurements 3.3.1. Euclidean Distance Euclidean distance is used for similarity comparison between query image and classified image in the database by using the following equation d= (5)

P= R=

Where is the ith query image feature and is the corresponding feature in the feature vector database. Here N refers to the number of images in the database. The Similarity between Images are represented in Figure 5.

Figure.7.SampleBrain.jpg image insert into database

Figure 5.Similarity between Images

4. EXPERIMENTAL RESULTS AND PERFORMANCE EVALUATION

This medical retrieval system is implemented using Java with image database of 1000 images containing a variety of images. These images include various parts of the body like lung, liver, kidney, brain etc. These images are gray level images and structurally similar images. Figure 6 shows some image examples from the database.

Figure.8.Sample classification process for database images

Figure.6.Sample Images Volume 2, Issue 3 May June 2013

Figure.9.Sample Ear.jpgQuery image for Retrieval Process Page 337

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856

Figure.10.Output of Retrieved images of Ear.jpg 4.2. Analysis of performance Classification Among 1000 images the number of images taken for testing is 162 and the number of images taken for training is 838.For each images, extracted Shape and texture features are given as input to classification phase .The total number of feature classes are 52. Table IV represents retrieval results of features precision and recall. The Figure 11 and Figure 12 represent Precision and Recall Graph. Table IV Medical Image Retrieval Results
Retrieval Mode Percentage of Precision for top Relevant images 65 Percentage of Recall for top Relevant images 70

Figure.11.Precision Graph

Figure.12.Recall Graph

ED Shape feature Image Retrieval GFD Shape feature Image Retrieval Combined ED and GFD Shape Features Image Retrieval RVM Classified Feature Image Retrieval

80

75

84

80

95

90

The Figure 13 represents the performance analysis of the RVM and SVM classifier for the detection of specific classes from the grouped features. This graph plots the detection rate such as positive feature images versus the negative features per image wide ranging over the continuum of the decision threshold. The trained classifiers were evaluated using all the features in the test subset. RVM approximately achieved an accuracy of 90% also this accuracy level is similar to that obtained from the SVM. But the RVM classifier could reduce the detection time from nearly 300 s to about 40 s per image. Volume 2, Issue 3 May June 2013

Figure 13.Comparison between RVM and SVM classification methodologies. The experimental results show the RVM technique can reduce the computational complexity of the SVM based on considering its detection accuracy. This makes RVM more feasible for CBMIR System.

5. CONCLUSION AND FUTURE WORK

In keyword feature based image retrieval systems, semantics of images are accurately specified but vast amount of labor required in manual image annotations. In Page 338

International Journal of Emerging Trends & Technology in Computer Science (IJETTCS)

Web Site: www.ijettcs.org Email: editor@ijettcs.org, editorijettcs@gmail.com Volume 2, Issue 3, May June 2013 ISSN 2278-6856
visual feature based image retrieval systems, images would be indexed by their own visual content, such as color, shape, texture. The main thing in visual features based image retrieval system is the gap between visual feature representations and semantic concepts of Images. For efficient similar image retrieval and integration, the medical image should be processed systematically to extract a representing feature vector for each member image.This proposed System uses shape features and Image Classification by Relevance Vector Machine and used Euclidean distance as the similarity measure between combined features and query image features. In our experiment we used 1000 medical image covers liver, lung, kidney, brain images. The database images are divided into 10 categories, each category containing 100 images. Results reflect that our content based medical image retrieval (CBMIR) using multiple features with classification out performs with respect to retrieval accuracy and precision as compared with single features. This will give retrieval accuracy, speed, and clarity of the medical images to predict exact disease situation of the patients. So that doctors can get exact idea about disease in order to give the treatments for their patients. Our future work is to provide symptoms description, remedies for the diseases along with medical images. retrieval systems in medical applications clinical benefits and future directions, International Journal of Medical Information., pp: 73:13, 2004. [10] D. S. Zhang and G. Lu Content-Based Shape Retrieval Using Different Shape Descriptors: A Comparative Study. Accepted for publishing on IEEE International Conference on Multimedia and Expo (ICME2001), Tokyo, Japan, pp.317-320, August 22-25, 2001.33 [11] Wong, W.-T.; Shih, F. Y. & Liu, J.: Shape-based image retrieval using support vector machines, Fourier descriptors and self-organizing maps.Inf. Sci., Elsevier Science Inc., (2007), 177, 1878-1891 [12] M. Flickner, et al, Query by Image and Video Content: The QBIC System, IEEE Computer,28(9): 23-32, 1995.B.Ramamurthy et al. / International Journal of Engineering Science and Technology (IJEST) ISSN [13] D. S. Zhang and G. Lu. "Shape Based Image Retrieval Using Generic Fourier Descriptors".Submitted to International Journal of Signal Processing: Image Communication, August, 2001. [14] T.M.Lehmann,M.O.Guild,C.Thies,B.Fischer,K.Spitz er,H.Ney Content-Based Image Retrieval in Medical ApplicationsInf Med 2004;43:354-61. [15] B.Ramamurthy, K.R.Chandran Content based Image Retrieval for Medical Images using Canny Edge Detection Algorithm International Journal of Computer Applications (0975 8887) Volume 17 No.6, March 2011 [16] A. Grace Selvarani1 and S. Annadurai Content Based Medical Image Retrieval System Using Shape and Texture Features ICGST-BIME Journal, Volume 8, Issue 1, 2008 [17] F. Long, H.J Zhang, D.D Feng. Fundamentals of content-based image retrievalMultimedia Information Retrieval and Management Springer, Berlin, 2003. [18] Arun K.S, Hema P Menon Content Based Medical Image Retrieval by Combining Rotation Invariant Contourlet Features and Fourier Descriptors International Journal of Recent Trends in Engineering, Vol 2, No. 2, 2009.

REFERENCES
[1] Soma BiswasGaurav Aggarwal, Rama Chellappa, An Efficient and Robust Algorithm for Shape Indexing and Retrieval IEEE transactions on multimedia, vol. 12, no. 5,2010 [2] Wei Bian and Dacheng Tao, Biased Discriminant Euclidean Embedding for Content-Based Image Retrieval IEEE transactions on image processing, vol. 19, no. 2, 2010 [3] Mohammad Reza Zare, Ahmed Mueen ,Woo Chaw Seng, Mohammad Hamza Awedh Combined Feature Extraction on Medical X-ray Images 978-07695-4482-3/11 2011 IEEE. [4] Mingbao Tian Integrated Feature Based Medical Image Retrieval978-1-4577-0860-2/11 2011 IEEE. [5] S. K. Chang, and A. Hsu, "Image information systems: where do we go from here?" IEEE Trans. On Knowledge and Data Engineering, Vol.5, No.5, pp. 431-442, Oct.1992. [6] H. Tamura, and N.Yokoya, "Image database systems: A survey, " Pattern Recognition, Vol.17,No.1, pp. 2943, 1984. [7] Feng Jing, Mingjing Li, Hong-Jiang Zhang, and Bo Zhang A Unified Framework for Image Retrieval Using Keyword and Visual Features IEEE transactions on image processing,vol. 14, no. 7, 2005 [8] Wei Zhang, Sven Dickinson, Stanley Sclaroff , Jacob Feldman, Stanley Dunn, Shape- Based Indexing in a Medical Image Database, Biomedical Image Analysis, pp-221 230, 26-27 Jun 1998. [9] Muller, H., N.Michoux, D.Bandon and A.Geissbuhler, A review of content based image Volume 2, Issue 3 May June 2013

Page 339