Automatic segmentation system for liver tumors based on the multilevel thresholding and electromagnetism optimization algorithm

In this article, we propose an automated segmentation system for liver tumors using magnetic resonance imaging and computed tomography. The proposed system is based on the algorithm of multilevel thresholding with electromagnetism optimization (EMO). The system starts with visualizing a patient's digital communication in medicine (DICOM) abdominal data set in three views. Two-stage active contour segmentation methods that integrate region-based local and global techniques using the active geodesic contour technique are proposed to segment the liver. To increase the accuracy and speed of segmentation for liver images, we identify the optimal threshold of the image segmentation method based on EMO with Otsu and Kapur algorithms. EMO offers interesting search capabilities while keeping a low computational cost. The proposed system was tested using a set of five DICOM data sets. All images were of the same size and stored in JPEG format (512 × 512 pixels). Experimental results illustrate that the proposed system outperforms state-of-the-art methods such as the watershed algorithm. The average sensitivity, specificity, and accuracy of the segmented liver using the active contour model were 97.05%, 99.88%, and 98.47%, respectively. Moreover, the average sensitivity, specificity, and accuracy of the segmented liver tumor results were 94.15%, 99.57%, and 96.86%, respectively.     

Performance analysis of brain tissues and tumor detection and grading system using ANFIS classifier

Abnormal growth of cells in brain leads to the formation of tumors, which are categorized into benign and malignant. In this article, Co‐Active Adaptive Neuro Fuzzy Inference System (CANFIS) classification based brain tumor detection and its grading system is proposed. It has two phases as brain tumor segmentation and brain tissue segmentation. In brain tumor segmentation, CANFIS classifier is used to classify the test brain image into benign or malignant. Then, morphological operations are applied over the malignant image in order to segment the tumor regions in brain image. The K‐means classifier is used to classify the brain tissues into Grey Matter (GM), White Matter (WM) and Cerebro Spinal Fluid (CSF) regions as three different classes. Next, the segmented tumor is graded as mild, moderate or severe based on the presence of segmented tumor region in brain tissues.     

Automatic liver tumor segmentation on multiphase computed tomography volume using SegNet deep neural network and K-means clustering

Liver and liver tumor segmentations are essential in computer-aided systems for diagnosing liver tumors. These systems must operate on multiphase computed tomography (CT) images instead of a single phase for accurate diagnosis for clinical applications. We have proposed a framework that can perform segmentation from quadriphasic CT data. The liver was segmented using a fine-tuned SegNet model and the liver tumor was segmented using the K-means clustering method coupled with a power-law transformation-based image enhancement technique. The best values for liver segmentation achieved were: Dice Coefficient = 96.46 ± 0.48%, Jaccard Index = 93.16 ± 0.89%, volumetric overlap error = 6.84 ± 0.89% and average symmetric surface distance = 0.59 ± 0.3 mm and the results for liver tumor delineation were Dice Coefficient = 85.07 ± 4.5%, Jaccard Index = 74.29 ± 6.8%, volumetric overlap error = 25.71 ± 6.8% and average symmetric surface distance = 1.14 ± 1.3 mm. The proposed liver segmentation method based on deep learning is fully automatic, robust, and effective for all phases. The image enhancement technique has shown promising results and aided in better liver tumor segmentation. The liver tumors were segmented satisfactorily; however, improvements concerning false positive reduction can further increase the accuracy.     

Automatic Segmentation of Liver from Abdominal Computed Tomography Images Using Energy Feature

Liver Segmentation is one of the challenging tasks in detecting and classifying liver tumors from Computed Tomography (CT) images. The segmentation of hepatic organ is more intricate task, owing to the fact that it possesses a sizeable quantum of vascularization. This paper proposes an algorithm for automatic seed point selection using energy feature for use in level set algorithm for segmentation of liver region in CT scans. The effectiveness of the method can be determined when used in a model to classify the liver CT images as tumorous or not. This involves segmentation of the region of interest (ROI) from the segmented liver, extraction of the shape and texture features from the segmented ROI and classification of the ROIs as tumorous or not by using a classifier based on the extracted features. In this work, the proposed seed point selection technique has been used in level set algorithm for segmentation of liver region in CT scans and the ROIs have been extracted using Fuzzy C Means clustering (FCM) which is one of the algorithms to segment the images. The dataset used in this method has been collected from various repositories and scan centers. The outcome of this proposed segmentation model has reduced the area overlap error that could offer the intended accuracy and consistency. It gives better results when compared with other existing algorithms. Fast execution in short span of time is another advantage of this method which in turns helps the radiologist to ascertain the abnormalities instantly.     

Performance comparison of texture feature analysis methods using PNN classifier for segmentation and classification of brain CT images

A computer software system is designed for the segmentation and classification of benign and malignant tumor slices in brain computed tomography images. In this paper, we present a texture analysis methods to find and select the texture features of the tumor region of each slice to be segmented by support vector machine (SVM). The images considered for this study belongs to 208 benign and malignant tumor slices. The features are extracted and selected using Student's t‐test. The reduced optimal features are used to model and train the probabilistic neural network (PNN) classifier and the classification accuracy is evaluated using k fold cross validation method. The segmentation results are also compared with the experienced radiologist ground truth. Quantitative analysis between ground truth and segmented tumor is presented in terms of quantitative measure of segmentation accuracy and the overlap similarity measure of Jaccard index. The proposed system provides some newly found texture features have important contribution in segmenting and classifying benign and malignant tumor slices efficiently and accurately. The experimental results show that the proposed hybrid texture feature analysis method using Probabilistic Neural Network (PNN) based classifier is able to achieve high segmentation and classification accuracy effectiveness as measured by Jaccard index, sensitivity, and specificity.     

Adrenal tumor characterization on magnetic resonance images

Adrenal tumors occur on adrenal glands and are generally detected on abdominal area scans. Adrenal tumors, which are incidentally detected, release vital hormones. These types of tumors that can be malignant affect body metabolism. Both of benign and malign adrenal tumors can have a similar size, intensity, and shape, this situation may lead to wrong decision during diagnosis and characterization of tumors. Thus, biopsy is done to confirm diagnosis of tumor types. In this study, adrenal tumor characterization is handled by using magnetic resonance images. In this way, it is wanted that patient can be disentangled from one or more imaging modalities (some of them can includes X-ray) and biopsy. An adrenal tumor image set, which includes five types of adrenal tumors and has 112 benign tumors and 10 malign tumors, was used in this study. Two data sets were created from the adrenal tumor image set by manually/semiautomatically segmented adrenal tumors and feature sets of these data sets are constituted by different methods. Two-dimensional gray-level co-occurrence matrix (2D-GLCM), gray-level run-length matrix (GLRLM), and two-dimensional discrete wavelet transform (2D-DWT) methods were analyzed to reveal the most effective features on adrenal tumor characterization. Feature sets were classified in two ways: benign/malign (binary classification) and type characterization (multiclass classification). Support vector machine and artificial neural network classified feature sets. The best performance on benign/malign classification was obtained by the 2D-GLCM feature set. The best results were assessed with sensitivity, specificity, accuracy, precision, and F-score metrics and they were 99.17%, 90%, 98.4%, 99.17%, and 99.13%, respectively. The highest classification performance on type characterization was obtained by the 2D-DWT feature set as 59.62%, 96.17%, 93.19%, 54.69%, and 54.94% for sensitivity, specificity, accuracy, precision, and F-score metrics, respectively.     

Brain tumor segmentation using a deep Shuffled-YOLO network

Brain tumor is an anomalous proliferation of cells in the brain that can evolve to malignant and benign tumors. Currently, segmentation of brain tumor is the most important surgical and pharmaceutical procedures. However, manually segmenting brain tumors is hard because it is hard to find erratically shaped tumors with only one modality; the MRI modalities are integrated to provide multi-modal images with data that can be utilized to segment tumors. The recent developments in machine learning and the accessibility of medical diagnostic imaging have made it possible to tackle the challenges of segmenting brain tumors with deep neural networks. In this work, a novel Shuffled-YOLO network has been proposed for segmenting brain tumors from multimodal MRI images. Initially, the scalable range-based adaptive bilateral filer (SCRAB) pre-processing technique was used to eliminate the noise artifacts from MRI while preserving the edges. In the segmentation phase, we propose a novel deep Shuffled-YOLO architecture for segmenting the internal tumor structures that include non-enhancing, edema, necrosis, and enhancing tumors from the multi-modality MRI sequences. The experimental fallouts reveal that the proposed Shuffled-YOLO network achieves a better accuracy range of 98.07% for BraTS 2020 and 97.04% for BraTS 2019 with very minimal computational complexity compared to the state-of-the-art models.     

Enhancing breast pectoral muscle segmentation performance by using skip connections in fully convolutional network

The precise detection and segmentation of pectoral muscle areas in mediolateral oblique (MLO) views is an essential step in the development of a computer-aided diagnosis system to access breast malignant lesions or parenchyma. The goal of this article is to develop a robust and fully automatic algorithm for pectoral muscle segmentation from mammography images. This paper presents an image enhancement approach that improves the quality of mammogram scans and a convolutional neural network-based fully convolutional network architecture enhanced with residual connections for automatic segmentation of the pectoral muscle from the MLO views of a digital mammogram. For this purpose, the model is tested and trained on three different mammogram datasets named MIAS, INBREAST, and DDSM. The ground truth labels of the pectoral muscle were identified under the supervision of experienced radiologists. For training and testing, 10-fold cross-validation was used. The proposed model was compared with baseline U-Net-based architecture. Finally, we used a postprocessing step to find the actual boundary of the pectoral muscle. Our presented architecture generated a mean Intersection over Union (IoU) of 97%, dice similarity coefficient (DSC) of 96% and 98% accuracy on testing data. The proposed architecture for pectoral muscle segmentation from the MLO views of mammogram images with high accuracy and dice score can be quickly merged with the breast tumor segmentation problem.     

Gamma Knife treatment planning: MR brain tumor segmentation and volume measurement based on unsupervised Fuzzy C‐Means clustering

Nowadays, radiation treatment is beginning to intensively use MRI thanks to its greater ability to discriminate healthy and diseased soft‐tissues. Leksell Gamma Knife® is a radio‐surgical device, used to treat different brain lesions, which are often inaccessible for conventional surgery, such as benign or malignant tumors. Currently, the target to be treated with radiation therapy is contoured with slice‐by‐slice manual segmentation on MR datasets. This approach makes the segmentation procedure time consuming and operator‐dependent. The repeatability of the tumor boundary delineation may be ensured only by using automatic or semiautomatic methods, supporting clinicians in the treatment planning phase. This article proposes a semiautomatic segmentation method, based on the unsupervised Fuzzy C‐Means clustering algorithm. Our approach helps segment the target and automatically calculates the lesion volume. To evaluate the performance of the proposed approach, segmentation tests on 15 MR datasets were performed, using both area‐based and distance‐based metrics, obtaining the following average values: Similarity Index = 95.59%, Jaccard Index = 91.86%, Sensitivity = 97.39%, Specificity = 94.30%, Mean Absolute Distance = 0.246[pixels], Maximum Distance = 1.050[pixels], and Hausdorff Distance = 1.365[pixels]. © 2015 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 25, 213–225, 2015     

Hybrid method combining superpixel,supervised learning,and random walk for glioma segmentation

Currently, the analysis of magnetic resonance imaging (MRI) brain images of pathological patients is performed manually, both for the recognition of brain structures or lesions and for their characterization. Physicians sometimes encounter difficulties in interpreting these images for a reliable diagnosis of the patient's condition. This is due to the difficulty of detecting the nature of the lesions, particularly glioma. Glioma is one of the most common tumors, and one of the most difficult to detect because of its shape, irregularities, and ambiguous limits. The segmentation of these tumors is one of the most crucial steps for their classification and surgical planning. This article presents a new, accurate, and automatic approach for the precise segmentation of early gliomas (benign tumors), combining the random walk (RW) algorithm and the simple linear iterative clustering algorithm. The study was carried out in four steps. The first step consisted of decomposing the image into superpixels to obtain an initial outline of the tumor. The superpixels were generated using the SLIC algorithm. In the second step, for each superpixel, a set of statistical and multifractal characteristics were calculated (gray‐level co‐occurrence matrix, multifractal detrending moving average). In the third step, the superpixels were classified using a supervised random forest (RF) type classier into healthy or tumorous brain tissue. In the final step, the contour of the detected tumor was enhanced using the customized RW algorithm. The proposed method was evaluated using the Brain Tumor Image Segmentation Challenge 2013 database. The results obtained are competitive compared to other existing methods.     

Development of computer‐aided approach for brain tumor detection using random forest classifier

The nonlinear development of cells in brain region forms the abnormal patterns in brain in the form of tumors. It is necessary to detect and diagnose the brain tumors in an automated manner using computer‐aided approaches at large population areas. The noises in brain magnetic resonance image is detected and reduced as preprocessing steps and then grey level co‐occurrence matrix are now extracted from the preprocessed brain image. In this article, random forest classifier‐based brain tumor detection and segmentation methodology is proposed to classify the brain image into normal or abnormal. The proposed brain tumor detection and segmentation system is analyzed in terms of sensitivity, specificity, false‐positive rate, false‐negative rate, likelihood ratio positive, and likelihood ratio negative.     

Image registration-based brain tumor detection and segmentation using ANFIS classification approach

Abnormal cells in human brain lead to the development of tumors. Manual detection of this tumor region is a time-consuming process. Hence, this paper proposes an efficient and automated computer-aided methodology for brain tumor detection and segmentation using image registration technique and classification approaches. This proposed work consists of the following modules: image registration, contourlet transform, and feature extraction with feature normalization, classification, and segmentation. The extracted features are optimized using genetic algorithm, and then an adaptive neuro-fuzzy inference system classification approach is used to classify the features for the detection and segmentation of tumor regions in brain magnetic resonance imaging. A quantitative analysis is performed to evaluate the proposed methodology for brain tumor detection using sensitivity, specificity, segmentation accuracy, precision, and Dice similarity coefficient.     

Detection and diagnosis of meningioma brain tumor using ANFIS classifier

Tumors are formed in brain due to the uncontrolled development of cells. These tumors can be cured if it is timely detected and by proper medication. This article proposes a computer‐aided automatic detection and diagnosis of meningioma brain tumors in brain images using Adaptive Neuro Fuzzy Inference System (ANFIS) classifier. The proposed system consists of feature extraction, classification, and segmentation and diagnosis sections. In this article, Grey level Co‐occurrence Matric (GLCM) and Grid features are extracted from the brain image and these features are classified using ANFIS classifier into normal or abnormal. Then, morphological operations are used to segment the abnormal regions in brain image. Based on the location of these abnormal regions in brain tissues, the segmented tumor regions are diagnosed.     

Region based coronary artery segmentation using modified Frangi's vesselness measure

Recent research suggests that the cardiovascular diseases (CVDs), seem to be the foremost cause of mortality among the world populace. Three dimensional (3D) imaging modality such as computed tomography angiography(CTA) is a standard noninvasive imaging modality which has great potentials for the visualization of heart and coronary arteries. This article presents a fully automated method for coronary artery extraction using modified Frangi's vesselness measure and region based segmentation. In this article, grayness and gradient based measures are used while computing Frangi's vesselness measure to improve the extraction of coronary arteries. The obtained vesselness measures are utilized for automatically computing the location of ostia. The locations of ostia are then used as starting seed points in region growing segmentation to extract coronary arteries. Three major coronary arteries, namely the left anterior descending artery (LAD), left circumflex artery (LCX) and right coronary artery (RCA) are segmented using the proposed method and the centerlines are extracted for the main coronary branches. The performance of the proposed method is evaluated using 12 3D CCTA data set. The experimental results reveal that during the calculation of modified Frangi's vesselness measure the proposed method gives improved results. The qualitative results obtained during the segmentation stage are also convincing. The average segmentation accuracy and overlap measure of the proposed method are 97.4% and 77.86%, respectively. Hence, the proposed automated approach can detect and extract coronary arteries in CCTA images with high performance.     

Brain Tumor Detection and Classification Using PSO and Convolutional Neural Network

Tumor detection has been an active research topic in recent years due to the high mortality rate. Computer vision (CV) and image processing techniques have recently become popular for detecting tumors in MRI images. The automated detection process is simpler and takes less time than manual processing. In addition, the difference in the expanding shape of brain tumor tissues complicates and complicates tumor detection for clinicians. We proposed a new framework for tumor detection as well as tumor classification into relevant categories in this paper. For tumor segmentation, the proposed framework employs the Particle Swarm Optimization (PSO) algorithm, and for classification, the convolutional neural network (CNN) algorithm. Popular preprocessing techniques such as noise removal, image sharpening, and skull stripping are used at the start of the segmentation process. Then, PSO-based segmentation is applied. In the classification step, two pre-trained CNN models, alexnet and inception-V3, are used and trained using transfer learning. Using a serial approach, features are extracted from both trained models and fused features for final classification. For classification, a variety of machine learning classifiers are used. Average dice values on datasets BRATS-2018 and BRATS-2017 are 98.11 percent and 98.25 percent, respectively, whereas average jaccard values are 96.30 percent and 96.57% (Segmentation Results). The results were extended on the same datasets for classification and achieved 99.0% accuracy, sensitivity of 0.99, specificity of 0.99, and precision of 0.99. Finally, the proposed method is compared to state-of-the-art existing methods and outperforms them.     

CANFIS based glioma brain tumor classification and retrieval system for tumor diagnosis

Brain tumor classification and retrieval system plays an important role in medical field. In this paper, an efficient Glioma Brain Tumor detection and its retrieval system is proposed. The proposed methodology consists of two modules as classification and retrieval. The classification modules are designed using preprocessing, feature extraction and tumor detection techniques using Co‐Active Adaptive Neuro Fuzzy Inference System (CANFIS) classifier. The image enhancement can be achieved using Heuristic histogram equalization technique as preprocessing and further texture features as Local Ternary Pattern (LTP) features and Grey Level Co‐occurrence Matrix (GLCM) features are extracted from the enhanced image. These features are used to classify the brain image into normal and abnormal using CANFIS classifier. The tumor region in abnormal brain image is segmented using normalized graph cut segmentation algorithm. The retrieval module is used to retrieve the similar segmented tumor regions from the dataset for diagnosing the tumor region using Euclidean algorithm. The proposed Glioma Brain tumor classification methodology achieves 97.28% sensitivity, 98.16% specificity and 99.14% accuracy. The proposed retrieval system achieves 97.29% precision and 98.16% recall rate with respect to ground truth images.     

Modified UNet Model for Brain Stroke Lesion Segmentation on Computed Tomography Images

The task of segmentation of brain regions affected by ischemic stroke is help to tackle important challenges of modern stroke imaging analysis. Unfortunately, at the moment, the models for solving this problem using machine learning methods are far from ideal. In this paper, we consider a modified 3D UNet architecture to improve the quality of stroke segmentation based on 3D computed tomography images. We use the ISLES 2018 (Ischemic Stroke Lesion Segmentation Challenge 2018) open dataset to train and test the proposed model. Interpretation of the obtained results, as well as the ideas for further experiments are included in the paper. Our evaluation is performed using the Dice or f1 score coefficient and the Jaccard index. Our architecture may simply be extended to ischemia segmentation and computed tomography image identification by selecting relevant hyperparameters. The Dice/f1 score similarity coefficient of our model shown 58% and results close to ground truth which is higher than the standard 3D UNet model, demonstrating that our model can accurately segment ischemic stroke. The modified 3D UNet model proposed by us uses an efficient averaging method inside a neural network. Since this set of ISLES is limited in number, using the data augmentation method and neural network regularization methods to prevent overfitting gave the best result. In addition, one of the advantages is the use of the Intersection over Union loss function, which is based on the assessment of the coincidence of the shapes of the recognized zones.     

A Novel Hybrid Machine Learning Approach for Classification of Brain Tumor Images

Abnormal growth of brain tissues is the real cause of brain tumor. Strategy for the diagnosis of brain tumor at initial stages is one of the key step for saving the life of a patient. The manual segmentation of brain tumor magnetic resonance images (MRIs) takes time and results vary significantly in low-level features. To address this issue, we have proposed a ResNet-50 feature extractor depended on multilevel deep convolutional neural network (CNN) for reliable images segmentation by considering the low-level features of MRI. In this model, we have extracted features through ResNet-50 architecture and fed these feature maps to multi-level CNN model. To handle the classification process, we have collected a total number of 2043 MRI patients of normal, benign, and malignant tumor. Three model CNN, multi-level CNN, and ResNet-50 based multi-level CNN have been used for detection and classification of brain tumors. All the model results are calculated in terms of various numerical values identified as precision (P), recall (R), accuracy (Acc) and f1-score (F1-S). The obtained average results are much better as compared to already existing methods. This modified transfer learning architecture might help the radiologists and doctors as a better significant system for tumor diagnosis.     

A comprehensive review: Segmentation of MRI images—brain tumor

Segmentation of tumors in human brain aims to classify different abnormal tissues (necrotic core, edema, active cells) from normal tissues (cerebrospinal fluid, gray matter, white matter) of the brain. In existence, detection of abnormal tissues is easy for studying brain tumor, but reproducibility, characterization of abnormalities and accuracy are complicated in the process of segmentation. The magnetic resonance imaging (MRI)‐based segmentation of tumors in brain images is more enhancing and attracting in current years of research studies. It is due to non‐invasive examination and good contrast prone to soft tissues of images obtained from MRI modality. Medical approval of different segmentation techniques depends on the benchmark and simplicity of the method. This article incorporates both fully‐automatic and semi‐automatic methods for segmentation. The outlook study of this article is to provide the summary of most significant segmentation methods of tumors in brain using MRI. © 2016 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 26, 295–304, 2016     

Empirical Comparisons of Deep Learning Networks on Liver Segmentation

Accurate segmentation of CT images of liver tumors is an important adjunct for the liver diagnosis and treatment of liver diseases. In recent years, due to the great improvement of hard device, many deep learning based methods have been proposed for automatic liver segmentation. Among them, there are the plain neural network headed by FCN and the residual neural network headed by Resnet, both of which have many variations. They have achieved certain achievements in medical image segmentation. In this paper, we firstly select five representative structures, i.e., FCN, U-Net, Segnet, Resnet and Densenet, to investigate their performance on liver segmentation. Since original Resnet and Densenet could not perform image segmentation directly, we make some adjustments for them to perform live segmentation. Our experimental results show that Densenet performs the best on liver segmentation, followed by Resnet. Both perform much better than Segnet, U-Net, and FCN. Among Segnet, U-Net, and FCN, U-Net performs the best, followed by Segnet. FCN performs the worst.