Di-phase midway convolution and deconvolution network for brain tumor segmentation in MRI images

A novel automatic image segmentation technique in magnetic resonance imaging (MRI) based on di-phase midway convolution and deconvolution network is proposed. It consists of three convolutional and deconvolutional blocks for downsampling and upsampling layers respectively. In first block, each input slice is separately convolved using two paths with 3 × 3 and 7 × 7 kernels to produce different feature maps. Then the mean value of these feature maps is processed into upcoming blocks in downsampling and upsampling layers. This processed outcome is classified and segmented using softmax classification. Further, the volume, probability density distribution of tumor, and normal tissue regions are calculated using tissue-type mapping technique. This method is extensively tested with BRATS 2012, BRATS 2013, and BRATS 2018 data sets. Our experimental results achieved higher dice similarity coefficient values of 24.3%, 27.5%, and 3.4%, respectively, for these three data sets when compared to the state-of-art brain tumor segmentation methods.     

NeXt for neuro‐radiosurgery: A fully automatic approach for necrosis extraction in brain tumor MRI using an unsupervised machine learning technique

Stereotactic neuro‐radiosurgery is a well‐established therapy for intracranial diseases, especially brain metastases and highly invasive cancers that are difficult to treat with conventional surgery or radiotherapy. Nowadays, magnetic resonance imaging (MRI) is the most used modality in radiation therapy for soft‐tissue anatomical districts, allowing for an accurate gross tumor volume (GTV) segmentation. Investigating also necrotic material within the whole tumor has significant clinical value in treatment planning and cancer progression assessment. These pathological necrotic regions are generally characterized by hypoxia, which is implicated in several aspects of tumor development and growth. Therefore, particular attention must be deserved to these hypoxic areas that could lead to recurrent cancers and resistance to therapeutic damage. This article proposes a novel fully automatic method for necrosis extraction (NeXt), using the Fuzzy C‐Means algorithm, after the GTV segmentation. This unsupervised Machine Learning technique detects and delineates the necrotic regions also in heterogeneous cancers. The overall processing pipeline is an integrated two‐stage segmentation approach useful to support neuro‐radiosurgery. NeXt can be exploited for dose escalation, allowing for a more selective strategy to increase radiation dose in hypoxic radioresistant areas. Moreover, NeXt analyzes contrast‐enhanced T1‐weighted MR images alone and does not require multispectral MRI data, representing a clinically feasible solution. This study considers an MRI dataset composed of 32 brain metastatic cancers, wherein 20 tumors present necroses. The segmentation accuracy of NeXt was evaluated using both spatial overlap‐based and distance‐based metrics, achieving these average values: Dice similarity coefficient 95.93% ± 4.23% and mean absolute distance 0.225 ± 0.229 (pixels).     

Gamma Knife treatment planning: MR brain tumor segmentation and volume measurement based on unsupervised Fuzzy C‐Means clustering

Nowadays, radiation treatment is beginning to intensively use MRI thanks to its greater ability to discriminate healthy and diseased soft‐tissues. Leksell Gamma Knife® is a radio‐surgical device, used to treat different brain lesions, which are often inaccessible for conventional surgery, such as benign or malignant tumors. Currently, the target to be treated with radiation therapy is contoured with slice‐by‐slice manual segmentation on MR datasets. This approach makes the segmentation procedure time consuming and operator‐dependent. The repeatability of the tumor boundary delineation may be ensured only by using automatic or semiautomatic methods, supporting clinicians in the treatment planning phase. This article proposes a semiautomatic segmentation method, based on the unsupervised Fuzzy C‐Means clustering algorithm. Our approach helps segment the target and automatically calculates the lesion volume. To evaluate the performance of the proposed approach, segmentation tests on 15 MR datasets were performed, using both area‐based and distance‐based metrics, obtaining the following average values: Similarity Index = 95.59%, Jaccard Index = 91.86%, Sensitivity = 97.39%, Specificity = 94.30%, Mean Absolute Distance = 0.246[pixels], Maximum Distance = 1.050[pixels], and Hausdorff Distance = 1.365[pixels]. © 2015 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 25, 213–225, 2015     

A deep learning model integrating convolution neural network and multiple kernel K means clustering for segmenting brain tumor in magnetic resonance images

In medical imaging, segmenting brain tumor becomes a vital task, and it provides a way for early diagnosis and treatment. Manual segmentation of brain tumor in magnetic resonance (MR) images is a time‐consuming and challenging task. Hence, there is a need for a computer‐aided brain tumor segmentation approach. Using deep learning algorithms, a robust brain tumor segmentation approach is implemented by integrating convolution neural network (CNN) and multiple kernel K means clustering (MKKMC). In this proposed CNN‐MKKMC approach, classification of MR images into normal and abnormal is performed by CNN algorithm. At next, MKKMC algorithm is employed to segment the brain tumor from the abnormal brain image. The proposed CNN‐MKKMC algorithm is evaluated both visually and objectively in terms of accuracy, sensitivity, and specificity with the existing segmentation methods. The experimental results demonstrate that the proposed CNN‐MKKMC approach yields better accuracy in segmenting brain tumor with less time cost.     

Fully automatic method for segmentation of brain tumor from multimodal magnetic resonance images using wavelet transformation and clustering technique

Fully automatic brain tumor segmentation is one of the critical tasks in magnetic resonance imaging (MRI) images. This proposed work is aimed to develop an automatic method for brain tumor segmentation process by wavelet transformation and clustering technique. The proposed method using discrete wavelet transform (DWT) for pre‐ and post‐processing, fuzzy c‐means (FCM) for brain tissues segmentation. Initially, MRI images are preprocessed by DWT to sharpen the images and enhance the tumor region. It assists to quicken the FCM clustering technique and classified into four major classes: gray matter (GM), white matter (WM), cerebrospinal fluid (CSF), and background (BG). Then check the abnormality detection using Fuzzy symmetric measure for GM, WM, and CSF classes. Finally, DWT method is applied in segmented abnormal region of images respectively and extracts the tumor portion. The proposed method used 30 multimodal MRI training datasets from BraTS2012 database. Several quantitative measures were calculated and compared with the existing. The proposed method yielded the mean value of similarity index as 0.73 for complete tumor, 0.53 for core tumor, and 0.35 for enhancing tumor. The proposed method gives better results than the existing challenging methods over the publicly available training dataset from MICCAI multimodal brain tumor segmentation challenge and a minimum processing time for tumor segmentation. © 2016 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 26, 305–314, 2016     

A Novel Hybrid Machine Learning Approach for Classification of Brain Tumor Images

Abnormal growth of brain tissues is the real cause of brain tumor. Strategy for the diagnosis of brain tumor at initial stages is one of the key step for saving the life of a patient. The manual segmentation of brain tumor magnetic resonance images (MRIs) takes time and results vary significantly in low-level features. To address this issue, we have proposed a ResNet-50 feature extractor depended on multilevel deep convolutional neural network (CNN) for reliable images segmentation by considering the low-level features of MRI. In this model, we have extracted features through ResNet-50 architecture and fed these feature maps to multi-level CNN model. To handle the classification process, we have collected a total number of 2043 MRI patients of normal, benign, and malignant tumor. Three model CNN, multi-level CNN, and ResNet-50 based multi-level CNN have been used for detection and classification of brain tumors. All the model results are calculated in terms of various numerical values identified as precision (P), recall (R), accuracy (Acc) and f1-score (F1-S). The obtained average results are much better as compared to already existing methods. This modified transfer learning architecture might help the radiologists and doctors as a better significant system for tumor diagnosis.     

Brain Tumor Segmentation in Multimodal MRI Using U-Net Layered Structure

The brain tumour is the mass where some tissues become old or damaged, but they do not die or not leave their space. Mainly brain tumour masses occur due to malignant masses. These tissues must die so that new tissues are allowed to be born and take their place. Tumour segmentation is a complex and time-taking problem due to the tumour’s size, shape, and appearance variation. Manually finding such masses in the brain by analyzing Magnetic Resonance Images (MRI) is a crucial task for experts and radiologists. Radiologists could not work for large volume images simultaneously, and many errors occurred due to overwhelming image analysis. The main objective of this research study is the segmentation of tumors in brain MRI images with the help of digital image processing and deep learning approaches. This research study proposed an automatic model for tumor segmentation in MRI images. The proposed model has a few significant steps, which first apply the pre-processing method for the whole dataset to convert Neuroimaging Informatics Technology Initiative (NIFTI) volumes into the 3D NumPy array. In the second step, the proposed model adopts U-Net deep learning segmentation algorithm with an improved layered structure and sets the updated parameters. In the third step, the proposed model uses state-of-the-art Medical Image Computing and Computer-Assisted Intervention (MICCAI) BRATS 2018 dataset with MRI modalities such as T1, T1Gd, T2, and Fluid-attenuated inversion recovery (FLAIR). Tumour types in MRI images are classified according to the tumour masses. Labelling of these masses carried by state-of-the-art approaches such that the first is enhancing tumour (label 4), edema (label 2), necrotic and non-enhancing tumour core (label 1), and the remaining region is label 0 such that edema (whole tumour), necrosis and active. The proposed model is evaluated and gets the Dice Coefficient (DSC) value for High-grade glioma (HGG) volumes for their test set-a, test set-b, and test set-c 0.9795, 0.9855 and 0.9793, respectively. DSC value for the Low-grade glioma (LGG) volumes for the test set is 0.9950, which shows the proposed model has achieved significant results in segmenting the tumour in MRI using deep learning approaches. The proposed model is fully automatic that can implement in clinics where human experts consume maximum time to identify the tumorous region of the brain MRI. The proposed model can help in a way it can proceed rapidly by treating the tumor segmentation in MRI.     

Automatic Segmentation of Liver from Abdominal Computed Tomography Images Using Energy Feature

Liver Segmentation is one of the challenging tasks in detecting and classifying liver tumors from Computed Tomography (CT) images. The segmentation of hepatic organ is more intricate task, owing to the fact that it possesses a sizeable quantum of vascularization. This paper proposes an algorithm for automatic seed point selection using energy feature for use in level set algorithm for segmentation of liver region in CT scans. The effectiveness of the method can be determined when used in a model to classify the liver CT images as tumorous or not. This involves segmentation of the region of interest (ROI) from the segmented liver, extraction of the shape and texture features from the segmented ROI and classification of the ROIs as tumorous or not by using a classifier based on the extracted features. In this work, the proposed seed point selection technique has been used in level set algorithm for segmentation of liver region in CT scans and the ROIs have been extracted using Fuzzy C Means clustering (FCM) which is one of the algorithms to segment the images. The dataset used in this method has been collected from various repositories and scan centers. The outcome of this proposed segmentation model has reduced the area overlap error that could offer the intended accuracy and consistency. It gives better results when compared with other existing algorithms. Fast execution in short span of time is another advantage of this method which in turns helps the radiologist to ascertain the abnormalities instantly.     

Robust brain MRI denoising and segmentation using enhanced non‐local means algorithm

Image denoising is an integral component of many practical medical systems. Non‐local means (NLM) is an effective method for image denoising which exploits the inherent structural redundancy present in images. Improved adaptive non‐local means (IANLM) is an improved variant of classical NLM based on a robust threshold criterion. In this paper, we have proposed an enhanced non‐local means (ENLM) algorithm, for application to brain MRI, by introducing several extensions to the IANLM algorithm. First, a Rician bias correction method is applied for adapting the IANLM algorithm to Rician noise in MR images. Second, a selective median filtering procedure based on fuzzy c‐means algorithm is proposed as a postprocessing step, in order to further improve the quality of IANLM‐filtered image. Third, different parameters of the proposed ENLM algorithm are optimized for application to brain MR images. Different variants of the proposed algorithm have been presented in order to investigate the influence of the proposed modifications. The proposed variants have been validated on both T1‐weighted (T1‐w) and T2‐weighted (T2‐w) simulated and real brain MRI. Compared with other denoising methods, superior quantitative and qualitative denoising results have been obtained for the proposed algorithm. Additionally, the proposed algorithm has been applied to T2‐weighted brain MRI with multiple sclerosis lesion to show its superior capability of preserving pathologically significant information. Finally, impact of the proposed algorithm has been tested on segmentation of brain MRI. Quantitative and qualitative segmentation results verify that the proposed algorithm based segmentation is better compared with segmentation produced by other contemporary techniques.     

Automatic detection of brain tumor in magnetic resonance images using multi‐texton histogram and support vector machine

Segmentation is the process of labeling objects in image data. It is a decisive phase in several medical imaging processing tasks for operation planning, radio therapy or diagnostics, and widely useful for studying the differences of healthy persons and persons with tumor. Magnetic Resonance Imaging brain tumor segmentation is a complicated task due to the variance and intricacy of tumors. In this article, a tumor segmentation scheme is presented, which focuses on the structural analysis on both tumorous and normal tissues. Our proposed method hits the target with the aid of the following major steps: (i) Tumor Region Location, (ii) Feature Extraction using Multi‐texton Technique, and (iii) Final Classification using support vector machine (SVM). The results for the tumor detection are validated through evaluation metrics such as, sensitivity, specificity, and accuracy. The comparative analysis is carried out by Radial Basis Function neural network and Feed Forward Neural Network. The obtained results depict that the proposed Multi‐texton histogram and support vector machine based brain tumor detection approach is more robust than the other classifiers in terms of sensitivity, specificity, and accuracy. © 2013 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 23, 97–103, 2013     

A comprehensive review: Segmentation of MRI images—brain tumor

Segmentation of tumors in human brain aims to classify different abnormal tissues (necrotic core, edema, active cells) from normal tissues (cerebrospinal fluid, gray matter, white matter) of the brain. In existence, detection of abnormal tissues is easy for studying brain tumor, but reproducibility, characterization of abnormalities and accuracy are complicated in the process of segmentation. The magnetic resonance imaging (MRI)‐based segmentation of tumors in brain images is more enhancing and attracting in current years of research studies. It is due to non‐invasive examination and good contrast prone to soft tissues of images obtained from MRI modality. Medical approval of different segmentation techniques depends on the benchmark and simplicity of the method. This article incorporates both fully‐automatic and semi‐automatic methods for segmentation. The outlook study of this article is to provide the summary of most significant segmentation methods of tumors in brain using MRI. © 2016 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 26, 295–304, 2016     

A fully automated hybrid methodology using Cuckoo‐based fuzzy clustering technique for magnetic resonance brain image segmentation

This article aims at developing an automated hybrid algorithm using Cuckoo Based Search (CBS) and interval type‐2 fuzzy based clustering, so as to exhibit efficient magnetic resonance (MR) brain image segmentation. An automatic MR brain image segmentation facilitates and enables a radiologist to have a brief review and easy analysis of complicated tumor regions of imprecise gray level regions with minimal user interface. The tumor region having severe intensity variations and suffering from poor boundaries are to be detected by the proposed hybrid technique that could ease the process of clinical diagnosis and this tends to be the core subject of this article. The ability of the proposed technique is compared using standard comparison parameters such as mean squared error, peak signal to noise ratio, computational time, Dice Overlap Index, and Jaccard T animoto C oefficient Index. The proposed CBS combined with interval type‐2 fuzzy based clustering produces a sensitivity of 0.7143 and specificity of 0.9375, which are far better than the conventional techniques such as kernel based, entropy based, graph‐cut based, and self‐organizing maps based clustering. Appreciable segmentation results of tumor region that enhances clinical diagnosis is made available through this article and two of the radiologists who have hands on experience in the field of radiology have extended their support in validating the efficiency of the proposed methodology and have given their consent in utilizing the proposed methodology in the processes of clinical oncology.     

An Efficient Image Analysis Framework for the Classification of Glioma Brain Images Using CNN Approach

The identification of brain tumors is multifarious work for the separation of the similar intensity pixels from their surrounding neighbours. The detection of tumors is performed with the help of automatic computing technique as presented in the proposed work. The non-active cells in brain region are known to be benign and they will never cause the death of the patient. These non-active cells follow a uniform pattern in brain and have lower density than the surrounding pixels. The Magnetic Resonance (MR) image contrast is improved by the cost map construction technique. The deep learning algorithm for differentiating the normal brain MRI images from glioma cases is implemented in the proposed method. This technique permits to extract the linear features from the brain MR image and glioma tumors are detected based on these extracted features. Using k-mean clustering algorithm the tumor regions in glioma are classified. The proposed algorithm provides high sensitivity, specificity and tumor segmentation accuracy.     

Integrating Fluorinated Polymer and Manganese‐Layered Double Hydroxide Nanoparticles as pH‐activated 19F MRI Agents for Specific and Sensitive Detection of Breast Cancer

¹⁹F magnetic resonance imaging (¹⁹F MRI) agents capable of being activated upon interactions with cancer triggers are attracting increasing attention, although challenges still remain for precise and specific detection of cancer tissues. In this study, a novel hybrid ¹⁹F MRI agent for pH‐sensitive detection of breast cancer tissues is reported, a composite system designed by conjugating a perfluoropolyether onto the surface of manganese‐incorporated layered double hydroxide (Mn‐LDH@PFPE) nanoparticles. The ¹⁹F NMR/MRI signals from aqueous solutions of Mn‐LDH@PFPE nanoparticles are quenched at pH 7.4, but “turned on” following a reduction in pH to below 6.5. This is due to partial dissolution of Mn²⁺ from the Mn‐LDH nanoparticles and subsequent reduction in the effect of paramagnetic relaxation. Significantly, in vivo experiments reveal that an intense ¹⁹F MR signal can be detected only in the breast tumor tissue after intravenous injection of Mn‐LDH@PFPE nanoparticles due to such a specific activation. Thus pH‐activated Mn‐LDH@PFPE nanoparticles are a potential “smart” ¹⁹F MRI agent for precise and specific detection of cancer diseases.     

A complete automated algorithm for segmentation of tissues and identification of tumor region in T1, T2, and FLAIR brain images using optimization and clustering techniques

Tissues in brain are the most complicated parts of our body, a clear examination and study are therefore required by a radiologist to identify the pathologies. Normal magnetic resonance (MR) scanner is capable of producing brain images with bounded tissues, where unique and segregated views of the tissues are required. A distinguished view upon the images is manually impossible and can be subjected to operator errors. With the assistance of a soft computing technique, an automated unique segmentation upon the brain tissues along with the identification of the tumor region can be effectively done. These functionalities assist the radiologist extensively. Several soft computing techniques have been proposed and one such technique which is being proposed is PSO‐based FCM algorithm. The results of the proposed algorithm is compared with fuzzy C‐means (FCM) and particle swarm optimization (PSO) algorithms using comparison factors such as mean square error (MSE), peak signal to noise ratio (PSNR), entropy (energy function), Jaccard (Tanimoto Coefficient) index, dice overlap index and memory requirement for processing the algorithm. The efficiency of the PSO‐FCM algorithm is verified using the comparison factors.     

Hierarchical fuzzy segmentation of brain MR images

In brain magnetic resonance (MR) images, image segmentation and 3D visualization are very useful tools for the diagnosis of abnormalities. Segmentation of white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) is the basic process for 3D visualization of brain MR images. Of the many algorithms, the fuzzy c‐means (FCM) technique has been widely used for segmentation of brain MR images. However, the FCM technique does not yield sufficient results under radio frequency (RF) nonuniformity. We propose a hierarchical FCM (HFCM), which provides good segmentation results under RF nonuniformity and does not require any parameter setting. We also generate Talairach templates of the brain that are deformed to 3D brain MR images. Using the deformed templates, only the cerebrum region is extracted from the 3D brain MR images. Then, the proposed HFCM partitions the cerebrum region into WM, GM, and CSF. © 2003 Wiley Periodicals, Inc. Int J Imaging Syst Technol 13, 115–125, 2003; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/ima.10035     

Gadolinium Metallofullerene‐Based Activatable Contrast Agent for Tumor Signal Amplification and Monitoring of Drug Release

Activatable imaging probes are promising to achieve increased signal‐to‐noise ratio for accurate tumor diagnosis and treatment monitoring. Magnetic resonance imaging (MRI) is a noninvasive imaging technique with excellent anatomic spatial resolution and unlimited tissue penetration depth. However, most of the activatable MRI contrast agents suffer from metal ion‐associated potential long‐term toxicity, which may limit their bioapplications and clinical translation. Herein, an activatable MRI agent with efficient MRI performance and high safety is developed for drug (doxorubicin) loading and tumor signal amplification. The agent is based on pH‐responsive polymer and gadolinium metallofullerene (GMF). This GMF‐based contrast agent shows high relaxivity and low risk of gadolinium ion release. At physiological pH, both GMF and drug molecules are encapsulated into the hydrophobic core of nanoparticles formed by the pH‐responsive polymer and shielded from the aqueous environment, resulting in relatively low longitudinal relativity and slow drug release. However, in acidic tumor microenvironment, the hydrophobic‐to‐hydrophilic conversion of the pH‐responsive polymer leads to amplified MR signal and rapid drug release simultaneously. These results suggest that the prepared activatable MRI contrast agent holds great promise for tumor detection and monitoring of drug release.     

Automatic segmentation of cerebral hemispheres in MR human head scans

Automatic segmentation of cerebral hemispheres in magnetic resonance (MR) brain images help to quantify the brain asymmetry and correct several MR brain deformities. The detection of mid‐sagittal plane (MSP) in human brain image is necessary to segment the hemispheres for both operator‐based and automated brain image asymmetric analysis. In this article, a computationally simple and accurate technique to detect MSP in MRI human head scans using curve fitting is developed. The left and right hemispheres are segmented based on the detected MSP. The accuracy of the MSP is evaluated by comparing the segmented left and right hemispheres against the manually segmented ones. Experimental results using 78 volumes of T1, T2 and PD‐weighted MRI brain images show that the proposed method has accurately segmented the cerebral hemispheres based on the detected MSP in axial and coronal orientations of normal and pathological brain images.     

Residual U-Network for Breast Tumor Segmentation from Magnetic Resonance Images

Breast cancer positions as the most well-known threat and the main source of malignant growth-related morbidity and mortality throughout the world. It is apical of all new cancer incidences analyzed among females. Two features substantially influence the classification accuracy of malignancy and benignity in automated cancer diagnostics. These are the precision of tumor segmentation and appropriateness of extracted attributes required for the diagnosis. In this research, the authors have proposed a ResU-Net (Residual U-Network) model for breast tumor segmentation. The proposed methodology renders augmented, and precise identification of tumor regions and produces accurate breast tumor segmentation in contrast-enhanced MR images. Furthermore, the proposed framework also encompasses the residual network technique, which subsequently enhances the performance and displays the improved training process. Over and above, the performance of ResU-Net has experimentally been analyzed with conventional U-Net, FCN8, FCN32. Algorithm performance is evaluated in the form of dice coefficient and MIoU (Mean Intersection of Union), accuracy, loss, sensitivity, specificity, F1score. Experimental results show that ResU-Net achieved validation accuracy & dice coefficient value of 73.22% & 85.32% respectively on the Rider Breast MRI dataset and outperformed as compared to the other algorithms used in experimentation.     

Fuzzy entropy‐based MR brain image segmentation using modified particle swarm optimization

This article presents an image segmentation technique based on fuzzy entropy, which is applied to magnetic resonance (MR) brain images in order to detect brain tumors. The proposed method performs image segmentation based on adaptive thresholding of the input MR images. The image is classified into two membership functions (MFs) of the fuzzy region: Z‐function and S‐function. The optimal parameters of these fuzzy MFs are obtained using modified particle swarm optimization (MPSO) algorithm. The objective function for obtaining the optimal fuzzy MF parameters is considered to be the maximum fuzzy entropy. Through a number of examples, The performance is compared with existing entropy based object segmentation approaches and the superiority of the proposed method is demonstrated. The experimental results are compared with the exhaustive search method and Otsu's segmentation technique. The result shows the proposed fuzzy entropy‐based segmentation method optimized using MPSO achieves maximum entropy with proper segmentation of infected areas and with minimum computational time. © 2013 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 23, 281–288, 2013