Abstract
Colorectal cancer (CRC) is one of the most commonly diagnosed cancers among both genders and its incidence rate is continuously increasing. CRC starts from small non-cancerous growths of tissue on the wall of the colon (large bowel) or rectum. Most polyps are harmless, but some can develop into CRC over time. Currently, colonoscopy is the golden standard method for the detection and removal of precancerous polyps. Colonoscopy, however, is an operator-dependent procedure and requires skilled endoscopists. Studies have shown that the polyp miss rate is around 25\% for certain cases. This miss rate has drawn the attention of engineers and computer scientists, including our group, for decades to develop a computer-aided polyp detection system that can help clinicians reduce this polyp miss rate during colonoscopy. This thesis has primarily contributed towards the investigation of the difficulties and challenges to develop an accurate automatic polyp detection and segmentation using deep learning approaches. Experimental results showed that deep learning is a promising approach to computerize colon polyp detection and segmentation, and it offers various approaches to improve the overall performance of the detection. In general, a massive amount of training data is the key to achieve desirable performance as there are already excellent CNN-based feature extractors. However, there is a lack of available training data, and manual polyp labeling of video frames is difficult and time-consuming. We showed that deep learning can be used to semi-automatically annotate video frames and produce 96\% of the Dice similarity score between the polyp masks provided by clinicians and the masks generated by our framework. We also showed that conditional GAN (CGAN) could be used to generate synthetic polyps to enlarge the training samples and improve the performance. The results demonstrated that deep learning-based models are vulnerable to small perturbations and noises. We found out that the bidirectional temporal information is essential to make CNN-based detection more reliable and less vulnerable.
List of papers
| Paper I Y. Shin, H. A. Qadir, L. Aabakken, J. Bergsland and I. Balasingham, "Automatic Colon Polyp Detection Using Region Based Deep CNN and Post Learning Approaches," in IEEE Access, vol. 6, pp. 40950-40962, 2018. DOI: 10.1109/ACCESS.2018.2856402, IF:4.098 The paper is icluded in the thesis, and also available at: https://doi.org/10.1109/ACCESS.2018.2856402 |
| Paper II Y. Shin, H. A. Qadir and I. Balasingham, "Abnormal Colon Polyp Image Synthesis Using Conditional Adversarial Networks for Improved Detection Performance," in IEEE Access, vol. 6, pp. 56007-56017, 2018. DOI: 10.1109/ACCESS.2018.2872717, IF:4.098 The paper is icluded in the thesis, and also available at: https://doi.org/10.1109/ACCESS.2018.2872717 |
| Paper III H. A. Qadir, I. Balasingham, J. Solhusvik, J. Bergsland, L. Aabakken and Y. Shin, "Improving Automatic Polyp Detection Using CNN by Exploiting Temporal Dependency in Colonoscopy Video," in IEEE Journal of Biomedical and Health Informatics, vol. 24, no. 1, pp. 180-193, Jan. 2020. DOI: 10.1109/JBHI.2019.2907434, IF:4.217 The paper is not available in DUO due to publisher restrictions. The published version is available at: https://doi.org/10.1109/JBHI.2019.2907434 |
| Paper IV H. A. Qadir, Y. Shin, J. Solhusvik, J. Bergsland, L. Aabakken and I. Balasingham, "Polyp Detection and Segmentation using Mask R-CNN: Does a Deeper Feature Extractor CNN Always Perform Better?," 2019 13th International Symposium on Medical Information and Communication Technology (ISMICT), Oslo, Norway, 2019, pp. 1-6. DOI: 10.1109/ISMICT.2019.8743694. The paper is icluded in the thesis, and also available at: https://doi.org/10.1109/ISMICT.2019.8743694 |
| Paper V H. A. Qadir, J. Solhusvik, J. Bergsland, L. Aabakken and I. Balasingham, "A Framework with a Fully Convolutional Neural Network For Semi-Automatic Colon Polyp Annotation," IEEE Access, vol. 7, pp. 169537-169547, 2019. DOI: 10.1109/ACCESS.2019.2954675, IF:4.098 The paper is icluded in the thesis, and also available at: https://doi.org/10.1109/ACCESS.2019.2954675 |
| Paper VI H. A. Qadir, J. Solhusvik, J. Bergsland, L. Aabakken and I. Balasingham, "Toward Real-Time Polyp Detection Using Fully CNN for 2D Gaussian Shape Prediction". Medical Image Analysis, March-2020 (under progress), IF:8.88 To be published. The paper is not available in DUO awaiting publishing. |