Real-time diagnosis of multi-category skin diseases based on IR-VGG

Ling TAN; Shanshan RONG; Jingming XIA; Sarker SAJIB; Wenjie MA

doi:10.11959/j.issn.2096-3750.2021.00217

您当前的位置：

首页 >

文章列表页 >

Real-time diagnosis of multi-category skin diseases based on IR-VGG

Service and Application | 更新时间：2024-06-05

- Real-time diagnosis of multi-category skin diseases based on IR-VGG
- Chinese Journal on Internet of Things Vol. 5, Issue 3, Pages: 115-125(2021)
- 作者机构：
  
  1. 南京信息工程大学计算机与软件学院，江苏南京 210044
  2. 南京信息工程大学人工智能学院，江苏南京 210044
  3. 南京信息工程大学雷丁学院，江苏南京 210044
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-3750.2021.00217
  CLC： TP391.41
- Published：30 September 2021，
  
  Published Online：2021-09，
- 稿件说明：
移动端阅览
LING TAN, SHANSHAN RONG, JINGMING XIA, et al. Real-time diagnosis of multi-category skin diseases based on IR-VGG. [J]. Chinese journal on internet of things, 2021, 5(3): 115-125.
DOI：

LING TAN, SHANSHAN RONG, JINGMING XIA, et al. Real-time diagnosis of multi-category skin diseases based on IR-VGG. [J]. Chinese journal on internet of things, 2021, 5(3): 115-125. DOI： 10.11959/j.issn.2096-3750.2021.00217.

摘要

恶性的皮肤病变在早期阶段的治愈率极高，基于深度学习的皮肤病诊断研究近年来受到持续关注，其诊断准确率较高，然而计算资源消耗大，且依赖于医院大型计算设备。为在物联网移动设备上实现快速准确皮肤病诊断，提出一种基于IR-VGG（inverted residual visual geometry group）的多分类皮肤病实时诊断系统，使用轮廓检测算法分割出皮肤病图像病灶区域，并用反转残差块替换 VGG16 第一层卷积块以降低网络参数权重和内存开销；将原图像和分割后的病灶图像输入IR-VGG网络，通过全局和局部特征提取后，输出皮肤病诊断结果。实验结果表明，IR-VGG网络结构在SkinData-1和SkinData-2皮肤病数据集上的准确率分别可达到94.71%和85.28%，并且可以有效降低复杂度，使诊断系统较容易在物联网移动设备上进行皮肤病实时诊断。

Abstract

Malignant skin lesions have a very high cure rate in the early stage.In recent years

dermatological diagnosis research based on deep learning has been continuously promoted

with high diagnostic accuracy.However

computational resource consumption is huge and it relies on large computing equipment in hospitals.In order to realize rapid and accurate diagnosis of skin diseases on Internet of things (IoT) mobile devices

a real-time diagnosis system of multiple categories of skin diseases based on inverted residual visual geometry group (IR-VGG) was proposed.The contour detection algorithm was used to segment the lesion area of skin image.The convolutional block of the first layer of VGG16 was replaced with reverse residual block to reduce the network parameter weight and memory overhead.The original image and the segmented lesion image was inputed into IR-VGG network

and the dermatological diagnosis results after global and local feature extraction were outputed.The experimental results show that the IR-VGG network structure can achieve 94.71% and 85.28% accuracy in Skindata-1 and Skindata-2 skin diseases data sets respectively

and can effectively reduce complexity

making it easier for the diagnostic system to make real-time skin diseases diagnosis on IoT mobile devices.

关键词

皮肤病边缘检测分割反转残差块深度学习物联网移动设备

Keywords

skin lesionsedge detection segmentationinverted residualdeep learningInternet of things mobile devices

references

ATLANTA. American cancer society[N]. Cancer Facts ＆ Figures, 2018.

斯璐, 郭军 . 新版中国黑素瘤诊治指南解读[J]. 临床肿瘤学杂志, 2012,17(2): 172-173.

SI L, GUO J . Interpretation of clinical practice guidelines for management of melanoma in China (new version of 2011)[J]. Chinese Clinical Oncology, 2012,17(2): 172-173.

KASMI R, MOKRANI K . Classification of malignant melanoma and benign skin lesions:implementation of automatic ABCD rule[J]. IET Image Processing, 2016,10(6): 448-455.

SOYER H P, ARGENZIANO G, ZALAUDEK I ,et al. Three-point checklist of dermoscopy[J]. Dermatology, 2004,208(1): 27-31.

ARGENZIANO G, CATRICALÀ C, ARDIGO M ,et al. Seven-point checklist of dermoscopy revisited[J]. British Journal of Dermatology, 2011,164(4): 785-790.

MENZIES S W . A method for the diagnosis of primary cutaneous melanoma using surface microscopy[J]. Dermatologic Clinics, 2001,19(2): 299-305.

HENNING J S, DUSZA S W, WANG S Q ,et al. The CASH (color,architecture,symmetry,and homogeneity) algorithm for dermoscopy[J]. Journal of the American Academy of Dermatology, 2007,56(1): 45-52.

XIE F Y, FAN H D, LI Y ,et al. Melanoma classification on dermoscopy images using a neural network ensemble model[J]. IEEE Transactions on Medical Imaging, 2017,36(3): 849-858.

ALI A R A, DESERNO T M . A systematic review of automated melanoma detection in dermatoscopic images and its ground truth data[C]// Proceedings of SPIE Medical Imaging:Image Perception,Observer Performance,and Technology Assessment. 2012.

KOROTKOV K, GARCIA R . Computerized analysis of pigmented skin lesions:a review[J]. Artificial Intelligence in Medicine, 2012,56(2): 69-90.

JAMIL U, KHALID S . Comparative study of classification techniques used in skin lesion detection systems[C]// Proceedings of 17th IEEE International Multi Topic Conference 2014. Piscataway:IEEE Press, 2014: 266-271.

BI L, KIM J, AHN E ,et al. Automatic melanoma detection via multi-scale lesion-biased representation and joint reverse classification[C]// Proceedings of 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI). Piscataway:IEEE Press, 2016: 1055-1058.

HUANG A, KWAN S Y, CHANG W Y ,et al. A robust hair segmentation and removal approach for clinical images of skin lesions[C]// Proceedings of 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Piscataway:IEEE Press, 2013: 3315-3318.

SÁEZ A, SERRANO C, ACHA B . Model-based classification methods of global patterns in dermoscopic images[J]. IEEE Transactions on Medical Imaging, 2014,33(5): 1137-1147.

IYATOMI H, CELEBI M E, SCHAEFER G ,et al. Automated color calibration method for dermoscopy images[J]. Computerized Medical Imaging and Graphics, 2011,35(2): 89-98.

SCHAEFER G, RAJAB M I, CELEBI M E ,et al. Colour and contrast enhancement for improved skin lesion segmentation[J]. Computerized Medical Imaging and Graphics, 2011,35(2): 99-104.

CELEBI M E, KINGRAVI H A, UDDIN B ,et al. A methodological approach to the classification of dermoscopy images[J]. Computerized Medical Imaging and Graphics, 2007,31(6): 362-373.

GANSTER H, PINZ P, ROHRER R ,et al. Automated melanoma recognition[J]. IEEE Transactions on Medical Imaging, 2001,20(3): 233-239.

XIE F Y, FAN H D, LI Y ,et al. Melanoma classification on dermoscopy images using a neural network ensemble model[J]. IEEE Transactions on Medical Imaging, 2017,36(3): 849-858.

CAPDEHOURAT G, COREZ A, BAZZANO A ,et al. Toward a combined tool to assist dermatologists in melanoma detection from dermoscopic images of pigmented skin lesions[J]. Pattern Recognition Letters, 2011,32(16): 2187-2196.

LAZEBNIK S, SCHMID C, PONCE J . Beyond bags of features:spatial pyramid matching for recognizing natural scene categories[C]// Proceedings of 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06). Piscataway:IEEE Press, 2006: 2169-2178.

CHEN S J, DING G G, LI C X ,et al. Image representation optimization based on locally aggregated descriptors[C]// Proceedings of Advances in Knowledge Discovery and Data Mining. 2016.

SÁNCHEZ J, PERRONNIN F, MENSINK T ,et al. Image classification with the fisher vector:theory and practice[J]. International Journal of Computer Vision, 2013,105(3): 222-245.

CHATFIELD K, LEMPITSKY V, VEDALDI A ,et al. The devil is in the details:an evaluation of recent feature encoding methods[C]// Proceedings of the British Machine Vision Conference(2011). 2011.

SONG Y Y, ZHANG L, CHEN S P ,et al. Accurate segmentation of cervical cytoplasm and nuclei based on multiscale convolutional network and graph partitioning[J]. IEEE Transactions on Biomedical Engineering, 2015,62(10): 2421-2433.

HE K M, ZHANG X Y, REN S Q ,et al. Deep residual learning for image recognition[C]// Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway:IEEE Press, 2016: 770-778.

KRIZHEVSKY A, SUTSKEVER I, HINTON G E . ImageNet classification with deep convolutional neural networks[J]. Communications of the ACM, 2017,60(6): 84-90.

SIMONYAN K, ZISSERMAN A . Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv:1409.1556, 2014.

LECUN Y, BENGIO Y, HINTON G . Deep learning[J]. Nature, 2015,521(7553): 436-444.

JAYALAKSHMI G S, KUMAR V S . Performance analysis of convolutional neural network (CNN) based cancerous skin lesion detection system[C]// Proceedings of 2019 International Conference on Computational Intelligence in Data Science (ICCIDS). Piscataway:IEEE Press, 2019: 1-6.

胡海根, 孔祥勇, 周乾伟 ,等. 基于深层卷积残差网络集成的黑色素瘤分类方法[J]. 计算机科学, 2019,46(5): 247-253.

HU H G, KONG X Y, ZHOU Q W ,et al. Melanoma classification method by integrating deep convolutional residual network[J]. Computer Science, 2019,46(5): 247-253.

YU L Q, CHEN H, DOU Q ,et al. Automated melanoma recognition in dermoscopy images via very deep residual networks[C]// Proceedings of IEEE Transactions on Medical Imaging. Piscataway:IEEE Press, 2019: 994-1004.

MAHBOD A, SCHAEFER G, WANG C L ,et al. Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification[J]. Computer Methods and Programs in Biomedicine, 2020,193: 105475.

李航, 余镇, 倪东 ,等. 基于深度残差网络的皮肤镜图像黑色素瘤的识别[J]. 中国生物医学工程学报, 2018,37(3): 274-282.

LI H, YU Z, NI D ,et al. Melanoma recognition in dermoscopy images via deep residual network[J]. Chinese Journal of Biomedical Engineering, 2018,37(3): 274-282.

GUHA S R, M RAFIZUL HAQUE S . Convolutional neural network based skin lesion analysis for classifying melanoma[C]// Proceedings of 2019 International Conference on Sustainable Technologies for Industry4.0 (STI). Piscataway:IEEE Press, 2019: 1-5.

CHEN M, ZHOU P, WU D ,et al. AI-Skin:skin disease recognition based on self-learning and wide data collection through a closed-loop framework[J]. Information Fusion, 2020,54: 1-9.

ZAFAR K, GILANI S O, WARIS A ,et al. Skin lesion segmentation from dermoscopic images using convolutional neural network[J]. Sensors, 2020,20(6): 1601.

MARQUES O . Gray-level transformations[M]. New Jersey: John Wiley ＆ Sons, 2011.

CHENG S H, SHANG G C, ZHANG L . Handwritten digit recognition based on improved VGG16 network[C]// Proceedings of SPIE 11069,Tenth International Conference on Graphics and Image Processing (ICGIP 2018). 2019.

CODELLA N, ROTEMBERG V, TSCHANDL P ,et al. Skin lesion analysis toward melanoma detection 2018:A challenge hosted by the international skin imaging collaboration (ISIC)[J]. arXiv preprint arXiv:1902.03368, 2019.

Views

268

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on EEG signal classification of motor imagery based on AE and Transformer

An intrusion detection method based on depthwise separable convolution and attention mechanism

Multi-domain collaborative anti-jamming based on multi-agent deep reinforcement learning

Differential privacy budget optimization based on deep learning in IoT

Res-DNN based signal detection algorithm for end-to-end MIMO systems

Related Author

Rui JIANG

Liuting SUN

Xiaoming WANG

Dapeng LI

Youyun XU

Feng LIU

Yiyang GE

Shuo LI

Related Institution

School of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications

National Engineering Research Center for Communication and Network Technology,Nanjing University of Posts and Telecommunications

Engineering Research Center of Network Management Technology for High Speed Railway of Ministry of Education, School of Computer and Information Technology, Beijing Jiaotong University

Collaborative Innovation Center of Railway Traffic Safety, Beijing Jiaotong University

National Engineering Research Center of Advanced Network Technologies, Beijing Jiaotong University

⁰