研究论文

研究论文

Computer-aided Detection of Tuberculosis from
Microbiological and Radiographic Images

Abdullahi Umar Ibrahim1†, Ayse Gunnay Kibarer1, Fadi Al-Turjman2

1Department of Biomedical Engineering, Near East University, 尼科西亚, Mersin 10, Turkey

2Department of Artificial Intelligence, Research Centre for AI and IoT, Near East University, 尼科西亚, Mersin 10, Turkey

关键词: Tuberculosis; Deep Learning; Pretrained AlexNet; Chest X-ray; Microscopic slide

引文: Ibrahim, A.U., Kibarer, A.G., Al-Turjman, F。: Computer-aided Detection of Tuberculosis from Microbiological and

Radiographic Images. 数据智能 5 (2023). 土井: 10.1162/dint_a_00198

已收到: 九月 5, 2022; 修改: 十月 22, 2022; 公认: 一月 4, 2023

抽象的

Tuberculosis caused by Mycobacterium tuberculosis have been a major challenge for medical and
healthcare sectors in many underdeveloped countries with limited diagnosis tools. Tuberculosis can be
detected from microscopic slides and chest X-ray but as a result of the high cases of tuberculosis, this method
can be tedious for both Microbiologists and Radiologists and can lead to miss-diagnosis. These challenges
can be solved by employing Computer-Aided Detection (CAD)via AI-driven models which learn features
based on convolution and result in an output with high accuracy. 在本文中, we described automated
discrimination of X-ray and microscope slide images into tuberculosis and non-tuberculosis cases using
pretrained AlexNet Models. The study employed Chest X-ray dataset made available on Kaggle repository
and microscopic slide images from both Near East University Hospital and Kaggle repository. For classification
of tuberculosis using microscopic slide images, the model achieved 90.56% 准确性, 97.78% 灵敏度
和 83.33% specificity for 70: 30 splits. For classification of tuberculosis using X-ray images, 该模型
达到了 93.89% 准确性, 96.67% sensitivity and 91.11% specificity for 70:30 splits. Our result is in
line with the notion that CNN models can be used for classifying medical images with higher accuracy
和精度.

Corresponding author: Abdullahi Umar Ibrahim (电子邮件: Abdullahi.umaribrahim@neu.edu.tr; ORCID: 0000-0003-3850-


9921).

© 2023 Chinese Academy of Sciences. 根据知识共享署名发布 4.0 国际的 (抄送 4.0)
执照.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

/

.

t

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

1. 介绍

According to WHO as of 2020, there were over 10 million people estimated to be infected with
Tuberculosis (TB) globally. 然而, it is reported that more than 1.4 million people died from the infection
which include more than 200 thousand people suffering with HIV. 全球范围, TB is among the top 20 causes
of death with HIV, cancer, pneumonia, cardiovascular disease etc. TB is rate higher than HIV/AIDS in terms
of leading cause of deaths from a single pathogen [1, 2].

The major challenges regarding TB are that children and adolescent are mostly overlooked by healthcare
providers which makes it difficult of diagnose and treat. 第二, there have been thousand cases of multi-
drug resistance TB which is difficult to treat using the current drugs and thus, pose serious health burden
and concern. The number is estimated to have increase by 10% as of 2018 with total number of 187
thousand people infected with the resistant TB. 然而, 在 2019, it was estimated that over 200 thousand
people are infected with multi-drug resistance TB or rifampicin resistant TB [2].

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

Early screening and detection of the bacteria is critical for preventing widespread and increasing
survival rate of patients. Medical laboratory technicians, pathologists, radiologists and microbiologists
utilize several diagnostic assays or techniques for accurate detection of the bacteria. Some of the approaches
include tissue biopsy assay, true NAT assay, tuberculin test, smear sputum culture, Xpert ultra and Xpert
mycobacterium TB assay (which is highly recommended by WHO) chest X-ray (CXR) images and compute
tomography (CT) scans [3].

The advent of Artificial intelligence (人工智能) has transformed computer science and other technological fields,
medicine, 农业, natural science etc. The technology has been utilized for data analysis, 图像
classification, prediction etc. In medicine, AI has been utilized for prediction of disease, identification
of drugs, image classification of disease such as cancer, pneumonia, COVID-19, skin lesions, 糖尿病
retinotopy etc. [4].

Due to low sensitivity of existing assays and interpretation of result obtained from this laboratory
procedures which is very tedious for medical experts, scientists developed the use of AI-driven models for
image-based screening of TB from microscopic slide and radiographic images [5]. 因此, the integration of
this technique for automated detection offer promise of lessening the human burden due to the lack of
adequate testing materials especially in developed countries and remote areas.

1.1 Computer Aided Diagnosis

Computed Aided Diagnosis (CAD) also referred to Computer Aided Detection (CAD) is a computer-based
application that assists medical experts in decision-making [6]. In healthcare system, a medical practitioner
uses medical images to evaluate information such as abnormality from images for proper diagnosis.
Interpretation of medical images is very critical in the medical field due to the fact that any miss-diagnosis
can be detrimental [7]. Different fields of medicine deal with specific types of images such as microscopic
slide images by microbiologists, pathological and histological stain slide by pathologists and oncologists,
CT scans or Chest Xray (CXR) by radiologists as well as ultrasound and endoscopy [8].

2

数据智能

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

CAD technology revolves around the use of multiple concepts such as medical image processing,
computer vision and AI. The primary function of CAD system is detection of abnormality in medical images
such as providing quantified image metrics to compute probabilities of different diagnoses and identification
of potential Regions of Interests (ROIs) [9]. These techniques have been applied for detection of different
grades of tumors (such as colon, prostate, breast and lung cancer) from pathological stain images, detection
of Mycobacterium tuberculosis from both microscopic slide images and radiographic images, detection of
pneumonia from CT scans and diabetic retinopathy. Other application of CAD systems includes diagnosis
of Alzheimer’s disease, pathological brain detection, coronary artery disease, bone metastases etc. [7].

1.1.1 人工智能 (人工智能)

The notions of AI have been trending throughout the last 6 几十年. The definition of the concept varies
among scholars. 然而, AI is termed as any technique that enables computers to mimic human behaviour.
The term AI was coined in the 1950s and subsequently Machine Learning (机器学习) as a subfield of AI was
introduced. ML is coined in the 1980s which is categorized in supervised ML (SML), unsupervised ML and
Reinforcement ML [10].

1.1.2 Machine Learning (机器学习)

ML is coined in 1959 by Arthur Samuel as “a field of AI that gives computers the ability to learn without
being explicitly programmed”. ML algorithms are grouped into 3 major categories, Supervised ML,
Unsupervised ML and Reinforcements ML. Supervised ML algorithms are the most common and widely
used ML techniques adopted by medical practitioners in which data are labelled and the network learn
features to recognise patterns in data for prediction or classification. The most popular SML techniques
include Neural Networks (NNs), Support Vector Machine (支持向量机), Random Forest (RF), decision Tree (DT),
ETC. [10, 11].

In Unsupervised ML, models learn from unlabelled data. These models learn to forecast result from the
data according to the patterns learned. The most widely used unsupervised ML models include Rule Mining
(RM) and Clustering algorithms. 同时, Reinforcement ML is termed as “when a computer program
learns from Experience (乙) with respect to some Task (时间) based on the Performance (磷) 措施, if P at T
is measured by P improve with experience [10, 11].

1.1.3 Deep learning and Artificial Neural Networks (人工神经网络)

深度学习 (DL) is a subfield of ML which is inspired by how human brain’s function due to connections
or synapses of nerve cells or neurons. Model learn as a result of data connection between neurons in the
网络. A simple neural network is termed as perceptron which take input as data set and produced an
output as classification or prediction outcome. DL neural networks are made of multiple perceptron’s with
an input layer (伊尔), and many hidden layers (HL) before output layer (OL) [12, 13]. Since the emergence of
DL in 2010, scientists have designed different models using convolutional neural networks that can classify
and analyse medical images such as cancer, tuberculosis, radiological images for diagnosis of diseases [14].

数据智能

3

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

.

/

t

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

Convolutional Neural Network (CNN) is a class of ANN with multi-layer perceptron which are fully
connected network in which each neuron from one layer is connected to all neurons in the next layer.
CNNs are termed as networks that utilize series of mathematical operations knows as “Convolution”. 那里
are various neural networks architectures developed. Some of the architectures have performed better than
others in terms of regression, classification and denoising images. The current best models include AlexNet
和 8 layers, VGGNet with 19 和 16 layers, Inception module also known as GoogleNet with 22 layers
和 9 modules and Residual or ResNet with 152 layers. In order to train a NNs, a backpropagation
algorithm is used to adjust the weight according to the data pattern and optimize the error between
predicted output and actual output [15, 16].

1.1.4 AlexNet

AlexNet is the first CNN developed that outperform other models in the ImageNet Large Scale Visual
Recognition Challenge (ILSVRC) competition in 2012. AlexNet is developed by Alex Krizhevsky. The model
consists of overall 8 layers, 其中 5 are convolutional layers and 3 fully connected layers. The first two
convolutional layers are made of 3 operations which include convolution, pooling and normalization.
AlexNet use Rectified Linear Unit (ReLu) as an activation function unlike Tanh and sigmoid functions that
are used in traditional ML. ReLU converts negative numbers to zeros and help models learn non-linear
功能 [17, 18].

Max pooling is the most common pooling methods which main function is to down sample or to reduce
image size by pooling most important feature or by pooling out the number with highest pixel value. 这
下一个 2 layers are mainly convolution layers without pooling and normalization and the final convolution
layer consists of only convolution and pooling without normalization. 首先 2 fully connected layers are
dropout layers which main function is to reduce overfitting through reduction of number of neurons. 这
final FCL is basically for classification as shown in figure 1 [19, 20].

1.1.5 Transfer Learning (TL)

TL is defined as ML approach where a model trained on a specific task is re-purposed on other related
task or a means to extract knowledge from a source setting and apply it to a different target setting. TL can
also be described as a process where what models learned from a specific task or setting is harnessed to
improve better outcome in another task or setting. Some of the advantages of TL or pretrained models over
the ones developed from scratch include low computation, better performance, small learning rates, 时间
saving, ETC. [21].

1.2 Tuberculosis (TB)

TB is an airborne infection caused by a bacterium known as Mycobacterium tuberculosis (MBTB) 哪个
are slender, rod shape microbes with length ranging from 1–10μm and strict aerobes (need oxygen to
survive). They possess a waxy cell wall as a result of formation of “Mycolic Acid” making them “Acid

4

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

t

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 1. AlexNet architecture.

fast” which signifies that they can retain on to a dye or stain in spite of being exposed to alcohol, 因此,
making the bacilli look red in color when Ziehl-Nelson stain is applied. 然而, due to the nature of their
waxy cell wall, they tend to repel weak disinfectants and can survive on a dry surface for a long period
of time [22]. According to WHO 2019 报告, deaths as a result of TB-related disease decreased from
1.6 百万 2017 到 1.5 百万 2018. It was estimated that 10 million people fell ill as a result of TB
在 2018, with the majority of patients coming from India, Pakistan and China. The symptoms of tuberculosis
include haemolysis (coughing up blood), fever, weight loss, night sweats etc. [1].

1.2.1 Diagnosis

There are many approaches adopted by pathologist for the detection of TB; some of the techniques
include Tuberculin Skin Test (TST), 显微镜检查, chest X-ray, Purified Protein Derivative (PPD), GeneXpert,
culture test and Interferon c-release assay. 然而, among these techniques, microscopic sputum smear
evaluation using microscope remains the most common approach globally, especially in underdeveloped
and developing countries due to its affordability, simplicity, speed and maintenance when compared to
other techniques [3].

数据智能

5

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

1.3 挑战

Majority of microbiological diagnostic depends on chemical and analytical assays and interpretation by
professionals in the field. 因此, due to the tedious nature of the assays, lack of adequate and reliable testing
kit and reagents, or expiration of the existing chemicals especially in underdeveloped countries, this result
in miss-diagnosis, irreproducibility, false-positive results and inaccuracy. Despite the fact that the use of
microscope for identification of microbial pathogens is very crucial for screening and diagnosis, this method
is hindered by several challenges which can lead to miss-diagnosis and false-positive cases [23].

Some of the challenges of microscopic examination of Mycobacterium tuberculosis include the
overlapping of the bacteria on top of each other, the size of the bacteria which is very small (IE。, 1–10 μm),
low background contrast, irregular appearance, heterogenous shape, faint boundaries. 而且, screening
large number of microscopic slides images can be very hectic and tedious for pathologists. In order to
resolve these challenges and limitations, there is need to develop more rigorous, robust, accurate, 快速地,
reliable technique that can be utilized for screening and diagnosis of TB [3, 23].

The aim of this work is to applied DL-TL for the detection of TB. 然而, there are several studies that
addressed this issue. One of the distinctions of our study with existing literature is that we trained and
validated AlexNet model using microscopic slide images and X-ray while existing studies only focus
on one type of medical image. 第二, majority of studies evaluated model based on conventional
performance metrics, 然而, in this study, we conducted 10k cross validation in order to provides average
performance of the model rather than using single evaluation.

1.4 Contribution

• The use of pretrained AlexNet for classification of TB from microscopic slide and X-ray images.
• The use of pretrained AlexNet for classification of TB from microscopic slide images.
• Performance evaluation based on Accuracy, sensitivity and specificity.
• Evaluation of model using 10k-folds cross validation
• Realistic comparison between pretrained AlexNet with the current state-of-the-art.

2. RELATED WORK

2.1 Microscopic Slide

Automated detection of Mycobacterium tuberculosis has aided in accurate diagnosis of the disease. 这
integration of computer-based technology into healthcare has transformed the sector and contribute to
increase in efficiency. Several studies in the literature have demonstrated the benefit of integrating CAD
系统. Smith et al. [24] utilized a high-quality microscope designed to collect high resolution stain slide
图片. In order to make the bacilli visible, the researchers amplified the number of colonies and stained
using dye to acquired 25000 图片. The study conducted different types of image augmentation which
are used to train the CNN model in order to discriminate between various types of bacteria (rod, 链

6

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

t

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

and round-shapes). The model achieved an overall accuracy of 95%. The classification of Mycobacterium
tuberculosis and normal cases using ANN is provided by Khan et al. [25]. The study utilized over 12
thousand images which are partitioned into 70% for training of the model and 30% for validation. 这
image training was carried out using feedforward backpropagation model and the model achieved 94%
testing accuracy. A CNN Model built from scratch by Xiong et al. [5] name TB-AI was used for detection
of Mycobacterium tuberculosis bacillus. The model was trained using 45 total samples with 15 as negative
cases and 30 as positive cases which are tissue samples that were treated using acid-fast stain. The result
has shown TB-AI achieved 83.65% specificity and 97.94% 灵敏度.

Panicker et al. [26] utilized CNN approach to detect Mycobacterium tuberculosis bacillus from
microscopic sputum spear images. The dataset was obtained from a public domain with 120 images which
were cropped to 900 patches for both positive and negative samples for segmentation method. The model
accomplished sensitivity of 97.13% and specificity of 78.4%. A study based on the use of SVM for the
detection of Mycobacterium tuberculosis is provided by Costa Filho et al. [27]. The study employed 120
smear microscopic slide image from 12 案例. Prior to training, the images undergo conventional smear
microscopy and segmentation. The study reported an error rate of 3.38% and sensitivity of 96.8%. The use
of microscopic slide images for the classification of TB and non-Tb cases is proposed by Ibrahim et al. [23].
The study acquired microscopic slide images from Near East University (NEU) Hospital which contain 530
图片. Data augmentation based on rotation and cropping were also conducted to increase the training
set to 2444 图片. The images were trained and tested using pretrained AlexNet model which resulted
进入 98.73% 准确性, 98.59% sensitivity and 98.84% specificity. Machine vs Human experiments were
conducted where DL model outperformed human pathologists.

A deeper model was employed by El-Melegy et al. [28] for detection of Ziehl Nelson-stained sputum
smear of TB and healthy images. The research utilized 500 images which are divided into 80% 和 20%
for training and validation respectively and train using Faster Region-based convolutional neural network
plus CNN (F-R-CNN+CNN) and Region-based convolutional neural network F-R-CNN. F-R-CNN+CNN
达到了 85.1% sensitivity and 98.4% accuracy while F-R-CNN achieved 82.6% sensitivity and 98.3%
准确性. Due to the prevalence of TB in Uganda, Muyama et al. [29] utilized 3 TL models based on ResNet
(inception V3), GoogleNet and VGGNet for computer assisted-detection of TB from Ziehl-Nelson sputum
smear slide images. The study made used of dataset obtained from an online database and the ones captured
using cell phone’s camera in the university microbiology laboratory. 这 2 datasets are combined together
and partitioned into 80% for training and 20% for validation. The models were trained according to (我)
find-tunning (二) with augmentation and (三、) without augmentation. 然而, among all the pre-trained
型号, ResNet achieved the highest accuracy score of 86.7%. The summary for detection of tuberculosis
from microscopic slide using AI-driven tools is presented in Table 1.

数据智能

7

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

t

.

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

Tabl e 1. Detection of tuberculosis from microscopic slide using AI-driven tools.

参考

Neural Network

Sample type

数据集

结果

[25]

[27]

[24]

[28]

[3]

[29]

[23]

CNN

支持向量机 & CNN

CNN

CNN

CNN

ResNet, GoogleNet
and VGGNet
Pretrained AlexNet

Microscopic Stained
图像
Microscopic stained
图片
Microscopic stained
图像
Microscopic stained
图像

Microscopic stained
图像
Ziehl-Nelson-stained
smear sputum slides
Ziehl-Nelson-stained
smear sputum slides

2.2 Chest X-ray

12,636

94% 准确性

120

96.80% 准确性

25,000 图片 95% 准确性

500 图片

案例: 45

F-R-CNN achieved 98.3% 准确性
和 82.6% 灵敏度
F-R-CNN+CNN achieved 98.4%
accuracy and 85.1% 灵敏度
97% sensitive and 83.65% specifi c

Not specifi ed

86.7% 准确性

2464 图片

98.73% 准确性, 98.59% 灵敏度
和 98.84% specifi city

Klassen et al. [30] employed CNN to discriminate between normal and pulmonary TB using radiographs.
The study utilized 1007 posterior chest radiographs which were partition into training, validation and testing
分别. The images were trained using 2 models which include GoogleNet and AlexNet. 他们俩
models ensembled together to achieved AUC of 0.99 with a sensitivity of 97.3% and specificity of 94.7%.
The same approach was adopted by Yahiaoui et al. [31] to classify TB from healthy samples using SVM.
The model was trained using 15 total CXR images (acquired from 50 patients suffering from TB and 100
healthy samples). 然而, the model achieved 96.7% 准确性.

The use of TL based on VGGNet and SVM as the model classifier is reported by Ahsan et al. [32]. 这
study utilized dataset obtained from Shenzhen hospital, China and from Montgomery County Tuberculosis
Control Program (MCTCP) in the form of CXR images. The images were trained based on (我) with augmentation
和 (二) without augmentation. The model achieved 81.25% validation accuracy with augmentation and
80% validation accuracy without augmentation. Chang et al. [33] proposed a 2-stage classification of TB
based on TL on CNN. The study made used of 1727 cases of TB culture acquired from Tao-Yuan general
hospital, 台湾. The dataset was trained using VGGNet, YOLO and CNN designed from scratch. 经过
targeting the result of the model on non-negative class, the proposed system achieved 98% recall and 99%
precision.

To classify normal and abnormal X-ray images of individuals suffering from TB, Abbas and Abdelsamea [34]
utilized a pretrained AlexNet model. The model was trained based on 138 total CXR images (58 normal and
80 abnormal X-ray images). To increase number of training set, the X-ray images undergo data augmentation.
The model hyperparameters were turned according to deep-tuning, shallow-tuning and fine-tuning

8

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

.

t

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

技巧. The study revealed that hyperparametric fine-tuning of pretrained AlexNet outperform other
tuning techniques with 0.998 AUC score, 99.7% sensitivity and 99.9% specificity. The application of hybrid
model for automated detection of TB is proposed by Sahool et al. [35]. The hybrid model comprises of
MobileNet with 88 layers and feature selector in the form of Artificial Ecosystem-based optimization (AEO)
algorithm. The model was trained on X-ray dataset acquired from Shenzhen hospital, China with 662 totals
frontal CXR images (of which 336 are positive and 336 negative). The model achieved 90.2% 最好的
classification accuracy, 93.85% sensitivity and 86.76% specificity.

The study conducted by Ibrahim et al. [36] applied 2 classifiers for the classification of TB and non-TB
图片. 2 Pretrained AlexNet models (AlexNet+Softmax and AlexNet+SVM) are trained and tested using
3871 TB images and 3500 non-TB images. The evaluation of the model performance yielded 98.19%
accuracy using AlexNet+Softmax and 98.38% using AlexNet+SVM. The study conducted by Nafisah and
穆罕默德 [37] applied DL models for the classification of CXR images into TB and non-TB cases. 一些
DL models which include (EfficientNetB3, MobileNet, ResNeXt-50, Inception-ResNet-V2 and Xception)
were trained and tested using 692 TB and 406 non-TB segmented images. The evaluation of the model
performance has shown that EfficientNetB3 achieved the highest result with 99.1% 准确性, 98.7% average
accuracy and 99.9% ROC. The summary for detection of tuberculosis from Chest X-ray using AI-driven
tools is presented in table 2.

桌子 2. Detection of tuberculosis from chest X-ray using AI-driven tools.

参考

Neural Network

Sample type

数据集

结果

[32]

[31]

[33]

[34]

[36]

[37]

Automated recognition and
pattern analysis
支持向量机

Flougraphic chest
mages
Chest X-ray images 150 案例 50 积极的

Negative = 238
Positive = 70

sensitivity 75.0–87.2%,
specifi city 53.5–60.0%,
96.68% 准确性

Pretrained AlexNet model

Chest X-ray images 138 (58 negative and

和 100 negatives

80 positive cases)

Hybrid model (MobileNet
and Artifi cial Ecosystem-
based optimization algorithm

Frontal chest X-ray 662 (336 positive and

336 negative)

AlexNet+Softmax and
AlexNet+SVM

Chest X-ray images 3871 TB images and
3500 non-TB images.

Effi cientNetB3, MobileNet,
ResNeXt-50, Inception-
ResNet-V2 and Xception)

Chest X-ray images 692 TB and 406

non-TB segmented
图片

0.998 AUC score, 99.7%
sensitivity and 99.9%
specifi city
90.2% best classifi cation
准确性, 93.85%
sensitivity and 86.76%
specifi city.
98.19% accuracy using
AlexNet+Softmax and
98.38% 使用
AlexNet+SVM.
Effi cientNetB3 with 99.1%
准确性, 98.7% average
accuracy and 99.9% ROC

The field of CAD is changing the landscape of disease diagnosis through improving diagnostic efficiency,
reducing the use of toxic chemicals and workload. Several researches in the existing literature have
demonstrated how AI-driven models aid in diagnosis of several diseases ranging from cancer (breast,

数据智能

9

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

t

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

melanoma, colorectal, prostate etc.), TB, pneumonia (COVID-19 and non-COVID-19). Screening of TB is
crucial for early diagnosis and timely treatment especially in underdeveloped countries with prevalence of
the disease. Majority of the studies in the literature either focus solely on the application of AI-driven models
on microscopic slide images or X-ray images. 然而, this study includes both medical images and
provide comparative analysis of the result obtained and their distinctions. 最后, majority of exiting
studies evaluated models based on conventional metrics (which include accuracy, 灵敏度, specificity,
AUC, ROC etc.) of training and testing sets. While in this study we include the use of cross validation in
order to provides average performance of the model rather than using single evaluation.

3. METHODOLOGY

This chapter discuss about the overall methodology which include data collection, image pre-processing,
data labelling, data split, cross validation pretrained model adjustment, data training and mode of evaluation.

3.1 Overview

The summary of the overall methodology is illustrated in Figure 2. Dataset were obtained from 2 不同的
来源 (1) X-ray images from Kaggle repository and (2) microscopic slide from Near East University Hospital
and Kaggle repository. In order to fit the images into AlexNet model, data processing step was conducted
by reducing the image the required pixel size and fed into the pretrained AlexNet model. The model was
subsequently evaluated on the basis of sensitivity, specificity and Accuracy.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

.

/

/

t

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 2. Flow Chart (GN: General Dataset and CV: Cross Validation).

10

数据智能

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

3.2 Data Collection

3.2.1 Microscopic Slide Images

Microscopic slide images have been used extensively in clinical diagnosis of pathogenic disease such
as TB, Pneumonia, Anthrax, Cholera, Meningitis, Gonorrhoea etc. Microscopic slides imaging is the most
popular conventional approach for the detection of TB. The slides use in this study were prepared through
smearing of sputum collected from suspected patients. The basic protocol includes smearing the sputum
on clean slides follow by flaming using low flame in order to fix the air-dried smear. Nexus is the spray of
Auramine O stain for 10–15 minutes. The slide is then wash using alcohol and subsequently rinsing using
deionized water. The final step is based on addition of potassium permanganate to counter stain the slide
which result into a clear contrast background which can be view using electronic microscope. The images
obtained from the microscope can be save in a computer for further analysis. 2 sample of microscopic
slides employed in this study are shown in Figure 3. The overall microscopic slide images are 600 (300
positive and 300 negative).

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

.

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 3. Microscopic Slide Images. 正确的: Positive (tuberculosis) microscopic slide image. The purple and red
thick bacilli depict mycobacterium tuberculosis. 左边: Negative.

数据智能

11

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

3.2.2 Chest X-ray

The use of radiographic images provides medical expert with a clear view of patient’s organs which aid
in diagnosis and clinical decision. Chest X-ray images are used to diagnose disease associated with the
lungs such as pneumonia (细菌, viral which include COVID-19) effusion and TB as shown in Figure 4.
The X-ray images used in this study are acquired from publicly available website known as Kaggle. 这
total X-ray images used in this study is 600 (300 positive and 300 negative or normal images).

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

数字 4. Chest X-ray Images. 正确的: Positive. 左边: Negative.

3.3 Data Processing

t

/

.

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

The microscopic slides images employed for this research were first evaluated and labelled by clinical
pathologists into positive and negative cases. The X-ray images used are already labelled in the website.
Both the microscopic slide images and chest X-ray images are too large ranging from 1MB to 6MB per each
single image. In order to fit the images into AlexNet model, the images are reduced using an online free
website known as Birme (https://www.birme.net/). The images are resized into 227x227x3. 227 denoted
the pixel size for both vertical and horizontal while 3 denoted channels which include Red, Green and
Blue (RGB).

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

3.4 Data Split

After resizing, the images are split into 70:30 for training and testing respectively. Based on the 600
images obtained, 420 (210 positive and 210 negative are used for training (I.e., 70%) 和 180 (90 积极的
和 90 negative) for testing (I.e., 30%) 如表所示 3.

12

数据智能

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

桌子 3. Data split of Microscopic Slides Images and Chest X-ray Images.

数据集

Training (70%)

Testing (30%)

Positive

Negative

Positive

Negative

Microscopic Slide
Chest X-ray

210
210

210
210

90
90

90
90

全部的

600
600

3.5 Cross Validation (CV)

Evaluation of model performance is crucial for determining overall accuracy and generalization.
Evaluation of model performance based on conventional ML approach involve training computer models
using training set and evaluating their performance using testing set (IE。, holdout set). 然而, this method
is not reliable and accurate for finalizing model performances. In order to resolve this issue, 科学家
proposed the use of CV. This technique is use for assessing generalization of independent data using
statistical analysis [38, 39]. 而且, this technique is useful for evaluating ML models based on training
models with subsets of the input dataset (IE。, 90%) and evaluating the performance using complementary
subset (IE。, 10%). CV differs with conventional ML performance approach as it allow the use of each subset
as part of the training set and testing set (IE。, reshuffling of subset where each data point get an equal
chance to be included in both training and testing set. Cross validation is conducted using k folds, 在哪里
k can be 3, 5 或者 10. Some of the advantages of CV is that it can help scientists detect overfitting, 提供
average performance of the model rather than using single evaluation (IE。, 70:30%) [39]. 所以, CV is
crucial for more accurate evaluation of model performances.

CV is regarded as one of the most important approaches adopted in DL for selection of parameters and
evaluation of model performance. CV enable the use of the entire dataset as training and testing respectively.
Each fold is use as training and testing. In this study, 10k folds are used, 9 folds for training and 1-fold for
testing for both microscopic slides and X-ray images. Each dataset contains 600 图片 (microscopic slides
images and Chest X-ray images). 因此, the images are split into 9 folds (270) and 1-fold (30) for both positive
and negative cases.

3.6 Model Training

For both microscopic slide images and chest X-ray images, 70% split was used for training in Matlab
install with DL, image processing toolbox and AlexNet driver. The program is run on a PC with 8GB random
access memory, intel R core-i7-3537U, GPU and window 64-bit. The remaining 30% was reserved for
testing. The subsequent training of the model for general dataset and cross validation is adjusted to 20
epoch and 0.0001 learning rate. The code use for training and testing is included in the supplementary file.

数据智能

13

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

.

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

3.7 Evaluation Metrics

To evaluate the performance of the learned models, some certain parameters are utilized; 准确性,
Precision also known as sensitivity and specificity or recall. Accuracy is defined as the ratio of properly
classified images over total sum of images; it is also described as the sum of precision and recall. 为了
evaluating the accuracy and loss of the learned model the resulting formulas are employed:

Loss

n

1
= − ∑
n =

1

日志

PC

Accuracy

= −

C

(1)

(2)

Where N is the overall number of images during training and testing, n is the number of images and PC is
the probability of the correctly classified images.

Confusion matrix is the common approach used for evaluation of model performance based on True
Positive (TP), True Negative (TN), False Positive (FP) and False Negative (FN). TPs is the number of samples
that are correctly identified by the model as positive cases or number of cases who actually have TB
according to each model. TNs is the number of samples that are correctly identified by the model as
negative cases or number of cases who are actually healthy (普通的) and classified as negative according
to each model. FPs are the number of samples that are incorrectly classified as negative by the model or
number of cases that are actually negative (normal or healthy) but classified as TB according to each model.
FNs are the number of samples that are incorrectly classified as positive by the model or number of cases
that are actually positive (TB) but classified as normal or healthy according to each model as shown in
桌子 4.

True Positive rate (Sensitivity) is the portion of positive cases or samples which are precisely classified as

positive sample (IE。, it describes the ration of positive cases that are correctly identified as positives).

Sensitivity

TPs
+
TPs FNs

(3)

False positive rate (FPR) also known as Specificity is the portion of positive cases or samples which are
wrongly classified as positive samples (IE。, it describes the ratio of negative samples that are incorrectly
classified as positives).

Specificity

TNs
+
TNs FPs

桌子 4. Confusion matrix.

(4)

预测

Actual Positive

Actual Negatives

Positive Predictions
Negative Predictions

TP
FN

FP
TN

14

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

.

t

/

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

4. RESULT AND DISCUSSION

This section focusses on the results obtained as a result of training and testing of the pretrained AlexNet
model using both microscopic slide images and chest X-ray images. The chapter also present the result
obtained from cross validation of 2 dataset and comparison with state of the art.

4.1 Classification of Tuberculosis using Microscopic Slide Images

4.1.1 General Dataset: Microscopic Slide Images

Pretrained AlexNet was used to classify positive and negative cases of TB from microscopic slide images.
The dataset was split into 70:30, 80:20 和 90:10 for training. In the case of 70:30 split, training of the
model resulted in 580 iterations and 20 epochs as shown in Figure 5. The remaining 30% are used for
testing. The model achieved 96.83%% training accuracy, 98.41% training sensitivity, 95.24% 训练
specificity, 90. 56% testing accuracy, 97.78% testing sensitivity and 83.33% testing specificity as shown in
桌子 6 and Figure 5. In the case of 80:20 split, training of the model resulted in 660 iterations and 20
纪元. The remaining 20% are used for testing. The model achieved 96.53% training accuracy, 93.03%
training sensitivity, 100% training specificity, 100% testing accuracy, 100% testing sensitivity and 100%

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 5. Accuracy and loss function for Training AlexNet Model using microscopic slide images.

数据智能

15

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

testing specificity as shown in Table 6. In the case of 90:10 split, training of the model resulted in 740
iterations and 20 纪元. The remaining 10% are used for testing. The model achieved 97.53% 训练
准确性, 95.06% training sensitivity, 100% training specificity, 96.67% testing accuracy, 93.33% testing
sensitivity and 100% testing specificity as shown in Table 5 和图 6. The results presented in table 5
has shown that increasing the number of dataset lead to increase in training accuracy. 然而, our results
are in line with the study carried out by Prashanth et al. [40] based on data splits from 50%–90%. 而且,
80:20 split achieved higher testing accuracy which shows that model is “fit” compare to 70:30 (with less
training set) 和 90:10 which is relatively “overfit” due to testing on small number of datasets.

桌子 5. General Dataset Microscopic slide (70:30, 80:20 和 90:10).

Parameters

Accuracy (%)
Sensitivity (%)
Specifi city (%)

70:30

80:20

90:10

Training

Testing

Training

Testing

Training

Testing

96.83
98.41
95.24

90.56
97.78
83.33

96.53
93.06

100

100
100
100

97.53
95.06

100

96.67
93.33

100

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

.

/

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 6. General Microscopic Slide Images Result.

4.1.2 Cross Validation for Microscopic Slide Images

CV was conducted in order to evaluate the general performance of the model by employing every K-fold
as training and testing respectively. The model achieved average training accuracy of 88.70%, average
training sensitivity of 99.50%, average training specificity of 97.78%. In terms of testing, the model achieved
average testing accuracy of 94.66%, average testing sensitivity of 98.33% and average testing specificity of
91.00% 如表所示 6.

16

数据智能

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

桌子 6. Cross Validation for Microscopic Slide Images.

K-fold

Training A*

Training SV*

Training SP*

Testing A*

Testing SV*

Testing SP*

K1
K2
K3
K4
K5
K6
K7
K8
K9
K10
Average

99.38
98.77
98.77
99.38
99.38
98.15
98.77
95.68
99.38
98.77
88.70

98.77
98.77
98.77

100
100
100
100

98.77

100
100

99.50

100

98.77
98.77
98.77
98.77
96.30
97.53
92.59
98.77
97.53
97.78

100

90.00
76.67
93.33
98.33
95.00

100

93.33

100
100

94.66

100
100

96.67
96.67

100

90.00

100
100
100
100

98.33

100

80.00
56.67
90.00
96.67

100
100

86.67

100
100

91.00

A*=Accuracy

SV*=Sensitivity

SP*=Specifi city

4.2 Classification of Tuberculosis Using Chest X-ray Images

4.2.1 General Dataset: Chest X-ray Images

Pretrained AlexNet was used to classify positive and negative cases of TB from MS images. The dataset
was split into 70:30, 80:20 和 90:10 for training and testing. In the case of 70:30 split, training of the
model resulted in 580 iterations and 20 epochs as shown in figure 7. The remaining 30% are used for
testing. The model achieved 99.21% training accuracy, 100% training sensitivity, 98.41% training specificity,
93.39% testing accuracy, 96.67% testing sensitivity and 91.11% testing specificity as shown in Table 8
and Figure 6. In the case of 80:20 split, training of the model resulted in 660 iterations and 20 纪元.
The remaining 20% are used for testing. The model achieved 96.53% training accuracy, 97.22% 训练
灵敏度, 95.83% training specificity, 94.17% testing accuracy, 98.33% testing sensitivity and 90% testing
specificity as shown in Table 8. In the case of 90:10 split, training of the model resulted in 7540 迭代
和 20 纪元. The remaining 10% are used for testing. The model achieved 99.38% training accuracy,
100% training sensitivity, 98.77% training specificity, 98.33% testing accuracy, 100% testing sensitivity and
96.67% testing specificity as shown in Table 7 和图 8.

桌子 7. General Dataset Chest X-ray (70:30; 80:20 和 90:10).

Parameters

70:30

80:20

90:10

Training

Testing

Training

Testing

Training

Testing

Accuracy (%)
Sensitivity (%)
Specifi city (%)

99.21

100

98.41

93.89
96.67
91.11

96.53
97.22
95.83

94.17
98.33
90.00

99.38

100

98.77

98.33

100

96.67

数据智能

17

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

数字 7. Accuracy and loss function for Training AlexNet Model using chest X-ray images.

t

.

/

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

数字 8. General Chest X-ray Images Result.

18

数据智能

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

4.2.2 Cross Validation for Chest X-ray Images

CV was conducted in order to evaluate the general performance of the model by employing every K-fold
as training and testing respectively. The model achieved average training accuracy of 97.22%, average
training sensitivity of 99.87%, average training specificity of 95.58%. In terms of testing, the model achieved
average testing accuracy of 94.00%, average testing sensitivity of 98.33% and average testing specificity of
98.33% 如表所示 8.

桌子 8. Cross Validation for Chest Xray Images.

K-fold

Training A*

Training SV*

Training SP*

Testing A*

Testing SV*

Testing SP*

K1
K2
K3
K4
K5
K6
K7
K8
K9
K10
Average

96.30
99.38
95.06
96.91
97.53
93.83
98.15
96.30
98.77

100

97.22

100

98.77

100
100
100
100
100
100
100
100

99.87

92.59

100

90.12
93.83
95.06
87.65
96.30
92.59
97.53

100

95.58

100

98.33
95.00
91.67
95.00
85.00
96.67
91.67
90.00
95.00
94.00

100

96.67

100
100
100
100
100
100

96.67
90.00
98.33

100
100

90.00
83.33
90.00
70.00
93.33
83.33
83.33

100

98.33

A*=Accuracy

SV*=Sensitivity

SP*=Specifi city

4.3 Comparison with State of the Art

4.3.1 Comparison with State of the Art for Microscopic Slide Images

70:30 split is used for comparison as a result of support from many articles in the literature. The result
obtained for general dataset yield 90.56% testing accuracy, 97.78% sensitivity and 83.33% specificity and
average cross validation resulted in 94.66% average testing accuracy, 98.33% average testing sensitivity
和 91.00% average testing specificity. Compare to study conducted by Khan et al. [25] 和 94% 准确性.
Despite the fact that the study trained and tested the model using over 12,000 microscopic slide images,
our model which is trained and tested using 600 images achieved similar accuracy based on average CV
and less based on 70:30 data split. According to literature, using SVM as a classifier increase model
表现. 因此, the result achieved by Costa Filho et al. [27] (96.80%) outperform our model (两个都
70:30 spilt and CV). This can be attributed to the use of SVM instead of SoftMax use by our model. 史密斯
et al. [24] utilized 25 thousand dataset and achieved 95% accuracy compared with our model which
utilized 600 dataset and achieved 94.66% average CV and 90.56% 准确性. The study conducted by
El-Melegy et al. [28] achieved higher accuracy (I.e., 98.4%) but achieved lower sensitivity ((I.e., 85.1%)
compare to our model (97.78% 为了 70:30 split and 98.33% average sensitivity). The study conducted by
Ibrahim et al. [23] achieved higher result (98.73% 准确性, 98.59% sensitivity and 98.84% specificity).
This can be attributed to training pretrained AlexNet with over 2000 images compare to our study with 600

数据智能

19

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

.

/

t

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

图片. The result obtained by Xiong et al. [5] (97% sensitivity and 83.65% specificity) perform lower than
our model in terms of sensitivity and specificity. Our model outperforms the result obtained by Muyama
等人. [29] 和 86.7% accuracy as shown in table 9.

桌子 9. Comparison of AlexNet Model with state of the art for classifi cation of microscopic slide.

参考

Neural Network

Number of Dataset

[25]
[27]
[24]
[28]
[5]
[29]
[23]
70:30
CV

CNN
支持向量机 & CNN
CNN
CNN
CNN
ResNet
Pretrained AlexNet
Pretrained AlexNet
Pretrained AlexNet

12,636
120
25,000 图片
500 图片
案例: 45
Not specifi ed
2464
600
600

结果

Accuracy

Sensitivity

Specifi city

94%
96.80%
95%
98.4%

86.7%
98.73%
90.56%
94.66%




85.1%
97%

98.59%
97.78%
98.33%



83.65%

98.84%
83.33%
91.00%

4.3.2 Comparison with State of the Art for Chest X-ray Images

The result obtained for general dataset yielded 93.89% testing accuracy, 96.67% testing sensitivity and
91.11% testing specificity and average cross validation result in 94.00% average testing accuracy, 98.33%
average testing sensitivity and 98.33% average testing specificity. By comparing our result with the study
conducted by Klassen et al. [30], our model achieved higher sensitivity and specificity as presented compare
到 87.2% sensitivity and 60% specificity achieved by Klassen and colleagues. The study conducted by
Yahiaoui et al. [31] 和 96.68% accuracy and the study conducted by Chang et al. [33] 和 99.7%
sensitivity and 99.9% specificity achieved better performance than our model. The most realistic comparison
is based on the study conducted by Abbas and Abdelsamea [34] who utilized 662 X-ray images which is
closer to our dataset of 600 X-ray images. 然而, despite the difference of 62 images our model performs
better compare to the use of hybrid model proposed the 2 authors which 90.2% 准确性, 93.85% 灵敏度
和 86.76% specificity

The study conducted by Ibrahim et al. [36] using AlexNet+SVM achieved higher result (98.38%, 98.71%
98.04% 准确性, sensitivity and specificity respectively) compare to our study, this can be attributed with
the use of large number of datasets (IE。, 7371 图片). 而且, the study conducted by Nafisah and
穆罕默德 [37] achieved higher accuracy and average accuracy (99.1% 和 98.7%) compare to our
模型. This result can be attributed to the use of EfficientNetB3 which contains more layers than AlexNet
model as shown in Table 10.

20

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

.

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

桌子 10. Comparison of AlexNet Model with state of the art for classifi cation of Chest X-ray Images.

参考

模型

数据集

[30]

[31]
[33]
[34]
[36]
[37]
70:30
CV

Automated recognition
and pattern analysis
支持向量机
Pretrained AlexNet
Hybrid model
AlexNet+SVM
Effi cientNetB3
Pretrained AlexNet
Pretrained AlexNet

308

150
138
662
7371
1098
600
600

结果

Accuracy/AUC

Sensitivity

Specifi city

87.2%,

60.0%

96.68%
0.998 AUC
90.2%
98.38%
99.1%
93.89%
94.00%


99.7%
93.85%
98.71


96.67%
98.33%


99.9%
86.76%
98.04


91.11%
98.33%

5. 结论

TB is one of the most common diseases that affect the lungs. The disease is very contagious and can
spread from infected patients to healthy ones. 因此, diagnosis of TB is very crucial for early treatment,
prevention and control. Medical expert employs different approaches for the detection of the disease, 一些
of which includes tuberculin test, blood test, microscopic slide sputum smear test, genetic testing and
radiographic imaging. 这 2 common diagnosis of TB include microscopic slide sputum test and chest X-ray
成像. Despite the wide approaches employ by clinicians for the detection TB, it is still limited or
hindered by so many challenges which includes lack of point of point care, low sensitivity, low background
图片, small size of bacilli, the use of toxic chemical reagents, time consuming, tediousness, the need for
trained clinicians.

In order to address some of these challenges, we proposed the use of pretrained AlexNet model which
is a DL model that recognize pattern integrated with classifier for classification of disease into positive and
negative classes. The study employed 2 set of datasets which consist of microscopic slide images and chest
X-ray images obtained from Near East University and Kaggle website respectively. The dataset undergoes
image processing, labelling, splitting and training using Matlab software. The performance evaluation of
the model based on training and testing are assess based on accuracy, sensitivity and sensitivity.

For classification of TB using MS images, t the model achieved 90.56% testing accuracy, 97.78%
sensitivity and 83.33% specificity in the case of 70: 30 splits. In the case of 80:20 split, the model achieved
100% testing accuracy, 100% testing sensitivity and 100% testing specificity. In the case of 90:10 split, 这
model achieved 96.67% testing accuracy, 93.33% testing sensitivity and 100% testing specificity. 在里面
case of CV, the model achieved 94.66% average testing accuracy, 98.33% average testing sensitivity and
91.00% average testing specificity.

For classification of TB using X-ray images, the model achieved 93.89% testing accuracy, 96.67% testing
sensitivity and 91.11% testing specificity in the case of 70: 30 splits. In the case of 80:20 split, 该模型

数据智能

21

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

t

.

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

达到了 96.53% training accuracy, 97.22% training sensitivity, 95.83% training specificity, 94.17% testing
准确性, 98.33% testing sensitivity and 90% testing specificity. In the case of 90:10 split, 该模型
达到了 99.38% training accuracy, 100% training sensitivity, 98.77% training specificity, 98.33% testing
准确性, 100% testing sensitivity and 96.67% testing specificity. In the case of CV, the model achieved
94.00% average testing accuracy, 98.33% average testing sensitivity and 98.33% average testing specificity.
The success of these models on both microscopic slide images and chest X-ray images is in line with the
notion that DL models can be useful for classification and discrimination of diseases into different groups
with high accuracy, precision, sensitivity and specificity.

Some of the limitations of this study include the lack of sufficient datasets, different stained images, 这
use of frontal view posterior X-ray images. 因此, with sufficient amount of dataset with different variations
(I.e., lateral and frontal view) we can expand the work using AlexNet (SoftMax or Support Vector Machine
classifier), DenseNet, inception V3, InceptionResNet V2, MobileNet V2, NashNetmobile, VGG-16, VGG-19
and Xception. 而且, the study can be expanded using ensemble models or hybrid models and the use
of different classifiers and other techniques such as segmentation and data augmentation.

AUTHOR CONTRIBUTION STATEMENT

Abdullahi Umar Ibrahim (Abdullahi.umaribrahim@neu.edu.tr; ORCID: 0000-0003-3850-9921), Curation
of Dataset, Experimental set up and model training, result and discussion; Ayse Gunnay Kibarer (aysegunay.
kibarer@neu.edu.tr), Overview literature/related work and proofreading; Fadi Al-Turjman (fadi.alturjman@
neu.edu.tr; 0000-0001-5418-873X), Overview Introduction and supervised the whole work.

参考

[1] World Health Organization Report on Tuberculosis (2020). Available at https://apps.who.int/iris/bitstream/

handle/10665/329368/9789241565714-eng.pdf?ua=1. Access on 11 九月, 2021

[2] Narasimhan, P。, Wood, J。, MacIntyre, C.R., Mathai, D .: Risk factors for tuberculosis. Pulmonary Medicine

(2013). DOI: https://doi.org/10.1155/2013/828939

[3] Priya, E., 斯里尼瓦桑, S。: Separation of overlapping bacilli in microscopic digital TB images. Biocybernetics

and Biomedical Engineering 35(2), 87–99 (2015). DOI: https://doi.org/10.1016/j.bbe.2014.08.002

[4] Briganti, G。, Le Moine, 奥。: Artificial intelligence in medicine: today and tomorrow. Frontiers in Medicine 7,

27 (2020). DOI: https://doi.org/10.3389/fmed.2020.0002

[5] Xiong, Y。, Ba, X。, Hou, A。, 张, K., 陈, L。, 李, T。: Automatic detection of mycobacterium tuberculosis
using artificial intelligence. Journal of Thoracic Disease 10(3), 1936 (2018). DOI: https://doi.org/10.21037/
jtd.2018.01.91

[6] Doi, K.: Computer-aided diagnosis in medical imaging: historical review, current status and future potential.
Computerized Medical Imaging and Graphics 31(4–5), 198–211 (2007). DOI: https://doi.org/10.1016/
j.compmedimag.2007.02.002

[7] Halalli, B., Makandar, A。: Computer aided diagnosis-medical image analysis techniques. Breast Imaging

85 (2018)

22

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

.

/

/

t

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

[8] 陈, C.M., 周, Y.H., Tagawa, N。, 做, Y。: Computer-aided detection and diagnosis in medical imaging.

Computational and Mathematical Methods in Medicine 2013. DOI: https://doi.org/10.1155/2013/790608

[9] Cicerone, M.T., Camp Jr, C.H.: Potential roles for spectroscopic coherent Raman imaging for histopathology
and biomedicine. Neurophotonics and Biomedical Spectroscopy 547–570 (2019). 爱思唯尔. DOI: https://土井.
org/10.1016/B978-0-323-48067-3.00021-4

[10] Alloghani, M。, Al-Jumeily, D ., Mustafina, J。, et al.: A systematic review on supervised and unsupervised
machine learning algorithms for data science. Supervised and Unsupervised Learning for Data Science 3–21
(2020). DOI: https://doi.org/10.1007/978-3-030-22475-2_1

[11] Paiva, J.S., Cardoso, J。, 佩雷拉, T。: Supervised learning methods for pathological arterial pulse wave
differentiation: a SVM and neural networks approach. International Journal of Medical Informatics 109,
30–38 (2018). DOI: https://doi.org/10.1016/j.ijmedinf.2017.10.011

[12] Helwan, A。, Abiyev, R。: Shape and texture features for the identification of breast cancer. 在诉讼程序中

the world congress on engineering and computer science, 卷. 2, PP. 19–21 (十月 2016)

[13] Abiyev, R.H., Ma’aitaH, M.K.S.: Deep convolutional neural networks for chest diseases detection. 杂志

Healthcare Engineering (2018). DOI: https://doi.org/10.1155/2018/4168538

[14] Mnih, A。, 欣顿, G.E.: A scalable hierarchical distributed language model. 在: Proceedings of the 21st

International Conference on Neural Information Processing Systems, PP. 1081–1088 (2008)

[15] Simonyan, K., Zisserman, A。: Very deep convolutional networks for large-scale image recognition. arXiv

preprint arXiv:1409.1556 (2014)

[16] 他, K., 张, X。, Ren, S。, Sun, J。: Deep residual learning for image recognition. In Proceedings of the IEEE

conference on computer vision and pattern recognition, PP. 770–778 (2016)

[17] 克里热夫斯基, A。, 吸勺, 我。, 欣顿, G.E.: Imagenet classification with deep convolutional neural networks.

Advances in Neural Information Processing Systems 25 (2012)

[18] Aloysius, N。, Geetha, M。: A review on deep convolutional neural networks. 在: 2017 international conference
on communication and signal processing (ICCSP), PP. 0588–0592 (2017). IEEE. DOI: https://doi.org/10.1109/
ICCSP.2017.8286426

[19] 梁, J。, 刘, R。: Stacked denoising autoencoder and dropout together to prevent overfitting in deep neural
网络. 在: 2015 8th international congress on image and signal processing (CISP), PP. 697–701 (2015).
IEEE. DOI: https://doi.org/10.1109/CISP.2015.7407967

[20] Han, X。, Zhong, Y。, 曹, L。, 张, L。: Pre-trained alexnet architecture with pyramid pooling and supervision
for high spatial resolution remote sensing image scene classification. Remote Sensing 9(8), 848 (2017). DOI:
https://doi.org/10.3390/rs9080848

[21] Raghu, M。, 张, C。, Kleinberg, J。, 等人。: Transfusion: Understanding transfer learning for medical imaging.

Advances in Neural Information Processing Systems 32 (2019)

[22] Tsai, K.S., 张, H.L., Chien, S.T., 陈, K.L., 陈, K.H., Mai, M.H., et al.: Childhood tuberculosis:
epidemiology, diagnosis, treatment, and vaccination. Pediatrics & Neonatology 54(5), 295–302 (2013). DOI:
https://doi.org/10.1016/j.pedneo.2013.01.019

[23] Ibrahim, A.U., Guler, E., Guvenir, M。, et al: Automated detection of Mycobacterium tuberculosis using
transfer learning. The Journal of Infection in Developing Countries 15(05), 678–686 (2021). DOI: https://土井.
org/10.3855/jidc.13532

[24] 史密斯, K.P., Kang, A.D., Kirby, J.E.: Automated interpretation of blood culture gram stains by use of a deep
convolutional neural network. Journal of Clinical Microbiology 56(3), e01521–17 (2018). DOI: DOI: https://
doi.org/10.1128/JCM.01521-17

[25] 汗, M.T., Kaushik, A.C., 吉, L。, Malik, S.I., Ali, S。, Wei, D.Q.: Artificial neural networks for prediction of
tuberculosis disease. Frontiers in Microbiology 10, 395 (2019). DOI: https://doi.org/10.3389/fmicb.2019.
00395

数据智能

23

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

.

/

t

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

[26] Panicker, R.O., Kalmady, K.S., Rajan, J。, Sabu, M.K.: Automatic detection of tuberculosis bacilli from
microscopic sputum smear images using deep learning methods. Biocybernetics and Biomedical Engineering
38(3), 691–699 (2018). DOI: https://doi.org/10.1016/j.bbe.2018.05.007

[27] Costa Filho, C.F.F., 征收, P.C., Xavier, C.D.M., Fujimoto, L.B.M., Costa, M.G.F.: Automatic identification
of tuberculosis mycobacterium. Research on Biomedical Engineering 31, 33–43 (2015). DOI: https://土井.
org/10.1590/2446-4740.0524

[28] El-Melegy, M。, Mohamed, D ., ElMelegy, T。: Automatic detection of tuberculosis bacilli from microscopic
sputum smear images using faster r-cnn, transfer learning and augmentation. In Iberian Conference on Pattern
Recognition and Image Analysis, PP. 270–278 (七月 2019). 施普林格, 占婆.

[29] Muyama, L。, Nakatumba-Nabende, J。, Mudali, D .: Automated detection of tuberculosis from sputum smear
microscopic images using transfer learning techniques. In International Conference on Intelligent Systems
Design and Applications, PP. 59–68 (十二月 2019). 施普林格, 占婆. DOI: https://doi.org/10.1007/978-
3-030-49342-4_6

[30] Klassen, V.I., Safin, A.A., Maltsev, A.V., Andrianov, N.G., Morozov, S.P., Vladzymyrskyy, A.V.: AI-based
screening of pulmonary tuberculosis: diagnostic accuracy. Journal of eHealth Technology and Application
16(1), 28–32 (2018)

[31] Yahiaoui, A。, Er, 奥。, Yumuşak, N。: A new method of automatic recognition for tuberculosis disease diagnosis

using support vector machines Biomedical Research 28(9), 4208–4212 (2017)

[32] A hsan, M。, Gomes, R。, 丹顿, A。: Application of a convolutional neural network using transfer learning
for tuberculosis detection. 在: 2019 IEEE International Conference on Electro Information Technology (EIT),
IEEE, PP. 427–433 (2019)

[33] 张, R.I., Chiu, Y.H., 林, J.W.: Two-stage classification of tuberculosis culture diagnosis using convolutional
neural network with transfer learning. The Journal of Supercomputing 76(11), 8641–8656 (2020). DOI:
https://doi.org/10.1007/s11227-020-03152-x

[34] Abbas, A。, Abdelsamea, M.M.: Learning transformations for automated classification of manifestation of
tuberculosis using convolutional neural network. 在: 2018 13th International Conference on Computer
Engineering and Systems (ICCES), IEEE, PP. 122–126 (2018)

[35] Sahlol, A.T., Abd Elaziz, M。, Tariq Jamal, A。, 等人。: A novel method for detection of tuberculosis in chest
radiographs using artificial ecosystem-based optimisation of deep neural network features. Symmetry 12(7),
1146 (2020). DOI: https://doi.org/10.3390/sym12071146

[36] Ibrahim, A.U., Al-Turjman, F。, Ozsoz, M。, Serte, S。: Computer aided detection of tuberculosis using two
classifiers. Biomedical Engineering/Biomedizinische Technik 67(6), 513–524 (2022). DOI: https://doi.org/
10.1515/bmt-2021-0310

[37] Nafisah, S.I., 穆罕默德, G。: Tuberculosis detection in chest radiograph using convolutional neural network
architecture and explainable artificial intelligence. Neural Computing and Applications 1–21 (2022). DOI:
https://doi.org/10.1007/s00521-022-07258-6

[38] Ghojogh, B., Crowley, M。: The theory behind overfitting, cross validation, regularization, bagging, 和

boosting: tutorial. arXiv 预印本 arXiv:1905.12787 (2019)

[39] 国王, R.D., Orhobor, O.I., 泰勒, C.C.: Cross-validation is safe to use. Nature Machine Intelligence 3(4),

276–276 (2021). DOI: https://doi.org/10.1038/s42256-021-00332-z

[40] Prashanth, D.S., Mehta, R.V.K., 夏尔马, N。: Classification of Handwritten Devanagari Number–An analysis
of Pattern Recognition Tool using Neural Network and CNN. Procedia Computer Science 167, 2445–2457
(2020). DOI: https://doi.org/10.1016/j.procs.2020.03.297

24

数据智能

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

.

/

t

/

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

作者简介

Abdullahi Umar Ibrahim was born in Zaria, Kaduna state on the 25th
of October 1989. He studied at Nigerian Institute of Science and leather
technology Zaria to obtain both OND and HND in Laboratory Science
技术. He served at General Hospital Mina Niger state for 1 年. 他
studied MSc in Bioengineering at Cyprus International university and worked
as Student Assistant at the university’s information center. He completed his
Doctoral degree in Biomedical Engineering and also worked as a research
Assistant in the same department. He worked at Kaduna State University as
a laboratory technology. 现在, he is an Assistant professor and also the
vice chairman in Biomedical Engineering. His research interest is related to
CRISPR as genetic engineering tool and application of Artificial Intelligence
in Medicine.

Prof. 博士. Ayse Günay Kibarer received her BSc from Middle East Technical
大学 (METU), Department of Chemistry in 1979. She completed her
MSc in 1982. She was awarded with Fulbright Scholarship in 1983 并且是
invited by the late Prof. William J. Bailey to the University of Maryland.
学院公园, US to participate in his working group for her PhD studies. 她
returned to METU in 1984 and completed her PhD at METU in 1989. 她
stayed in the same department and was appointed as Assist. Prof. in the newly
founded major branch of Biotechnology at Hacettepe University, Department
of Biology. After receiving her associate professorship, she was invited by the
chair of the Department of Chemistry at the same university in 1997 和
continued her studies. 在 2008, she was invited as a visiting professor from
the University of Akron, 哦, 我们. 最近, she has been appointed as a full-
time professor by Near East University (2018) and has started working in the
Department of Biomedical Engineering. Her main research interests are cold
plasma and gold nanoparticles for cancer treatment, immobilization of
microorganisms to produce enzymes, enzyme immobilization, architectural
synthesis of microcarriers via raft polymerization technique, preparation of
nanocomposites for antitumor activity and design of nanocomposite
adhesives in solid melt working within a wide range of temperature for space
applications.

数据智能

25

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

/

/

t

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

t

/

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

Uncorrected Proof

Computer-aided Detection of Tuberculosis from Microbiological and Radiographic Images

Prof. 博士. Fadi Al-Turjman received his Ph.D. in computer science from
Queen’s University, 加拿大, 在 2011. He is a full professor and a research
center director at Near East University, 尼科西亚, 塞浦路斯. Prof. Al-Turjman is
a leading authority in the areas of smart/intelligent IoT systems, 无线的, 和
mobile networks’ architectures, protocols, deployments, and performance
evaluation in Artificial Intelligence of Things (AIoT). His publication history
spans over 350 SCI/E publications, in addition to numerous keynotes and
plenary talks at flagship venues. He has authored and edited more than 40
books about cognition, 安全, and wireless sensor networks’ deployments
in smart IoT environments, which have been published by well-reputed
publishers such as Taylor and Francis, 爱思唯尔, IET, and Springer. He has
received several recognitions and best papers’ awards at top international
conferences. He also received the prestigious Best Research Paper Award
from Elsevier Computer Communications Journal for the period 2015–2018,
in addition to the Top Researcher Award for 2018 at Antalya Bilim University,
Turkey. Prof. Al-Turjman has led a number of international symposia and
workshops in flagship communication society conferences. 现在, 他
serves as book series editor and the lead guest/associate editor for several
top tier journals, including the IEEE Communications Surveys and Tutorials
(IF 23.9) and the Elsevier Sustainable Cities and Society (IF 5.7), 此外
to organizing international conferences and symposiums on the most up to
date research topics in AI and IoT.

D

w
n

A
d
e
d

F
r


H

t
t

p

:
/
/

d

r
e
C
t
.


t
.

e
d

d
n

/

t
/

A
r
t

C
e

p
d

F
/

d


/

t

/

/

.

1
0
1
1
6
2
d
n
_
A
_
0
0
1
9
8
2
0
7
2
3
9
2
d
n
_
A
_
0
0
1
9
8
p
d

.

/

t

F


y
G

e
s
t

t


n
0
7
S
e
p
e


e
r
2
0
2
3

26

数据智能

Uncorrected ProofRESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image
RESEARCH PAPER image

下载pdf