Original Article 1

26
Original Article Image Technology Based Detection of Infected Shrimp in Adverse Environments Thi Thi Zin 1,* , Takehiro Morimoto 1 , Naraid Suanyuk 2 , Toshiaki Itami 3 and Chutima Tantikitti 2 1 Department of Electrical and Systems Engineering, Faculty of Engineering, University of Miyazaki, Miyazaki 889-2192, Japan 2 Aquatic Science and Innovative Management Division, Faculty of Natural Resources, Prince of Songkla University, Songkhla 90110, Thailand 3 Department of Marine Bio-Science, Faculty of Life Science and Biotechnology, Fukuyama University, Fukuyama, Hiroshima 7290292, Japan * Corresponding author, [email protected] Abstract In recent years, countries around Japan and especially in Southeast Asia, white spot disease (WSD) is highly infectious and severely damages shrimp aquaculture. At the same time, the various diseases are occurring in shrimp farms. In the early stages of infection, shrimp shows three abnormal behaviors: (1) they appear in the shallow waters of the farm, (2) they do not move and do not eat even when feeding, and (3) they suddenly stop moving. Currently, infected shrimps are found by visual inspection, which places a burden on the farmers and delays the discovery. Therefore, in this paper, we proposed a system for detecting infected shrimp by using image processing technology in order to eliminate the delay of discovery and reduce the burden of farmers. According to our experimental results, the proposed system has 95% precision, 100% recall rate and accuracy of 96.4% by using hold-out evaluation method. Keywords: Infected Shrimp Detection, Image Processing Techniques, Shrimp Feeding Behaviors, Artificial Sea Water Manuscript 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Transcript of Original Article 1

Page 1: Original Article 1

Original Article

Image Technology Based Detection of Infected Shrimp in Adverse Environments

Thi Thi Zin1,*, Takehiro Morimoto1, Naraid Suanyuk2, Toshiaki Itami3 and

Chutima Tantikitti2

1Department of Electrical and Systems Engineering, Faculty of Engineering,

University of Miyazaki, Miyazaki 889-2192, Japan

2Aquatic Science and Innovative Management Division, Faculty of Natural Resources,

Prince of Songkla University, Songkhla 90110, Thailand

3Department of Marine Bio-Science, Faculty of Life Science and Biotechnology,

Fukuyama University, Fukuyama, Hiroshima 7290292, Japan

* Corresponding author, [email protected]

Abstract

In recent years, countries around Japan and especially in Southeast Asia, white

spot disease (WSD) is highly infectious and severely damages shrimp aquaculture. At the

same time, the various diseases are occurring in shrimp farms. In the early stages of

infection, shrimp shows three abnormal behaviors: (1) they appear in the shallow waters

of the farm, (2) they do not move and do not eat even when feeding, and (3) they suddenly

stop moving. Currently, infected shrimps are found by visual inspection, which places a

burden on the farmers and delays the discovery. Therefore, in this paper, we proposed a

system for detecting infected shrimp by using image processing technology in order to

eliminate the delay of discovery and reduce the burden of farmers. According to our

experimental results, the proposed system has 95% precision, 100% recall rate and

accuracy of 96.4% by using hold-out evaluation method.

Keywords: Infected Shrimp Detection, Image Processing Techniques, Shrimp Feeding

Behaviors, Artificial Sea Water

Manuscript

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 2: Original Article 1

1. Introduction

In recent years, the cultivation of whiteleg shrimp has become popular in countries

around Japan and especially in Southeast Asia. It is said that 3/4 of the shrimp produced

in the world are whiteleg shrimp. The growing period of black tiger shrimp is about 5

months while the growing period of whiteleg shrimp is about 3 months. The production

efficiency of whiteleg shrimp is good because it took about a month to grow (Sea food

aquarium, 2018). About 77.9% of whiteleg shrimp farming production is in Asia while

the rest is produced from the Americas (Maeda, 2014). The profitability is the main reason

behind shrimp farming industry and it is important to control various diseases that can

occur at shrimp farms to maintain the production rate (Asche et al., 2020).

Due to the high-density culture in shrimp production, various diseases occur in

shrimp farms (Inada, Mekata, & Itami, 2017). Among them, White spot disease (WSD)

is causing enormous damage and high mortality rate in production of various types of

shrimp (Debnath, Karim, Keus, Mohan, & Belton, 2016; Rodríguez et al., 2003). The

WSD was caused by White Spot Syndrome Virus (WSSV) and it is the most destructive

disease in shrimp farming industry (Millard et al., 2020). The WSD infected shrimp can

reach 100% mortality in 3–7 days causing significant economic losses to the shrimp

farming industry (Ramos-Carreño et al., 2014; Zhu, Twan, Tseng, Peng, & Hwang,

2019). The infected shrimp showed abnormal behaviors such as appear in the shallow

area of the farm, stop eating food and suddenly stop moving (Morimoto, 2018; Seike,

2019). The WSD is also equivalent to penaeid acute viremia (PAV) which has serious

impact on both shrimp farming industry and hatchery production in the Americas and

Southeast Asia countries (Satoh, 2012). The WSSV is sometimes misdiagnosed as yellow

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 3: Original Article 1

head virus (YHV) because of similarity structure between these two viruses (Pantoja &

Lightner, 2003).

The infection with WSD is characterized by white spots on the exoskeleton of the

infected shrimp. The WSD transmission can spread out by following ways: (i)

cannibalism between shrimp, (ii) transmission from parent shrimp and (iii) waterborne

infection. There is no effective cure because it is caused by viral infection hence, early

detection of infected shrimp is important. Therefore, we proposed a system for detection

of infected and non-infected shrimp based on the shrimp behavior in the aquarium. The

rest of the paper is organized as follows: section 2 presents the materials and methods

used in the proposed system, section 3 describes experimental environments and section

4 describes results and discussions. Finally, the conclusions and future work are described

in section 5.

2. Materials and Methods

In this paper, we proposed a system for detection of infected and non-infected

shrimp based on the shrimp behavior in the aquarium. We focused on the abnormal

behavior of infected shrimp not eating food. Basically, the infected shrimp are staying away

from food even feeding (Sawachika, 2017). Food was placed in the container and border

was covered with tape. The proposed system consisted of three functional modules: (i)

extraction of feeding area (ii) feeding confirmation of shrimp and (iii) infected shrimp

detection. The system flow diagram of proposed system is shown in Figure 1.

2.1 Extraction of feeding area

The image without containing shrimps was taken as background image and it was

converted from RGB (Red, Green and Blue) to HSV (Hue, Saturation and Value) color

space. This color space conversion from RGB to HSV can be done by using following

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 4: Original Article 1

equations. We used MATLAB programming language to make conversion process from

RGB to HSV.

},,max{max BGRI (1)

},,min{min BGRI (2)

maxIV (3)

minminmax )( IIIS (4)

BIII

GR

GIII

RB

RIII

BG

H

max

minmax

max

minmax

max

minmax

if , 3

4

3

if , 3

2

3

if ,3

(5)

In these equations, the I is the intensity values of input image values. This color

space conversion process is shown in Figure 2(a) and 2(b). And then, this image was a

threshold into binary image for feeding area extraction. After feeding area was extracted,

image preprocessing steps such as noise removing and morphological operations

(Masatoshi, 2016) were performed. Then, the filling process (Soille, 1999) was made on

this binary image to fill the hole region for getting food region area. This process is shown

in Figure 2(c) and 2(d).

2.2 Feeding confirmation of shrimp

The shrimp comes to feeding area to eat. When shrimp comes to this area, the

shape of the background subtraction image changed. To detect shrimp, the current frame

was subtracted from the background image. Finally, the XOR (exclusive OR) operation

was performed between the resulted image and the background image to extract the

shrimp. The input image and background subtracted image is illustrated in Figure 3(a)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 5: Original Article 1

and 3(b) and the XOR operation between background image and background subtracted

image is shown in Figure 3(c).

This process was done frame by frame and we could detect the existence or

absence of shrimp in food region. After XOR operation, some noise may contain in the

result image. We used morphology operation to eliminate noise contained in the image.

This process is shown in Figure 4.

2.3 Infected shrimp detection

To distinguish infected and non-infected shrimp, we used feeding behavior as a

feature. The number of visits and staying time in the feeding area are recorded for each

shrimp. Basically, the characteristic of infected shrimp is that they are not interested in

food and keep away from food area even though feeding (Morimoto, Zin, & Itami, 2018;

Morimoto, 2020). The threshold values are set for visit and stay time at food region area

to distinguish infected and non-infected shrimp. The effective feeding is regarded as the

shrimp stays for a certain period of time. We have total of 32 recorded videos. From these

videos, we used 4 videos of non-infected shrimp data as training data and the optimal

threshold values are calculated. This information is shown in Table 1. From the training

data, the least number of visits and eating time spent in food region is searched and these

values are set as threshold value.

From the training data, the optimal threshold value is chosen as Tvisit = 2 which is

the least number of time that the shrimp come to food region. In addition, the minimum

number of average stay frame (TavgFrame) for shrimp is chosen as TavgFrame = 12. We used

effective feeding (ET) as a feature to classify whether the shrimp is infected or non-

infected as shown in equation 6. The ET value is incremented if the conditions are

satisfied.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 6: Original Article 1

otherwise,

)T frame stay of (number and )Tvisit of (number if ,ET

avgFramevisit

0

1 (6)

If the final ET value is less than two, the system determined the shrimps are

infected with virus by using the following equation.

otherwise,infectedNon

)ET(if,InfectedResult

2 (7)

3. Experiment Environment

In this paper, the experiments were performed at the Aquatic Science and

Innovative Management Division, Faculty of Natural Resources, Prince of Songkla

University, Thailand. The total of 9 aquaria or tanks were prepared for experiments. The

size of each aquarium has a dimension of 60 × 40 × 40 cm and the overhead camera is

setup. We randomly selected the white leg shrimp raised in the Prince of Songkla

University and put 3 shrimps in each aquarium. Prior to use the shrimp was confirmed to

be WSSV free by PCR. After that, artificial injection of WSSV were conducted. The size

of shrimp is approximately between 10 and 12 grams. A commercial shrimp feed was

used in this experiment. The three aquariums, T1R1 to T1R3 contained artificial sea water

with non-infected shrimp. The T2R1 to T2R3 aquaria contained artificial sea water with

infected shrimp. The T3R1 to T3R3 aquaria were set up with farm water and infected

shrimps. The farm water was taken from shrimp farm in Nakhon Si Thammarat Province,

Kingdom of Thailand. If the experiment was carried out in a situation where the salt

concentration was different between the farm water and the artificial sea water, the correct

result could not be obtained. So, the experiment was conducted with the same salt

concentration. The salinity of the water is 30 ppt.

The Penaeus vannamei (whiteleg shrimp), the main cultured species in Southeast

Asia, was used. The experiment period was from 12th to 19th September, 2019. Feeding

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 7: Original Article 1

was made three times a day (8:30 am, 12:30 pm and 4:30 pm). The video recording was

performed twice a day (8:30 am, 12:30 pm) 5 minutes after feeding was made. The total

of 32 videos are recorded and 4 videos are used as training data and remaining 28 videos

are used as testing data. The Figure 5 showed the experimental environment and setup.

The camera used in this experiment was MUSON MC2 Pro1 with resolution of

480 × 640 pixels. The processed frame rate was 1 fps (frame per second). Each recorded

video has 300 frames. We calculated the ET value till the end of each video and calculated

the one final ET value for each video. The information of testing data used in the

experiment is shown in Table 2. The evaluation in this experiment was performed under

the following conditions. When the shrimp has stayed in feeding area for 12 seconds (12

frames) or less, the effective number of feedings was 1 or less. When the above conditions

were met, the shrimp in the aquarium were to be infected with the disease. The threshold

value, ET was set with reference to the value from the training data.

4. Results and Discussions

The number of testing data used in the experiment was 9 for non-infected shrimp

and 19 for infected shrimp (10 of which were farm water). The experimental results on

the 3rd day of recorded video of non-infected shrimp at aquarium T1R1 is shown in Figure

6 and detailed information are described in Table 3. The number of staying frames in

feeding area are 33, 9, 19 and 7 and effective number of feeding is 2 times. Therefore,

this data is determined to be non-infected condition.

According to research data, the infected shrimp appeared their symptoms starting

from 2 or 3 days. Therefore, we generally choose the data at 3rd day to illustrate the

experimental condition. The experimental results on the 3rd day of recorded video of

infected shrimp at aquarium T2R2 is shown in Figure 7 and detailed information are

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 8: Original Article 1

described in Table 4. Even though the shrimp visited feeding area twice, the shrimp did

not stay in the feeding area sufficiently and so the effective number of feeding was zero.

Therefore, this day was classified infected condition by the system.

The experimental results on the 3rd day of recorded video of infected shrimp at

aquarium T3R1 is shown in Figure 8 and detailed information are described in Table 5.

In Table 5, the effective number of feeding count was zero because shrimps never visited

the feeding area. By comparing the results with the data of non-infected shrimp and

infected shrimp taken at the same time on the same day, there was a tendency for a large

difference in the number of visits and the number of stay frames. Therefore, the

characteristic that infected shrimp became less eating was remarkable from the results of

experiment. Since the effective number of feedings was zero time and the system

determined as infected condition.

In order to clarify the cause of the death of shrimp, the PCR (Polymerase Chain

Reaction) test was performed with the cooperation of Aquatic Science and Innovative

Management Division, Faculty of Natural Resources, Prince of Songkla University. The

PCR test was to check for the presence of pathogens that cannot be seen with a microscope

such as a virus. It is a test method that detects by amplifying the DNA of the pathogen, a

reliable diagnosis can then be made. As a result of PCR examination, WSD was the cause

of death for all shrimp except one shrimp. White spots were formed on the outer shell of

infected shrimp. The sample image of white spots found in the death shrimp is shown in

Figure 9.

The Table 6 shows the processing results and accuracy of the data used in this

experiment. The system could correctly identify 27 out of 28 data. As for the data of

infected shrimp, all the data could be accurately identified in both artificial seawater and

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 9: Original Article 1

farm water. To evaluate our proposed system, we calculated precision, recall and F1 score

by using the following equations:

FPTP

TP Precision

(8)

FNTP

TPRecall

(9)

lRecalPrecision

RecallPrecisionF1

2 (10)

where, TP = true positive, FP = false positive and FN = false negative

Our proposed system obtained 95% precision, 100% recall rate and F1 score of

0.97. Overall, the proposed system has an accuracy of 96.4%.

According to the literature survey, most of the experiments are processed on

single captured image that is outside of water environment but our experiments are

performed on sequences of image data which were operated in underwater environment.

The strength of our system is that it directly monitored the shrimp behaviors to identify

whether the shrimp is infected with virus or not. To the best of our knowledge, our

proposed system is the first study to implement about monitoring system for infected

shrimp detection using image sequences in underwater environment.

5. Conclusions and Future Work

In this study, we proposed a system for detecting infected shrimp by using image

processing technology. In the proposed method, we focused on the characteristic that

shrimp infected with the disease did not approach the food and did not move to the food

area. The infected shrimp and non-infected were identified based on the number of visits

and the staying time in feeding area. As a result of this experiment, the proposed system

correctly identified 27 shrimps out of 28 samples and having the accuracy of 96.4%. The

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 10: Original Article 1

system correctly identified on infected shrimp for both artificial sea water and farm water

condition. Therefore, the proposed system will be applicable and useful in shrimp farms.

For the future works, the experiment will make on different environment with various

conditions of shrimps such as infected and non-infected shrimp will be mixed.

Acknowledgments

This research was partially supported by Grant of Fukuyama University, Japan.

References

Asche, F., Anderson, J.L., Botta, R., Kumar, G., Abrahamsen, E.B., Nguyen, L.T., &

Valderrama, D. (2020). The economics of shrimp disease. Journal of Invertebrate

Pathology, p. 107397. doi: 10.1016/j.jip.2020.107397

Debnath, P.P., Karim, M., Keus, H.J., Mohan, C.V., & Belton, B. (2016). Effects of white

spot disease and bio-security on shrimp farming in Bangladesh. Fish Pathology,

51(Special-issue), S60-S65. doi: 10.3147/jsfp.51.S60

Inada, M., Mekata, T., & Itami, T. (2017). White spot disease: WSD (= penaeid acute

viremia: PAV). Gyobyo Kenkyu= Fish Pathology, 52(3), 115–120. doi:

10.3147/jsfp.52.115

Maeda, K. (2014). A histopathological study of whiteleg shrimp diagnosed with EMS

(Master Thesis, Tokyo University of Marine Science and Technology)

(Japanese).

Masatoshi, O. (2016). “Digital Image Processing”, Image Information Education

Promotion Association, pp. 52.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 11: Original Article 1

Millard, R. S., Ellis, R.P., Bateman, K.S., Bickley, L.K., Tyler, C.R., van Aerle, R., &

Santos, E.M. (2020). How do abiotic environmental conditions influence shrimp

susceptibility to disease? A critical analysis focussed on White Spot Disease.

Journal of Invertebrate Pathology, p. 107369. doi: 10.1016/j.jip.2020.107369

Morimoto, T., Zin, T.T., & Itami, T. (2018). A Study on Abnormal Behavior Detection

of Infected Shrimp. Proceedings of the IEEE 7th Global Conference on

Consumer Electronics (GCCE), 291–292. doi: 10.1109/GCCE.2018.8574860

Morimoto, T. (2018). A study on Abnormal Behavior Detection of Infected Shrimp

(Graduation Thesis, University of Miyazaki, Japan) (Japanese).

Morimoto, T. (2020). A study on detection of infected shrimp in adverse environment

(Master Thesis, University of Miyazaki, Japan) (Japanese).

Pantoja, C.R., & Lightner, D.V. (2003). Similarity between the histopathology of white

spot syndrome virus and yellow head syndrome virus and its relevance to

diagnosis of YHV disease in the Americas. Aquaculture, 218(1-4), 47-54. doi:

10.1016/S0044-8486(02)00421-0

Ramos-Carreño, S., Valencia-Yáñez, R., Correa-Sandoval, F., Ruíz-García, N., Díaz-

Herrera, F., & Giffard-Mena, I. (2014). White spot syndrome virus (WSSV)

infection in shrimp (Litopenaeus vannamei) exposed to low and high

salinity. Archives of virology, 159(9), 2213–2222. doi: 10.1007/s00705-014-

2052-0

Rodríguez, J., Bayot, B., Amano, Y., Panchana, F., De Blas, I., Alday, V., & Calderon, J.

(2003). White spot syndrome virus infection in cultured Penaeus vannamei

(Boone) in Ecuador with emphasis on histopathology and ultrastructure. Journal

of Fish Disease, 26(8), 439–450. doi: 10.1046/j.1365-2761.2003.00483.x

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 12: Original Article 1

Satoh, J. (2012). Studies on prevention measure of white spot disease of kuruma shrimp

Marsupenaeus japonicus. Bulletin of Fisheries Research Agency, (36), 57–106.

Sawachika, Y. (2017). A Study of Detecting Sick Early by Abnormal Behavior of Shrimps

(Graduation Thesis, University of Miyazaki, Japan) (Japanese).

Seafood aquarium. (2018, June 28). Ecology of Whiteleg shrimp seasonal produce.

(Japanese). Retrieved from https://kaisen-aquarium.com/banameiebi-847/

Seike, M. (2019). Research on detection of white spot disease of shrimp using image

processing (Graduation Thesis, University of Miyazaki, Japan) (Japanese).

Soille, P. (1999). Morphological Image Analysis: Principles and Applications, Springer-

Verlag, 173–174.

Zhu, F., Twan, W.H., Tseng, L.C., Peng, S.H., & Hwang, J.S. (2019). First detection of

white spot syndrome virus (WSSV) in the mud shrimp Austinogebia edulis in

Taiwan. Scientific Reports, 9(1), 1–7. doi: 10.1038/s41598-019-54837-0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 13: Original Article 1

Figure 1. System flow diagram of the proposed system.

(a) (b)

(c) (d)

Figure 2: (a) Original RGB image, (b) HSV image, (c) Binary image after threshold,

(d) Binary image after filling process

Infected shrimp

detection

Feeding confirmation

of shrimp

Extraction of

feeding area

Input image

Figure

Page 14: Original Article 1

(a) (b)

(c)

Figure 3 (a) Input image, (b) Background subtracted image, (c) The XOR operation

result image.

Figure 4: The final process of shrimp extraction.

A B Z

0 0 0

1 0 1

0 1 1

1 1 0

A: background image

B: background subtracted image

Z: image result

Page 15: Original Article 1

(a) (b)

(c) (d) (e)

Figure 5 (a) Experiment environment, (b) Diagram of experimental environment,

(c) Camera setup, (d) Artificial seawater and (e) Farm water

Figure 6: The information of T1R1 aquarium.

shrimp

Camera

60 cm

40 cm

40 cm

0

1

2

3

4

5

6

0 60 120 180 240 300

Num

ber

of

vis

its

(tim

es)

Frame (s)

T1R1 Day3 afternoon

Number of visits

Effective number of feedings

Page 16: Original Article 1

Figure 7: The information of T2R2 aquarium.

Figure 8: The information of T3R1 aquarium.

0

1

2

3

4

5

6

0 60 120 180 240 300

Num

ber

of

vis

its

(tim

es)

Frame (s)

T2R2 Day3 afternoon

Number of visits

Effective number of feedings

0

1

2

3

4

5

6

0 60 120 180 240 300

Nu

mb

er o

f v

isit

s (t

imes

)

Frame (s)

T3R1 Day3 afternoon

Effective number of feedings

Number of visits

Page 17: Original Article 1

Figure 9. The typical white spots on the carapace of the infected shrimp.

Page 18: Original Article 1

Table 1. Training data information

Name Number of

visits (times)

Number of stay frame

in feeding area (frame)

Average number of

stay frame (frame)

Day1 T1R3 2 18, 34 26

Day2 T1R3 2 3, 39 21

Day3 T1R3 6 5, 6, 9, 14, 16, 21 11.8

Day4 T1R3 5 3, 11, 14, 15, 26 13.8

Table 2. Testing data information

Aquarium Number of data

(video)

Resolution

(pixel)

Shooting time

(seconds)

T1 R1 4

480 × 640 300

R2 5

T2 R2 4

R3 5

T3 R1 4

R3 6

Table 3. Total number of visits and eating on feeding area at T1R1 and T1R2

Aquarium NV ET NSF Result

T1

R1

Day 3 afternoon 4 2 33,9,19,7 Non-infected

Day 4 afternoon 5 2 7,7,29,5,26 Non-infected

Day 6 morning 7 4 28,4,3,83,44,4,21 Non-infected

Day 7 morning 7 2 6,27,31,4,3,4,9 Non-infected

R2

Day 2 morning 4 2 7,6,12,92 Non-infected

Day 3 afternoon 4 2 11,3,21,12 Non-infected

Day 4 afternoon 5 2 3,11,56,3,65 Non-infected

Day 6 afternoon 2 1 14,120 Infected

Day 7 morning 3 3 14,19,139 Non-infected

NV: Number of visits (times), ET: Effective number of feeding (times), NSF: Number of stay frame in

feeding area (frame)

Table

Page 19: Original Article 1

Table 4. Total number of visits and eating on feeding area at T2R2 and T2R3

Aquarium NV ET NSF Result

T2

R2

Day 2 morning 3 0 5,4,3 Infected

Day 3 afternoon 2 0 4,3 Infected

Day 4 afternoon 1 1 16 Infected

Day 6 morning 1 0 5 Infected

R3

Day 2 morning 3 0 4,3,4 Infected

Day 3 afternoon 2 0 6,9 Infected

Day 4 afternoon 1 0 5 Infected

Day 6 morning 1 0 3 Infected

Day 7 morning 1 0 3 Infected

NV: Number of visits (times), ET: Effective number of feeding (times), NSF: Number of stay frame in

feeding area (frame)

Table 5. Total number of visits and eating on feeding area at T3R1 and T3R3

Aquarium NV ET NSF Result

T3

R1

Day 3 afternoon 0 0 0 Infected

Day 4 afternoon 0 0 0 Infected

Day 6 morning 1 1 26 Infected

Day 7 morning 2 0 5,6 Infected

R3

Day 2 morning 4 1 7,7,5,22 Infected

Day 3 afternoon 1 1 12 Infected

Day 4 afternoon 3 1 3,7,33 Infected

Day 5 afternoon 0 0 0 Infected

Day 6 morning 0 0 0 Infected

Day 7 morning 0 0 0 Infected

NV: Number of visits (times), ET: Effective number of feeding (times), NSF: Number of stay frame in

feeding area (frame)

Page 20: Original Article 1

Table 6. Accuracy of the proposed system

Aquarium Number of data (video) Correct Accuracy (%)

T1 9 8 88.8

T2 9 9 100

T3 10 10 100

Total 28 27 96.4

T1: Non-infected shrimp, T2: Infected shrimp in artificial sea water, T3: Infected shrimp in farm

water

Page 21: Original Article 1

Authors Reply to Reviewer 3 Comments

We would like to thank you for your valuable comments and suggestions to make our paper

improvements.

Comment 1: The authors responded to reviewers' comments very well. Necessary corrections

have been made. However, I would like the authors to add performance measure details in the

abstract to improve the completeness. i.e. [In the abstract] the authors should mention accuracy,

sensitivity, ... etc.

In addition, the authors should mention in the abstract that the hold-out technique has been used

(not cross-validation).

Reply: Thank you very much your comment. We added performance measured of our proposed

system in the abstract. We also described that hold-out technique is used for performance

evaluation. Please kindly see in the revised version of our paper.

Reply to Reviewer 3 Comment

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 22: Original Article 1

Authors Reply to Reviewer 4 Comments

We would like to thank you for your valuable comments and suggestions to make our paper

improvements.

Comment 1: 2.1 Extraction of feeding area, please add "We used MATLAB programming

language to make conversion process from RGB to HSV." in the first paragraph.

Reply: Thank you very much your suggestion. We inserted new sentence in the section 2.1

Extraction of feeding area. Please kindly see in the revised version of our paper.

Comment 2: Experiment Environment, "The size of each aquarium has a dimension of 50 × 30 ×

30 cm and the overhead camera is setup.", the height of aquarium is not align with Figure 5 (b) -

the distance from aquarium bottom to the blue line (I guess it is water surface?) or camera opening

is 30 cm but there are some more distance to reach the top or height of aquarium.

Reply: Thank you very much your comment. To make sure to describe the correct size on revised

paper, we remeasure each aquarium and we would like to update the aquarium size. The size of

each aquarium is 60 × 40 × 40 cm. We updated the aquarium size in our revised paper and also

redrew the Figure 5(b) for clear explanation. Please kindly see in the revised version of our paper.

Comment 3: Result and Discussion

- Why do the authors report the result only one replication per treatment by using Figures 6-

8?

- Please add "According to research data, the infected shrimp appeared their symptoms

starting from 2 or 3 days. Therefore, we generally choose the data at 3rd day to illustrate

the experimental condition." in front of the second paragraph.

- Please add more discussion on the reported results including citation to support the

discussion such as:

o Is there any standard level for the acceptable accuracy?

o The accuracy of your system is low or high as compare to the other studies.

o What is the strength of your system as compared to the other methods?

Reply: Thank you for your suggestion. We added the suggested sentence at the beginning of

second paragraph in section 4 ‘Result and Discussion’.

According to the literature survey, most of the experiments are processed on single captured image

that is outside of water environment but our experiments are performed on sequences of image

data which were operated in underwater environment. The strength of our system is that it directly

monitored the shrimp behaviors to identify whether the shrimp is infected with virus or not.

Therefore, it is difficult to compare with other studies due to different experiment. To the best of

our knowledge, our proposed system is the first study to implement about monitoring system for

Reply to Reviewer 4 Comment

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 23: Original Article 1

infected shrimp detection using image sequences in underwater environment. Although we cannot

compare with other studies, the accuracy of the proposed system can be acceptable which can

correctly classify 27 out of 28 testing videos, having 95% precision, 100% recall rate and accuracy

of 96.4%.

We added new sentences in the last paragraph of section 4, ‘Result and Discussion’. Please kindly

see in the revised version of our paper.

Comment 4: References and citation

- Change the citation format according to SJST format: Spell the names of 5 authors in (Zhu

et al., 2019) at first citation in Introduction.

- Change the References format according to SJST format such as:

o Asche, F., Anderson, J.L., Botta, R., Kumar, G., Abrahamsen, E.B., Nguyen, L.T.

& Valderrama, D. (2020). The economics of shrimp disease. Journal of invertebrate

pathology, p. 107397. doi: https://doi.org/10.1016/j.jip.2020.107397

o Nguyen, L.T. -> Nguyen, L.T.,

o Journal of invertebrate pathology -> Journal of Invertebrate Pathology

o More corrections are needed for Masatoshi; Millard; Morimoto, 2018: Morimoto,

2020; Seike; Soille; Zhu

Reply: Thank you very much for your correction. We changed and updated the citation format

and reference format according to SJST format. Please kindly see in the revised version of our

paper.

Comment 5: Figure 8, please use the same legend as Figures 6 & 7 for "Effective number of

feedings".

Reply: Thank you very much for your point. We updated Figure 8 legend as same as Figure 6 and

7 for “Effective number of feedings”. Please kindly see in the revised version of our paper.

Comment 6: Table

- Table 2, What is "Number of data"? Is it the same as "Number of visits (times)" in Tables

3-5, and "Number of data (video)" in Table 6? Please use one clear statement if they are

the same.

- Tables 3-5, please add data of all replication and day of record (day 2 - day 7) in each

treatment.

- Table 6, Why do you report only 2 replications per treatment? Did you use one replication

of each treatment for training data? You should clarify it in Materials and Methods.

- Table 6, at remark, it should be better to use T1 = Non-infected shrimp, T2 = Infected

shrimp in artificial sea water, T3 = Infected shrimp in farm water. Moreover, it can be

shortened after moving the data of all replication and day of record to Tables 3-5 - therefore,

the first column will be T1, T2 and T3.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 24: Original Article 1

Reply: Thank you very much for your suggestion. We updated the second column heading in Table

2 from “Number of data” to “Number of data (video)”.

The experiment period was from 12th to 19th September, 2019. The total of 32 videos are recorded

and 4 videos are used as training data (described in Table 1) for calculation of optimal threshold

values. The remaining 28 videos are used as testing data. According to the suggestion, we updated

the data of replication and day of record for all 28 testing videos in Table 3 to Table 5. We also

updated the Table 6 remark to T1 = Non-infected shrimp, T2 = Infected shrimp in artificial sea

water and T3 = Infected shrimp in farm water.

Please kindly see in the revised version of our paper.

Comment 7: Miscellaneous

- Please change "Department of Aquatic Science" to "Aquatic Science and Innovative

Management Division," in Materials and Methods, Results and Discussion.

Reply: Thank you very much for the correction. We have changed from “Department of Aquatic

Science” to “Aquatic Science and Innovative Management Division” in our revised version. Please

kindly see it.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 25: Original Article 1

Cover letter for Academic Editor

We are submitting herewith the following documents as asked by the editor.

According to the reviewers' comments, this article has been improved for the experiments

and clarity of the method.

The revised parts, updated sentences and paragraphs, figures and tables are highlighted in

yellow color. Please kindly see in the revised version of our paper.

Abstract

We added new sentence at the end of paragraph to describe the performance measured

of our proposed system.

1. Introduction

We updated in-text citations according to SJST’s journal format.

2. Materials and Methods

We added new sentence in the first paragraph of section 2.1 Extraction of feeding

area.

3. Experiment Environment

We changed from “Department of Aquatic Science” to “Aquatic Science and

Innovative Management Division”.

We updated the aquarium size from 50 × 30 × 30 cm to 60 × 40 × 40 cm.

We inserted new sentence in the second paragraph.

We updated table column heading name of Table 2 from “Number of data” to

“Number of data (video)”.

4. Results and Discussion

We updated the Table 3 information as suggested by the reviewer.

We inserted new sentence in second paragraph.

We updated the Table 4 information as suggested by the reviewer.

We updated the Figure 8’s legend (Effective number of feedings) as same as Figure

6 and 7.

Cover letter for Academic Editor

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65

Page 26: Original Article 1

We updated the Table 5 information as suggested by the reviewer.

We changed from “Department of Aquatic Science” to “Aquatic Science and

Innovative Management Division”.

We updated the Table 6 as suggested by the reviewer.

We added new last paragraph.

References

We reformatted our references according to SJST’s journal format.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65