ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using...

19
263 ORIGINAL PAPER International Journal of Occupational Medicine and Environmental Health 2015;28(2):263 – 281 http://dx.doi.org/10.13075/ijomeh.1896.00274 The project was co-financed by the European Union through the European Regional Development Fund under the Innovative Economy Program. Development Project contract no. POIG.01.03.01-10-085/09 and funding by the National Research and Development Centre (NCBR) project DOBR/0038/R/ID2/2013/03. Received: March 30, 2014. Accepted: June 11, 2014. Corresponding author: M. Bernat, Military University of Technology, Faculty of Electronics, Institute of Telecommunication, Gen. Sylwestra Kaliskiego 2, 00-908 Warszawa, Poland (e-mail: [email protected]). ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL METHODS FOR DETERMINATION OF PUPIL ACTIVITY KRZYSZTOF RÓŻANOWSKI 1 , MICHAŁ BERNAT 2 , and AGNIESZKA KAMIŃSKA 3 1 Military Institute of Aviation Medicine, Warszawa, Poland Aviation Bioengineering Department 2 Military University of Technology, Warszawa, Poland Faculty of Electronics, Institute of Telecommunication 3 Cardinal Stefan Wyszyński University in Warsaw, Warszawa, Poland Faculty of Family Studies Abstract Objectives: The purpose of this study was to develop and initially validate an objective, yet quick, method for assessment of human fatigue. This aim can be achieved by the use of an optical, non-contact method of analysis of pupil activity. The study involved 2 phenomena typical for the behavior of the human pupil: pupillary reflex and pupillary movements. The 1st phe- nomenon is related to the pupillary light reflex (PLR), which presents the results of physiological adaptation mechanisms of the human eye. The pupillary unrest index (PUI) is an additional parameter referring to the tendency for instability of the pupil. Material and Methods: Indicators of these 2 mechanisms were assessed under the same experimental labora- tory conditions. Assessment was conducted on a group of volunteers (N = 10) during 4 controlled series of measurements performed at night. Pupillary reflex parameters associated with PLR and pupillary unrest index (PUI) were recorded using F²D Fit-For-Duty, a commercially available system made by AMTech Pupilknowlogy GmbH. Baseline pupil diameter, oscil- lations, reflex latency, maximum reaction time, pupil constriction time, pupil dilation time, and constriction amplitude were recorded. Results: As a result of the study, we were able to demonstrate correlation and confirm the usefulness of PLR and PST methods in the assessment of sleep deprivation. Parameters of PLR that may indicate human fatigue were identi- fied. The effect of light impulse sequences on the dynamics of pupillary reflex and the relationship between PUI (pupillary unrest index) measurement duration and sleepiness assessment validity, were assessed. Conclusions: The results of the pilot studies were sufficient to develop minimum requirements for a PLR sensor that would be capable of estimating the level of fatigue with accuracy of a PUI method, but at a 5 times faster rate. Key words: Fatigue, Activity of the pupil, Pupillography, Pupillary Light Reflex, Pupillary Unrest Index Nofer Institute of Occupational Medicine, Łódź, Poland

Transcript of ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using...

Page 1: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

263

O R I G I N A L P A P E R

International Journal of Occupational Medicine and Environmental Health 2015;28(2):263 – 281http://dx.doi.org/10.13075/ijomeh.1896.00274

The project was co-financed by the European Union through the European Regional Development Fund under the Innovative Economy Program. Development Project contract no. POIG.01.03.01-10-085/09 and funding by the National Research and Development Centre (NCBR) project DOBR/0038/R/ID2/2013/03.Received: March 30, 2014. Accepted: June 11, 2014.Corresponding author: M. Bernat, Military University of Technology, Faculty of Electronics, Institute of Telecommunication, Gen. Sylwestra Kaliskiego 2, 00-908 Warszawa, Poland (e-mail: [email protected]).

ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL METHODS FOR DETERMINATION OF PUPIL ACTIVITYKRZYSZTOF RÓŻANOWSKI1, MICHAŁ BERNAT2, and AGNIESZKA KAMIŃSKA3

1 Military Institute of Aviation Medicine, Warszawa, PolandAviation Bioengineering Department2 Military University of Technology, Warszawa, PolandFaculty of Electronics, Institute of Telecommunication3 Cardinal Stefan Wyszyński University in Warsaw, Warszawa, PolandFaculty of Family Studies

AbstractObjectives: The purpose of this study was to develop and initially validate an objective, yet quick, method for assessment of human fatigue. This aim can be achieved by the use of an optical, non-contact method of analysis of pupil activity. The study involved 2 phenomena typical for the behavior of the human pupil: pupillary reflex and pupillary movements. The 1st phe-nomenon is related to the pupillary light reflex (PLR), which presents the results of physiological adaptation mechanisms of the human eye. The pupillary unrest index (PUI) is an additional parameter referring to the tendency for instability of the pupil. Material and Methods: Indicators of these 2 mechanisms were assessed under the same experimental labora-tory conditions. Assessment was conducted on a group of volunteers (N = 10) during 4 controlled series of measurements performed at night. Pupillary reflex parameters associated with PLR and pupillary unrest index (PUI) were recorded using F²D Fit-For-Duty, a commercially available system made by AMTech Pupilknowlogy GmbH. Baseline pupil diameter, oscil-lations, reflex latency, maximum reaction time, pupil constriction time, pupil dilation time, and constriction amplitude were recorded. Results: As a result of the study, we were able to demonstrate correlation and confirm the usefulness of PLR and PST methods in the assessment of sleep deprivation. Parameters of PLR that may indicate human fatigue were identi-fied. The effect of light impulse sequences on the dynamics of pupillary reflex and the relationship between PUI (pupillary unrest index) measurement duration and sleepiness assessment validity, were assessed. Conclusions: The results of the pilot studies were sufficient to develop minimum requirements for a PLR sensor that would be capable of estimating the level of fatigue with accuracy of a PUI method, but at a 5 times faster rate.

Key words:Fatigue, Activity of the pupil, Pupillography, Pupillary Light Reflex, Pupillary Unrest Index

Nofer Institute of Occupational Medicine, Łódź, Poland

Page 2: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)264

dilatation of the pupil (mydriasis). Conversely, parasym-pathetic stimulation causes contraction of the circular muscle and constriction of the pupil (miosis). The pupil-lary reflex is mediated by acetylcholine and noradrenaline, causing miosis and mydriasis, respectively. Thus, changes in the pupil size in response to a light stimulus are based on a functional equilibrium between sympathetic and parasympathetic activity.It is reasonable to expect that the overall condition of the autonomic nervous system will affect the pupillary re-sponse to a stimulus of light. Parasympathetic dysfunction may cause relative mydriasis of the pupil in light condi-tions and diminished constrictor reflexes with or without pupillotonia, which is thought to result from aberrant re-innervations. Sympathetic dysfunction may cause relative miosis of the pupil in the dark, increased re-dilatation lag and attenuation of the startle reflex [8].Pupillometry was initially used in ophthalmology [9]. The size of the pupil is crucial for interpretation of perimetry of the visual field, electroretinography and the preop-erative assessment for refractive surgery [10]. It is also utilized in neuro-ophthalmology for the assessment of lesions of the afferent or efferent nervous pathways [11]. The PLR has already been studied to detect a PNS defect in different conditions: alcoholism, diabetes, AIDS, de-pression, anxiety, drug addiction and schizophrenia. Pu-pillography is also being utilized in research on the Alz-heimer’s and Parkinson’s diseases [12]. Since pupillary

INTRODUCTIONThe authors’ experience in the design of microsensory measurement solutions and psychophysiological signals forms the basis of this research [1–6]. Their research fo-cuses on the development of non-contact sensors allowing for a continuous analysis of fatigue under changing condi-tions (drivers, engine drivers, crane operators) or even ex-treme environment (typical of emergency rescue services, soldiers, commercial and military pilots).Research work utilized a commercial measuring system with sensors that are an interesting combination of hard-ware and software solutions. This specific class of optical sensors, based on visual image analysis, is used in pupil-lometry and enables identification of eye movements, parameters associated with eye shadowing, and dynamics of the pupillary response. The evaluation of pupil motion provides functional information about the autonomous nervous system [7]. The pupillary light reflex (PLR) is a response of the iris to changes in the intensity of light falling on the retina. This reflex is modulated by the state of eye accommodation, as well as sensory and emotional factors. Iris constrictor and relaxant muscles are the effec-tors that maintain a constant level of illumination of the retina. Time characteristics of the pupillary reflex depend on the state of the autonomic nervous system (ANS), the sympathetic nervous system (SNS), and the parasympa-thetic nervous system (PNS) (Figure 1).Circular and radial muscles control the size of the pupil. The former are innervated by parasympathetic fibers, and the latter by sympathetic fibers. Thus, radius of the pu-pil is controlled by the sympathetic and parasympathetic autonomic nervous systems, in response to environmental light – a mechanism called the pupil light reflex. There-fore, the pupillary radius response to an external light stimulus may provide an indirect means to assess the in-tegrity of neuronal pathways controlling pupil size.Sympathetic stimulation of α-1 adrenergic receptors causes contraction of the radial muscle and subsequent

Lightsource

Retinareaction

PNS(parasympatheticnervous system)

SNS(sympathetic

nervous system)

ANS(autonomic nervous system)

Feedback

Regulatory mechanisms

Iris muscleproperties

Fig. 1. Components of the mechanisms controlling pupil behavior

Page 3: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 265

in the dynamics of PLR parameters, such as prolonged pupil dilation, increased amplitude of contraction and prolonged overall duration of the reflex.Current literature lacks publications comparing the param-eters of PST, such as PUI, with pupillary reflex parameters or the interpretation of these ratios with respect to sensory or mental fatigue. There are several predefined parame-ters describing the PLR. Parameters that were used in this analysis are those provided by F²D Fit-For-Duty device by AMTech, which was used in this research. These pa-rameters are presented in Figure 2. Latency (L) describes the delay between the light impulse and pupil reaction, du-ration of reaction (DR) is the time to reach the minimum diameter, time of minimum diameter (TMD) refers to the length of time during which the diameter is less than 50% of the initial value, 2/3 contraction interval (2/3 CI) refers to the time at which the amplitude reaches 1/3 of the value in the contraction phase, 1/3 redilatation interval (1/3 RI) represents the time at which the amplitude reaches 1/3 of the value in the redilatation phase, and amplitude (A) de-fines the difference between the maximum and the mini-mum value of the diameter [22,23].The authors conducted a study analyzing parameters defined in Figure 2 in an attempt to assess the strength of the relationship between PLR and PST parameters.

MATERIAL AND METHODSExperimental designThe object of the study was to identify and verify chan ging PLR behavior in relation to the PUI factor (calculated on the basis of the PST test) described in the literature. The 1st phase of the study was preceded by a series of ex-periments using the commercially available F²D Fit-For-Duty device by AMTech.The F²D recording of spontaneous and involuntary pu-pil movements in the darkness is the simplest method to objectively measure and evaluate the level of sleepi-ness. The system includes infrared goggles, which are

dilation is regulated autonomically, an effort was made to use this method as a valid measure of pain [13]. Re-search using pupillometry is being carried out to assess alertness in hypersomnolent patients. Observation of pu-pil behavior is also used in clinically sleepy patients [14], as well as in the assessment of cardiac autonomic func-tion in athletes [15].As shown, this method has a variety of clinical applica-tions. Furthermore, the identification of pupil dynamics is also the subject of research concerning monitoring of various areas of human behavior [16–18]. This is mainly due to the possibility of assessment of the human psycho-physiological status influenced by the level of sleepiness or alertness through the so-called fatigue wave, which is the basis of pupillographic sleepiness test (PST) [19]. The size of the pupil is predominantly controlled by sympathetic inhibition of the parasympathetic Edinger-Westphal nuclei. Spontaneous changes in pupil size are mainly the effect of reduced central sympathetic activ-ity. Fatigue waves are slow rhythmic oscillations of the pupil size observed in the darkness in a state of reduced alertness. The PST test should be conducted in complete darkness (infrared goggles) and silence for 11 min. Dur-ing the test, the patient should be placed in a comfort-able sitting position. The result of the frequency analysis by Fast Fourier Transformation is given in a power value for the frequency range of < 0.8 Hz as a mean of the entire measurement.In their study, the authors made use of another param-eter referring to the tendency of the pupil for instability, i.e., the pupillary unrest index (PUI) (rPUI® is determined by AmTech, it will be used interchangeably with PUI for the remainder of this article). It is defined by cumulative changes in the pupil size based on the mean values of con-secutive data sequences [20,21].In summary, the increasing oscillations of pupillary move-ment are a result of reduced activity of the sympathetic nervous system. Decreasing SNS activity leads to changes

Page 4: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)266

virtual reality environment seen by the driver. Images are projected onto a flat 3-panel screen located 250 cm from the driver’s seat back panel.Additionally, FlexComp Infinity monitoring system was used. It offers 10 high-speed channels (2048 samples/s) and communicates with Thought Technology sensors. During the experiment sensors that specialize for: electro-cardiography (EKG), skin conductance, skin temperature, respiration waveform, and blood volume pulse waveform were connected.The sensors pass signals to the host computer via the microprocessor-controlled FlexComp Infiniti encoder unit. The encoder samples the incoming signals, digitizes, encodes and transmits the sampled data to the TT-USB

used to conduct PUI measurements. Sampling frequency equals 25 Hz, with spatial resolution of 0.05 mm.The experimental model assumed verification of PLR pa-rameter usability in correlation with the results of pupil-lography sleepiness test. For each subject, the tests were conducted 4 times during the night hours at 2.5-h inter-vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a fully functional driving simulator that includes: driver’s panel, virtual environment mod-ule, instructor/system operator panel and simulation software. It contains all the steering features, dashboard and a re ar-view mirror simulation system. It is equipped with a 3D image-generating computer system and a color

(6)

(1) (2)

(3)

(4) (5)

Pupi

llary

dia

met

er (m

m)

0 500 1000 1500 2000

Time (ms)

3

4

5

6

7

8

9

1 – latency2 – duration of reaction3 – time of minimum diameter4 – 2/3 constraction time5 – 1/3 redilatation time6 – amplitude

0 500 1000 1500 2000

Time (ms)

Pupi

llary

dia

met

er (m

m)

3

4

5

6

7

8

9

Light pulse

a) b)

Light pulse

PLR – the pupillary light reflex.

Fig. 2. Changes in pupil diameter in response to a light pulse with the description of selected parameters to characterize these changes – average of all PLR measurements: a) left eye, b) right eye

Page 5: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 267

the APK apparatus was also performed. The device is in-tended for psychological tests for e.g., drivers and heavy-machinery operators in terms of the speed of psychomotor reaction at an imposed or random rate, eye-hand coor-dination skills, perception of speed and accuracy, time-limited decision-making and resistance to fatigue. Simple psychological tests were designed only to control psycho-motor ability throughout the study. They did not have an impact on the main objective of the experiment.Measurements utilizing the goggles began with a PST test lasting 11 min as required by the procedure. Next, after a 2-min interval, PLR test commenced.The pupillary light reflex measurement was performed on both eyes, which were subjected to a series of 5 flashes at 30-s intervals. A block diagram of the experimental model is presented in Figure 3. Repeated eyeball stimula-tion with a source of light is the result of work performed by researchers on the measurement of physiological pa-rameters [25]. The right eye was subjected to light stim-uli first. The duration of pupillary reflex measurement was 150 s. Then, over a period of 60 s, the system switched to the left eye, which similarly to the right eye, was subject-ed to a series of 5 impulses of light over a period of 150 s. The entire process was carried out with the subjects wear-ing goggles to ensure the same measurement conditions, mainly in terms of accommodation.Each measurement ended with a short 5-minute session in the truck simulator, during which the subjects had to ob-serve the intersection and memorize the number of traffic light changes, the number of pedestrians passing through the intersection, the number of passing motorcyclists, cars and trucks. The vehicle was immobilized, with active con-trol systems, visualization and sound.Due to the fact that the PST is a well-established method utilized in sleep research/medicine and consists of an 11-min recording of pupil diameter by infrared video pu-pillography, the PUI factor was used as a reference for verification of the analyzed pupillary reflex parameters

interface unit. A fiber optic cable is used for transmission, providing maximum freedom of movement, signal fidelity, and electrical isolation. Due to the ability to view data in online mode, the subjects were monitored for their ability to participate in the subsequent phases of the experiment. Their psychophysical ability was verified using Piórkowski and cross devices (APK apparatus – visual-motor coordi-nation test device).Data obtained from the simulator were not directly used in the analysis. The simulator was used to standardize the behavior during the 4 monitored tasks. The observation test recorded events such as spotted pedestrians, trucks and cars, and traffic light changes at an intersection where the car simulator was placed. The study subjects were not aware of the fact that the obtained results were not the main object of the study.

Study subjectsResearch was performed at night on a group of 10 vol-unteers in a laboratory environment. Their mean age was 27±0.4 years. Each study participant was informed about the study design and provided an informed con-sent [24]. On the day of the experiment, the partici-pants abstained from caffeine intake of any form for at least 4 h before the test and for the entire duration of the test. Additionally, in accordance with methodo-logy requirements, each participant spent 7–8 h rest-ing the night before the study. Each participant per-formed the test 4 times (Task 0, Task 1, Task 2, Task 3) betwe en 11:00 p.m. and 6:30 a.m.

Experimental procedureMeasurement of the participants’ PLR and PST was one of the elements of the experiment. It also included as-sessment of the subjective level of fatigue using Japanese Questionnaire and the level of alertness measured by SSS (Stanford Sleepiness Scale), which is a quick and easy way to assess a person’s level of alertness. The test using

Page 6: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)268

Statistical analysis was performed using classic statistical methods based on the variance analysis. A single-index multivariate testing in the initial analysis of a given PLR data was performed. Based on these results, the vari-ables that changed significantly in subsequent observa-tions were identified. A single-index univariate analysis was performed for this subgroup of variables. A post hoc analysis (test: least significant differences – LSD, Scheffe, Tukey HSD and Bonferroni) was performed to collect de-tailed information about the nature of changes in the in-dividual variables analyzed. The factors used in the analy-sis were those defined by the variables Task, Eye, Profile

in the assessment of the level of sleepiness and reduced concentration.

STATISTICSThe fundamental purpose of the statistical analysis was to estimate the change in the values obtained using the PLR and the PST in subsequent measurements (4 sets of mea-surements over the duration of the experiment – Task vari-able). A number of fundamental (Tables 1–3) and suppor-ting (Tables 4 and 5) analyses was performed, along with a presentation of the behavior of the analyzed variables (Figures 4–7, 8a, 9 and 10).

SSS(Stanford

Sleepiness Scale)

ASK(psychological

tests)START POINT

PST(pupillographicsleepiness test)

CFI(Cumulative Fatique Index) END POINT

PLR(pupillary light reflex)

PBAO System

faceLab 5 System

Single test panel Truck simulator

Test timeMP 0 MP 1 MP 2 MP 3 MP 4

Left eye – 5 pulses Right eye – 5 pulses

MP 0 – measuring point 0: daily; MP 1 – measuring point 1: ~ 11:00 p.m.; MP 2 – measuring point 2: ~ 1:30 a.m.; MP 3 – measuring point 3: ~ 4:00 a.m.; MP 4 – measuring point 4: ~ 6:30 a.m. PBAO – oculomotor activity examination subsystem.

Fig. 3. Block diagram of the experimental model – the pilot study phase

Page 7: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 269

the Reaction Time variable). Throughout the analysis, the Task variable was the most important factor analyzed.Variance analysis assumed that the dependent variables were expressed in at least the interval scale. Additionally, the dependent variables should follow normal distribu-tion within the groups. The 2nd objective was verification of homogeneity (equality) of variance. Error variance (sum of squares – SS error) was calculated by adding the sum of the squares within the groups. If the variance of the 2 groups was different, it was not appropriate to add them together and the variance within the group

(sequence of light excitation). Table 3 shows the LSD test results for the Task factor.An identical scheme was adopted for the analysis of PUI data. The only difference was that the tests were per-formed for the variables Task and Window. Anova analysis was performed using data obtained from the SSS and the psychological tests (for the Number variable). Manova analysis utilized the results of the psychological tests (for

Table 1. Relative amplitude of pupillary contraction at subsequent measurement points (Task 0–3)

Task PLR measurements(n)

Relative amplitudeM SD

0 100 24.21 5.111 100 25.53 5.282 100 26.22 5.363 100 27.28 5.47

PLR – pupillary light reflex; M – mean; SD – standard deviation.

Table 2. Contraction velocity at subsequent measurement points (Task 0–3)

Task PLR measurements(n)

Contraction velocityM SD

0 100 3.98 0.821 100 4.21 0.892 100 4.29 0.833 100 4.49 0.87

Abbreviations as in Table 1.

Table 3. Results of the post hoc analysis (least significant differences test – LSD test) for rPUI_relative

TaskLSD test – rPUI_relative

0 1 2 30 – 0 0 01 0 – 0 02 0 0 – 0.0023 0 0 0.002 –

rPUI – pupillary unrest index.

Table 4. Changes in statistically significant relative amplitude (RA) and contraction velocity (CV) parameters in response to the number of light pulses, in terms of the task variable

RA CV

light pulses(n) pRA

light pulses(n) pCV

1 0.591 1 0.1882 0.093 2 0.0773 0.013 3 0.0274 0.003 4 0.0035 0.001 5 0.001

pRA – relative amplitude p value; pCV – contraction velocity p value.

Table 5. Pupillary unrest index (rPUI®) estimation error (ErrrPUI) with time-limited measurement

WindowErrrPUI

(%)

total Task 0 Task 1 Task 2 Task 31 100.00 100.00 100.00 100.00 100.002 75.68 81.75 81.50 78.50 67.023 57.46 55.21 64.81 48.29 63.114 43.59 32.63 51.98 36.28 51.285 27.47 23.01 39.96 19.26 30.616 18.19 16.24 31.93 12.70 16.947 5.81 7.29 14.45 3.29 2.858 0 0 0 0 0

Page 8: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)270

indicates that the values of these statistical tests did not produce statistically significant results that would allow for the rejection of the hypothesis of normal distribu-tion and homogeneity of variance. Skewness values for the individual variables were in the range of –0.430–0.011. A slight deviation from the norm was observed in the rPUI® variable, for which the maximum value of skewness was 0.741. All the analyses were performed using Statistica 10 PL software.Figures below show PLR source signals (Figure 11) with labeled vector changes and PUI for measurement se-quences (Figure 12). Individual pupil behavior is shown, including significantly different baseline pupil diameter. This formed the basis for the analysis, the results of which are discussed later in this article.

could not be estimated (because there was no common variance).The study tested the assumptions of Anova/Manova analysis, i.e., deviation from normal distribution of the individual dependent variables within the groups (defined as Task, Profile, Window, Eye variables) by means of the Kolmogorov-Smirnov and Shapiro-Wilk test. Levene’s test was used to assess homogene-ity of variance. The analysis of variables from PLR, SSS and psychological tests presented in this work

Task

0.4

0.5

0.6

0.7

0.8

0.9

1.0

1.1

1.2

rPUI

Task

-0.1

0.0

0.1

0.2

0.3

0.4

0.5

rPUI

_re

lativ

e

a)

b)

F(3, 394) = 18.655, p = 0

F(3, 394) = 47.102, p = 0

0 321

0 321

Fig. 5. a) Pupillary Unrest Index (rPUI®) value, b) relative change of rPUI®, at subsequent measurement points

Task

22

23

24

25

26

27

28

29

30

Rela

tive

ampl

itude

(%)

Task

3.7

3.8

3.9

4.0

4.1

4.2

4.3

4.4

4.5

4.6

4.7

4.8

Cont

ract

ion

velo

city

(mm

/s)

F(3, 365) = 5.4981, p = 0.00105

F(3, 365) = 5.2707, p = 0.00144

0 1 2 3

0 1 2 3

a)

b)

Fig. 4. Graph changes: a) amplitude of contraction, b) rate of pupillary constriction in subsequent stages of measurement

Page 9: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 271

A univariate, multi-dimensional analysis of variance was performed. The purpose of the analysis was to demon-strate changes associated with the subject’s fatigue by using the PLR method during the experiment. Figure 4 presents the results for 2 parameters relative amplitude (RA) and contraction velocity (CV), which

RESULTSThe results of the pupillary reflex analysis are located at the beginning, because they constitute the most impor-tant element of the analyses. Statistical analysis of a series of detected pupillary reflex parameters was performed. These parameters are presented in Table 6.

0 1 2 3Task

20

21

22

23

24

25

26

27

28

29

30

Rela

tive

ampl

itude

(%)

3.2

3.4

3.6

3.8

4.0

4.2

4.4

4.6

4.8

5.0

5.2

Cont

ract

ion

velo

city

(mm

/s)

0 1 2 3Task

Imp1

Imp2

Imp3

Imp4

Imp5

Profile:

Imp1

Imp2

Imp3

Imp4

Imp5

Profile:

a)

b)

Fig. 6. Parameters: a) relative amplitude and b) contraction velocity generated for 5 subsequent pupillary light reflex (PLR) impulses (Imp)

1KL 2KM 3KR 4KS 5MS 6MD 7MB 8PL 9PF 10WKPerson

10

15

20

25

30

35

40

Rela

tive

ampl

itude

(%)

1KL 2KM 3KR 4KS 5MS 6MD 7MB 8PL 9PFPerson

10WK2.0

2.5

3.0

3.5

4.0

4.5

5.0

5.5

6.0

6.5Co

ntra

ctio

n ve

locit

y (m

m/s

)

a)

b)

task 0

task 1

task 2

task 3

task 0

task 1

task 2

task 3

Fig. 7. Relative change: a) pupillary contraction amplitude, b) rate of pupillary constriction, for a single participant in subsequent stages of measurement

Page 10: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)272

were proven to be significantly statistically different (p < 0.05).The test probability is shown in each figure (Figure 4). The differences in other parameters as determined by the 4 sets of PLR measurements (Table 6) were not statistically significant.Figure 4 shows a change in the average values for the RA and the CV parameters for both eyes and 5 light stimuli. Statistically significant difference of p = 0.00105 for RA and p = 0.00144 for CV, is evident.

1 2 3 4 5 6 7 80

0.05

0.10

0.15

0.20

0.25

0.30

0.35

Window

Mea

n rP

UI (m

m/s

)

1 2 3 4 5 6 7 8−0.4

−0.2

0.0

0.2

0.4

0.6

0.8

1.0

1.2

1.4

Window

Mea

n rP

UI (m

m/s

)

1

2

3

4

5

6

7

8

9

10

Person:

0.40a)

b)

Fig. 9. Pupillary Unrest Index (rPUI®) value: a) for the entire group (total), and b) individually for all persons studied, shown according to subsequent measurement windows

Table 6. Statistically analyzed pupillary light reflex (PLR) parameters

Parameter UnitLatency sDuration of reaction sAmplitude mmRelative amplitude % Contraction velocity mm/sDilatation velocity mm/s2/3-constriction interval mm2/3-constriction time s1/3-redilation interval mm1/3-redilation time sTime of minimum diameter s

1KL 2KM 3KR 4KS 5MS 6MD 7MB 8PL 9PF 10WKPerson

-0.4

-0.2

0.0

0.2

0.4

0.6

0.8

1.0

1.2

1.4

1.6

rPUI

_re

lativ

e

Task

1.5

2.0

2.5

3.0

3.5

4.0

4.5

5.0

5.5

SSS

0 1 2 3

task 0

task 1

task 2

task 3

a)

b)

F(3, 394) = 76.836, p = 0

Fig. 8. a) Relative value of Pupillary Unrest Index (rPUI®) parameter for a single person at subsequent measurement points, b) declared Stanford Sleepiness Scale (SSS) values at subsequent measurement points

Page 11: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 273

The PLR results were referred to the results of PST (PUI), as a widely-adopted and recognized method for the as-sessment of fatigue. A 1-dimensional, 1-way analysis of variance was used in the case of the PLR. The analysis took into account only one rPUI® parameter and the Task factor. In this case, the purpose of the analysis was to show the changes associated with fatigue as measured by the PUI over duration of the experiment.The results are in line with expectations. Subsequent mea-surement periods show the growth of the rPUI_relative parameter. A proper trend of changes is preserved along with the differences in the average values of rPUI_rela-tive, which are large enough to yield values of p < 0.005 in the subsequent measurements.The rPUI_relative parameter was assigned for the analysis. It represents the relative change of rPUI® and eliminates the individual characteristics affecting the rPUI® value, which is different in each individual.

Tables 1 and 2 show the average values of RA and CV along with the standard deviation recorded at subse-quent periods of measurement.As regards the RA and the CV parameter, post hoc analy-ses were performed, the results of which are presented in Tables 7 and 8.The tests clearly show that it is possible to identify chang-es in the pupillary reflex on the basis of RA and CV in the 3rd and 4th measurement. The statistically signifi-cant results are also present between the 2nd and the 4th measurement.

maxmin.mean

Task

0.4

0.5

0.6

0.7

0.8

0.9

1.0

1.1

1.2

1.3

Reac

tion

time

(s)

0 1 2 3Task

44.0

44.5

45.0

45.5

46.0

46.5

47.0

47.5

Corre

ct re

actio

n (n

)

F(3, 394) = 2.3534, p = 0.07169

0 1 2 3

a)

b)

max – maximal value; min. – minimal value. APK apparatus – Piórkowski and cross devices (visual-motor coordination test device).

Fig. 10. a) Response times measured with the APK apparatus, b) number of correct answers at subsequent measurement points

Table 7. Results of the post hoc analysis (LSD test) for relative amplitude (RA)

TaskLSD test (RA)

0 1 2 30 – 0.161 0.009 01 0.161 – 0.235 0.0282 0.009 0.235 – 0.3103 0 0.028 0.310 –

LSD – as in Table 3.

Table 8. Results of the post hoc analysis (LSD test) for contraction velocity (CV)

TaskLSD test (CV)

0 1 2 30 – 0.156 0.004 01 0.156 – 0.140 0.0172 0.004 0.140 – 0.3623 0 0.017 0.362 –

LSD – as in Table 3.

Page 12: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)274

As in the case of parameters obtained in the PLR test, the post hoc analysis was also performed for the rPUI_rela-tive parameter. The obtained results show that changes in

Mean rPUI® values were calculated from the obtained mea-surement data and a relative growth of this indicator was independently analyzed for each person. It was observed that the rPUI® parameter is highly personalized. For this reason, rPUI_relative parameter was set up to estimate the relative change in the amplitude of involuntary, oscillating movements of the pupil relative to the 1st measurement (Task 0). Changes in behavior are similar, regardless of abso-lute rPUI® value or relative individual value being analyzed.Comparison of the results presented in Figures 4 and 5 shows an agreement between the parameters obtained by the PLR and the PST methods.Tables 9 and 10 show the average values of the rPUI® and the rPUI_relative parameters at subsequent mea- su re ments.

vector changes:

amplitude and contraction velocity

0 500 1000 1500 20003

4

5

6

7

8

9

Pupi

llary

dia

met

er (m

m)

a)

Time (ms)0 500 1000 1500 2000

3

4

5

6

7

8

9

Pupi

llary

dia

met

er (m

m)

b)

Time (ms)

PLR: pulse = 250 ms, λ = 660 nm.

Fig. 11. Source data recorded in the pupillary light reflex (PLR) study – person no. 3, 4 tasks, 5 pulses each: a) left eye, b) right eye

0

0

2

2

4

4

6

6

rPUI

® (m

m/s

)

Task 0

Task 1

Task 2

0 1 2 3 4 5 6 7

Task 3

0

0

2

2

4

4

6

6

Time ×10 (ms)5

Fig. 12. Source data for Pupillary Unrest Index (rPUI®) – sequence of 4 measurements (tasks), person no. 3

Page 13: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 275

applied (Profile 1–5), without providing the results of sta-tistical tests. It can be concluded that in both parameters – RA and CV, the 5th stimulation produced larger and more visible changes as compared to the 1st stimulation.Since the authors had the results of 5 light stimulations, an independent analysis of variance for the Profile factor (light pulse number) was conducted. It took into account the individual light pulses independently and observed their variation at subsequent periods of measurement.Analysis of data presented in Table 4 indicates that the method of pupil stimulation has significant influence on the values of RA and CV parameters. With only a single stimulation and p value of < 0.05, it would be impossible to distinguish between the different phases of the test. In the univariate analysis of variance for the Task fac-tor, both RA and CV showed relatively small inter-group variability in comparison to intra-group variability, with the following values: pRA_1 = 0.591 and pCV_1 = 0.188. Having only a single pupillary reflex measurement, it would be impossible to assess the level of increased sleepiness in subsequent measurement sessions likewise in the case of 2 and 3 light stimuli where the p values were higher than 0.05. Utilization of a series of 4 stimuli on a single eye provided a statistically significant differ-ence between RA and CV values in subsequent sessions (Task), pRA_4 = 0.003, pCV_4 = 0.003. This difference in-creased when the results of the 5th sti mulation were added to the analysis.The answer as to why this was occurring was presented in Figure 5, which displays values for RA and CV parameters for the 5 consecutive pulses in a given measurement ses-sion. Each subsequent Task displayed a growing tendency for greater contraction in a shorter time.This phenomenon was also reflected in Figure 13, which displays the differences in pupillary reflex for the right and left eye (the right eye was stimulated first).The authors present a graphical representation of the key parameters obtained by the PLR (RA and CV) method

this parameter are so substantial in subsequent measure-ments that their differences are statistically significant in any combination of measurements (Table 3).As a result of a strong similarity in the behavior of param-eters obtained by the PLR and the PST, the authors were able to perform an analysis to try to determine the optimal method of measurement using the PLR only. In the experi-ment, the PLR was measured through a series of 5 light pulses. Thus, the authors wanted to find out what effects the number of light pulses had on the values of RA and CV, and whether there was any association with the level of fa-tigue (measuring period). Due to the size of the population tested, Figure 6 shows the average values of RA and CV taking into consideration the number of stimulations

Table 9. Pupillary unrest index (rPUI®) results at subsequent measurement points (Task 0–3)

Task PUI measurements(n)

rPUI®

M min. maxTotal 40 0.83 0.23 2.280 10 0.62 0.23 1.131 10 0.76 0,29 1.372 10 0.91 0.36 1.633 10 1.02 0.38 2.28

rPUI® – the pupillary unrest index (PUI) determined by AmTech, used interchangeably with PUI for the remainder of this article.Other abbreviations as in Table 1 and Figure 10.

Table 10. Relative results rPUI® at subsequent measurement points (Task 0–3)

Task PUI measurements(n)

rPUI_relativeM min. max

Total 40 0.28 –0.08 1.410 10 0 0 01 10 0.13 0.01 0.392 10 0.28 0.07 0.563 10 0.39 –0.08 1.41

Abbreviations as in Table 1 and 9 and Figure 10.

Page 14: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)276

fatigue, faster than the PST, which takes 11 min to com-plete. Nonetheless, the authors are convinced that future studies performed on a larger group of subjects will dem-onstrate a stronger correlation of these behaviors.The entire experiment with the analysis was conducted in an attempt to find a quick method of assessment of fatigue using PST, and consequently the PLR. Since the system used in the study allowed for rPUI® calculation in 8 mea-surement windows for a total of an 11-min measurement period, analysis of its behavior during the experiment was performed. The parameter was calculated every 82.5 s. The results are shown in Figure 14.Figure 9b shows individual differences between the pa-rameter values. Relationship between rPUI® and the task number is preserved regardless of the test duration (Figure 14). Task 3 in Figure 14 was performed in a state of greatest fatigue, as manifested by the largest amplitude of change in pupil size, per unit of time.

%1001

1

1

1

1

����

����

��

K

i i

K

j j

rPUI

rPUIN

rPUIKErr

i

(1)

where:N – maximal number of windows (N = 8),I – window number, for which error is calculated,K – window number, at which hypothetical test conclusion occurs.

Analysis of estimation error ErrrPUI in Figure 15, Table 5 indicates that amplitude variations of rapid, involun-tary and oscillatory changes of pupil diameter displayed fairly linear characteristics. In the 5th window, at 412.5 s of the study, rPUI® reached value, which despite minor variations, was maintained for the remainder of the study. If we were to take values from individual measurement windows to estimate the resultant rPUI®, then one could say that we managed to shorten the measurement peri-od by nearly 40%. However, rPUI® calculation method

(Figure 7) and the PST (rPUI®) method (Figure 8a) to demonstrate the individual behavior of these variables.The results shown in Figure 10, i.e., the constant values of Reaction time and Number parameters, suggest sleep de-privation. The results of analysis of variance confirm the permanence of the average values of these variables in the subsequent points of measurement. In both cases, no statistical significance for the Task factor was observed.A comparative analysis of Figure 4, 5, and 8b clearly shows a strong similarity in the behavior of the PLR, rPUI®, and SSS parameters.The authors aimed at determination of the minimum re-quirements for a highly sensitive method of assessment of

F(1, 385) = 4.8285, p = 0.02859

F(1, 391) = 0.19920, p = 0.65561

Fig. 13. Parameters a) relative amplitude and b) contraction velocity generated independently for the left and the right eye

Page 15: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 277

When analyzing the results presented in Figure 5 and Figure 8b, it is evident that both: the objective fatigue ex-pressed by the rPUI®, and the subjective fatigue (SSS test), increased with each subsequent measurement.During the PLR experiment, the authors measured the RA and the CV parameters with stimulation of the left and right eye. Interesting results were observed. The obtained values should be identical regardless of the stimulated eye. The results in Figure 13 showed a varia-tion. This observation is important in the context of the development of an optimal method of measurement. The difference in the obtained values is most likely due to ac-commodation time of the eye measured as the 2nd one, and the influence of stimulation of the opposite eye. The eye examined as the 2nd one (the left eye) was blacked out for 2.5 min longer than the right eye and was subject-ed to an extended stimulation with light, 5 passive flashes and 5 direct flashes.A graphical representation of the key parameters ob-tained by the PLR method (Figure 7) and the PST method (Figure 8a) demonstrates the individual behav-ior of the variables. Although the average values for the entire population demonstrate an increase with consec-utive periods of measurement (Task), this behavior was not uniformly observed. This finding raises 2 very in-teresting conclusions. Individual changes in parameters are strongly associated with the human circadian cycle. In most cases (6 persons), the critical time of function-ing in the morning occurred at 4:00 a.m. In 4 individuals it shifted to 6:30 a.m. (the 4th period of measurement during the experiment). Two phases of fatigue arouse from the 4 periods of measurement. The 1st phase last-ing until 2:30 a.m. consisted of the first 2 measurements and the 2nd phase consisted of the subsequent 2 mea-surements ending at 6:30 a.m. Figures 7 and 11a show that in the 2nd phase, 90% of the cases displayed an increase in the parameters obtained from the PLR and the PST. An exception is a test subject marked

implemented by the F²D Fit-For-Duty system uses the average value of all 8 measurement windows. Upon acceptance of measurement error ErrrPUI < 10%, the re-sulting reduction in measurement time is only 12.5%.

DISCUSSIONAn increase in the relative amplitude and contrac-tion velocity parameters is due to reduced SNS activity and increased PNS activity. Comparison of the results with PUI measurements allows for an indirect assump-tion that PLR may be used to assess the level of sleepiness and alertness, given that an accurate measurement system is used.

1 2 3 4 5 6 7 80

0.1

0.2

0.3

0.4

0.5

0.6

0.7

Window

task 0

task 1

task 2

task 3Man

rPUI

® (m

m/s

)

Fig. 14. Pupillary Unrest Index (rPUI®) value for all persons (N = 10) studied at consecutive measurement windows, separated into tasks

1 2 3 4 5 6 7 80

25

50

75

100

Window

Estim

atio

n er

ror (

%)

totaltask 0

task 2task 3

task 1

Fig. 15. Pupillary Unrest Index (rPUI®) estimation error in terms of the duration of study

Page 16: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)278

time. It indicates a very sensitive method of measurement capable of identifying states of ANS arousal during sleep deprivation lasting less than 48 h.The experiment utilized equipment that recorded re-sponse times to light stimuli and the number of correct responses (Tables 11 and 12). As indicated, a proper ex-perimental group was chosen – a group that was able to adapt to the study conditions and requirements, resulting in similar findings of a 7-h-long test performed at night time. It is not difficult to breakdown the compensation mechanism for physical, mental and sensory fatigue. How-ever, it was the goal of the study to conduct the measure-ments at monotony of the night and with no sources of stimulation. Analysis of the ANS behavior as reflected in the PLR phenomenon could have been conducted only under the conditions of time passing, darkness and sight fixated on the moving objects. Changes were observed and correlated fully with the results of the SSS questionnaire and the changes in rPUI®.The authors depended on the continued psychophysi-cal ability of the test subjects, despite the observed sleep deprivation. This enabled them to monitor the level of fatigue and assess the likelihood of falling asleep dur-ing PST testing. Experiment setting, standards associated with research equipment, methods of measurement and disciplined implementation of methodology enabled the determination of key parameters that are critical in terms of the structure of an optical sensor.

as Person 9PF. This finding may have been caused by a temporary stimulation of the subject, perhaps due to a change in the music that was played to all the test sub-jects. Although these sounds were of similar tone, they could have had an excitatory effect on the test subject. It also demonstrates the importance of the environment in which the research is conducted.From the point of view of the authors, it is important that the changes occurring in the 2 phases of the ex-periment were consistent in most cases (PLR vs. PST). The differences that occurred were likely the result of a temporary stimulation that may occur during minor sleep deprivation. The PLR and the PST measurements were performed consecutively and lasted a minimum of 16 min. The PST measurement lasted 11 min, while the dual PLR measurement lasted 2.5 min for each eye. Activation of the SNS and the PNS may occur during this

Table 11. Reaction times (RT) measured with the APK apparatus at subsequent measurement points (Task 0–3)

Task Correct reactions (n)

RTmax RTmin. RTmean

M SD M SD M SDTotal 398 1.129 0.122 0.572 0.049 0.781 0.0700 99 1.126 0.081 0.582 0.051 0.813 0.0811 102 1.125 0.085 0.578 0.058 0.780 0.0632 98 1.131 0.044 0.572 0.044 0.772 0.0503 99 1.133 0.210 0.554 0.034 0.758 0.070

Abbreviations as in Table 1 and Figure 10.

Table 12. Correct reactions measured with the APK apparatus at subsequent measurement points (Task 0–3)

TaskCorrect reactions

n M SDTotal 398 45.9 3.50 99 46.1 3.61 102 45.1 3.82 98 46.4 2.93 99 46.1 3.8

Abbreviations as in Figures 1 and 10.

Page 17: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 279

experiment. This is of great significance in cases where the measurement is done with a mobile device and under dy-namic conditions. It should be also noted that the sequence of applied stimuli affects the values of dynamic PLR pa-rameters, especially RA and CV. These parameters are characterized by high inter-subject variability.However, shortening the duration of PST examination provides little benefit, because in the case of a relatively large rPUI® estimation error, the amount of time saved will be small. The study results suggest that the duration of PST examination may be shortened by about 12% with maintained margin of error of 10%. This confirms the benefit of technology developed on the basis of PLR.Sleep deprivation measurements were conducted 4 times and the time between them was controlled in terms of ac-tivities performed by the respondents. They participated in truck simulator sessions that did not require physical effort and were preceded by psychological control tests. The measured reaction times (RT – Figure 10a) and the number of correct responses (N – Figure 10b) before sub-sequent measurement phases (labeled on the graphs as: Task 0, Task 1, Task 2, Task 3) did not show any statistically significant differences.The measured reaction times and N parameters re-flect psychomotor ability at a constant level, while PLR/rPUI®/SSS indicators show significant changes associated with reduced alertness or increased sleepiness.These results support the idea that PLR can be effective in the assessment of sleepiness. Subjective feeling of sleepi-ness was evident in the study subjects. Test consistent with the SSS clearly shows that a sense of fatigue in the study participants increased by 100% during the experiment. The authors were able to define the relationship between the PUI, PLR and SSS. The results of simple psycho-logical tests focusing on temporary psychomotor ability, along with SSS results suggest that the PLR can be an ef-fective and accurate indi cator of fatigue used not only in a laboratory setting.

CONCLUSIONSThe aim of the study was to find indicators for a quick and accurate method of assessment of fatigue manifested by somnolence among individuals performing tasks under dynamic or even extreme conditions. Analysis of pupil be-havior was used for this purpose. Pupil behavior was ana-lyzed during excitation by a pulse of light lasting 250 ms and a wavelength of 660 nm, also known as PLR, and in-voluntary, oscillating pupil movement recorded in complete darkness (PST). According to the standards, PST testing is performed for 11 min. This length of time is accepted in the laboratory environment and requires that scene images be obscured. This obviously makes performing the duties of an operator impossible as would be the case in monitoring drivers, crane operators, engine drivers, pilots, not to men-tion soldiers in combat.The authors conducted a unique study attempting to com-pare 2 physiological phenomena associated with pupil be-havior under various conditions. The pupillographic sleep-iness test (PST) was regarded as a reference, described in the literature as an indicator of the level of sleepiness. The designed experiment, which identified the parameters of pupillary reflex reactions to stimulation with light, dem-onstrated a close relationship between the changes occur-ring in rPUI® and those taking place in relative amplitude and contraction velocity. The article presents only those parameters (see Table 6), which similarly to rPUI® were shown to be statistically different in subsequent measure-ments. This is an extremely important observation, which suggests that the selected PLR parameters may indeed indicate reduced concentration or sleepiness in humans.These parameters reflect changes taking place in the auto-nomic nervous system caused by even minor sleep depri-vation (< 48 h).This data may be obtained over 4 times faster and without the need of obscuring the operator’s field of vision. Shorter duration of the study may be accomplished by abandoning serial pupillary reflex measurements, as was the case in this

Page 18: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

O R I G I N A L P A P E R K. RÓŻANOWSKI ET AL.

IJOMEH 2015;28(2)280

6. Piotrowski Z, Różanowski K. Robust algorithm for heart rate (HR) detection and heart rate variability (HRV) esti-mation. Acta Phys Pol A. 2010;118(1):131–5.

7. Wilhelm B, Wilhelm H, Streicher P, Lüdtke H, Adler M. Pupillography as an objective attention test. Wien Med Wochenschr. 1996;146(13–14):387–9.

8. Ferrari GL, Marques JLB, Gandhi R, Heller SR, Schnei-der FK, Tesfaye S, et al. Using dynamic pupillometry as a simple screening tool to detect autonomic aeuropathy in patients with diabets: A pilot study. Biomed Eng On-line. 2010;9:26, http://dx.doi.org/10.1186/1475-925X-9-26.

9. Kawasaki A, Kardon RH. Disorders of the pupil. Ophthal-mol Clin North Am. 2001;14(1):149–68.

10. Duffey RJ, Leaming D. US trends in refractive surgery: 2003 ISRS/AAO survey. J Refract Surg 2005;21(1):87–91.

11. Loewenfeld I, Lowenstein O. The pupil: Anatomy, physiology, and clinical applications. Iowa State University Press; 1993.

12. Fotiou DF, Stergioua V, Tsiptsiosa D, Litharib C, Nakouc M, Karlovasitoua A. Cholinergic deficiency in Alzheimer’s and Parkinson’s disease: Evaluation with pupillometry. Int J Psychophysiol. 2009 Aug;73(2):143–9, http://dx.doi.org/10.1016/j.ijpsycho.2009.01.011.

13. Höfle M, Kenntner-Mabiala R, Pauli P, Alpers GW. You can see pain in the eye: Pupillometry as an index of pain intensity under different luminance conditions. Origi-nal research article. Int J Psychophysiol. 2008 Dec;70(3): 171–5, http://dx.doi.org/10.1016/j.ijpsycho.2008.06.008.

14. McLaren JW, Hauri PJ, Lin S-C, Harris CD. Pupillom-etry in clinically sleepy patients. Original research article. Sleep Med. 2002 July;3(4):347–52.

15. Kaltsatou A, Kouidi E, Lithari C, Koutlianos N, Fotiou F, Deligiannis A. Assessment of cardiac autonomic function in dynamic athletes by pupillometry. Int J Psychophysiol. 2010 Sep;77(3):283–4, http://dx.doi.org/10.1016/j.ijpsycho. 2010.06.148.

16. Payen JF, Isnardon S, Lavolaine J, Bouzat P, Vinclair M, Francony G. Pupillometry in anesthesia and critical care. Ann Fr Anesth Reanim. 2012 Jun;31(6):e155–9.

These observations contribute significantly to the devel-opment of a rapid, objective and accurate assessment of fatigue models in terms of reduced concentration and sleepiness. They may be implemented in precision opti-cal sensors, which are part of real-time fatigue assessment systems.However, a more precise description of the correlation between these 2 methods requires further studies on a lar-ger group of subjects.The authors are currently conducting research on objec-tive methods for the verification of sensitivity and accuracy of optical fatigue sensors based on PLR, through the use of functional neuroimaging (fMRI) and multichannel map-ping of bioelectric activity in the brain. Such combination of methods will allow for an objective, neurometric evalu-ation of the processes of fatigue, reduced concentration, sleepiness with a decreased response to external factors. The fMRI method enables imaging of blood flow changes in brain structures involved with the activities designed in the experiment. In the case of studies in which both specificity and sensitivity are recorded simultaneously, the reliability may reach values close to 100%.

REFERENCES

1. Różanowski K, Murawski K. Optical sensor to monitor pu-pillary light reflex. Acta Phys Pol A. 2013;124(3):558–62.

2. Różanowski K, Murawski K. An infrared sensor for eye tracking in a harsh car environment. Acta Phys Pol A. 2012; 122(5):874–9.

3. Życzkowski M, Różanowski K, Murawski K, Karol M, Mar-kowski P. Research and parameter optimization the infrared sensor for eye track. Acta Phys Pol A. 2012;122(5):942–5.

4. Murawski K, Różanowski K, Krej M. Research and parameter optimization of the pattern recognition algorithm for the eye tracking infrared sensor. Acta Phys Pol A. 2013;124(3):513–6.

5. Murawski K, Różanowski K. Pattern recognition algo-rithm for eye tracker sensor video data analysis. Acta Phys Pol A. 2013;124(3):509–12.

Page 19: ESTIMATION OF OPERATORS’ FATIGUE USING OPTICAL … · vals. Experiments were conducted using truck simula-tor SYMSAM-2. The simulator made by ETC-PZL Aero-space Industries is a

PUPIL ACTIVITY EVALUATION, PLR&PUI OPTICAL METHODS O R I G I N A L P A P E R

IJOMEH 2015;28(2) 281

22. de Souza JK, Pinto MA, Vieira PG, Baron J, Tierra-Crio-llo CJ. An open-source, FireWire camera-based, Labview-controlled image acquisition system for automated, dyna-mic pupillometry and blink detection. Comput Methods Programs Biomed. 2013 Dec;112(3):607–23, http://dx.doi.org/10.1016/j.cmpb.2013.07.011.

23. Canver MC, Cancer AC, Revere KE, Amado D, Ben-net J, Chung DS. Novel mathematical algorithm for pupillometric data analysis. Comput Methods Pro-grams Biomed. 2014;113(1):221–5.

24. Czarkowski M, Różanowski K. Polish Research Ethics Committees in the European Union system of assess-ing medical experiments. Sci Eng Ethics. 2009 Jun;15(2): 201–12, http://dx.doi.org/10.1007/s11948-009-9113-x.

25. Czarkowski M, Mikulska M, Zebrowski M, Baran A, Ro-zanowski K. Tilt test alters accuracy of the oscillometric device Omron HEM-705CP. J Hum Hypertens. 2004;18(4): 293–4, http://dx.doi.org/10.1038/sj.jhh.1001667.

17. Wilhelm BJ, Widmann A, Durst W, Heine C, Otto G. Objective and quantitative analysis of daytime sleepi-ness in physicians after night duties. Int J Psychophysi-ol. 2009 Jun;72(3):307–13, http://dx.doi.org/10.1016/j.ijpsy-cho.2009.01.008.

18. Warga M, Lüdtke H, Wilhelm H, Wilhelm B. How do spontaneous pupillary oscillations in light relate to light intensity? Original research article. Vision Res. 2009 Feb; 49(3):295–300, http://dx.doi.org/10.1016/j.visres.2008.09.019.

19. Lowenstein O, Feinberg R, Loewenfeld IE. Pupillary move-ments during acute and chronic fatigue. Invest Ophthal-mol Vis Sci. 1963;2(2):138–57.

20. Lobato-Rincón LL, Cabanillas Campos MC, Navarro-Vallas JJ, Bonnin-Arias C, Chamorro E, Sanchez-Ramos Roda C. Utility of dynamic pupillometry in alcohol testing on drivers. Adicciones. 2013;25(2):137–45.

21. Nakayama M, Yamamoto K, Kobayashi F. Estimation of sleepiness using pupillary response and its freque-ncy components. Int J Bioinform Res Appl. 2012;8(5–6): 342–65, http://dx.doi.org/10.1504/IJBRA.2012.049621.

This work is available in Open Access model and licensed under a Creative Commons Attribution-NonCommercial 3.0 Poland License – http://creativecommons.org/licenses/by-nc/3.0/pl/deed.en.