A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature...

8
Pergamon 0042-6989(95)00229-4 Vision Res., Vol. 36, No. 11, pp. 1543-1550, 1996 Copyright © 1996 Elsevier Science Ltd. All fights reserved ~ Printed in Great Britain" 0042-6989/96 $15.00 + 0.00 A Chromatic-cancellation Property of Human Pupillary Responses EIJI KIMURA,* ROCKEFELLER S. L. YOUNG*~" Received 21 February 1995; in revised form 22 August 1995 The pupil exhibits a response property somewhat analogous to perceptual red-green cancellation. Across a limited range of flash intensities near threshold, pnpillary constrictions evoked by red flashes can be reduced, if not nulled, by the simultaneous addition of a green flash. The percentage of trials on which a stimulus.evoked response can be correctly discriminated from noise also falls to chance level as a green flash is added to the red flash. In terms of the quanta absorbed by L and M cones, the cancellation can be modelled as a function of 10.65*L-M[. Copyright © 1996 Elsevier Science Ltd. Color opponency Chromatic cancellation L and M cones Pupillary light reflex Pupillometry INTRODUCTION That the pupil responds specifically to changes in the chromaticity (in addition to the luminance) of a stimulus field was first appreciated by Kohn and Clynes (1969). They provided several demonstrations showing that the pupil constricts to chromatic stimulus transitions when the transition is isoluminant or accompanied by a luminance decrement. Subsequent studies (e.g. Saini & Cohen, 1979; Young & Alpern, 1980) replicated and extended some of their demonstrations, removing the possibility that such pupil constrictions were produced by stimulus artifacts or by some other trivial reasons. More recently, studies have provided further supporting data (e.g. Young et al., 1987, 1993; Barbur et al., 1992). Collectively, these observations have added intrigue to our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying chromatic mechanism is similar or dissimilar to the one mediating perceptual color vision. Krastel et al. (1985) provided the first evidence that the pupillary responses may be mediated by a cone-opponent interac- tion not unlike that mediating perceptual color vision. They found that the pupillary action spectrum on a steady-white background was virtually identical to the spectral sensitivity curve of the psychophysical chro- matic channel measured under the same stimulus condition. The pupillary action spectrum had three prominent lobes with peaks in a long, middle, and short wavelength region and a dip in sensitivity near 570 nm *Department of Ophthalmology and Visual Sciences, Texas Tech University Health Sciences Center, Lubbock, TX 79430-0001, U.S.A. tTo whom all correspondence should be addressed [Email [email protected]]. (Sloan notch) which, in accordance with psychophysical theory, reflects the subtractive interaction of the under- lying cone-opponent mechanism (e.g. Sperling & Har- werth, 1971; King-Smith & Carden, 1976; Thornton & Pugh, 1983; Kalloniatis & Harwerth, 1990; Calkins et al., 1992). Kimura and Young (1995a) confirmed Krastel's observation, but also showed that the pupillary responses evoked by monochromatic flashes on a steady-white background were more complex than previously as- sumed. Of specific relevance to the present study, Kimura and Young showed that the pupillary response is composed of at least two spectrally distinct components, only one of which has the Sloan notch in its action spectrum. Additionally, Kimura and Young showed that the OFF portion of the pupillary response (that is, the response that Kohn and Clynes referred to as the "color removal" effect) has the Sloan notch in its action spectrum. The present paper investigates the nature of the putative cone-opponent interaction further. Because the dip in log sensitivity near 570 nm does not extend to minus infinity (Krastel et al., 1985; Kimura & Young, 1995a), it is unclear whether the pupillary visual process has a "neutral point", i.e., the property that the signal from the visual process could be nulled by selecting a light of some wavelength composition. In theory, a cone- opponent interaction may or may not have a neutral point. A process characterized by a subtractive interaction between L and M cones, e.g. IL-MI, is an example of a process with a neutral point. For some wavelength of light, the number of quanta absorbed by L and M cones would be equal, causing the output to become zero, i.e., IL-MI ~- 0. A process characterized by (IL-MI + L + M) would be an example which does not exhibit a neutral point, as the summing of L- and M-cone signals prevents 1543

Transcript of A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature...

Page 1: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

Pergamon 0042-6989(95)00229-4

Vision Res., Vol. 36, No. 11, pp. 1543-1550, 1996 Copyright © 1996 Elsevier Science Ltd. All fights reserved ~

Printed in Great Britain" 0042-6989/96 $15.00 + 0.00

A Chromatic-cancellation Property of Human Pupillary Responses EIJI KIMURA,* ROCKEFELLER S. L. YOUNG*~"

Received 21 February 1995; in revised form 22 August 1995

The pupil exhibits a response property somewhat analogous to perceptual red-green cancellation. Across a limited range of flash intensities near threshold, pnpillary constrictions evoked by red flashes can be reduced, if not nulled, by the simultaneous addition of a green flash. The percentage of trials on which a stimulus.evoked response can be correctly discriminated from noise also falls to chance level as a green flash is added to the red flash. In terms of the quanta absorbed by L and M cones, the cancellation can be modelled as a function of 10.65*L-M[. Copyright © 1996 Elsevier Science Ltd.

Color opponency Chromatic cancellation L and M cones Pupillary light reflex Pupillometry

INTRODUCTION

That the pupil responds specifically to changes in the chromaticity (in addition to the luminance) of a stimulus field was first appreciated by Kohn and Clynes (1969). They provided several demonstrations showing that the pupil constricts to chromatic stimulus transitions when the transition is isoluminant or accompanied by a luminance decrement. Subsequent studies (e.g. Saini & Cohen, 1979; Young & Alpern, 1980) replicated and extended some of their demonstrations, removing the possibility that such pupil constrictions were produced by stimulus artifacts or by some other trivial reasons. More recently, studies have provided further supporting data (e.g. Young et al., 1987, 1993; Barbur et al., 1992).

Collectively, these observations have added intrigue to our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying chromatic mechanism is similar or dissimilar to the one mediating perceptual color vision. Krastel et al. (1985) provided the first evidence that the pupillary responses may be mediated by a cone-opponent interac- tion not unlike that mediating perceptual color vision. They found that the pupillary action spectrum on a steady-white background was virtually identical to the spectral sensitivity curve of the psychophysical chro- matic channel measured under the same stimulus condition. The pupillary action spectrum had three prominent lobes with peaks in a long, middle, and short wavelength region and a dip in sensitivity near 570 nm

*Department of Ophthalmology and Visual Sciences, Texas Tech University Health Sciences Center, Lubbock, TX 79430-0001, U.S.A.

tTo whom all correspondence should be addressed [Email [email protected]].

(Sloan notch) which, in accordance with psychophysical theory, reflects the subtractive interaction of the under- lying cone-opponent mechanism (e.g. Sperling & Har- werth, 1971; King-Smith & Carden, 1976; Thornton & Pugh, 1983; Kalloniatis & Harwerth, 1990; Calkins et al., 1992).

Kimura and Young (1995a) confirmed Krastel's observation, but also showed that the pupillary responses evoked by monochromatic flashes on a steady-white background were more complex than previously as- sumed. Of specific relevance to the present study, Kimura and Young showed that the pupillary response is composed of at least two spectrally distinct components, only one of which has the Sloan notch in its action spectrum. Additionally, Kimura and Young showed that the OFF portion of the pupillary response (that is, the response that Kohn and Clynes referred to as the "color removal" effect) has the Sloan notch in its action spectrum.

The present paper investigates the nature of the putative cone-opponent interaction further. Because the dip in log sensitivity near 570 nm does not extend to minus infinity (Krastel et al., 1985; Kimura & Young, 1995a), it is unclear whether the pupillary visual process has a "neutral point", i.e., the property that the signal from the visual process could be nulled by selecting a light of some wavelength composition. In theory, a cone- opponent interaction may or may not have a neutral point. A process characterized by a subtractive interaction between L and M cones, e.g. IL-MI, is an example of a process with a neutral point. For some wavelength of light, the number of quanta absorbed by L and M cones would be equal, causing the output to become zero, i.e., IL-MI ~- 0. A process characterized by (IL-MI + L + M) would be an example which does not exhibit a neutral point, as the summing of L- and M-cone signals prevents

1543

Page 2: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

1544 E. KIMURA and R. S. L. YOUNG

the output from becoming zero. Interestingly, however, the action spectrum for this process would exhibit a Sloan notch. So, to further elucidate the nature of the pupillary visual process, the aims of the present study were to investigate whether pupfllary responses evoked by a red flash can be cancelled (or nulled) by adding a green flash, to determine whether such responses are consistent with a subtractive L- and M-cone interaction and to determine the relative weight of the quanta absorbed by L and M cones for such interaction. In keeping with psychophysi- cal terminology, we will refer to the response cancella- tion or nullification at the neutral point as "chromatic cancellation".

METHODS

The observers were the same three who participated in Kimura and Young (1995a). They all have normal color vision and normal visual acuity. Written informed consent was obtained from each observer prior to the start of the study. None of them were on medication during the testing period.

The stimulus fields were projected through a three- channel MaxweUian view optical system. One channel produced a steady white background field. The other two channels provided monochromatic test flashes that could be mixed at a beam splitter. Test wavelengths were controlled with a diffraction grating monochromator (Instruments SA, Inc., 4 nm half-band width) and an interference filter (Ditric Optics, <12 nm of half-band width), respectively. The observer viewed the stimulus with the left eye. A dental bite bar was used to maintain alignment between the observer's eye and the optical system. The pupillary responses were recorded from the observer's right eye using an IR video pupil tracking system (ISCAN model RK-416). The pupil diameter was recorded with about 21 #m of resolution and with a data sampling rate of 60 Hz. Resolution was determined both by estimating the smallest pupil diameter difference that can be discriminated by the recording system and by estimating the standard deviation in repeated measure- ments of fixed diameter artificial pupils. The two methods of determination provided essentially identical results. The responses to each stimulus condition were analyzed off-line. Other details are described in Kimura and Young (1995a).

Test fields of 30 deg diameter were flashed for 6 sec on a steady white background of the same size. The retinal illuminance of the white background field was about 2.43 log phot td (2.75 log scot td) which minimized the involvement of rods, at least when the test flashes were near threshold (Aguilar & Stiles, 1954). Results of our previous study conducted under similar background conditions support this belief by demonstrating that for relatively low intensity flashes, the ON and OFF action spectra do not show any evidence of rod intrusion [Fig. 4(B) of Kimura & Young (1995a)].

The test stimulus was either a monochromatic flash, a bichromatic mixture flash, or a temporal exchange of two monochromatic fields. In the case of the bichromatic

mixture, a monochromatic flash of fixed intensity was mixed with another monochromatic flash of variable intensity. In the case of the temporal exchange, the intensities of the two monochromatic fields were varied so that the quantum absorption by L (or M) cones changed while that by M (or L) cones remained constant. The intensities of the monochromatic fields were calculated according to the (quantized) spectral sensitiv- ity curve of each type of cones described by Smith and Pokorny (1975).

At the beginning of an experimental session, the observer dark-adapted for at least 10 min and then pre- adapted to the white background field for 2 min. The stimulus conditions were tested in a pseudorandom fashion during each experimental session which lasted approx. 3 hr. Each stimulus condition was repeated at least 30 times during the course of the experiment.

The novel aspect of our methods concerns the analysis of minute pupillary responses. In addition to analyzing the pupillary responses by conventional signal averaging techniques, we developed a method which exploits the probabilistic nature of threshold and near-threshold pupillary responses. Similar to psychophysical "yes/ no" responses, pupillary responses exhibit response fluctuation; that is, a dim flash of the fixed intensity may evoke a response on one trial but not on the next trial (e.g. Stewart & Young, 1989). Therefore, as an alternative measure of the pupillary response strength, we also examined the percentage of trials on which the pupil is observed to constrict.

Inspired by the psychophysical two-alternative forced choice procedure, we took the response frequency method a step further, developing a criterion-free, computer-automatic approach. Conceptually, a "decision maker" (a computer algorithm) compares two responses on a given trial. One response comes from a stimulus trial (i.e., a trial on which a stimulus flash was presented), and the other comes from a blank trial (i.e., a trial on which no flash was presented). The decision maker examines both responses and then decides on the basis of a "decision rule" which of the two comes from the stimulus trial. When a response occurs on every trial (as in the case for a bright flash stimulus), we expect the decision maker to obtain 100% correct performance. However, when no response is evoked (as in the case of a response null), we expect the decision maker to obtain 50% correct performance, that is, chance level. This approach is "criterion-free" in that the decision maker does not compare the responses against a criterion (e.g. 0.1 mm amplitude), but rather it compares whether one (e.g. a stimulus-evoked) response is larger than another re- sponse (e.g. obtained from a blank trial).

In actual application, pupillary responses were ob- tained from separate stimulus and blank trials, rather than from a single trial with two viewing periods, as is typical in psychophysical experiments. Additionally, the analy- sis was performed off-line after the entire set of data for the observer had been obtained. The off-line analysis procedure provided us with greater flexibility, allowing

Page 3: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

A CHROMATIC-CANCELLATION PROPERTY OF HUMAN PUPILLARY RESPONSES 1545

the data to be analyzed using several different approaches and algorithms. The computational strategy for determin- ing the percentage correct, hereafter the discrimination index, is based on work by Massof and Emmel (1987). The discrimination index was computed for each stimulus condition from NM paired comparisons of N stimulus and M blank trials. The confidence interval for a discrimination index value could be calculated using equation (16) described in Massof and Emmel (1987).

The "decision rule" used was that the response with the higher of the two "scores" comes from the stimulus trial. A "score" for each response waveform is computed by an algorithm which temporally integrates the initial constriction phases of the ON- and of the OFF-portions of the pupillary response. (A step-by-step description of the computational processes is provided in the Appendix.)

It may be worth noting that the computer algorithm was developed only after many attempts. The one finally selected was based on its high performance to correctly discriminate the stimulus from blank trials (for moderate intensity flashes) and on its reliability, as measured by the repeatability from session to session in a preliminary experiment [see Fig. 2 in Kimura & Young (1994)]. Additionally, the algorithm satisfied the criterion that the response waveforms identified as coming from a stimulus trial indeed appeared to the investigators as light-evoked pupillary responses.

fixed 650 nm • variable 530 nm

O: J ,

, ', 4 .9

', , 5 .3

: : 5.6 , , 5.9 r " , , 6.1 (j~°

, , 6 .2 . O ', , ' 6 .3 .....

' ' 6.4

' ' 6 .5 0

6.6 =~ > , ', 6 .7 v

, - '7"--------~- : ~ - - . 6.9 i ', 7.1

~ 7.3 7.5

,

0 . 5 m m

K \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ X . ~ ~/////Z//////////~ , t

0 2 4 6 8 10

Time (sec) FIGURE 1. The addition of green (530 nm) can reduce the response evoked by a red flash (650 ran). Topmost record illustrates that a dim

1 2 red flash (7.30 log quanta sec" deg" ) evokes a pupillary constriction following the flash onset (time zero) and offset (6 sec), Subsequent records illustrate the response obtained when the same red flash is mixed with a green flash of progressively greater intensity (designated by log values to the right). The arrow designates a red-green flash mixture which produces no obvious constriction. Each record was the average waveform of 30 responses. In this and following figures, "log Q" indicates quantum flux expressed as the logarithm of the

quanta sec z deg -2.

RESULTS

Averaged waveforms (Fig. 1) illustrate the pupillary responses evoked solely by a 650 nm (red) flash (topmost record) or by bichromatic mixtures consisting of the same red flash plus a 530 nm (green) flash of variable intensities (successively lower records). The pupillary responses are generally small in amplitude, consisting of constrictions (downward deflections) following the stimulus onset and offset. The series of responses suggest that increasing the total quantum flux incident on the retina does not necessarily lead to an increase in the response amplitude. The addition of the green to the red flash can decrease the constriction amplitude until a response minimum or a response null (designated by the arrow) is reached.

Such a demonstration, however, may not be univer- sally accepted as compelling evidence of a response minimum because the decrease in response amplitude is typically small relative to trial-to-trial variability and because the amplitude decrease may not be obvious in every observer (Fig. 2). So to investigate further whether a response minimum or null actually occurs, we developed an alternative method of quantifying the pupillary response. As described in Methods, we measured the response frequency (i.e., the percentage of trials on which a response can be detected).

ON 0.6 . ' . , . = . J . , •

o:4 2 _ _ 0.2

0.0 -

-0.2 ~ ' . * ' ' t , t ,

5 6 7 8

0 . 6 , ' . ' . , . , . , . ,

E O : M ~:~ 0.4

~ . 0.0 - E

<~ -~.2 , ' ." . . . . . ' • 5 6 7 8

0.6 ,'~' . , . , . , . ,

O: A 0.4

O.0 - -

-0;2 ,'." ' ' ' I 5 6 7

OFF 0.6 4 . , . .~ i , J •

O" J 650nrn: 7.30 log O

0.4

0.2 - -" ~ [ ~ r ~ v ~

0.0

- 0 . 2 " • ' ' '

5 6 7 8 0 . 6 4 . , . , . , . , . ,

0 : M 65Ohm: 7.41 log Q 0.4

0.2 n ' ~ = - ° .0 _ - 2 _

-0.2 n . * i i

5 6 7 8 0 . 6 ~ ' . " , , . , . , .

O : A 650rim: 7.62 log Q

0.4 .

0.2

-0.2 I 5 6 7

Log Q of 530 nm Light

FIGURE 2. Amplitude of the ON- (left column) and OFF- (right column) portions of the pupillary response as a function of the 530 nm flash intensity in the red--green mixture. The intensity of the 650 nm flash was fixed at the level shown in the right graph for each observer. The leftmost data point in each graph shows the response amplitude

evoked by the 650 nm flash alone. Error bars show _+ 1 SEM.

Page 4: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

1546 E. KIMURA and R. S. L. YOUNG

The results of our response frequency analysis were similar for all three observers (Fig. 3). When the green flash is presented by itself (Fig. 3, top left), the discrimination index function resembles a psychometric function. The discrimination index increases from chance level (50%) for very low flash intensities to 100% for more intense flashes. By comparison, however, when a red flash is simultaneously presented with the green flash, the discrimination index function is different. Rather than increasing with the green flash intensity, the discrimina-

tion index falls at first. For certain intensities of the red flash such as 7.10 log quanta sec -~ deg "2 for observer J, 7.21 log quanta sec ~ (leg "2 for observer M, and 7.62 log quanta sec "1 (leg -2 for observer A, the discrimination index falls sharply to chance level. The fall in performance to chance level is significant as the performance for lower green flash intensities lies above the shaded area, the 95% confidence interval around chance level. (Note: Results of the analysis used here and in the remainder of Results is based on both the ON- and

(a) 100

90

80

70

60

50

,.--, 40

X 100

"~ 90 c- e- 8O

• ~ 70

c" 6O

~ SO

0 4O m t21

100

90

80

70,

60

50

40

5 6 7 8

6 5 0 n m : 6.90 log Q ~

./.~ , I , I , I , I

6 6 7

- 65Onto: 7.10 log Q //-"~

[

, ' . ~ , I , I , I , I

5 6 7

O: J

,OO, o

8o i

60

5O

5 6 7 8

100 . 650nm: 7.50 log Q

g O • • / .

80 ' < ~

70

60

5O

40 / . " ' ' ' ' ' I , l

100

90

80

70

60

50

40

5 6 7

.~ t . , . , . ~ . i - 650nrn: 7.70 log Q •.,o .~ "

5 6 7

Log Q of 530 nm Light

(b) O:M

100

90

80

70

60

50

40 g X 100

"O 90 c"

c- 80

O 70

c- 60

E so

o 40

a

5 6 7 8

~ A . i . = . , . J

650rim: 7.01 log Q / ~

~ . . t , i , i , I , l

5 6 7 8 "/-¢ . i . i . J . ,

100 650nm: 7.21 log Q =,,"---

90 /

80

70. • •

60 • • •

5 0 ~ ~ ° = = " . . . . ~ " " . . . . . . •

40 -// , I , i , I , i 5 6 7

100

90

80

70

60

50

40

100

90

80

70

60

50

40

10C

90

80

70

60

50

40

650nrn: 7.41 log Q ~ .

/

5 6 7 8

65Onto: ~.61 log Q ~.

/.~ 1--t~. ; I :

, J , I , I , I , I

5 6 7 8

" - ' . , . J . , . J

65Ohm: 7.81 log O . ~

/ / - e ~ . . . . . . . . . . i

i ' d , I , I , I , I

5 6 7

Log Q of 530 nm Light

(c) loo

90

80

7o v 60 X ( D 5 0

"O ¢'- 40 c -

' ~ 100 . 90 80

"¢,~ 70 . m

D 6O

50

40

O:A . , , , ~

100

8O

70

60'

5O 40

5 6 7 8 5 6 7

100 - 650nm: 7.62 log Q

80 ee 70

°° i 5O 4O

5 6 7 8 5 6 7 8

Log Q of 530 nm Light

FIGURE 3. Percentage of trials on which a pupiUary response evoked by red-green mixtures can be correctly discriminated from noise. The intensity of the red flash in the mixture was fixed at the level designated in the upper left corner of each graph. The intensity of the green flash (530 nm) is shown on the abscissa. The far left point in each graph corresponds to the discrimination index when only the red flash was presented. The shaded area shows the 95% confidence interval around chance discrimination performance. Curves illustrate theoretical func- tions based on the (L-M) cone-opponent model described in the text. The results are presented separately for three observers: observer J (a)

observer M (b), and observer A (c).

Page 5: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

A CHROMATIC-CANCELLATION PROPERTY OF HUMAN PUPILLARY RESPONSES 1547

OFF-portions of the responses. Preliminary analysis of either response portion showed similar results. However, analysis based on both response portions generally resulted in smoother discrimination index functions and was therefore considered more informative.)

The green intensity required to decrease performance to chance level seems to depend in part on the red intensity. In general, the higher the red intensity, the higher the green intensity required. However, when the red intensity is increased beyond some level (7.30 log quanta sec" deg -2 for observer J and 7.41 log quanta sec "1 deg "2 for observer M), there is no obvious evidence that the discrimination index fails to chance level. Additionally, inspection of the averaged response wave- forms also provided little, if any, hint of an obvious response reduction. The high intensity results for observer A were not obtained, as observer A was not available for subsequent tests.

To investigate whether the discrimination index functions could be described in terms of a subtractive L- and M-cone interaction, a quantitative model was developed. The model was inspired, in part, by the psychometric discrimination function

f(I) = 1 - 0.5 * 2 -(t/rY (1)

where T is the threshold, I is the flash intensity, and ~ is a free parameter to adjust the steepness of the function. To incorporate the cone-opponent process into the discrimi- nation function, we substituted (L-M) in place of the flash intensity so that

f (L, M) = 1 - 0.5 * 2 -(Iw*L-MI/rY (2)

Now f(.) is a function of the quanta absorbed by L and M cones. A relative weighting coefficient, w, is used t o take into account the possibility that the quantum absorptions by L and M cones do not have the identical effect on the pupillary response. The difference in cone quantum absorption is rectified to conform to the empirical observation that an increase in quanta absorbed either by L or M cones alone results in an increase in the discrimination index (described below).

The fit of the model [equation (2)] to the data is illustrated in Fig. 3. The model first of all accounts for the discrimination index function when the green flash is presented by itself (Fig. 3, upper left graph). In this condition, the rectified (L-M) signal increases propor- tionally with the green flash intensity. Secondly, the model accounts for the discrimination index function when relatively low intensity red flashes are added to the green flash. In these conditions, the rectified (L-M) signal changes nonlinearly, at first, decreasing toward zero as the intensity of the green flash increased, and then later increasing with further increases in the green intensity. The actual discrimination data show similar changes. The adequacy of the model, however, breaks down when higher intensity red flashes are added to the green flash. Here, the model continues to anticipate a fall in performance to chance level at some green intensity,

but the actual discrimination indices show only a slight fall, ff any.

The model also helps to pinpoint the intensities of the red and green flashes that cause the discrimination index to fall to chance level (Fig. 3). When expressed in terms of the quanta absorbed by L and M cones, these red- green mixtures show an interesting property (Fig. 4). Intensities of the red and green flashes are such that the quanta absorbed by M cones are proportional to those absorbed by L cones.

The weighting coefficient, w, is a main result of the theoretical fit of the model to the data (Table 1). The weighting coefficient varied slightly for different stimu- lus conditions, but because no systematic relationship was apparent, the values were averaged for each observer. The coefficients for all three observers indicate that the quanta absorbed by L cones are weighted slightly less than those absorbed by M cones. For comparison, we also showed the relative weighting coefficients for psychophysical responses (Table 2).

Complementing the red-green mixture experiment, we also examined the responses evoked by temporally exchanging two colors in a manner such that only the number of quanta absorbed by one type of cones (either L or M cones) is changed. The results show that the discrimination index rises as the quantum absorption by either L cone alone or M cone alone is increased (Fig. 5). For comparison, data from the green alone condition (taken from Fig. 3, top left) are replotted to illustrate the results obtained when the quantum absorption by L and M cones are simultaneously increased. The main point is that the discrimination index for either the L or M cone alone condition lies to the left of that for the L and M cone condition. This finding demonstrates that the pupil is more sensitive to a flash in which most of the quanta are absorbed by one cone type as compared to a flash in which the same number of quanta is absorbed by two

¢/} ¢- 0 0

'10 "7,

0

m

N e . . .

o x

%

10

i i i i i

o J

[] M A A

2 4 6 8 10

10 6 x Quanta sec "1 deg "2 for L- cones

FIGURE 4. Quantum absorptions required for pupiUary chromatic cancellation. The red-green color mixtures for cancellation are determined from the fit of the (L-M) cone-opponent model to the data shown in Fig. 3. The quantum absorption by M cones appears to increase proportionally with the quantum absorption by L cones for all three observers. Lines illustrate approximate linearity in the relation- ship. This property is consistent with the subtractive L- and M-cone

interaction.

Page 6: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

1548 E. KIMURA and R. S. L. YOUNG

types of cones. (Note: The green alone condition was used for the comparison because extensive data for this condition had been collected. If the pupillary responses are mediated by a subtraetive L- and M-cone interaction, One might expect that an even more dramatic difference could be demonstrated had we compared the L or M cone alone condition to a flash condition near or at the spectral neutral point of the subtractive cone interaction. Pre- liminary results for a yellow, 570 rim, flash show this to be the case. The discrimination index function for the 570 nm flash condition lies even further right of the function for the green alone condition.)

DISCUSSION

Previous studies (Krastel et al., 1985; Kimura & Young, 1995a) suggested that the pupillary visual process underlying the detection of chromaticity changes may be modeled as a cone-opponent interaction not dissimilar to that involved in perceptual red-green color detection. The present results support this belief and further elucidate the nature of the pupillary visual process by providing direct evidence for chromatic cancellation and the existence of a neutral point. The chromatic cancella- tion is observed for all three observers as documented in terms of the percentage of trials on which a stimulus- evoked response can be correctly discriminated from noise (Fig. 3).

If the pupillary responses were simply driven by cone- opponent signals, one might further expect the pupillary responses to be bidirectional; for example, the pupil constricts in response to red flashes and dilates in response to green flashes. While such bidirectional responses are neither found in the present nor previous studies, the present study shows that the pupillary responses can be modeled by a rectified subtractive L- and M-cone interaction. The results showed that the shape of the discrimination index functions can be described fairly well across a range of conditions by such a model (Figs 3 and 5). Moreover, the empirical data conform with the prediction that, in order to maintain a null response, Iw*L-MI = 0, the quanta absorbed by M cones must increase proportionally with the quanta absorbed by L cones (Fig. 4). Finally, the sensitivity of the pupil is higher when the quanta are absorbed by only

TABLE 1. Relative weighting coefficient, w*, for pupillary responses

Observer Range? Mean

J 0.52-0.72 0.66 M 0.57-0.81 0.67 A 0.52-0.70 0.60

*Coefficient w from the equation Iw*L-MI = 0. tCoeffieients obtained for the different conditions shown in Fig. 3.

L or M cones than when the same number of quanta is absorbed by both L and M cones (Fig. 5).

If the pupillary responses are driven by a subtractive L- and M-cone interaction, the question arises whether the relative weight of the quanta absorbed by L vs M cones derived from pupillary experiments is similar or dissim- ilar to that derived from psychophysical experiments. Because chromatic cancellation was found for the pupillary response, the coefficient w in the equation Iw*L-MI = 0 can be determined in a straightforward way (Table 1). The results show that the w for the pupillary responses lies within (albeit at the lower end of) the range of values computed from published psychophysical results (Table 2). In both the psychophysical and pupillary responses, the quanta absorbed by L cones are weighted slightly less than those absorbed by M cones.

If the pupillary responses were driven solely by a subtractive L- and M-cone interaction, one might expect that chromatic cancellation would occur independently of the flash intensity. Our results, however, show that chromatic cancellation only occurs across a narrow range of flash intensities near the pupillary threshold, raising questions about whether or how this intensity-dependent property is consistent with the L- and M-opponent model. One possibility is that the cone interaction has a nonlinear intensity-dependent property, and thus, cannot be simply explained in terms of a subtractive interaction. Another, perhaps more likely, possibility relates to the finding that there are multiple underlying visual processes which, among other properties, have different action spectra (Kimura & Young, 1995a). According to this possibility, the L- and M-cone opponent process would be the most sensitive process, whereas other process(es) would have lower sensitivity when the observer is adapted to a steady white background. Complete chromatic cancellation occurs only across a limited intensity range because it is only across this range that the pupillary response is

TABLE 2. Relative weighting coefficient, w, for psychophysical responses

Studies* wt Sources of estimate

Kalloniatis & Harwerth (1990) 0.64 Spectral sensitivity curve in rhesus monkeys on white background (1.5-4.5 log td)

0.74 Spectral sensitivity curve on 578 nm background (3.83 log td)

0.80 Psychophysical spectral sensitivity curve using stimulus conditions similar to present study

Calkins et al. (1992)

Kimura & Young (1995a)

*Studies providing comparable data to the present study. #Coefficient averaged across subjects.

Page 7: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

A CHROMATIC-CANCELLATION PROPERTY OF HUMAN PUPILLARY RESPONSES 1549

O: J

100 . . - . . .

90 X

~ 7o

._ 60

121 5O

40 4 9 9

i , i ,

0 • I I I I

5 6 7 8

Log (QL+QM)

lOO

90

80

70

60

50

40 4

_Q: M i i ! l

O Oo° I I I I

5 6 7 8

Log (QL+QM)

FIGURE 5. Comparison of the pupillary discrimination index for a condition in which the quanta are absorbed by both L and M cones (O) vs conditions in which the same number of quanta is absorbed mostly by either L or M cones ( • or I ) , respectively. In this graph, ff signals from L and M cones subtract from one another, the data from the (L & M) condition should lie to the right of the data of either the L or the M condition. If signals from L and M cones add with one another, the reverse should occur. Solid curves illustrate the adequacy of the (L-M) cone-opponent model. The parameter w was set at the value shown in Table 1. The other parameters in equation (2) were allowed to vary.

solely mediated by the subtractive L- and M-cone process; above this intensity range, the pupillary response is presumably mediated by the subtractive process and other process(es).

In summary of the above discussion, all the results in the present study are consistent with a cone-opponent hypothesis. It may be worth mentioning, however, that prior to Krastel's discovery (Krastel et al., 1985) of a Sloan notch in the pupillary action spectrum, Young and Alpern (1980) suggested a more general hypothesis regarding how the pupillary responses are evoked by chromatic stimuli. The hypothesis was that the pupillary constriction is evoked by a chromaticity change detector or some mechanism which signals a temporal change in the chromaticity of the visual scenery independently of luminance. The chromaticity detector would provide a signal whenever the chromaticity (x, y) of the visual field is changed to (x + Ax, y + Ay); otherwise, the detector remains silent. Such chromaticity detector could account for chromatic cancellation. The response evoked by one chromatic flash can be cancelled by the addition of another chromatic flash when the mixing of the colors results in a flash with the same chromaticity as the background. In that case, the flash would not produce a chromaticity change; thus, the response to the mixture flash would be nulled.

In the present experiment, however, the chromatic cancellation occurs even though the chromaticity of the bichromatic mixture is different from that of the back- ground. One can appreciate the chromaticity difference

*Note: Intensities of red-green mixtures required to produce a null response are in the order of 100 times less than the S-cone threshold as estimated from the results of Kimura and Young (1995a). The S- cone threshold for observer J is 8.17 log quanta sec 1 deg 2, for observer M is 7.72 log quanta sec 1 deg 2, and for observer A is 8.28 log quanta sec "1 deg "2 for 530 nm flashes. The intensity of the 650 nm flash is not important, as S cones absorb the negligible number of quanta of this wavelength.

between the flash and background in terms of the underlying photoreceptor signals: the mixture flash is void of S-cone signals,* whereas the intense white background produces a substantial S-cone signal. So the present results imply that if the chromaticity detector hypothesis is to remain tenable, one must presume that the chromaticity detector is tritanopic or at least have weak S-cone input. Furthermore, because there is evidence that S cones contribute strongly to pupillary responses evoked by changes in stimulus chromaticity (e.g. Young & Alpern, 1980; Kimura & Young, 1995b), one would have to presume that the S-cone mediated chromaticity detection occurs independently of the chromaticity detector isolated under the present condi- tion.

In conclusion, the present results describe a new pupillary response property, chromatic cancellation, which contributes further to the belief that the pupillary visual processes are, in some respects, functionally similar to perceptual visual processes. The pupillary visual process mediating the chromatic responses can be modeled with a cone-opponent interaction, providing the visual signals are rectified.

R E F E R E N C E S

Aguilar, M. & Stiles, W. S. (1954). Saturation of the rod mechanism of the retina at high levels of stimulation. Optica Acta, 1, 59-65.

Barbur, J. L., Birch, J. & Harlow, A. J. (1992). Threshold and suprathreshold responses to chromatic stimuli using psychophysical and pupillometfic methods. Noninvasive assessment of the visual system, 1992 Technical Digest Series (Vol. 1, pp. 51-54). Washington, D.C.: Optical Society of America.

Calkins, D. J., Thornton, J. E. & Pugh, E. N. Jr (1992). Monochromatism determined at a long-wavelength/middle-wave- length cone-antagonistic locus. Vision Research, 32, 2349-2367.

KaUoniatis, M. & Harwerth, R. S. (1990). Spectral sensitivity and adaptation characteristics of cone mechanisms under white-light adaptation. Journal of the Optical Society of America A, 7, 1912-1928.

Kimura, E. & Young, R. S. L. (1994). A noninvasive, objective method for investigating cone-opponent signals in humans: Pupillary

Page 8: A Chromatic-cancellation Property of Human Pupillary Responses · our understanding of the nature of the human pupillary visual pathway, raising such questions as to whether the underlying

1550 E. KIMURA and R. S. L. YOUNG

responses evoked by bichromatic mixture flashes. Vision science and its applications, 1994 Technical Digest Series (VOl. 2, pp. 308- 311). Washington, D.C.: Optical Society of America.

Kimura, E. & Young, R. S. L. (1995a). Nature of the pupillary responses evoked by chromatic flashes on a white background. Vision Research, 35, 897-906.

Kimura, E. & Young, R. S. L. (1995b). Pupillometric investigation of an S-cone generated response in humans. Vision Science and Its Applications, 1995 Technical Digest Series (Vol. 1, pp. 282-285). Washington, D.C.: Optical Society of America.

King-Smith, P. E. & Carden, D. (1976). Luminance and opponent- color contributions to visual detection and adaptation and to temporal and spatial integration. Journal of the Optical Society of America, 66, 709-717.

Kohn, M. & Clynes, M. (1969). Color dynamics of the pupil. Annals of the New York Academy of Science, 156, 931-950.

Krastel, H., Alexandridis, E. & Gertz, J. (1985). Pupil increment thresholds are influenced by color opponent mechanisms. Ophthalmologica, 191, 35-38.

Massof, R. W. & Enamel, T. C. (1987). Criterion-free parameter-free distribution-independent index of diagnostic test performance. Applied Optics, 26, 1395-1408.

Saini, V. D. & Cohen, G. H. (1979). Using color substitution pupil response to expose chromatic mechanisms. Journal of the Optical Society of America, 69, 1029-1035.

Smith, V. C. & Pokorny, J. (1975). Spectral sensitivity of the foveal cone photopigments between 400 and 500 nm. Vision Research, 15, 161-171.

Sperling, H. G. & Harwerth, R. S. (1971). Red-green cone interactions in the increment-threshold spectral sensitivity of primates. Science, 172, 180-184.

Stewart, B. E. & Young, R. S. L. (1989). Pupillary response: An index of visual threshold. Applied Optics, 28, 1122-1127.

Sutter, E. E. & Tran, D. (1992). The field topography of ERG components in man--I. The photopic luminance response. Vision Research, 32, 433--446.

Thornton, J. E. & Pugh, E. N. Jr (1983). Red/green color opponency at detection threshold. Science, 219, 191-193.

Young, R. S. L. & Alpern, M. (1980). Pupil responses to foveal exchange of monochromatic lights. Journal of the Optical Society of America, 70, 697-706.

Young, R. S. L., Clavadetseher, J. E. & Teller, D. T. (1987). Screening of red-green color-deficient observers using the chromatic pupillary response. Clinical Vision Science, 2, 117-122.

Young, R. S. L., Han, B. H. & Wu, P. Y. (1993). Transient and sustained components of the pupillary responses evoked by luminance and color. Vision Research, 33, 437-446.

Young, R. S. L., Kimura, E. & DeLucia, P. R. (1995). A pupillometric correlate of scotopic visual acuity. Vision Research, 35, 2235-2242.

Acknowledgements--This work was supported by National Eye Institute Grant (EY08384) to R. S. L. Young, by an unrestricted grant from Research to Prevent Blindness, Inc., to the Department of Ophthalmology and Visual Sciences, and by a Grant-in-Aid of Research from the National Academy of Sciences through Sigma Xi to E. Kimura. Dr Lieyi Fang provided valuable comments on an earlier draft of this paper.

APPENDIX

Calculation of the discrimination index. The purpose of this Appendix is to provide a step-by-step

description of the computational processes involved in calculating the discrimination index. In general, two stages in the computation can be distinguished, the calculation of a "response score" and the decision making process which "decides" on the basis of the response score whether a response is stimulus-evoked or not. Note that the computation described below deals with responses obtained from individual trials, not with the averaged response.

Steps in Computing a Response Score

Step 1

The individual response was passed through a low-pass temporal filter (a running average algorithm) to improve the signal-to-noise ratio.

Step 2

Upward or downward baseline slopes in the response were removed [see Figs. 1 and 2 of Young et al. (1995) for illustration of the baseline slope]. We estimated the baseline slopes for the ON- and OFF- response portions separately from the time-average of the first derivatives over the period just prior to the flash onset or to the offset. The slopes were then removed from the ON- and OFF-response portions.

Step 3

A "template function" was then multiplied to the ON- and OFF- response portions. This procedure, in effect, "filters" the responses further [a procedure similar to the one implemented more elegantly by Sutter & Tran (1992)]. The template function was derived from the normalized, averaged response waveforms evoked by flashes.

Step 4

Finally, a "response score" was computed for the ON- and OFF- portions of the response. The response score is simply a scalar value, the temporal integral of the pupil amplitude during the fixed time period corresponding to the constriction phases of the ON- and OFF- portions of the stimulus-evoked pupillary response. The response score was computed in the same way for responses acquired from stimulus and blank trials.

The decision making was done by a computer algorithm after all of the responses had already been collected. For each stimulus condition, there would be N trials and, of course, N response scores. Additionally, there would be M response scores acquired from blank trials. To compute the discrimination index, each response score obtained on a stimulus trial was compared with each score obtained on a blank trial, and the percentage correct (hit rate) was computed for the NM paired comparisons. The decision rule was that a stimulus-evoked response is the one with the larger score. For example, suppose the response scores obtained on trials for one stimulus condition are 5, 7, 8, and 9, while the response scores obtained on blank trials are 0, 3, 6, 3, and 4. The response score 5 on the first stimulus trial is larger than four out of five scores on blank trials. The response score of 7 is larger than all five of the response scores on blank trials, and so on. In total, the response scores for this stimulus intensity are larger in 19 of 20 (or 4 × 5) comparisons. Therefore, the discrimination index for this example would be 0.95.

The decision making process was repeated for each stimulus condition. The responses from blank trials obtained in all experimental sessions were pooled and used for every stimulus condition. The total number of blank trials was 330 for observer J, 360 for observer M, and 120 for observer A.