Arthur Melvin Farley Ca rnegi e - Me I Ion University ...

AD/A-004 090

VIPS: A VISUAL IMAGERY AND PERCEPTION SYSTEM; THE RESULT OF A PROTOCOL ANALYSIS. VOLUME I

Arthur Melvin Farley

Ca rnegi e - Me I Ion University

Prepared for:

Air Force Office of Scientific Research Advanced Research Projects Agency

May 1974

DISTRIBUTED BY:

mh y#MAMl Tar hair ■! lafarB^iaa CMvlikA

U. S. KPARTMENT OF COMMERCE

r"" " .. i I

I

I I

Best Available

Copy

•

TT\TTAQ«;TT-Trn StCUNlTV CLASSiriCATlON OF THIS PAOC <H^•>n t)»- Frtmr-dl

REPORT DOCUMENTATION PAGE 1 NCPORT NUMBEH 2 COVT ACCtSJION MO

«. TITLE <i>a iubtul»)

VIPS: A VISUAL IMAGERY AND PERCEPTION SYSTEM; THE RESULT OF A PROTOCOL ANALYSIS , VOL I

r AuiHonr«;

Arthur Melvln Farley

• PCN^ORMING ORGANIZATION NAME AND ADDRESS

Carnegie-Me lion T'r.iverslty Computer Science Dept. Pittsburgh, PA 15213

11. CONTROLLING OFFICE NAME AND ADDRESS

Advanced Research Projects Agency 1400 Wilson Boulevard Arlington. Virginia 22209

• 4. MONITORING AGENCY NAME * AOORESSfU dillmnitt horn Lcnltolllng Olliei)

Air Force Office of Scientific Research (NM) 1400 Wilson Boulevard Arlington. Virginia 22209

RKAD INSTRUCTIONS BF.KOKE COMPLETIN-. FORM

) RECIPIENT'S CATAwfiC NUMQCR

i TVRC Br REPORT • PERIOD COVERED

Interim

• ■ PERroRMINC ORC. REPORT NUMBER

•• CONTRACT OR GRANT NUMBCRffJ

F44620-73-C-0074

10. PROGRAM ELEMENT. PROJECT, TAS< AREA A WORK UNIT NUMBERS

61101D AO-2466

It. REPORT DATE

May 1974 II. NUMRER OF PACES

158 IS. SECURITY CLASS. (»1 IM» fpotl)

UNCLASSIFIED

11«. OeCLASSiriCATION/OOMNGRADINO SCHEDULE

I«. OISTRISUTION STATEMENT (ol IM» HtpoH)

APPROVED FOR PUBLIC RELEASE; DISTRIBUTION UNLIMITED.

IT. OlSTRHUTlON STATEMENT (»I Ih» •»•(racl infr»4 In Bleck JO, II 4UI»t*nt htm Rtport)

IS. SUPPLEMENTARV NOTES

It. KEY WORDS fCMiiMu* an r*v«r<« tlät II n«ca«*wy m%ä Idmnllly t* Mack niffli»«0

R^prortur^H ttv

NATIONAL TfCHNICAL INFORMATION SCRVICE II S Department of Cornrr'prfp

Spnngfujl.l VA IIVA RKB SUUET10 OUNGE 20. ABSTRACT <rMt«fHM M »»«•• (i4* ii i»c««fwy an« «Mniifr »r »'«ck mMik«o VIPS is a program Clmplamented in LISP 1.5) wihic embodies a psychological theory of visual imagery and form per ccptlon. An experimental task was designed which required subjects to perform perceptual activity over an extended time frame. The subject was required to mov( a small viewing hole about a presented line drawing until being able to produce a verbal recall description and drawn reporduction of the whole picture. The sub" Ject was also instructed to "think aloud" during the hole movement prodecure. Transcriptions of selected video-tape protocols served as the immediate basis for VIPS design. Relevant research results of cognitive psychology provided addition

DO.KTnUn CDiTioNoriMov..i.o.soL.T« y UNCLASSIFIED (continued)

SECURITY CLASSIFICATION OF THIS PAGE <*■*>•* Dmlm EnltrtdJ

* . 20. abstract (continued)

al design criteria. Behavioral correspondences between protocols and equivalent traces of VIPS activity indicate theory sufficiency. The theory proposes that visual form perception is a constructive activity involving the coordinated use of several memories and processes, which are defined. The resultant visual image (the perception) is realized by the integration of a succession of views of (fix- ations upon) the external environment stimulation. A proposal for the form and content of symbolic visual imagery is developed as a necessary part of VIPS. A comparison of recent research indications leads to the proposal that flexibility of information representation is a fundamental aspect of human cognition.

i ! 1

I

a

VIPS: A Visual Imagery and Perception System;

the result of a protocol analysis

Volume I

Arthur Mclvin Farley

Department of Computer Sciertce Carncgie-Me! Ion University

Pittsburgh, Pennsylvania 152]3 May, 1974

Submitted to Carneglc-Mellon University in partial fulfillment of the requirements for the degree of Doctor of Philosophy.

This work was supported by the Advanced Rerearch Projects Agency of the office of the Secretary of Defense (F44620-73-O0074) and is monitored by the Air Force Office of Scientific Research. This doc- ument has been approved for public release and sale; Its distribution is unlimited.

1 i

PNETACI

TMIS WORK WAS PROMPTED B< A NUMBER Of £X?E^;£\C-S WHICH iNOKATEO TO

ME THAT VISUAL PERCEPTUAL EXPEIQCNCI IS NOT itVtSI MERtLV A REFLECTION Of

THE iTATF OF AN EXTERNAl 5TIMJLATi\c; ENVIRONMENT THIS UO TQ A OESIR" TO

UNOi »STAND HOW THE WCEPTUAl PROCESSfS OF VISION CRE4TC PSRCEPTtONS

FROM THE STRfCTuREO ITMJLATXM VACHMG THE RETINA THE INVESTIGATION IS

AS VET INCOMPLETE, VIPS BEING AN INITIAL M03EL RiOUlRING FORTHER EXTENSION

AND SPECIFICATION

I GRATEFULLV ACKNOWLEDGE TME HELP OC M MERCEDES "BIMMT KQST^AS IN

THE PREPARATION 0' THIS MAVJSCRPT AND THE "ELP OF OR. THOMf.S VORAN IN THi

IMPLEMENTATION OF THE IMAK.TV A'fl POK&Wi ?V3T:M

/<

bradiaK.

*i

ABST~,\CT

v:::>s rs a program (om;:~'em!!n:ed '" US? 1.5) wa .~h embodoes a psycho!03r: Jl

t ~?o· ; of vosuJt tmaa~ry and form per :~;,!.on. ,\n ox;:lartmental t •• ;. was da:.• J .,ed

un! ol b~tn~ able t ) produce a verbal rc:J,l ce~:r.;:~t .Jn and dra·Nn reproduct.on ~I !he

whole prcture. The subject was also tnstru;l~d to ":,,ml<. aloud• durtn& :he h::~:a

movement pr;,cadure. Transcr .pltons of selected .. d~J·Ia;:~e protocols serv.:!d JS the

•--n--ne~ral!! basts l or VIPS desrgn. Rele 1ant rese~rch r:!~ult!O of cognrltva p:;y::,o!oay

provrded addtl tO,al des1gn crrteraa. Beha·JrOral o~rc~;:~or:::lences belweel'l ;:~r ;,':;,: :>'>

and equt1alent lrJces of Vl?S ac!11rl y rn::lr:a:e l h:!ory sufftctency. The theory

vo:;~Fol una•:p (:ne per~!!plton) •s realized by the tnlegralton of a suc~es~•on of 'I'!!'NS of

(frxa:·o .• s u;:~on) lh:! c:.~!.Jrnal c.,·~~~on:r~'ll s!tm!Jiatr:>n. !\ proposal for the fOr "n nd

tnfor .. ,at.oo rci)rcseniO!hOn rs 3 i.JndJ:r.e.,t JI J~;:~ect .>! hum.l., cognrtron .

• ' :r'

VOlUMt I

TABLE OF CONTENTS

3

Ci'APHR 1 1 Introduction

Imagrr, I hisTowr or iMAOte» 1 MEANING «T "IMA«" b VISUAL IMAGE SPtCinCATION 8 VISUAL IMAGE ClASSIf ICATH» . . 10

Vi5u»i fo"n Pe'Crption 11 CLASSICAL THEORV li CtSTALT THEO.* 13 TOPMAL A.ÔMECMArjICJL PATTERN PECOCNITION AN ALTERNATIVE • OONSTMUCTIM THEORV 15

jot'i o* tê Thesis la Thî.s Cort»»! Gu'd» . . 21

CHAI

1 '

.4

CHAPTER 12 E»pe'-ents jnd An^/sn »

TLIBJECTS ?1 EXPfRIANT I ?6 UPPK-ÄW II ?8 STIMULI CHAHACÊRISTICS

2 Anaiytif Jl DATA TRANSCRIPTION 31 IRANSCRIPTiONUSt 34

2. 1

?9

CHAPTCR 13 The Kjge »»»•i^ntjt.o"

1 îgf Wep'p'.p'-t»l>C" Cfite'u 38 2 'he Vi-.u«! I^'ip.» Ppp-esf'ji on 41

SVMH'lJC »M'RtSfNTATION 41 IMAGE CWJNKS 42 IMAGE CMUW CHARACTERISTICS . 44 VfRTE» CHUNK 47

CHA'

1 •■

2 •

-'

IMAGE 900» "XESS - TRAVERSAL" OBJECT CHUNK LINE CHUNK ■LINE .52 SIDE CHUNK . FACE CHUNK

49 51

53 54

1NTERCHUNK RELATIONS ... 5? EQUIVALENCY AND REDUNDANCY . .. M IMAGE REPRESENTATION FLEXIBILITY .

Tha Imige m VIPS ... 60 59

CHAPTER 14 Th» fo'm and Activity o' VIPS 63

Syst»m Overvew 63 THi MEMORIES 64

I. PICiPICtur») . . 65 << VRIVisuH Reguler) 67

VI ... 68 EKP and ATT 69 DIR »nd RAN . 70

3 STM (Short T»rm Memory) .71 Components 0* Long Term Memory ... 73 4 LTM'Long Term Memory) ... 73 6 RL'M (Re-ognit'On Long Term Memor,' 74 6 1TM'Intermeddle Term Memor/) . 76

THE PRiJCESSES a I VI SYS (V'Sual Input Process) ... 7» Process S'm.'anlies 80 Process Control Structure 8? ? AA SYS (Av.imiljtiOn Accomodal.On ^'OCl-SSI 3 PEC SYS (RlCop.mtion Process) 84 4 INC SYS ilNCorpor.it.on Process) 8h

Die S.'tem .n Action 86 A PROIOCOL - PROGRAM TPACE SECJtNCE 86 'MfORETICAL IMPLICATIONS 9? OOAl PELATEO tPlSODES 93

.-si

CMAPTER 1% vits Eitownwi

n 1 Memory t «tensicin TCLTM (temporal Contc»tuai long term Memory) SLTM (Semantic LOng Term Mrmory) 98

2. Three - Dimensional Pictu'e Perception . 99 RELEVANT PROPOSALS 100 A THEORY 101 PROTOCOL INDICATIONS . 103

*b

/*

'I

SPAn.H Cor.SISUNCV . 104 FUHTHER WOTÜOX mOKATlONS 109 jenerdltjt'ü Vt^u^' Inidge ^nd Perception System 109 IMAGE Gt\fRALi;ATION . , 109

EUMMT OENOUitttTiaN 110 PEBCEPriON SYSTEM GENEBALI.'ATION U-".

THE PfCF-Tl'.!'. GOAl .. IN PERIPNERAL ViSiOH 116 PERIPHERAL iNF0»MAT10N RtPHEScNTATiON .118 THE SINGLE (INITiAL» riXATIOM . 119 EVEMOVEMEW SEQUENCES 123

CHAPTER lb Conclu^njn 129

Study con p^'^on . 12'» IUYIOR-S BLOCKS . 129 .: WtWS STIMULUS rNCOCINO . . 131

M.1RAN-0 PATH IMAGE n3 RE PRE SE IM f A T ION COWPARISDN 134

Fiesib.' ly o* Rep'Cientjtion .. 135 LANGUAGES OF ART 136 A THEORY Of rOGNIIiOM 138 PSYCHOLOGICAL INDICATIONS ■ M4 RELATED PROPOSALS , l<»5 THE ROLE OF REPRESENTATION , 147 ruture Rts»»rch, Conduvon 14*

REFERENCES I»)

ALL APPENDICES ARE FOUND :, VOLUME II

K//

.-

/ ^.

V;r3 A V ua> i^üge'y ina Percept on Sysle"";

Cna:'er LI - Introauct'Oi

The t tie 0' !hi« thesis coive^s the dual nature ot its content Both th« imjjery

sys'otr' usei to 'eD'^.ent vsuat mtor-matic" and tr-e oercept'jji pôcesi>es used to

u-je-Mand lha external v%utl enure--- -t are invest gated Tnesi l«0 concerns are

not "dcie-'rtäni but rainj-, t-e, a'» tunaaêntai, nttrreiated

'his tn-foojeto'» chapter * rj» presents a o.-êf h.story o' me ideas aoout visual

imagery ^nd pe'eept on T-en tnere t* 'ows a statement ot tue goais ot the tnesis

Finally, an euilmf ot content is presented to guide the reader through or to th»

cnap'e's tnat touow.

1 I">aEe'y

M15T0PV Of IMAGEPY

>jger, has had tl ups and dOwns m psychO'Ogy Prior to the t*entietn century,

PSyCnoogy WM eSSentia y a Pa't ton 0' ph lOSOpny concerned wlh the *0r«.ngs Of

In« -nnd. The pr.mary Bass lor any theory at mat t ■•■» was nlrospecton Imagery

and 'e a'-M mental st : concepts -egned '.^pre ne as theoretical constructs

Cia-np.on-. ot '.^cn introspective theories, .n: uding Wni-am lames and f Ö

r.tcrcner, cons-.lentiy noted the important roe piaypo by imagery 'h thought ^nd

peri eption James de-.cr.bed the meaning ot conc-t-te «vords to be "--ensory imapi---

/

■

!

.

; thts view to include abstract term mean'ngs as we'

Uut at the very t'me '.rese two men *ere ae.eooiig such ideas 'm»£**r> ,--id

related n-entaiist'C CttiKtpli *ere ueärnrng their rap.a ae^cent from pro-nmence Triey

weT ioo^ !o oe aiwo^t co-"p'ete'v apanaoned as vi^t tneoret.ca^ coostfucts m

Amtrictn p^vcnoiogy Thi» 'ap>a («U was primarily the PMU*< O* the en"erg.n^

behavippiit.c OutiOO* One MME go*' Ot tn s out'OO* w*s to minimise In* m*e. entiai

constructs •mtlifig Between a g.-en <npul ituMul and tre re^u'ting rffbpo^M. Be.n^

such an intereMia^ construct, rr,agtfy came under attach

Imagery n^d oeen aire,id, shaken by several e"ppr.mental results, whim furtner

acted d'j. a calaty«! tor tne tm^rgftAC« Ot bena/iorism L^perirrent«, in |ht rote learn *£

of nonsense s>liac»»es, first carried Out o, Ebbinghau'.e (18(45), seemed to indicate tne

*■ «pendability ot mage CttntrucH ferna'd's C"1'* rt«ultt indicated that memory

imagts were not actually »aithful reproduc'on<. ot rtatity, even for people clamtinf

"photog'aphtc" memor, capability. The tiiuW0\j'& eioer.rnents supplied further

evidence for (h.niung m the absence of conscious maftry

Such damaging experimental I nd.njs prodded an impetus for the rise of

behaviorism Behaviorism immedate1/ set to wO'H to oeve'op a more pars.momous

theory of thought and ^omor^ M.oivin| only verbal concepts One of its 'eading

representatives John Watson wrj'e:

"1 shou."* th ow out imagery altogether and attempt to show that practicai.y ell natural thought goes on m terms ot sensor motor processes m the larym [word encodings]"' (Watson, 1913, p. 174)

Another primary goal of behaviontm was the objectificaliOn of psychological

observation. Thus, the method of introspection fell to near disuse and general

ispicion. At Watson further wrote:

*.

metiofl'-, "C ■ Ve '.c t-' ■ .» ue o' l-^ aa'* aepc'ae^t upon rne reaa *ev A fh which t"c, lend têrr.se .e'j To ■"'c-p'etit 0" m te-mj ot COhse Ousnes» " wo d . p <58'

Beh*. O'-sts such »s A.t*fo^ oe e.ed Tnat t'-e n«rvOut w»l#* d-d "Ot ra.e even

"tea »ctivjton ihoepe"ae'ce, tnal (ii sMrnjiiliOi («t.vitom derived nt<*st*ri<)

*'orh ê'-ve 0'g»n p'Ote'ses, Thus, îgtry i^d ntro<.pect on »e'e contf»öctos Ta

D« t p'«"" ses

Lwperi'v.er;»! psvchc;-,"'' n the first hall t-t t^s centu^/ tended to *of«

e«ck)$ivei> with (Mily con''oi »Be .e'O«1 »lioc »ti"4 as e'per.n-entji mjte'il. Thu

oM» i mvo ed the use o* ••O'lenie s> aoes. cei''j a sluat on »•■f s not

conducive to t>-e use o- 'eoo't o' »ager» iP« . o. i9''i' T>vj resee'ch ^.^êwO'n

p »/ed « s gn.t.rjnt roe n »eepng -age*, dO'-i-ant n psycnO'Ogy in ton;-»»!, the

sever»! .ntrospect .e rctulti ot t-e pe- oa st. I u' iea -»ge con»''jct«.

A'ouno i960, ii-ege'y oega" to '»■e'ê'ge. due to an af.un-uet on of poll positive

*n3 ■•■...<• ,!■ tecto-s E«pe'ment» results mdicatn^ tne en stence »nd use ot mege'v

provided the pos.tive tecto^s Th* growth o* psycnopne»m»cOiORy ana senso'

deprivation reteccn p-o-'dea numerous reports o' na'utinjtory .mages fieu'oogcal

n/e;tig»tions, pin cu'ariy those n.oi^ ng o 'ect stin-jijtion Jt 11« br»in (Penlie d ana

jaspe's, i9bili, atso p'Oviaefl reports ot ■"ifi't

Concurrent^, the goais o) c-..c"3 0g :a research e>oer e-ea radical change

'"e joai 'or research ro* heta-ne the rea'itaton o* dela-ed ana iiperative moae's 0'

Ih« i>«nav nj organsm Mode Ou idmg h«d not oeen a goa 0* »it ier introspect ve or

behavionstic psychology, Out dd oarro* criteria ana tehoique froii both Mode

inputs and Outputs cou a he tnccHed ooject vely agamsl aat» (behavionstic), but the

j

4

psychologosl agaon bcc.1'ne a sourte or cnet'-S ·or .,e mo-.e as des•e" •' r

,ontrospecl tve l. Thos prov•oco a r.1mewor1. for lhtl oncoroo· a: on or '"""~: ·'" tnl o an

obse, tovely , ,easured, ..-oocl ·b.!>~d :h•orv

i n;;> eme· d<Jnce of comoult"C rr>acnonert a.,d tre earl suc essful devo?lopmcnt <. vf

.1r t •f c .1! mt.-lltscnce se"ed :o ·:w ... a·o he , e.• vf n .. ..,a., ' "-''~&~! and ro.:o· c.,p: on ,, ..

oe· .,~ achv•ttes of nlotrl"ai J<~ pro.:ess•ne. nos menlaltst•c out oo~ prov•deo fur tner

!:rounos tor rere .... ·cd •·west ~a:·o'l .,. •mase·

l\e& t~ltve factors were '' ' 'O t"'\ O•veo " •mt~ :;e · ~ 's re·omcrt;cnc!:' The :>r •- ,t· v 0"11?

was a &<0'"''"6 dos~a: osfachon .., ,;h t ~'>e progress of be"J• o•osrn ~s ;, Bu!;.:•S .. , \ 1970 )

note!i: "tne nc. ~ense sy llaote nao ad ti s day" , and "tne promtS!.'!i of be'lavtorosl s

reM;uned unfutftlled" l n•s c ssaloslattoon led to a c esc· s~ rutony of :-e ar5uments

agaonst •magcry anc the realtzo~:ton that tn some wo~ys tney were vacuous.

ne onaccuracy of v•sual memor 1 had bee., '1eto u;, as a o•~proo' of vtsual

tmac;ery. But all modes of me~'0'Y hao re::;eateo•y bet'n shown to be tnaccur ate, not

JUSI Vt!Oual. Bartlt'll (19~.:!) noteo l h•s, tharacler ~"'3 ll'e~ or 1 as a p ar t•al con!.l r uct tO!:

o f r r.ahty and not as a reproduci •On. Bart lett w as one of tne fe..w psycnolo&•>ts o f :ne

l ome to gtve '"'•'Se• y a role '" numan beh.w .or.

The realozat.on also came that verbaity oroented thought orocesses were "~ much

•nferred or trrphctt as thos'! usms .magery. Verbal respo"'ses could be ;ust a!. weli

med•aled by onferred mentt1l tmaees as by mterred mentt~t words. In fact , results wh•ch

tnd•cate the elust~·ce of v tsual recognol ton memory '" •nfa,ts provtde an ext~mple ot ll

vesual memory (•magery) w•lh the possobthly of a verbt~l encodmg ehmtnated (Fagan,

1972). A thtrd ft~ctor was that verbal-based theor•es were ,ot ,ecessaroly more

parstiiiOneous. In vosual recogn•tion tasks and vosual matchtng ta'iks one mdeed

J

aptfd'ea 'o oe DÔPO^ ig unrtece^'y p'ocessing n th? act o* translating a;1 nput to

nan-i's or \erDa aescriptions '0' co-^par son

fc*perim!*nts noting reaction time aiftt';-c?s between name and îsuai same-

o ife'e-* cc-npa' sons of vttuitly presented stim^- rave produced reijits ta.oraoe ;o

fria^^'y {7v»r»hy, 1'569, Po-.ner anj Keeê, 1968. Posner and Mtfcheif. 'i9t>'* Other

9<pe' n-.gnts invo v ng concept asôc at ons na.e appearea to indica'e tne ulilndion ot

non-*o-o, "nag-ai med adors (PaiviO, 1971). Pa • o (!971) has presen;ed a most

va'ü^D'e survey ana dscuss'On ot eipertmtntal resu ts re'evant to imagery Other

recent DOOHS IR chardson, 19"0i Segal, 1970; Chase, i973) present further rttutti and

though* relevant to imagery ana the processing ot visual information imagery has

reU-nea as a concept to oe investigated n cognitiv« psychology.

MEAN:-i3 J' ■■IVAGE"

Wnat is tne mean ng 0( |re concept "image" 'or ".magery") ' Tne tarn of (MfmitiOn

nas not proven eisy lor ps/cnoogy Accord ng to a consensus of oct on«ry

definitions an irr.ige is a menta repr^-cntaton or mitation ot anything This dt?finition

is not adequate tor pryent ps,cicjogcal purposes As further interest m imagery has

developed, proolems concerning .ts p/cciM aelin.tion nave arisen

Two definl.ons repre'entatue of differ ng approaches to the specification ot

magery fo'iow Th« modaily approach to the oetinition is illustrated »$ follows,

def.r ng the imiage or imagery as:

"non-êroal memory representations of concrete objects »nd e ents, or non-verbal modes 0* tnought feg.imiwmation) in wn.ch such representatonc are actively generated and manipulated by the individual" (PaiviO, 1971, p 12)

The second approach, one 'trussing modality independence, is as follows:

' I

**Tht funct'on o* memory imagery is to put y« m ortet contact with HOW tnmgs ooeo, 0' tounoed, 0' feit, or tatted, «S diitmct from WÂT they reser^ü^d, *n*t (h#y sounded like, looked kirn, v f or tested MM "

(Bower, 1972. pÛ

Neither definrt<on is satisfactory Pa ■. o's db^nitôn leaves ope" tê rr<tica<

question o* how Id distinguish between "verbal" and "non-veroar representations m

the head This definition of imagery i ettiy confronts proolems ot epi'-.tcioiogica'

status, ambiguity, and possible contrad*ct<on 3art<ett notes tnestf problems to resul

from the »act that

"mcbt §.t§&9mmM% that na e üeen made about MjfM ,n traa-t onal ps/cholog/ concern fheir nature ratner than tê.r funct'On. wât the/ are rather tna« wnat tne^ nâê -t po'.s'Oie to do" (Barfiett, 1932. p2I5).

Bower's def n tion attfl reês neaviiy upon pnenoêno.og'Cai intuition for its

meaning Bower's definition aâin »once» ' priMtfi , tne mature of I*» imefa ano

tdte . the came p'Obiern». a'. Paiô's Furthermore, t fai.s Oy irr.piypng !''at jhe image '.

an rnternauy oi)r.ervabie entity ofter.ng a mean', o* "atrect fontatt" with MfHOry

reiatrd tfilc^meliOn A visual 'mage it not *hat the .ittie rnan sees mvde but whet is

in-.ide tne little man that MtS.

Even atceptrng the'.e t*o det ndona' ^petftations as be^g adequaW? does not

yielc a favorao'e '.'tijat'On The d'*fering d*»?.rees of irrportance placed upon

rppre'.entat on modality leadl to differmg ar-d d ve'gert ewpprmental ronceTv. Thus,

Current imagery re-.earth >•. being conducts wttiout the benefit of an adequate and

atcepted dpdnrlion a*, ba' ■ Ceih iflvestifahOfl »*»u%1 attempt Jo clarify the concept,

both as a preconsideratipn and a', a result for discussion

The dettnitton offrêd norc specdes the structure content, and function of tne

\

/

imagt. An age (>n gener«,; is an mltrnal symbolic wwtil 'ecestnUtion of

nlormjtion wnxh it c«p<t)ic of ae:?'>">n>ng (gu 3 ng) MhaviO' (tniDing a 'cspont«),

and which nat an internal rrooanl/ cktrtCitndiC. 'Secant c" ner« moani

"me^nmingtui" In tho caso of an ima^t rtsult ng from porcoptga) activity, "stmanttc"

imp-.es tnat t» , input mean-ng ts preserved in the representation, though not

nccvtMeily m its e«a(t torm or order Tr»dt tne in'orn at on of an image s adequate

• or benavio- determination macates a tja',c funcl.ona equivalence oet»een the -mage

■ nd senior, input Ba-tiett wlj.1) notfs 'n.s ao.iity of imjge'y to free human

behavior from strct deoenoence open tne continuous temporai sequence o'

environmenta sensory input

Images a'e but one form ot representation »itn.n Ine .nternai "sensor, order"

Tne "sensory order" (Ka,e«. .9521 Dears a .united (Out often sulficienti

correspondence to tê "pi-.sea o'Of" o' tne ei!er-a im ronmenl Tnt eements o'

th s internal rppresentat on^ o'3er aeeop ta »e'e;' a •terences pet*een sensor»

nput wh.cn «re recessarv 'c In» rea. iat on of aaeq.ate isuccess'- I oeâ. or "ne

"ra son d'etre" of any ~>*i;e .s 'o Dfo* tie a Da's tor aaea-.<te oena. o*

Tn» mterna. moda ty cna-acte-stic dstnf.,snes mages from o!"er mrr..0ry

repre^rntat ons o» mean.ng fig p'o. Jes a bas.c 'e at onsn.p to an associated

perenptua process »sensor, mooa-!») A- operat ona> or functonai de*.n tun of

nternai nôda.ity nas peen s*atea o» 5 ôn. as »o o*s

" nto-mat on s sto'c.' n ûcn a war l"at t tan tie ret'ie ed D> ntema c'Ocrs'es tem&ph* to t-e et'erna. t-. ,■ - fat a'e w<ea 'o 'et' e e "•or*-at on n tne (a"esno"a ng »»ooa U 'rom ettemai sources" i^ôn, I97|. pif7)

'nere'ore. Ine n<3.»j|0f. » t-i , -tft o' a (»en neaa ty s structured to re

Reproduced from ~jK^ bgrt »viUbU copy.

U- 1

t'Meitivei» ■•"J elttc-rnTiy "^tra f.nt-'orwardly) retfievAO:e ü* proce'se* .•..imorpn.c to

tlOSrf Ot |h«t pe'ceptj*' »100«'1/ Tne ."lorr- 'on s "B«'CeBti,» iy itruClu'efl" The

moa^Mly jtlr.Dule jt ai Tages .rto"*»'. on slruCtjr» caviae» < ""»»r» 'or |ht

evai-j»tiOn o* iny proposed .■'■ ..a' mage rt-presentation

ViSuAL iMAGt SPfCiflCATiON

This genefj ••"*(» del ^.ton must Be lurtner quelided M visuel terms to be

su't'C enl tor tne purpo'.es oi tie thesis As a lirst step. Iîe v.Su«! imagj s detineo as

t"« internal semantic . ■ i' ^ at vis..a. .ntor-âton tapabê ol aetermin.ng

vi»u*iiy-rei»ted oehav.or |i remans Id spec ty v ■■MH intormjt.on and viSuaily-reated

nenav 0' " orae' to cowpieie !«• ue'-nit'On

The inlormation «ithm a visuei image is structured so as to be slraigM-forwaraly

«ce^sbie by processes somorpnic to tnose «hen access eitema ntormat o"

"i.'¥niory sttmv'iat.on) during yisua oe'rept on Visual st mulation is acceded by a

series o* soat.aii/ related campings (scann nî djr.ng visual percepton Visual image

access must be .'.ombrpnit in mean ng to visual stann-ng A visual .mage tht-relore has

an ituphcit. '.(«.it ally Uet.ned pO nt ot view Internal moda'ty produces a cr.ter.on tor

tne -ontent and structural characterstcs ot th« visual mage, and indicates an mil a

interreiat.onsi' p between the ■. «ua mage and the v.sua pfcept.jn process

St. . to be spee'ed are tne ( a".es ot ntormationai .a .es (symbO.si moed.ted n

tne pe-ceptu»! y-baseo structurp Internal modality MKuwc»! HM im»ge prope'ty

aiso Neuro'ogicai eiperimpn»jtion nÄ. ndicated *he «eat^re detect.on capab' t es ot

the trog, cat, and mon»e, . son (e,ei systems (Lett- n, el a . 1962, Mubei ana Aessei.

:96?, H66, 1%8) ^Sycnoogical and psythopnysc» rtsu ts h»ve indicated similar

^»n.

■W ', »"d »ct.v^ty wth.n tne n^^jn v^ o- sîlem (8*rl etl, 1932 . N. Website.n, 1973)

The'eio'e. oê c'*c4 o' info'-nilo^ vaiues -"Dedoea * Iht visual imigt is lh*l of the

symro s represe^'atv« ot de'i ' K e .'<su« tealufev

^n« c*1 f ■ c-as% ot âge ■ . ^ ; D ■. s tsest spe:^ ea tnrougn a ae'.n t on of (MujUy-

'e a!e3 sehaviO' *h» <'5uai 'mage -a/ st'.» as a iO*':» 0> .olormal.on to guide two

bet" .vpe$ o" activity Oe n -"oto' Kt-îty •■tnm a ocai, scaliei envronment Tn.»

■ ncuaes nel •" » coo-dnatpi cvsKai in, action . but aiso the control ol the head

ana eye movemenU a';50C'atpi « th the «null pe'cepton process Th« other :. Bf ot

act . t, i coghitive oena pr MvOfvMg spat a- and v.sue' feature content :«a"Cif

are 'ne architecture' p ann ng and veroa fete' o-ng ot a spatial fintmll environment or

scene 'he prme Ldgmtivf eiampe s vituil torm perception A MMM! "age is the

Oas". lor perceptual -n':". •vfs. n/po! ■■, and eipectat.ons

" ' üe adeauate tor th« determination ot tnese oehaviO's. a c-ess ot spat a

rtpr-at'On veiuet (sympos) -r jst a so necessa- > oe "noedoed "to tne sv.cture ot

the v su*' "nag*. Va ues so" ; enl tor tr« spec^cation at pas<lioh. je.'ton. and

distance irangei rrane up hut c ass o* spat>e>i> mean nglui symBo s >ee Broods

(196ä.i9'3i hat reported -es^ts '■3" se.erai las« .nierterence eiperiments »hich

na cate OOln 'ne eastence ol -itemji meôr, ~odai I es and tne spat a content ot t'e

• ntema: visuei representation Trese results a so np.cate that maging m a •• o Ja ',

-•erleres »f.th aclvily in«oi^ ng percep'un ,n trat modai l> The nt.rierence

incjcates tne cose real onsn p oetween âge'r an j perception

In ■■ .: j-, me tuny spec ' ed detin ten ot the yisua image s •"» ntema

semantic representat On ol spate ana »tull 'eat.-« in'ormat on , struct jred to as to

b* strigntlsritiera>y 'et'e.aoe by "'e'-a processes some-pnc to those of vituel

.. •

10

perception. A viiu<l 'mage « 'urthcfn-:'« cjpiot Of Mt>n| n i Das i lor motor and

cognitive behjvior » m iegard la In* visuw •nv>ronm«nt representea

'r.e visud percept.' proce» -■»•> • lanajmentei delnitionti mlluence upon Ine

structure and content ol "e MMri '^age The visual «mage Has a cjrrespondmgly

signilicant e'leel upon Inp perception process, aclng as as an mloriraVonal guide lor

the perceptual act'vitr Tne r«age serves as source o* 'ealure eapectalions and eye

(hea (I movement control '.peci'ical'Ons a^' ng .sua perception, frnjiiy, perceptual

activity is a primary source ol visual images Tne resu'tant perception ol the current

environment is a visual image

VISuAL IMAGE CLASS" ICATiOh

The degree Ol correlation with e<lernal events it the determining factor lor one

scale ol image classification In order of decreasing eiternal correspondence, a visual

image may be classified as a perception, an illusion, a hellucinat<on, or a dream,

memory, or mental image As Sega states:

"When we have been atve to ascertain that a gi en impression shows adeouate correlai an with enternal events to satisfy our current needs, t is conventional to call it a 'perception' " (Segal, 1970)

Another comperaole classification is based upon the degree to which an image

depend* upon eiternal Isensor/) as opposed to internal sources Si mc-.i'ion lor its

content (Horowitz, 19721 At one end of the scale, dreams or mental images rely

soeiy upon internal information sources Richardson has defined mental imagery to be

those con«, ous mental eipenences which "eutt tor us m the absence ol those

stimulus conditions that are known to produce their genuine sensory or perceptual

I

-.

a

courltrptrK* (Riclwdson, 1970). Ho«*y*r, p*rc*pt.o«s. «t Ire Olh«r end of Ihe sol«,

do r>ot rtiy V0'*ly upon t>ltrn<i ntc'T4l>on \javy e.peiliic e',. «no fipcncnce

dnte'n«! tlateO h«v* cC'sittiM.y DMH srown to p*/ iimlxmi 'O'ts >n '■■■•>

• et'ztXon o> perccplu«! »««grs <nd lo e"fc: Htga conltnt iStrkdcy, i/iO, Scg« .

1970iC»'»»» »ndC'jn, 197?)

rn*st >m«g« cla»'<'(«l on si« t» must oe cont nu«, «th tht bOunö»"*i b«l***n

e.c cMM e "R inditt'nct. The c>M»«, *nd O'ttn rep caleo, sljd/ o, Pemy (1910)

hm ''^own |net In« conscous ?.;•" €'"<e of riJi -g and p*rce><<n( «re not no' f»u ,

d<stinct. In tnet study, perception is m.sUKen to be imagery As tor ine «nverse.

stuOcs Oy Goldiamona end P««k>ns ii9tB n«ve snoum tn«t .megcry cm De misteten

to be perception Visual perception ana vsuai m«gery appear to t>e nseparaoy

entangled.

i. Visual Fof m Perception

As v su*l imagery and perception ere to interrelated, consider row severe'

proposed t'ieones ot tnc OD.ec" e vitua* perception o* torn Mote tnet vituel

percept on hat been n«rro«ed to tne area 0< torm perception Tne thotis is not

directly concerned wiln Orignlness, coier, or novement perception, tnough these ma>

be oi.ic participants end/or resultants o' 'orm perception The thesis ■( «s

investigation of how the representation ot tne environment es «petially interrelated

torms is reeined

/

•

.. ;•

12

CLAStlCAl THEOSV

C'*$S'C<i Or «lom.stic theor/ prcs3»s tn»! tn« M(Ml uf"eo' 0" o' 'c- is «n

"untantcOus cone-s 0" -e« »a B^ 'unctDIMMI ■»••'tic»»" «"en Jt t)*s»a uBOn

tie V#4UM of tr^ s"-* itst d scrim<n4t}<e or homogeêo^v patches of tn« «1 NUAIB

ii-»MfOtJ, 196?' Tf,e .<» o,0r ttnittion »10"-» »■» »jto^JtiCJIly .■■.•■•] w tn

»no ftcj'i tn« non ./'Sua1 s»ns»ttOn^ 0* tof»" Tn» nttrenfes jê o.^sea upon pr»-

ei'Slent »"onntflj» o» kneslnetc, I«C'J». »»d ntmovtmt*\ eipcncnces wnicn f<s

•■Jton'« »f?oci»t»d •■tn ine s»nijt.o"s iGr»|0'y. 1970»

On» SOu'C* <"t Cf't , •- »0' 'n* theory '» tn« prODOsCQ jîO"': .- ,-. n«tur« ot tn«

Perc«p|u»l inf»ren(»J ThK S»fn'I y MpkM ln«t f» p-oc«ts % not 4n«>y;<D>« »nd

tn«t »ny nt«rm«d <*« s'»*»« 0* proc«»« "| «no .'••0'"'«t on r«pr«4«nt»t.on *r« no'

(Wt^CteB1« To tn« contrjr,, -»{«"I '»s«»rt»\ n«« infl,c»t«a th» •■i«t««c« 0< t«v«rj

0«rc«Dtu<1 tt*|«t (So«riin|. i96C. ite'-r»-i, ItCi

Another proecm to' the l-eor, i tn« »..aente 'or In« t»**j-e e< -actiOn «D<iity

»nd act vily o' tne vivo" »yi'e-»' noted «bov« Thoi, the bMX vi«u»i »emiton •, not

0* MS for« Of a ret'h». ot'-'t 0* homo'erteOuS COiOr atom's Furtn«rwOr«, !her« ■

«videnc« that dslarK« 'ry :• i*t/ tie ndwMd ■ tn« "sentaton* Bario« . '0 '' hat

dfe-' -ed that th«r» H rel.ral Kliv.ty *r«et y retpontiv« to -.ufticent totalon

a>tp«rity petoee- ngnt -o it to th« too ey«t Ostanc« pe'rep' o- K th«r«lor« not

vo e y • retult el *uncOnt(.Oui >nl«r«nc«' at it proposed by th« clatscal theory

OMMMI '"TO' ,'■■ K(Ounl ol a«pth pe'etpto" n«a o««n on« of >tt "i.or «ipisnatory

tuctett«« (Got«1- 1M8)

• 1

13

GES'ALT TMtOfV

GatUt thBO'» 3».» 00*3 « » ' >:t'3" tO »lOmi! c '.'Wl'i U u»» to noti .' '

Ciettalt pjycN><og. . ew4 v •.,.» pfteplo" to oe tn» ■tfsul ol H » *PP i*t D^ O' îfir

o-ja'j»!>0"i! <•» to tn« cj^pel» tnccjitetea . Iuji t e,o S,. Ia«t * pro<"»i.t,,

tHWltrily, contnuty, »no t osu'e «'• c»'"#3 to ce In» 'und»"..»"!«, naves ot 'O""

oe'cepI'O" "nes» »*•, preact « tn » ■ gn ovg'r« o' s»t'«Ucl On. «nun o* mm,

loj'cjity pO'.v 0'» p*'rrc>^< o'g<^{«lant w m Uct ot rt» iea 'O' » g .en

preientna ^.'u»! Iieid ixott««. ;9J'j'

")n# (real p'oO'en 'a rj rê-.ta't Ineor, ■, tn« ip«c'caton ot l-i- e popo'.ed

organ./at ona aws n tef*-*- »n.tn aê not weff., ntut'.-e Oeau/atian ot t- i p'Ob.e^

n«^ >ed to attempt-, to quant.*, tnese ^ pects o1 tn« vitual «nvTOnm^nt On« such

appfoacn has oeen to app , -■o^'âton tneor«t ca* tecrniqês n tn« mjlytit of

D'»«nt«d visual »nv.rontrent'. ittnej.» u96<}. ;9%9l p'0^3«d l^^• lT»t compete ,

devcopad attempt ot tuen an approacn, cons o«'ing tn« j.i*,* tea m t«rms ot >ts

COntan»d '«dundani ,

Otner s •naan/ tM'ved MMM '0' pre:".«>( d«* n n| tne G«st»it cgan /atona a«'

na/t CJI ttrea th«ms«iv«s • f nwasu'n| In« imoun' ot inlor"<«tion n«c«st«ry to

ae'-c ce or pent, « l<|ur« Tn« pracao t, ol p«rc«plion, |iv«fl a pr«s«nt«d l'«id, it

men een to ne MwarsMy e ..'■ i to tuen an mlormalion measuf« This pr>ncipi« of

pe'ceplio". derived from GtttMl onins M not«d, n«s b««n cwM in« "mmimu«»

principi«" Hochberg has been involved in several attempts 10 •■pi»" tne Ihr««

dimension«! p«rc«plions of stragnt ..ne drawings m light of (lot minimum pr ncpl«

(Hocnborg .no McA isl«r, 1963; Mornoeig and Brookt, 1960» Th« proo em ol

.

\

14

»övQuite y '.peciif ng (ho-.e intuitive organt/al.'* .al laws ras no( yet ooeo «olveJ An/

measure of stimu'us cHaractvrnlici upon whih to bMt Ihi GeMaif -aw performance

r-eces-iariiy mtroOucev t^.i* measure or information.^ encodrng a« an mtern-.ediary

construct, a foreign aaa hon to tne bas'C tieor,- prtpM»!

Another proP-em 'or Gesta't theory ts that the organizational "l«««" ar« not

actually determinant*, of aehi/ipr An observer can -.oiuntan'y reverse '-gure ana

ground or choo'e uetwe«" a''3rnat yf 'gurat percec^'OOi The «MM 'or such

•livities are not part o* tee Gestalt tneo^y 0* pe'cept.on

One hilfll, most r^po-tan» fa 'ure, is that the "wnoe" to which the laws «Ppiy '*

not '.pecified 0' readn, spef-f-abie Tne fa:t ignced 0/ Gesla t perceptual theory .s

that a f^gw'e <objettl is nsnnally weeded through a succession of gtimpse« Partial

*igural regions »re *oveaii> I «ated »t u-Herenr r^mes Partei "egions may have

Sign ficant effects upon the co^pê f'gurai percept on tS ôn, i96 7, Mochbe'g, 1968.

Gregory, I970i If Gestat a«, are oni/ «ipp<caDie to !ne tola; /•tual * c'd, tne effects

of tfese part.ai regons aê not oo-aned If mese 'm*'er, tontaêo rpg ons are the

"who'e" unit», for ia« app caton. Ciesta t theory fa I to offer my means oy wf to

nte^'ate the'- -ito co^p efe ! ene pertepfons

FOMMl AiNO MECHAîJCAL PATT£ffN RtCOGMTJON

he p'Of»f<»m implpn-enl^t on tra mat^P" at'f a^ fOr'«..ii/at on of two mp'noO-. of

p.ittfrn refOgnittOn nctaa'e sow* inherent *par>..i:.p', tnri limitet'Ont of these as

pos'.'bie eip jn^t on1, o* îsuai fprf" pe'eept-on

'emp.ate watching wa' one of the eari e'.t retrod', o' pattern refO^n.t.un to he

mpirnmied (Kaonow, i9h'> A stimulu*. it matcned aga^n',! a set Of recogn/^tM-

/

19

patterns, w'tH the "b»sl match" oe»^ th« one rtcog^ved. The method «at touna to

have limited applicability dje to tne adverse «ftects upon performance by small

variances 0» form and incre^.ng recognition set ' ze. Nmigt U967) d'SCuSses

template matchin.; « a possiü ■? e«pianat.on of Iff« perception Me notes significant

problems m accounting for otirer.ed recogn.t'On "variances over retmat po^ I on, »i/e,

anc: orientation (in %om CftSM)

Severa> ea'ly pattern recognition pjr-ams «e'e oased ut3n 'eature e^tracton

ThMt systems ircorpo'^ted .«tj, .'es to ceate md MjMl fe*tu'e operators l^nr ana

Vossier, 19^1). to adjust 'ealure *e'gnt.ngs a Q Mooerts, .960), 4nd to *0'm .aiuab>e

feature co^b-natons (Se^rage, 1959' "êse ab' tes have bên recently 'edisc^sêd

by Uhr (i9T3j A m<,thematnal forp^*!.nation o* this method has indicated se^.era'

inhfrtnl limitations IP» cept'ons ; M ns», and âpert, i9b9i A system us-* i

d <imelp''-counded feature eitractort i* nt^pauie o* cietem rung pattt-n

conrpctedne^'- Pp^.og,, ' on n conte«! is iie^cmcj -.rip siüf.* 0* a system öa'>ea soieiy

upO' feature extract 0"

AN ALURWIVE - TMI CONSTRuCTlVl TMEO»V

Tre Cassc^ a"3 Tie'ta t feor es o* ♦0"" perceot'O^ and Vie teT ate and

feature eitra^tion metnod*. o* p^tt*"- recegnton art « rPe" to h* e wr Ca«

sno'VO'T r.^ as tneorpt :a eipaâtons An «itr'natve thfOry ha4, bet'" oe e op-ng,

ba'.ed ^PG" tê po-. t \c aâ reât .e resets ge-p'.i'ej o^ the ir*eo'es and "^t^'Od*-

discussed Th»^ tieo*« s ra ed the const'^ct e têo'» 0* visua- form pe'ccption It*,

ba i p't" e s mat !be att . t» o* *Ofn per;ept on s tnf consl'uctiOn of an intern«!

rpprosentrtt on *h(n e^POd'»« tne -.tf^ctu'e uontentl o' tr>e e»t»»na vi»u*

16

unvironment itne pefceptÔ"1 Thit contûct've .ut * ■' olves the integral »-: o* •»

sequence Ot intOf^-at'On^l nputs def' ed ♦ro*' * -«-•' s ..' eye ' ultons upon the

external en. ironmert iêp'Oêntat.on co^fuctiO" dots not «-wp', the tont<nuOu*.

genfation ot new. .n.qoe sympO' structure? Tn,s C0n$t'w;ti0t -nvotves tne seectvo

art .at'On ^nd KSO a! on o* pr«*«iitt#nl ima(«a Of image component', isywiDO'f. jna

rpidt ons), Inat unique (npt pr«v Outly ^.eeî tm ronm^ntl cjn be pe'te ■ ea nc .at«&

the ability to create ne* *truclu,'ts from ava aoe co^ponent^ to construct a visuM

'r>iase ^ha: new v.sua d<scriinmati0nf can oe êa'êd ideates IK* ability to create

ne* components tor imaê construction

The constructive tr-eo-, o* 'iftua peTeplOn pro^dî a stf a gnt torwaro

e«pi<ina! on for tne effects of niernai states (-e goa^si JPO" percept on Goa-s can

e'fed the selection o* act .a!ed * age coTipoênts. c«pe'e^ce has deter', iped those

co^j/onen!', which a'e available 'O' r"agtf ^corpora'on Appropr ate Knunrlcdge ray

be activated to CO'* penmate tor erroneous st Tiulat on -âcatons 1lJ'ing pe'Lept'On

Tne tfftct« Ot water (the cer\ ',* en p-enoêÔ"! and eêg as'es *co O'ea Or

prisnat.c) can t)t' KSimil^lod r'o ''e image constructor S'^'Uriy, »T ao -ty '0

vokmtariiy alter tne pe'êpt on o* a" en/ pomnfitl orese','s no p'ooe*' 'or t-ê theory.

Tne resonance theory o^ ocrcept on (CibfOft, i960' p'OpO'.e'. tn.it pe'fep* o-

resu'ts from a d'reel analysis o* stimulation structure In contrast to tne ■©«struct .e

theory, re'.onancp t'-ror y encounters fliffifuty i« * e ••■? ^nation ot t'e effects 0*

nlprnat states ana tne ability to 'Olunta^ly aêr percept<ons Patnc 'an t e "p. a

pi'" jrncnnn of re-.onanfr., / ■, M percept on i-, iiflter f|*"{r.tjea *'. a ;>'•■">:"(•■ jn tl

interf(>'t'n(c or ntoract on between ntcrnai '.täte-, a^fi 'f""0r^ stimulation i a', e»

(19^/) ha', evon dtscribod internal /isual reprc.entat e--. a', a form o* "inlr'trrrnce

17

«a-L" pitte"-!' Tnj; p'ooos»! ü -ot "»ue n«f», but cOn»tru:t .» jctivily Ii'Ob'.P

»si • >' O" »na »cco">oai? 0" ar se ac&cr>bec J* a tonn o* mlefte'ence

"ebo U9';9 began |ht mcae'" p5,cnoojca. (ormuMiM o* > (andrucliv*

theory o' •0"'n pa'ceot 3" -ebb's mod«i intrudes tne nte^-a! on oi npuls and tê

oirec! on ot eye atlenion as oasc eements. H« proposes t«o casses ot h>|ht< O'ber

reu'a' units: cell »■se-ro'es a'o pâse sequences Te assen-o ies are g'ObP-gs ot

"e^'Ons whicn a'e * re3 tregoent y ana i rnu'tantOjS'y by h.gh probab'My stiû^s

oatto'ns Pr-ase seq-ences a'e tn» to'tner ,0 n.rg ot seve'a Sjch ceH asse^b; es

win.cn -a.e o'U-- ;t,' ^clva'eo n ;e""p0'ai seoênc» Thu ,0'nmg acts to tat "täte

So:- seq-entai t • -'ä iso-neonat «.e an eipe;tal on) ano to o-ect attent.on upon t-e

e-. -O'-ent to acco-np'sn '-e sa'ne One p'Ooe^ s t-at -eob's p'oposa ooes -•ot

ê a'e 0'ect . to a eê ot sensof. input, on'y dea "'. n tn oafed re^tâ p'jeesses

"■■ e jai c ae»:' nlom-at on -'ej-at on o^--J pe'cept o- s nlroducM

.i.»n locnce'i i;9öS,i9"0,i9'jl iias »eco-e a pnma'y t,gu'« n In»

nve-.tgatin ano s.iec.titat on ji 'He consf^ctue !n«0'i w pôposc^ t at a Has c

j'.pe.t o' ■ sua pe'cept o- s an âf , "i st'uttu'a. O'ga" jal on wnci ■• ,ives

DOSS be tue ê ect e atte"* o" upon »no success,e nte^'at'O" ot the . sua

e-. -onê-t Th'» o-j»n.'aton s e'ôaea o. "sc-fiatc - <cs" »-en a-e

cons^'utted to gu ae In« pe'ceptua «;■ . '. ""eie -^ps a'e |fne'ated »tco'dng to

• •ia-â'ona a«', o' 031" J a»s ca e.pe'e-ce1 J"J Ostat i"--." r-..m pnnc.pe"'

0' gms

*" . *■ es s a;.eii's aâ a*te" ots to '«'tne' spec t» tn s Inecel ca p'Opasa^

• t'o- - cz .*'?' •■ r ■ v .''c "'.»o" » '** a ; ^ss o» Sua " a;.(»s • ',..* 'O'ni

Pt-'fi-p'O" '' S .«■' i !'( - ," 0* ".i.-^c't'/s ' . , ,.* . - .«p" iO'\rpt ^no ot .ts

Reproduced from f» Kjj avilabU copy.

I

rol# in cognitton The perceptual image 15 conMruded both as guidt tor th«

perceptual activity and a-^ product of that behavior

J Cjoals ol the The',«.

The research which .r; reported here n a further investtgatiOh and tpecittcation ot

tne corotrucliê theory ol v 5uai form percepton Wee spec 'ically, the goals hav»

been; fl) to invest.gate the naturg of the p'Oce^'ês ana memor.es which sre involved

m IT« luaton ana intograton of successê .lews of the environmenli i2) to

mve-itigile the nature of tê mlemai representaton isymooiic visual .mage) which is

capable ol embodying the necessary partial and comp.ete percept.ons. (3) to specify

the result» ol the investigations in the 'orm ol an ooerational, computer-implemented

visual imagery ana perception system IVIPS) VI?S s sjen t program which has been

mplpniented .n LiSP 16 on the CVü PDP-10.

Tng motivation lor the two investigations is abundant. The need is best

eipressed by the lollowmg Uo statements:

"There 15 little e dence to gude Our thinking on now these mteg'at.ons and construct ons ta«e p'ace In led, . ittle altenton has been paid to how such processes occur at an" (Maber and He-shenson, 1973, pi 74)

"Wnat we need ■. a set of operations lor delmmg and studying the kind ol visual storage that will build up tne structures ol peroeved lorms out ol momentary glimpses" (HochMrg, 1968, p32?).

At for the goal ol specilymg the result« in the form ol a computer-implemented

model, I believe that one major factor which has contributed to the fluid state of

allays at the theoretic JI level m the failure to attempt complete specilications and

19

implementalions a* l^e iTigiry »no pirceptuil procssse^ .mplitd by a st<t«d Iheor/

Accepting the view Injt pe'ceptioi fc Tigery «re o»i.cili/ s/mbouc, mformit.on

p'Ocessmg act.viliei, tue computer jnd inert' easting programming language »/»terns

de -ISP) now provide a «ahMH* means tor tne further investigation ot tneoreticai

proposal». Not only can some . jnt ae sned on tie sulticiency question» for »ny

proposal, but through implementation design and subsequent actual System behavior,

other theory implications possiDiy not rea zed earner appear for con»ideratiOn. What

control information is necessary ana can it be feas.bly mcludt'd1 1» the information

representation concise enough to fit into a hm.tea STW lactive memory), yet rich

enough to afford thi -le.ences which sub,ects dsplay' These are omy two of the

many questions whic*- • tnnot real y be answered for a perceptual (cognitive) theory

until * completely operai onal specification and Implementation hat been realized, or at

least attempted, for a reasonable suoset of acti/ity Experimental research m

psyeno-ogy has provided Iht necessary critical mass ol design relevant information to

attempi jn initial implementation of tne theory such as VIPS.

The implementation goal here ha» been more eiitensive (inclusive) than that Of

•chirving simple input-output equivalence or correspondence. VIPS employ» a number

el n.emory component» and perceptual processct which eaplicitly contain all of the

symbolic information involved m the pe ceptuai system"» operation The memory

component» and their associates characteristics hive been interred from e«perimentai

results ol cognitive psychology (icon, STM, LTM). Thus, the model attempt» to realize

correspondence at c le»» superlic ai, internal level. The programmed system's Output

is a trace ol memory content- at selected points ol processing. A common criticism of

computer-implemented '.ode s (simulations) of human cognitive behavior has been that

!

l..

20

they necessarily employ man, h.dflen, tomoute'-o^ented, non-psyt -o'og'CJ' Optra on*

to acn.eve tfiput-Output equ>-. a.ence. Thtf ana other »-pcendy imp'emerted systems

(Nvw^l^Si MO'an,i9.'i) alter-.ot to mane tneoretca1 f.. cations espiict in |he

■ mplrnientatiOn to «■ greater eitent Ih,*n uctore and to Cipio'e (confront) the

con?.#?q itnccs

i • ,

-.

•i 'ês.s Content Gude

■ o acco-^pi'sh Iê D«sic nvest.Ba'o*/ go«, tê necessary t.rst goal o* tht the^.i

was to de.eop an eipe' »«e^ta s tuat.on *ncn *ou'3 7 eJ a»ta o* vaftM to image ano

p-'ceotuai process (»tCffccal on QKlptof 12 p'O. des a oescr.ption o» tne l*o

©■Pffments carr ed oat, o* tê »O"*1 0* Hit OVa acqj'red, *n<j of Hit analyvs

P'ocâ.'e whicH led to tv »«uttant •..''t-^ '.pec'caton

Cn»Dte' 13 dttcriMt tn* imaf« rtprfttntjtiOfl wnich has been proposed A

discuss on of the oast Of*, gn crte» a jt ied »s *0 o*ed Dy a »u'' »"P aâton ot tne

ft$ü t'nj rrage »pev »>;at-o'-

'>-»Dtft' 1.4 '% an eiposton o* Ihg p-oposeo pe'ceptua. pôcesso' at an ovtrvt*

ev» Co^'.t.tjent wemo'ie«; and processes and the r inteTe'atidn .n.ps aê fuHy

K-sc'iped Mucn o* th.*, teve» ot specittation viU be 'ee« to resutt fro»« a oer>'e to

•e'nain con-, itent »IHI enternai, 'e evant psycho'ogca- ^nd^gs and IheO'tes. espec-auy

'.D^ce^n.ng tht memcy proposais The specit.c cpeâtonai chaâcte'i^t cs and

contents o* the».e nnwof»«» a^d ^rocMMi are direct res-'*«, of the e-per menta'iy

a^q'jfed protoco< data Thu cnapter ts tre Ovf^l theoretical statement o» tne tnes.s

the second ha» of Ihi cnapte' Mfvtt to Ihittratt the proposed percepti-ai system

a^d mage representation n act.on

Cn -pier 15 dscusses poss<o e e«tens ons to tne .rrp^mented system to account

for *hc S'-ojett oehaôr upon Img tfrMrmgi ?*&*% tnree d menson «pro.ect.onaii

perception*, 'r-f perceptua theory embodied t>/ tne implemented system •. then

discussed and ihowfl to be sat s'actOf y genera ;ab<e In such a general form, rt s

sfiown to be useful m accounting tor both d.recty acquired «no ««ternaiiy noted »yt-

!

,

22

mOvi'm«n! d«t« *oa ln»-f «*ioc «Tea MtMl p*rca#t*On& Ärcowp»nF ng proposal *-»

«isO îOe to *v»'it |h| e«ttnson and teê'aMijt.on o* the fjil/ inst«"t ited .âê

'epreêntation *or Ima rjri« «gs to •Aguri «' . tu«i e". r&- ^t"t* *nd pe' pêâi vision

consiu^. #|iftfH

Chapter 16, a^ the cOmuvor, cc; .»';■ In« proposed nnjê'y lyftpff *nd ?

'■epri-'.entaf.onii structurot to otner lOmpa'si-1- propCd'' A p'e* OoftC-ption anti

d.scusiton o' a gPfloral tn« ', o( ognti on, rt'eifcn iu^^^ton^, »"d «n e«/jluat'Oi O*

tnes^ go*1 rpphtotiofl C0«C'u0i !* i '•POM

In th* '.econO .0'u-»'e, v>'jpt»f I] ; g #•« fc^pele e^po'.-tio-n o* ê t^'ee

sopp ementar/ po'ctplj». proc*»«M ««d 0* inp two .mp.e"^««Ied KttmtlaliOn-

»<cOÔd«tiOn p'Oc»-.' .iHlpnl -tors »n.ch •'«'• oe»« "♦•"ea t'om *he ojt»"ed dat^

*ht cnapte' fete'ences *r-êidc#s d-spi*/ng |hp dctj» «np.eê^tîo" i's'rgs to

pvpiJ »jlier unde^tand-ng

> Cn^ptef il ?, Dtnä.O' o* the tuii/ npe-' fed a"0 p'Of'/ar^ .mp'e"'e'',ed

peTeptua. tytttm l tont'«tea '0 fê onê^/eo subject"', act<vity o' tou' '.e'ected

prnt ico*. A qâ-tative P ^ ,*'ii. na'.eu 0" spy*rj< »ee-a'-t quentilal -e mp«%ures ü

gwe'> Tr,e chapte' rele'e^'ei *Dperd'e-. co^t*" n^ tra^tripttOft« ot iubi*cl

. e* ,./.or drd tfKOt 0» prü,;-.*' a.t îty al se/eâ1 Ipvpl« ot ',peC'f)< t/

/

rfM

Chapter 12 E"p»f''nents »ô l^mtyw

This ch»pt»r rs • dt^cpton o* t^t eip»'•«"(» a-'d wb*eque«1 •naiy'^cai

proredure^ e^pio/ed « Iht aevetopênt ot !"• pe'ceptua' p'0<e^%ng s^ste^

proposed by this th«v4 ^r« lirtt p«'t o* th« chapt*' co^side's th« •■percent n

terms oi ^jOjCCts, si mjn, reqî'ed tas«.-*, ar>d acqo red data The secona pa't

d'scuitses how thi% O'rect , acû 'ed data ^*% oee^ pro;essea to se'v» as * krM*l tor

the u'OpO'.ed ky«t«Mli <imn

t»per.frtentv

'*o e<per "-er'ts, eKh con?At'r»g o» se.era pa'ts. •«»■e conducted to D'Ovide the

data "ece'-'.a'* to 'nêst gate *-0'.e aspects o* hu'"*" vitufl pe'teptua: be'-a* or ot

-ntp'est *ith n the sta'eö goa •> o* th s \*t%% Tnt p« âr, design cte'-a tor the

t*.pc' ênts used a'e **\s* . Je» .<t es c* the Iês s goa s As »ufh, Eipe' fê^t 1

*.f»t tam«iierif#t tn^ suti.e' * v a ■ ass o* ■ *e d'aenngs which are Lrt#w Ifwoughout

♦ ♦■e '0;'0* ^g ta' *•■ as tt«Mul A tas* «. tuatO" s tê" cea'ed »h Ch tor res tê subect

' ■ '• /ate a •■■u (e-. , »n ö' pa*' a' p ctu'e v*»s to -ea^ /e a i.omp ete perception Ot

the .tiû us The »ubjeit " ' "J.e a i»a (3 degree vi»uJ a^g'e^ ôe abo^t a he

'Jfa*'hg i#* oftii" to '?*'te '• pe'tept O'" * s tas* » e'^s data 'e'e^ aht to

dete'"-'«'V, tê cc'-t'^f* f " e^"s ana :ap*h t es o'tê sjb.ecfs pe'feptua s.sten

The p'r-a'. pe»cec' a ta'» o* tê t »«.t etpe» ê^t sne.essa'', art.» ca- T*e

'.eiO-û e«pef mvnt p'o- if i^'a 'rc^ a "O'p hOfma vt*ual pe'cepto« îtuatôn It

/ •

;

24

invO'ves the trac^'^g ot tê iukjSCt^l eyf -novements a>.r | tê peftept'O« c' - Itn«

drawing stimutc- Trese second 'esu Is are tne^ nterp'eTeo -n hght o* the integ'ative

and imAginai operat ons interred tro^ tê pr<0' 'esuti to turiner specify a

comprehend'' e tneory

SUSJECTS

it '% not a goal ot Im» tnatu to mvestgate tn« act- co~e-'a; aspect', o' acquiring

Ire HDH'ty to etleriivei, oe'ceve straight line drawings ;i a la investigate the nature

ot Ue precedes and fêmores involved in tne developed eltect'.e perception ot sucn

pictures Therefore, perceptual capaoie subiect« were desired Tim is not to deny

that picture perception is a learned activity This has been lairly wen suoitantiated

by ch.io ob-.ervation and eiper.'rents introducing pxtures to people ot cultures which

do not use pictures as a spat al representation "nedium (Miner, H'S) L »ewse, tne

poss t>ie .nf,uence o* any preteo ng aeve.opnientai per'O'l upon tf'e mature p rto'ial

perception proce'.'. is not oen.ed

:he desired sublets were persons ta-nmar with lie dass ot line drawings to be

presented as »timuii, thus in'erentiaily insuring their possession ot a developed s,s!eti

o* cuo'dnated processes and memor es appiicaDie to t-e ptrctptiOn o* such p^tures

The chosen sublets possessed the oesned eiperence. p JS tht characteristic that

they were unaware, to a great ei'ent, ot t'e Current »esea-ch techniques and resu ts

in the tield Ot the psychology ot percept On

i Ouf subjects were used The 'neo'y to be deêoped ne'e 'S ot the type which

has oeen called a »ni-lheory ['«we i) It accounts lor lew subiectt on relatively tew

behavioral perlormances The subjects employed were, at the time, «11 students 01

Cernegie-MeMon University, as lonows:

r ..

'juQtecl B (B > - mil» gr4dM<l( itijdtnt m compute' M>tnc*i

SjD.ect P (Paul) - male graduatt ttudtnt in mduttnn «dmimstrttioni

SuDiecl S (Sieve' - "J e graduate iludent m computer (cencei

Sub/ect G (G«en) - »ema'e senior unaergrafluate in graphic demn.

'hroujhout f-e e«pe'i">e"tai periormante« there appeared lo be no great

difference of capab^-ty nctween tub,.>ctt, though they possessed differing

bac*3'n ."js and current «tuatiors One aiception was that G showed some greater

sens tivity to KM Oengtn) characteristics in her perceptions, possibly an influence of

her graph c aesgn study (ins d fterence has Deen only noted qualitatively, >rom

anecdotal eiper mental mdicatons) Other sublet diiferencet, not in perceptual

capao't es but m ttrateges rmpo/ed, «< be dscussed <ater as results

EXPtfJIMEM 1

Ai four subjects co^oeled l^e three parts when comprise this eipe* ment

Before each pa't of fr-e eiper.ment Ine sub.ecl was presented with a copy of W*

instructions for tnat part 'ne subiect read ths aiOjd, and then was permtted to

•.tjQf the mslruc^'Ons unt I «.ure of uhderstandhg them These instructions were ail

the «formation g.ven concemr-g each eiperiment part

rne mstruct.ons for Part 1 a'e given m rigure ill Two of the reasons lo-

mciuson of this eapenment part a'e indicated M the last paragraph Of these

instructions It was fe1! lo be desirable to use a minimum of /erbal descriptions of the

pctures to be used, and as can be seen an that was said is "line drawmg" Figure 112

presents pclures ol the Iwei 'C line drawing stimuli used m Part I Trem this pert, the

I ..

2U

iXJ.iUK.-,!.:' I

PA* i 1

Fi|Uf« II. 1

!n^t ru^ r i on

You i.'iil now . -i ■ ( ted with a urif« o! 1 in« drjwingit, Yoti «r« tv»

look at i . iriuir until you .. you JI. i] I le i>( fully du cri'-in,-

it. You art t!.t i t-* i IOB* VOUI • <. > !j ..iv t'.^- ■..•ri, "i.....*;.", which will

proript to i ' • , >ftvr rwopenin '.'our < ill bt

1. orallv dcsiri'e t'H |i". Jr.n.in»*; there i^ TU> "^»rr-. ■"

do t riptlocii thou "i ei n I»' i. '■■ it-^ i ri d

•newer 4nv quefttiana I i -tv have AHJUC t V line dru'./in»:,

or >our dcttcnption

1. Jidw th%i I Inu drawing, *■ you ruLall it, on th« p4U in

trout ol you

I)d not Btftrt to d« crib« th« lint- drawing until a:ttr it IM* b««n r**-

novrd« Do nwt start drawinf Lh« Inu drawing until after >*M hAV« i* ptut« I

th« r ii di ICI iption and an^^trcd any quaatit i« I ask,

rhi. i^ .i training purlod to finllla^ls« \üU with i .v ctaai oi llna

drawir U'tfJ throughout latar «xparlnents and also to acquaint you with the

tasks ü: Je tri in ■*••'. drad'u trori ncnory«

A ■

■■:. Fifur« II 2

Ud

vM

OS

^

/d

z: Ld

..-l

26

bübieds le»rn th«l only st'jgnt i.n«s tre •mplo>ea, »nd tnat »veral aiMerenl !ypes

o» these stnighl km arm^c.'- ■•» "« eipecteo. lo.i» oe"g

U) s.mp'e two d." t^ns onai, geometric ob,fc!i. *tn or wthOut OverLiy (Figure U 2 (i> );

(?) strähnt •o'Äjrd Infee d-nersionji p-o.ectio^s ie Figure HZ (") »,

(3) impovjibe ixree d "(•-'-■on»! P'0,ections ii4 fgu'e II? (m) h

(4) transparent (ravervpiei tn'ee-Oimensionai Bro,ectiOn4 (i.e. Figure 11? dvl ).

As noted, tne suDjects aiso practiced ae'tripng tneir perceptions and

subsequent)/ drawing them tror*^ tneir constructed memory representation. This pai t

ot the enper—lent also had a hidden subject screenng purpose II the subjects were

• ncapabte o* drawing or describing from rremor/, or it their perceptions were ol the

free association typ« de "loots like my aunt's nouse"). then they could be e'imihated

However, a' ot the initial tour subjects were sufficiently successful.

The verbal descriptions given were recorded on audio tape, and the accompanying

drawing sequences were reco-ded on v deo tape to oe used at data es will be

discussed in the anal/sis section to fellow.

The instructions to Part il ol E«per ment I are given m Figure 113 ; and an ««ample

Of tb« stimuli »mpioyed is given in Figur* 114. Thu part was conducted in anticipation

Ol Part til. From Mverai pre-eiperimental trials ol Part III, it was found that a

vocabulary problem could emsl, resulting m the us« ol hand waving to d«scribe

int«rm«diat« obj«ct constructs. Tins part was thus primarily a screening part in

purpeso, though tha verbal results obtaincl and recorded on audio tap« were

considered to be valuabi« data as discussed later.

p>

Instructions

You will now be preaestW Jil

should cons der each to be a iraall

to one of those seen in the prcvit

looking at sucli a dnwing throu.;»!

view of the drawing at any ttne.

do as follows:

1. descn'je what the partial

2, give any ideas you have a

given partial picture cou

I will do one example for clarific

■

1

.■6a

KXFKHIMEI.T I

PAKT II

Fijur« 11.3

Instr ictions

Vou will now be prcMAtarf with a series of partial line drawings. You

should consider each to be a »mal. part ot a larger line drawlni; similar

to one of tbose seen in the previous part of the experinent as it one wert

looking at such a drawing through a tubi.- which allowed only a small, partial

view of the drawing at any tine. While viewing the picture you are to orally

do as follows

1. describe what the partial picture is itself

2. give any ideas you have about the whole, of which th«

given partial picture could be part

I will do one example for clarification.

Fijur. 11.4

I

21

the instructions to Part >., *re given m figu'f lib Tu- etpermentdi procedure

and tjsK o* Part til is an e«1ension o* a metnod noted b/ "Ochbe'g (I9tiöi In those

preliminary stud'ts, subjects *ere presented witti sequences ct partial views enclosed

wth.n a circle »eoresentalivt o' tne ve* 'g holft. Tê eiper'rrienter rtmamecl m

control 0» the succession .ma prtfttntatiO^ tim« 0» tne d'screte. part-ai views in Part

HI here the subject has compete cont'O1 o.er tne ho-* positioning including the drect

movennent 0* the Hoie In me nocnoe^g !as»is, sequences 0* paMiü v e*s are

presented without a rect mOvtmtfM contro or occurrence MO tWvtWfrt n those

cases had to oe totaüy mlarrtd or was imp.ed Dy direct onai arrows ntersper-.ed

Detwoen .news

Part lil tnen is tê lifmticaftl pa't ot th s eiper.'nent Tne behav Or oblaêd h«ra

it to be moueiied and •■plained •■)/ tne program irnp.ementea perteptuai Sy'.tem Tne

"thipK out oud" .eroih/at on, ootamed he'e a-e no! nt'ospect.ve accounts by the

*.ubj'?( t cüncom.ng his Doha or Tney are pnn ** / svo*I erbai cues .ndicative o* n s

nt^rnal procp'-.s.ng status

ine pictures e"ip'0/ed m !•■• part «ere '"s ~ «• >n type" to tô-.e ot Part I Mo

ptUre from Pa't i was errp.oved f'gure life presents piCturts 0* t» e ne drawrp

stimnn used m Part ;!I The ' o enr,o cement and .prhÄi/a'on prolofO', /erbsl

desc ription, ^nd d'aw" \ seq .enê were a11 reÔ'deci on /ideo tdpf I ♦ouno -t

vinntfD'sar, to n-.t«. que .ttons o* f'ê Mibjects concerning »npir de'" pliOfH. a1. 1 also

nad 'Ound in Part I

All the sublets «pre capable ot |his t^-t« tiowe er, A.\ suPiect* 'ound t to t)e a

ttemandtf,,', !*•> ^ncj *;■ o a tiring one o'-e Tr f»^ Qne t^n quanta! <»*/ note a

dpgrrfij^tion m pprlormjnct anrl wea'ine'.-, ol vO'ce duf ng the test protocols 0( each

I

EXJ ::->ir.-,:." i PA!: i i; i

Fifura 11.5

In t' ^.t_i_oil''

i.florf you . . a cArdbu'rd and pdpvr ohiiriJ, which will easily • o-. L

about :''•<- : .i' 1 f top, , rv this now,

P.i i - fht«ld wi 11 ■ . placed o.ci -i l i ■ lr - i ■■ ■* »ni »it : 1 ir in t vp«

to one <.•: r M oci in :'art I, rtm shieid will »liov only a b'.tll part

of thi :T .iv . i;,, to ' . .via* i- t r t., throii.. i the Itolv in th« cardboard,

io-i arc to -"u'.c the ^l- , hj : ».' . : t «■ litld, about the drawing until )OU

li-tl .. !. 'f Jc cr, mg the cv»i pli-ti» drawi ; in a faah ion . liar to that

doi.i' c • !, Vou »'til ih«.;i •■ top r o . ■ ' ■ ■ . 1 * and tli oially i.c the

dv^cripti '■". '-ou .» i ! lopi 1, in w i 1 u ■. I r.ay 'uv*.-, a; .

draw thi ;-. ■ : K .» you r. ill it - all . . . n t.» t *: Jone i n I'art '.,

: , ■ "■ ■

Figure II.6

.

7 V

v«

i • /

the tuta ect to »utensiveiy UhkM ha M'ceplu«! ao S ind mcmonts.

EX?raiMENT H

Tnu tioe' ""»"' was co^Ouclf d aooul 0"e month a'ter tiiperii»»nt I. employmi two

o' th» pr»vou, S'JB ecl» (P ,i-3 " rn* »«per ment was conducita upon tyt

mu/em»nl tf je« -J eq, pn-ent aeüg-eo ■3 cohst'ucted oy John Zouö [Souid ana

Srhat'O', 1965). 1t m,»e' a lee^'Sion camt'a 'iput .mag* Ot th» prtstnteO «ilMl

stimuli (lins d'awmg) with , camera mpjt ot a beam ot light reflected Oll the cornel

'ens ol e subject's '«It eye This mimng produces a video tape p. ->io:3i ol I i|ht

■pot moving «out ' » presented visual scene Due to the bulging ol th» »,» at the

lens region, and tne geomelrca opt cs ol retleclon, th i ngnl spot, wilrm an erro' ol

3 dt'C'ees. approaimales the current e^e tm^tion point upon the presented line

brewing

Tnis etperimenl had two parts, lie instructions to Part 1 be.ng gi.en in F gyre 11 7

figure 11.8 present-., pitlures si me stimun used m this par' Each picture was Hashed

(or app'Oiimate/ one-q-a'te- to one-tnrd second, tn.s lime be n| that 'ound to be

tn» o»»ic (average) luation t m» o' tn» e/e dunng tne scann nj ol a presented v sja

r.t rnuli (•ele'encel

T>*9 eroal deser ption given 0/ '"? -.jS.ect wa« ■- r J;J mt, together w.lh th»

d-ivihg don», was ».60' as mpc--anl da'a. as disc.-.^d i»t»r Th» »■ « --J.aT^nt

. deo tape record was a'so kfpt, lo be jt- red as a chec« to msure only • single •,-

Inet on during Ih» drawing presentation

Th» mslrucliOns lor Part II are given m Figu'e I!) Figure II 10 presents pictures

I

I -.<■ ..w ■....: II

PA

Figur« II 7

dl RTt» i.id :'Jrt II tu K>1U*, w.ll :>!• ■..•nJiutt-d on thi . . ..>.•.■. .nt

r rack uu jpput «tu- .

1 n»truct i im -

Ii ihii p-irt rou will •■ prtfM«nt«d w i: i -J vrim* JI ■ t ; 1.1: i i>ii lar in

t.pt- tu those pi.**MUtJ i , ! ,■ ie«rli«l ■ ;>f t ncnt -. ktor« eJch lim ol

• if^wi nc i • pr. tat i.l, J ■. ii » L ros!« will hf drdwn upon t i. . r--«;! i n I ronl :

im, i>ncf 'i'-«;! tit- i-it. platt-, .-on arc to look at Mi-Jtc tu- intt*rsi>ct lun

point -•: tlia cross. 1 will t'ttjn .ak«- -t tinal .-; . ■ idji I em .■: t'c i-v«

tracking Je.-ic»-, \\vuk w i U' vou continue to I ixatc v r . Inter »vt ion,

tUv line drawing ttimului will prea«nt(.-<J upon thi «cresn« ou ar« tu c >njitantl>

lixat« t K- crosi intrr ectlon throughout th«? pictur« presentation. H«v«r m^-.i

i»'ir eyes, I he •>*< track ing devlca vi 11 not« ■• ■ movanrnt, thus invalidating

mat trial .

A soon '»s t ■ , pi >. ture i ^ raaioved vou are to «t-t off tha bite plat«

and daacrtbe .»rj 11 .• wti,it .uu rt-ca 11 about the pi ^ entad drawlnn, whi iv «ketc h-

i •!< thoae parts that you can,

Mch putun-will '..- prt-.«■■I'.-'I •,.•■ i • . ^ : mttr .il, ! im-s will irv.

I

fifurm IIS

rv^

zy

u .1

:8c

■

PAK I II

In-'trucCioTi-' ^^ I

Von will now b« pr«a«ilC«d with a ■•?!•• oi partial UM drawings. Vau

should consider edih tu h« 4 ■ ull part at 4 : i- . - Iin« Jrawing similar

to one of thusu seen in the previous part oi the expet ir.ieat, as it one were

lookin.; at Mtcfa a drawins '.urou^h a tuhe which allowed only a wnall, partial

view ot the drawing at any tine. While VtWiAf the picture vou are to orally

do as tol low-.

I, Uestrile what the partia picture is it^el.'

2« give any ideas you ha e about the wtiole, ol whUh the

|iv«n partial picture <.ould be part

[ will do one example tor dar i t icat ion.

/

FlfM 1110

fr

^

ot tÔ'e line Qrawinf ^ftwuii u'.cd Vitr (hält ^veraJof thp-.e we ^»peaU fron ^^M ill

o* l'ie Pf'O' ffip^fiment Ihe g pn fif.c.plon o» ttê pfeê^V»^ p-cTu'p »Im *<•

ftudtO taped JIU tê res^ttng ii'^win,; »as «ept The '-re-rr /tm#r\t vdto tape

protocol •rf-, «ept. a so 1'ere wee ter pc^-es p'esented m th.s pj" to eacK

'ûoêct

STJMU i CHA»ACTE»iST|CS

A note 'Ôwd oe n-aoe ^^'e ronce'i^g stimuli câfactenstirs to' both

»».pr'iBipnt- i and ;;. ^"-j •'!» subsequent effects o* tê'.e charecl#fttt>cs -ipo'i the

enjttsis protedu'C a^J *'i- propeted i«*|t '■eÔ''/ The '»o 'mpo'tant stiwuii

chjr^te'istus *o De dist^* ■■«■

. \fe Overa :">e Q'a* tg wt

^ the i "e o'.entjtof". *t" " tne if^Ängs

A i o* *■ " «e d'awng ;■.■■•■.;, • • ;o e'ecf cpmparab'e area% ««th'n the

subvert1« '..a' ' e-d At Ine d-stances p'tse^ted. the ê dâw^gs in both

e«p€'irrest- ■ pa^'-t J '«er*, l c ■ v '♦/ * .e degrees o* ■ >a eng<e between thr<f

etftront* ponti rntt n-.^r,. , ». ^ -,. ^ •,*', *"a j'-e* . • ;■ .T"t o' eê p»iOve*ents

in tipe^'ênt H 'hr ••(.•• f'f. O'sta^^fs 'tonta<"ed ê êgtwe*»! ■e',t■.*'■■ o' a "ê

presented p^' ■• * *. '■ " common bO •"'!'.. ^l ♦hu^ o* COmp«rabie 'e^gths in

Pert ill. ot r •(>»" '■ "nr I, oî. one /eptea cou'd be seen at <■", one '«e Ihr* * •■

ho'e (^n.cf' '.panned appro«'mate . i jfg'ees o* /«sua a -' n n i ^meê^»

I he '!•»■'■, üi '.i •■» l ■■;■■'■ ■'.*■' 'irt'.i ^'j ■ ■'■ '' '• the r a'".-- !•■" . ■ ' ■ • •,.

p.rtitrp we 'esu'ted in the sul ■ u*.e 0* a cor".t'i'*t ab'-o ute po*. t onî rpêrvnee

•'»♦»nn. a-, hrfo tin»*" e»p*"! .i ''i' t jnos on the to^'iêfj tme tefment's ^ngth and

fe' 'egu'iMy m r-,-.!" • so tr\tc ta In* •..■ ■' ■■, to tmpio/ i contUnt ■-•isolut*

:is'»"ce rete'e^ce set «so 9otn c* In«« josoiut« re'erfnc« tram« hnvt *

c«<'4cter'»l c "*u»/y" tC'f«spO''0*it» 10 ftgons or nei(hbarh00<te oi picton«!

po<.'*.ons «nd Pnf,'' fdxtanccs) <Th.s Wlii b« further dscucsed and clarified in

Cnapler Hl i

Tne leconQ •■.,■',■'•■ ■,'-._•. cnarKteriStic i that only tour bat>c "e

0'>en'*l ons »f ut i jea. ?■"»« Bei-'g .ertcai, nor jontai, upper-ielt to io«er-rignt

a ago"* , «no '0«»' lett 'p upper t ghl a »go"*' *'tn le* e«iepl'0n» no im« draocng

COrtlined two Or rnore dijg0n«,i o' the we case orênüt on « tn ditler ng S,l0pet

Tne re'ean» e.pe'""e"!* oata inotates t'al MM »t »UIUS cnaratterisdc >«d tne

4ur5j<jcts to ciatstty (perceivei. ana suOsequer,t » rerremoe', line orientation» -n terrns

0* ;ii5t tnese 'Ou Daîr onentatons, yied.ng «grt po« Die line trave-Sing directions

(up UP, do«" 00, lett LE, r.gnt »'. aown lett - Du. up-ie« • UL, down t.ght -

OR, ,p right - uB)

'!'# exept ons Sve ' ftu'es ii ?i I a"d 11 6i ) ) pro. .:«? aêcoola. e.oence in taôr

ot tê*-» interreo directs" encodinfi rhe (utt)ecti CNOjrtered, a'^d .e'Da'ir noted,

some pro'e". PJ a ** ' ', due to the „i-^- „a1 emstence o* Ihd diHerent voped, same-

direited liagona anlhin A • ng.e p'esented stimutut p fture Also sublets ne*er

ment o-ed erp« , a«, i^t/fe J* '-cpe •or "-e nes. norma v us-ng one ot tne eight

P'OcO'.ed oreito"5 »hen .e-Da » not ng ir.o.eênt O'recton .n protocol

e': * i»' o^s o' ê or ig*'.A\ on m tn.« lescr pt on

Crev Oos re.e4.f> (stat.st.c* researf' âs si,,»" that s ope odgmer-ts are not

a '"r B /tea u" 'O'"- ., but 'e-a to < utter aoo-t se.era comn-on reference v entatons

ire*«-eicnsi In»* ».ee^s to no täte that hu» ans n ncrmai visual pertept'On situations

. •I

31

do remennbef directions in terms o* a relatively imM, I Mf set o* va'ues (lôu^h, in

more generji' environments, po^Dt> ôre than tne 0t(hl p^coosed) This custer.ng of

hum.*n O'entation peneptions has Deen IIIIIIIK noted M partia' justitna* on tor the

rt'pfesentation ot a 0 oct». word W'th sâaows m terms ot the saê e ght basx

directions Wa t<-, 1972) A.*'/ does not cam a psyChoio^'cai moae' otherwise

2. Anjiy»is

DATA T»A\SCS:PT;ON

'ne data, *hicn «as «.quired fro-v tne etper ments d'SC^ssed above, consists ot

aud o tapes o# ve'tei, part ^ pictu'e, ana compiete-picto'e veroa' description*., vdeo

tapes, whicn mc'uded stmu'taneous »üdio recorcJing ot ve^ba^zatio^s, o* th« subjects*

pef'irmances o* the ho'e mov ng tain, vdeo tapes o' ôbjects' dâ» ng sequences o*

reca <ed Una :■.•*,■', .meo-iapes o* tyt movement ":ann,ng sequences, pijs »ctu»'

na'd-cop, rtâwngs procijt.ed by tne subjects' througn fecalt of O'e-ented stimu^

This 'S not th* usua» stat-stica1 data gatne'ed in many psychoiOg'cai eipe' ments Thuv

no* tn.s data hti Deen used V generate fne proposed îsua' perception tneory and

the p'0gra^-i*p emented W At inforrngt on prpcessng system reQjires eipaât'On

Tne aud o and video tape '»■■.": ■.:■. «ere t rst transcribed <nto suitable *■.--■.

for ana<ysis These written or graphic I'ansrr pt.ons became the d-tta actually

con«, dered as tne bases 'O' sys'em '.pecification

Th# oata of tiper ^.enf 1, Pa'i 1, was aud'O recordings of compete me draw ng

descriptions and video recordings ot tne drawing actx/ity of subjects reproducing the

line drewmgs The transcnoed tQrm ot this data H •' ustated by by Figure 11 I 1 Th«

—. 0*m*m • I i

I ..

I 11a FlpralLll

l.il.l VTIME S sec.

•fey now there'• • uh

it looks

basically the shape •( a

parsllelo

rectsngualr psrallelplped except 1B

down In the lower r'.-'it hand corner

■n extra

an extra tr;angle has been

has been drawn on

«

■

II.8.S

II'c .1

It'» a right an^K- with a line blctctlnc It

and

uh

couIJ be p.4rt of a

two-Jitjfnf.ioa.il projection of a cube

or could Just bo

um

i lino bifectliig J square or

im

a diagonal of a square

Fieure II 12

I

)tc

liK» »h» com»' [SI] this part ri|ht her» loOKt l>Ka th» corn»r ot • uh [S2] ot a «quirt (S3] now, lat's s»» il I tin ... [54]

Fi|ur« 11.13

RT

il il i« going to be » »quare [Sb]

this would be th« bottom ot th» squaro [M]

• (

K

ludio dali it Iranscnbad >n t straight-torwara manne' Eidl hesitation in %f «eh is

noted by the conmencement of a new line of transcription. Any sgnidcant pause

(over 2 sec.i is noted by a '(pause)" VTIME s the appromirate viewing ' me in

seconds for that subject on that pcture.

The actual, hard copy Um drawing reproauct.on eiecuted by the sut,e:t servec as a

trameworK for the transcrpt on o* the drawing behavior, Numners and ar'U*s were

appropriately added to mj^ate the order and direction ol the drawn.; stro-v.

observed. Va'-ous features of this data contributed to the specification of tt« image

representation ol V1PS. The v ".ual concepts ana interrelationships between 'hem

which occurred m the verbal descnptiont were most mportant. Interactions between

the verbal and drawing behaviors were others

Part II of Eitperimant I was primarily of a tramin; and screening nature. The data

obtained were verbal reports based upon partial (single vertei) picture information.

These verbalizations were transcribed in a manner analogous to that ol Part I, as

illustrated in Figure 1112 The data wet marginally valuable for both mage and

processor proposals. The verbalizations provided indications of subjects' .erte«

classifications and the perceptual inferences made from such verle« classes

The date of Eapenment I, Part 111, was m the form of video-tapes of subject hole-

moving behavior, which included accompanying audio recording of subject

verbaliaations Selected protocols have been transcribed as e senes of informational

frame». Two such frame* are illustrated in Figure 11.13. The element A (see Figure

11.13) it the ordinal number of that frame in the noiocol, in the form Vi, i en integer.

Element B i* the partial view which the subject its through the hole at that punt m

tha protocol, the circle being representative el the hole opening. Clamant C is

*

33

>nc'u3*a aîy whan '-e subitct is at i v*rt«i of tn» Ln* d'awing. It indicate« wh c

v»rle» s if view acceding to > iuwb«'ing systtm detmed by lie hrtl page ot the

Ire"ocri0ti0n (see bottom o' Figure 11.11

The recond tieid ot a transcription tfame may be empty tes in Vi) or may tâve

'.■-ent'. D and t a^ '.Dectied contents 0 is an arrow representing the direction

o* the hoie movement occurring ai tna* point m the protocol, c « the symbolic code

used HI VIPS to represent tnat d'ect on vVhen no movement s occurring this field .s

empty. The third têid is used *or the transc'Ption ot ve'baliiat'Cns occurr.ng in

conjunction with the hoie oositon and movement state oehned by the hrsl fields

Tnes« verbalizations are again transcribed analogously to those of Part I.

Furth^r-nore, each speech segment .s labelled »t its end by a statement r.i.mbe' of the

form "[Si]" (I an integer1, facilitating ts reference by the te<l The compete /erbai

descriptions and reproductive drawings obtained were transcribed as for Part I, also

Figure 11.14 presents a sequence of nine protocol frames to illuttate more Mly the

noture ot the transcription and behavior

The data from E>per ment II, Part I, were audio recordinft of partial picture

descriptions and associa'ed partial drawings These resulted from the short, sngle

' «at on presentation of line drawing stimuli. The verbalizations wera transcribed as

usual, and the hard copy drawings paired to these. See Figure 11.15 for an e>ample of

the transcribed data.

The data fron Perl II of Experiment II consisted of video tapes of eye movement

protocols, audio tapes of subsequent verbal description« , and drawn reproduction«.

The eye movement sequences have been transcribed es in Figure 11.16 Clement A is

the -equential luation number, and B is the liaation duration m «mtieths ol e second

The initial sequence segment is connected by dotted line«.

I

looks ! Ke (hi corner [SI] thn pjtl rij-hl he'e looks like the come' ol a uh [52] 0* a squj'e (S3) now, let's see it I tan ,. [S4]

Figur« II 14

if it is going to be a square [S5]

this »'ould be the bottom ol the square [S6]

aha' [S7] looks lika we might have a triangular objt't [S8] instead o( a square [S9) this would be

the second sid« of the triangle [S10]

(slowlyl

(through ve'le« 8)

and this is the • H(idt[Sll]

Okay (S12J

~\

Fiiur» M IB

,Tr. .1 Vholc W.I'. 1 iW

thrtt din.n-. ional

11 -,

Iht fu-ur.- a Kquarc It couh) bl urn (pause) there was a line coming from tht- right corner going up pretty far like a dLi^onal across it •ind then up here thtrc was a very (laugh) there was a bunch of lines but I enn*t recall which way they were going or what typei of fchap. s they formd I think there wag a trl tnglc or so;nc-tliing up thcri

i___

Figure II 16

in

/

5

z

'

w

TPA^SCRIPTION uSe

The ve-o»! dec ptions ffo*« ê" j'y o» co^peteiy pe'ê-ta ttna d'** n^' tn*t

*'"f ODtamed thfOuf»! Eipe» "-eM ;. perts I *nci ill, i^d tip»"'»«nt U, Pari u, «'ved

A». « univcrs« o* 'ntofmat'on »or th« inte't"^ct o* tn« -w^» inemory y.eo^ JuCh

rtptiont Tht trpe^ u* lyings (tomept^j fe^>emDe'ed, t.-i« re^tion-.h.p^ u».ed

bt'*e#n reêôeêd p-tture 'pec't'ti and concept, pctu'e ch^rider^ltti not ivM#di

' o types o^ effOr'. occurring, ^nd the sequence o) the vefbai de'-c-pton'. »e'f ■*■

■j'.ed JS intfemai mdeetton?, p» The coÎeM »nj -itrijctj'e 0* the uôe'^ ^f ^tQ*

'epfpsen'atiOn

Soweth'hg »u^t oe TÄ'd concpfnmf tê 'ee-4hce o* th« .e'h*. : ■'> to !•>•

.pectcato" ot the vû*i ^tge «'•d peTep'. on system Tne p'o'oco i.efb«i ?•'on»

• 1 iti ^te'njii states (goals, tont.fir«tiOh«J «no is '.jch do 'o"" a reaôâo'e DJS s

Mr process »ulc '.pecitic^tton tne',e verbadâtiOtS i'e ôt nôspeLt /e MS«r1 on*, as

to the nature and course at -jct.-'tx The • sua mgt which i* constructed by the

perceptual activity serve', as the se^jniic pas»« tor the Subsequent ve'b»' de'xnption

M-, 'uch, the verbal descriptors indicates lolo^^îon tn*i must be tontaned >« or

re »diy derr/cd trom Iiiat . •,ja <m»ge

These sanse ewpfn'nent parts a'sO p'OviO*d a tO'fe^.pond ng group ot ime

drawings pe'tormed by reca1 . ply'.. 'KM tape record ngs o* the tfrtvmg -.equences

Tne tfraw<nj '.equente ■t'.fctf. grawtng hes tat ons and Use pen post'Ontftgs, a' d th#

tmal drawings n terms of errors, cor.S'Stent o-terations, and correctness at! wert aga-n

tonsidcpd ettect.ve bMM *0f inference concerning the iMgrimtig« end structure 0*

the (Omp.ete ima^.e memory rapftiewtrtig*! o* hM d'awmgs

'n» Dei*^0' pato-o's 0DU*»a M r^ptnnunt 1. Pi't Ul aô pô o*J "tj-n-Äto«

ê e^-ant to the '""age 'epre--#',ta'.0'" (J#s gn Thi c*lO^••, 'eo'esentatiO" Htutl âtuf a iy

'acii'tjte rt&tM 0" 0' tn# pe'cept ,*i inf»r»nc«ft, im«ge »tttff*t<onv. «nd -nput

«ntet.rat.ons »hicî occjr r |h« ojier ed De'-a. o^

*r*© o*nj.<or mooenrd by VIP5 • lh#l at fê r>ote ^c ••,•. p'C 'Ocols *rom

[■ptr m*fr ;. Part [II A , tht trarscPfd v.0*3 tape p'OtOto- ■ t" ed «is The

pr^mjry bMt« fof the ftftdfiC cJe* n-t.pn «•xJ impêê^tat'O^ 0* Tê perceptual

pÔ(»sse* ot Vi^S 'he iimHimnTat.cn 'etlect* :ê if- 'ed eÎt^daO'l-ty 0* Doth Tne

proposed p'OttfSie1- *^d "• *t\e 'ep'»«"?*! 0" To a »O't gm***' acrain of vi»u*t

sc*ne mput ana **• des'eJ fOft-at'Oh '*ittnd«D<i<ty) to The nor»«** eê wove-nent

Sihj.ft.0« *inc LiO'hg p»f p* e'a . siO« CC^S-d*'*! O^S

Au o* th» pôtoco ^ or'-■■',d t'O"" the eipe'-êht »e^t roî'Ofea at « [gw^rgl,

qua tatw», .*heroo'^ t»v#l **»!. This aâî'S gav* n«« to sO">* gene'a-

t na'af ♦eristics f tê pe*rep* a p'Ocest'h^ iyster-v pus the »nÔ'ât on rele-ant to

image mfnoff d*s>|n as o-scuved aoove Th.s ovt»*1 co^S'de'^.ion *as mttrumvnlil

m tre p'opo-a ot Ôüf I>W»O»HIM processes 'set Câpte' 4) Then three protocol»

for each s ih,ect wtrr (O-^p-ete-/ transfoed aô aâiywd m depth To further

■ ^•.tant.ate t"e (onsf.t.jeht pe'ceptua p'Ptesse* n Te'ms of cphtro ano operators

necessary Finally, processes *ere wp-emehted to account specif ca'iy fo* four of

thei« r.gu'e III7 hd'tates Tre degree ot ana^tc '■ons-oeral on g-.e" to eech

obta ne'i proTocO'

The protocol data was (O"' dt'ed To D« two TuluaMy hteract-ng groups of

.ntormafiO« One ^rOup ■■. the h©e-•Ôve'^nT seQ^f '■ itse't, <" ter-ns of location

(vtew). movetnent, *no Renerai ^pet-o ano tme fadO's The other oody of tntormjlion

- —

i

IM

J

Fifur« II 17

* t.

*

-L •c x. 1 X

r0 % t. * *

■2- -*. * ■^

k t. 2 t. X

b % X X *

V V H H

V V H I

I"5—/ M

\ t. H H

h H 1 J H

cO o a cO

I

2

47 i y

1 -46 \

I X

i»1

(T

J J ^t

H

i -1 1

J

I

J I

»

/ ;.

WM the v»rb(liz«(iOns provided il vjnous KCMiont by lh« subjects during the hole

movemant task parlorpunct.- 'n» verbal sl*tex«nts were used as indications of

currently active perceptual goa s, realiicd recognitions, J-J attended imago memory

ntormation. Th» hote-move-ienl sequences were ana yied 10 relate movement »ub-

sequenccs to these ntcrred str*te(ic perceptual |oai( Then eKh subsequence was

further analyzed to infer its associated undariyini control tactics. In the absence of

verbalization, perceptual toais were inverses mfcred from observed movement

subsaquences with control tactics which had e<sewnera been related to a verbalized

goal

The analysis of the data obtained from Ciperiient II upon the eye-movement

tracking device was mottly cerred out at a qualitative level with the eiception of a

quantitative analysis of tuation duraton*. This data was analyzed <n light of the

perceptual system and image representation developed from the analysis of the hole-

movmg protocols. The data served as the basis for the eatensien of the implemented

proposoi, also.

Part I of Esperiment II was designed 'o yield insight mto the amount, content, and

structure of visual information entered into image memory from one initial brief

tivation upon a presented ling drawing It is assumed that the primary informational

difference between the positioning ol the hole and the positioning of the eye at e

picture location is the absence of peripheral visual information in the hole positioning

case. It is noted that e completely different motor system tor positioning is involved in

•ach case. These are taken to bo functionally equivalent.

The eye movement sequence protocols obtained from Part II of Enpenment II (two

subjects) were all studied el a general level to note any regularities of behavior

!

37

potdbly »pMi"-! Ei|M •/• movtmanl 3'Dioco » w*r« than fully trmKribvd, "«as«

bemg upon tojr picturM 'or which hoi« -3^>m«nl protocols bjr Ih* ttn» (ub|*ct( had

bs»n Inoroufhiy transcribed and analyztd E«cn saqutnc* n trtntr.bcd ts a Mquanc*

of tinatiOn». Each fiaation is reprasent d m terms of location and duration. Fiaation

duration it attumad to be directly related to the amount of prucestinf occurring at

each tuation. The sequence of fiaation location« provide indication» for tha inference

of processing ttralagiat and states

Underlying tha development ot tha proposed processing modal we« a general

consideration and an overall amalgamation ot as much relevant ptychological

mto mation at postibie Some of lhata retuitt are appropriately ralaranced throughout

tha thesis. Findings concerning short term and long term memories, their aaittanca«,

tiles, overall retrieval ttructures, . nd operating (harKlanilKt ware vnad as datign

guidet. So were idea» concerning tha rapretantation of cognitive procattat m a

production syttem form [Newell and S>man,t972). Together ell of thu eiternel input to

the proposal furnished a valuable and necessary batit tor overall «ytten character

Thus, the implemented system i« net merely a computer program which accompliehat a

simu'atien of a body of obtarvad human behavior. Tha tyttem further realita« thta

simulation through the embodiment and utilitatien et the functional umt« el the human

procetsor, at propotad from the re«ultt of recent research in cogwtiva psychotegy -

This chapter has provided seme idea et what obtar-ad behavior, Iraneribed dele,

and analytit procedure hat led to the proposed imagery and perceptual system end

theory. The foiiowint chapters ere an eaposition el that promil.

/

.

Ja

Chapter 1.3 ... The >^ge Representation

inn chapter is an eoosl on ol tn» s.ôoic ""Jge reoreêr^t'On uied Ml ViPS 10

embotly vsuai intormaton Cnttfta whirn ser.eo to letern.in« the tomi o' the

rep'otent.ti on jre discussed. This is tolioweo o> a descripr on ot the epresen(at>on

rmai.y. t.ow tne miaje representat on appe^'S n Ine memoriei ot tre cognitive

ipe'i eptuaO processor x or.etiy oeiineo

1. Imaê Representation Cr (enj

Throu^nput tne development or tne proposed image memory representation several

gud ng aes.gn criteria »ere »oo ed Possess on o' Inese entity characteristic ab ilies

Oy ti-e propo-ai were deemed lo oe necessar, 'or an adequate oelmition I'iese

necessary properties are:

J VERaAt DfSOWTION ADEJoACV - The ability to r»»;.« represtntations

whicn not oniy contain tne mtormation necistary to yieid thi complete pictur«

uescr.ptions oota «ed as data n taper m.ents I »nd ii, out a so embody tn,s information

in s/mDOUc »Iruclurei bear ng stra-gnl-torward correspondence to tnose perceptual

unit (te oojects, otner cont tsr ana re ationsnips used n most destr ptions,

1 CWAWING Bfn^VlO» AOLWOAC» ■ The »miity lo rMhM representations which

are '-utt (ient a', a source ot (control* .ntormat'On tor tê tas» ot 0§mt*§ *rom memory,

and <»",cr. (jn iyt so used in a slrajhl-lor»aro manner to (ied the complete p ctur»

drawing sequences obt» ned as datj n tne eiptrimenls,

.M

M

3 PEBCCPTUAL ACTiv;TV ADtOiJACV - Tne »biWly to Ullm p«rti4i piclur«

reB'ti»"<»t'On »h.cn c*n. N « sl'i'ght-tor«»»ra winiwr, be dynamdlly dn tme)

»î-e-Iea («<M«d toi 0' *il»'»a, «"fl »he« furthtrmort c»n strvt »» » sourc» 0*

•-'O'm») on <o' ob.ect ■eeog'M.O", JO»l d^ttrnnnation , and ho* (»y») mOv«m«nl

cohl'O t-'Oogôut pr'crptu* behivO'-

4 ICMMnC CHARACTt« - ■'-» ab>l<ty 10 «Hew »or tht co««ittnct of tha

oi\"»tiOn«iiy v-ro-.i !'.fn.p"''j ' ü-O reprtstntatiOhiiiy ipttnl chtrtnonttict of

visu«' 'migery '»"•»•»■O'y) m • 5tr»ight-tO'«J'a i»«rn#r;

B IKTWNOl V,.JA.:"r CHARACTER Th« ikMy to bt «ccotMd by R««n«

b»*' "g 5tr».gh(-tO'w*fd (nomorpn.r) C0"»SP0h0«nC» to Ihjl uS*d 10 KCOtt tll»rn«l

vnus1 info" Jt 0".

6. EXUNSABklTr - Tn« ttiMy to bt «■tt^dco to rttliM r«pr*Mntations o» »I

vnud p»'ceoi o-s o' '0"" m < si'» g-t-'O'wt'O BaMif

Tfn woâ "5lr»ignt-fO'«»'3" tie ph'Jse V < it'j.git-tofwi'd tnjnitf") hn boon

CO"". 'Jent'y used «oove Tn» »ca (ph'«t) ■& to De jnoe'slooo to me*", "w.th no. or

a m •vmuf" ot, »ootonei process ^g", we'e process ng could be de'>vat<on, ttttu et'On

Of fc-rep'e-.ehlit on

"jet 'Jjct'On o' tnese 0*' gn cMe' > nsures < JUJ*- 'm*ge representjton «rmch is

cons.-.tenl « th the fxege oet n^t on o* Cnjpler I I The lirst three enter i correspond

to tr.e 'mjge'-, de''n,t onji *Dint, to se'v» as guide 'Or usuaiiy related behavior The

♦ourth crteria ret'ects tn» n>c»M» semantic character o* In» vsjai imaje's

.ntormat'on represe^tat'On Sat.i*actiOn ot th.s requ'refhtnr insures adequate

ndeoendence ot n>age content rrom the sequentat course Ot human behavior, yet

a iowt the ,mage to be a participating factor in that behavior

..

40

Th» fifth cnlani it taken di'iclly ''om thit prtviOut ifnag« dafmition. This

requirement represents the mlernel medelity chertcianstic of the visuel image. It

influences both representation structure and Ine processes which access this

structure. The last necessary ability is the result of the specific nature ot the image

representation developed here It is limited to the v sual environmenl ol slraghl line

drawings. The .-fore, the proposal clearly must be readily eitendable to be ol value.

These criteria for design ol tne visual uraga representation reflect the i>ecessary

and functional explanalor/ adeouacy required of the mage as a part of a scentific

theory of perception and imagery Tne rapresenlat.un must be a functional component

ol a system capable of providing mechanistic eipianations of empirical evidence V!PS

employs the image representation in the reproduction (simulation) ol obtained protocol

(behavior) sequences

In the above criteria there is no mention of introspective suggestion or

confirmation as being a necessary characteristic ol the proposed image representetion.

No asoect need be suggested or confirmed by consideration of conscious enpenence

Pylyshyn cautions that:

"What is eveiiebie to conscious inspection may not be what plays Ine important causal roe M psychological process* (Pylyshyn, 1973)

Furthermore, conscious e<perience s not a direct reflection of the content of

attended memory It is rather an internal phenomenon created by the application of

cognitive processes to the content o' atlenaed memory The internal modality criterion

is an indirect acknowledgement of the sensory - like nature of the conscious

eiperience of (visual) imagery

I

41

2. Th» Visual Iniaf* Raprcwntatisn

SYMBOLIC »EPBESLNTAT10N

Th« visual iinag* r«pr«Mnla(ion ot VIPS is symbolic in nature A visual imat» is •

structu. a of mtarralatad symbols Thai information is raprasantad symbolically by th«

human •s not a naw hypelhosis m psychology, as indieattd by th« (oilowmj statamont:

*My hypolhosis is ti«n thai thou(M modals or parallels reality -- that its essential feature is not 'the mind', the sell', 'sense data', nor propositions, but symbolism* (Craik, 1943, p 57)

The hypolhosis thai a visual image consists ol symbols and relelions imphos th«

primacy of the abstract m perception and cu|nilion. Without on enisling symbolic

(abstract) framework for reprasan'etion, there is only and always th« everchanginf

flu«, th« *blOOmm|, buftini contusion* ol William Janws. Cofnition knows «II only in

terms of abstract symbols and relations The pr.macy ol th« abstiact <s>mbolic) is

indicated by Our laiiur« to Imd a physical measure which is directly rdatad to any

domain o* perceptual qualities (symbols) and by the relativity of «II perceptual qualities

which implicitly makes such a linding impossible.

A computer may be described es a symbol processor. As such, it provid«> « means

for testini end evaluatin| the symbolic representation hypothesis. VIPS investijates

the use ol symbol c representation end processing as an e>planalion ler visual imagery

end perception Recent research has shawn th« ellicecy «' symbolic repr«senletion m

th« < - iputer - implemented eiplenelions ol humen b«hevior On tasks involving visual

mlormalion (Baylor, 1972; Naw«li, 1972, Mtrwi, 1973) Moran pr«s«nts an «il«miv«

«2

(urvty o* recent voro .* o 'or tê »or'" ma coMent o* tre symooiic 'ppreientaton ot

viSudf information

IWAOf CHUNKS

Tne DdsiC unit 0* '.ulH, ê^rg'u "läge inforn^* 0" »^thin V1P$ t% the fhunn

A visr«! inijige I? an nterre .♦tt'J r;*o .p (Mructwre* o4 ^'age cHünh, A thunn 15 *n

nterre ■ etl group of symbolic nfor•> at on e tments, Acte ^-^ to on» e'er'-ent o* * cnunk

impiei tn» .mmeaate »cces'ôlily o' a otne* tonta-ta ce'ent^ and the tnfonxalien

they emD3dv There n conoderaoie e<perimenia: ev.oence »nich s favorôie to fe

proposal 0* information fhjnK.ng in nyrran memory iV ^r, |fit| Ne«eii and Simon,

197;*) Tran'cr-bed data from tiie thesis e«pfriments provcle direct^ .«(quired,

inferential evidence for the rhun^ng of 'Sua1 ^format.on The relevant data factor ts

the consistent use ny the suoiects of a small .' n,te> set of visual concept t.pes Ealh

ronc?pt type has an associated fa's of symoonc n'ormation structures «h.ch embody

the 'npresentati.e spatial configurations of v.sual features

'his concepl-based chunk ng of v.sua information influences aH of the observed

forms Of visually-related benavior Dur ng perceplua' proctssing, .| influences the

determination of goal« and eipectations, s the unit of MWtl h/potnesei, and

accordingly affects the scann ng Icy« or noiei Of lê ime draiemg stimulus Ih« use Of

visual concepts as the oas« for partitioning (chunking! the repr^sentalion of the image

information is most directly evident by tfw use m tne verbal recall descriptions and

protocol erbaitatiOns .ne influence eitends to the reproductive drawing behavior

observed, bemg a primary factor m determining the sequence Ot drawing strokes used

by the subiecls. Bartlelt USi7' reports sim.iar resu-ts from a recall and reprodtKtion

task

.

43

'he 'Ole »lieh 'mjge c'njnhi'.g pljy^ in the pe^cepljji procesung n d'sc^t',i.a »nd

.'J'iled i C «ter 14 tpperj < ACo";ept now presenli three groups ot diXt from

^dft 1 ot C'pc fient 1 Tnp'.e nitrate the etfect which 'n*ofmat<on chunking wiln.n

the .'Suai "^age hM upon the observed verbai and drawing reca" bthjvior They also

^st'ate th« use ol visual concep's as tht Bass for n»g» chunking. Two visual

concept t, pes are a so introduced

GrooD 11 ntrr^jces tftf jie o' the oo)ect l/pe ..sual concept (OBJECT chunn).

Both sub.ects use Iht "cross" ano "tnangie" OD,»ct concepts to embody tne visual

pfor'nat.on as shown by trie .eroai descriptions The drawing seouences further

ref'ect the use Of these visual concepts Subser^ences of draw n^ strores correspond

to the partit.oninp/, of tne rrage rhun^s äoth drawn reproductions contain errors,

nowe.er. This ndicates me nan ity J oo,ect t/pe concepts aione to represent a

p cure consisting of se.erai spatially interrelated unteracting) objects

r.rouc 12 »gam illustrates tne usi ot the object type image concfpl Furlnermore,

i 1? P and 12S introduce the u.e of tht line t/pe vsuai image concept (LINE chunk)

''e'.e three eiampes jf Group 17 prjvde more e/dence of chunking's effect upon

fr-e reproductive draw nf bena or Each verbal description reflects a dillerenl

conceptua partitioning of tt» ■■ Su»i information. The diffe'encek are apparent in tne

draw ng beiavo"-., as 5ubsequences of strokes show correspondence to the visual

cone ^ts of the reated jerba description

■Iroup I 3 !iustratef, the importanr pomt that to chunk visuef information according

to an obtecl type concent doe*, not necessarily imply the naming of that object

'■■■'{■• subject has a name for tne object type image concept used to embody th«

. •..i,i information appearing on ether side Ot the center rectengl«. The primary

A4

' ~, in of tu» cnoce o' toncep! t,pe jsed !0 Chun» »ny v su»! information H to

Mtarmina Basic cha-ide' itie» of tf» lymsolic st'jctuê wfucn is to '»B'esent th»t

ntur-'at on This opeât o- is mO't *u*â-"enta tha^ ino! eQwvite*} to' varDaity

'abe ng \nam ngi that . sual ntormstio-i

O'her e»per-nentai data '3i:at» tnrsa o;-e' visua1 concept t«p»s *hlCn aê used

as chunk l/pes m VIPS to create the v sua' mages of straight -e d'av^ngs, The«e

a'B ;ne verte>, s de, ard face dn conjuncl'O" * I» t--ee-a --ens ona project.on iwagesi

type .ouai concepts Thus, tê-e »'e live basic icorresponjing) mage chunk types

used m VIPS, these beng VERTEX, C3j£CT, LINE, S'.Di, and ÂCE

IMAGE C-nUNK CHARACTERISTICS

There are tnree c'ai.'.»»s of elements mn^n are 'Ou^d m ewer/ mage chunk of

VIPS. There is one Chunk neane- e.ement, several Image 9ody e'emerts, and one Or

more Position elements Isee f.gure Ulli Each symbolic element is a group of

properties which -nterreiate the e ements thtmMlvM and aiso 'e'ate the element to

the appropriate visually meemngt^ symbois

The Chunk Header element serves to 'na'cate Ine type of visual concept embod ed

by the image chunk. This type s indicated by th« value of the e ement's assc. ateo

TYPE property (see ri|uri III.2). Anotntr «ssoc »'ed property is CR (Current

R»t»r«nce) which serves to reference (eftord access to) one jmege Body element of

fh» chunk'i image «Iructur». Oepei ung upon the chunk type, other propertit» er»

essocieted with th* Chunk Haider element, such is the NAME proparly of en OBJECT

type chunk'i Chunk Header «lament (tea Figure ill 2)

T .. I-i-ag* Body elements era the constituent symbolic elements of th« tamantic

y

44«

Figur« ULI

. JU'd Im9,Tö .;riunl( conjiats ofi

On« CHUNK !:h.AJKR tltBMt

j«veral IKAJE bout altacnta

One or Tora rO.SIIICN eleciant(3)

'.'h» pobbü'le aynbola for each t yp» ir«:

CHUNK HEADEK :• VI, 01, Ll, '4, :'i

IMAGa BOOT :- Xi, Al, I', .■.!, Ql

K)3ITI0K :- Pl

t »I

i

j

U4

V

O

. J

in

0

s o

>

X iu

tj ^ rj < ^ s/

^ ^ ^ ?i ^ S

S ~ \l

o~ ut d r 0; J

it «3 v5 '

(J J

Ui

e!» O

? 2 0 A

^ £: o, -2

T I«

i ^

Figur« MI 2

/s^

^

I J

I', fC

I«

1 J

P

O

.i o

r

0^

c9

5 3:

^ UI

u

w^

5 v >» J

A

1/ J

c \ -

I» «• ^ 0

/» A

.

structur« emboJ'ea ö/ the mag* cûn« This tymbOttC ctfucture is caiied the ".mage

b^dy" of <*n >mage cûnn Ai noted above, »Kh chunk t^pe has a c'.aracteristtc class

0* '■■age bod> structures a&socialtd *''h 't. ^we t^pes of image 3oüy elements are

used wthn Vi^S to red1/c tnese fliffer-ng classes 0t information structures These

typ«» a-e KIT, ANCLE, INTERNAL, END, and QuIOSct Each element t/pe -s

a st'iguished by tne prope'f e^ «wen mî De assocated *'th it (see Figurt ill 3)

'-eie p'ooert'es ■sete^mê a d*»e'#nl rpê for eac^ eemenl type wth'n the image

DOdy in'oTfat 0" Structure

Caen type ü* iâge Soa, eiemen* n^ ooin manaatofy and opvj*-^ propert-e*

ö fo.iateo with t The mandatory p'Opert.es are iptcifted for eêry giên instance of

*riat e^ment type within an âge body The optional properties are mdnatcd by a

stjr, "•", m F gyre 1113 When fjrtner opt.onai properties are specified for a giv/tn

o'ement instance de'err'.ne^ tne vaue of that ins(an(.e's mandatory TYPE property

For enampie, »n instance of a KIT type tlcmant may have TvPc â ue ^tX iunnnoafn

: * f when oni, the manjjtory properf.es are ipec f.ea, or may nave TYPE /alue KEX

(Known EXit) *hen both opt.Ona; properties »VX (»ange Verte« eX.t) and LVX (Link

Vert«»« eXti a'e spec fêa See appendi« A.LTM'Of tne ewparsion of the mnemonic,

Before further descrbmg tne symboi'C mage Stmetur«! which V!PS creates with

tnese d'f'erent Image ßedy elements, tr-e iast cias'i of -mage chun*. elements, the

Position type e'eênt, requires detmition. Tr.e e^pprirrpntai results y.e'd anecdota

evidencf for the proposal that the position«, of pcture (viiual) featu'e^ are

remt mr^red n tcrm$ o* an tmprtctte ("fu///') absomte IO*: atonal coordinate »-tale

wh-ch becomes associated with tne por'.on of the visu«! fieid of .nterest (in this casa,

the whole tine draw "g stimu.us). Subjects CO'.: stently use generjhr^d positional

I

rigur« 111 3

y^ LM A A At Ä ^ ^

-^" ■s ■ 3 5 3 - u* •» o M» or ^ 2

! til .-< (J

o 2 C » r 7 O <&

< < ■* o l- t 1- r y ? ri-

#k A A A A ^- /«. A. ^ HMH

V -0 ^ •^ H

i ■1 V

V »/

9

IP

J

■f 1- ■1

r)

J

J

1 -1 -i •

J

0« ^^* 'T A A "^* -%

A-

¥ -• Ä

J Sis < v

■s •*

• « * *

rv y

* O J J

i J

0

J

IJJ a. MM

■ % A A /^ r- A A A ?• £•< i J

4 i J -« -0 k*'.

< * j NI ^ 1 ^ w v/ v/ st 5 5 IP C? Q ' > 7 5 <;

111

T

> •-

.< j

e 3 J

^ /* •* A /* ^ c ^ A A A

•4 ■ O ^ 41

> 1 is 5 v N^ A^ z^*

? -J • * ■ 4 * ^ ^ >

>C o . 1

- i

3 ^ * 1

o 1

J 0-

<v/«>n Oo - «IV-""3 «vit o R. ui* »--m\ni

^ »v> i-^

6

i» Z M J

0 a! 0 ~ »» o

■ I "

(J * t K *

Ul *

% 5 / ?

t * ' 5 "^ • t <v

n ii

/* * <* * 4 >t

■

0-

.

lew m DOtn th* \efb»' clescrp'ons and the protoco e'Dji-zations Tne aD'.'ty 0'

tn» %uDj*ctt to fe»diV ^ypDtr.es/e in« -egfient lintiagM oetween p.ctjre êrt'tes

p'Oviae*. fu'l^f e.-iStrct Morjn ii973 âs oeeoped »n ^<*ge êp'eêntat o^

wn.tn ooe^ ôt include ^Dso'ute pof-io".! "•o'ât on ne n**, '.uDsequentiy ngtea an

■■.-■•• '• ■ . ■■,.(.'.- :■.'<-. :•■>■--? ,.^-' o-O' A " t- -t"

' p-. ■ pnratlO',

A •*,. 'on t e- »n| rmooo r ''p "t-/zy" local.en 0* eacn o* Int> Image Boa»

e •"■ 0"*'- wn.cn 't'eênct .t ü> '"e PNUM f opef!, A Po^.t'On -itm««! ;-as t*o

^"0- A*ed p'ope^t^s. i.SP .e'l - ^ z"* pOiiIoni and JDP (Uo - Down ô'.'Ton» ^SP

a-o -,^P eac'i *~ave se.^r po ,, D e s.ôc : a ^s 'ne at; -nu^d poM.on of tii# .■ s.a'

* e d s tûi D'0"-en mro 'o-T^ ■« ne p^ t oâ^ a'eas. as SPO*" ■" ? gu'e UI »l Tne S'2»

eons&tency ©♦ t»e ne dfawxng (.»«u hat enabled tne tenant appitcat'On o* tê

io:*t Ona- a't?«»? to trê r-»**e ictâ abscut« , 'e a'fa« - the -; ■■ •' •* ■• ■♦

* .■1 '■ p'oc ■:*■..•■ • .: j' *. ■ ■ - -r -. i'ea ■ ■. a' • ■ /r- ■ !

'• ■ ■ ■:■. r-:'„■,»: f» V A * ■ , - ' * • t' -c ■■ t * . : ■

.-,,./;-, •. ■. • ,• •■ •»., •■ • ••■, p,^ *.••'.. ,;- ti ■•■ t

. •■ ..■■.-.; ■■'■■•■.. j' V- ■ ■_■■-..- ■■ ■ ' •.■.■•

I P'I ;■• .* • -j. j. t,pi ■■"'• 'r't ■ ("-.■,.■. • on t.pe e »""«n; - ,i al

. ., ■ _. ., ,. . .■.,■■■ . . • ■, o* .■" .•■ "■, '•,- o*■ J ' p*.■ ■ . ',- ■ U- •* ■■ e

-. • , .... :. _ - ■ ■ -. •- , •'.:'■(■ c" *.*-•;••»-■ >♦ t' e

■ • )* a <» ■ ■■ :'^* t-'v .* ■., - ' . •■ ■ •■ • .« • ■ .''

* j ^ i y on< * ' •■ ■ ■ ■ ■> pe'.er". ^ ■.■■* ■,.>- i- ■■:>.; •

■' ■• ,- eni .■• '■ v ■ .-. •ep'r^f'a' " •V'iepv..» '.pi*.f • ■■- * DOü^d * ■•• '

' ■■ .. »e* -a. r :' t DOw"d 'c ' e <*'e* c* ''» i ' • .;."-*";

Reproducfd #(rom ^^M best »viUblt copy.

Vo-.hvüVxcX Kwv.S fiiur* 111 4

ov.0 0V.0

(me RV.O i ov.0 j

ORX

0«

oRX

\.VQ

Q\.0

l

.1,1, Flgura 1115

1 1 ' <—

■•.

I

47

•s * basic factor .n :-ie mtmltmnct of • «tiblt visual »ond m (pit* of thf varying

retinal md'.ations which occuf dunng constructive perceplon

In conjunction with this seven-by-seven 'eference grid 01 spatial povtior areas,

VIPS employs 5i> range or length codes, ^ne^e are, m increasing order i SH (SHorP,

Hi iMEdium), LO (LOngt, LS aong - Short), LM (Long - Medium), or U (Long - Long).

The length o* t ine ■■.eg-'ent (or ho1« rrovement) is determined according to the

numuer of pos tiorji areas traversed ^O' eiampi«, a ime segment between adjacent

areas it of length SH, while one from a comer art< to another comer area is of length

LL (ve'y 'ongl

VES'EX CMU\<

Each chunk type ana its associated ciass 0* image body structures is best

understood by tn« d'scuss jn of a representat v« eKample. As such, an eiample of a

VEWEX chunk is pr#Mntad in figure 111.6 As shown it the bottom of the figure, at

on« level the imag« chunk is Simply t linear ntt of e'emenlt. Th« Chunk Header

element (VI i occurs first .n this unear li»t, facilitating access to the element by »ny

attending process Th« order of the remaining elements at this linear litt level has no

meaningful significance.

Th« imcg« body of a VERTEX chunk consists of an equal number 0) interrelated XIT

and ANCLE typ« elements. Each XIT element repretentt on« line segn-ent «ml

direction of IM verlei (by the value of the DVX property) In Tigure 1116, X?

represent» th« UP enl Each XIT element is interrelated with two ANGLE element-, by

th« values of its associated internal vertei direction properties D1V1 and 01V2 Th«»«

properties have opposite directional values which are perpendicular to th« value of

I

Wa

Z

5 < rf 6 0 0

al »■ » r * * F -* 9

Fipjr« III.6

J I

^ »- o- 2 i- £

a 5

r

..

48

DV* In r.gyre 1116, 0!VI o' X? \% R; and DiV2 of XJ ■ iF Tnese t*o a.fect'Onî

values lhamselvcs become D'opert'es 0» tne XIT e errent, a ; edth 'ete'ence^ an

ANG-E element In Figura Illb. X2 has p'Dperties ^T and LE with RT re'erenong A3

ana LE refe't'K ng A^

An A\CiLE eieênt eôod'e1. tr-e v.su»l teatu'-e van^.e1 e^sting --tweer two

»djtctnt, different ai'erTea e* t difectrons o1 a verte» Chapter 1,2 has ipdvatea tât

the'e are e<gnt dcect'Onai /aiues (symDOis) jsed in ViPS Acco'dngiy, the ANG

rrorerty of ai ''''«GLL ■-'erne"! ca"''a^.e one o* ê ê-e" po'.*, 3 e argle .^^bosa- its

vaiui>. Tneê **'ir;'-' '.f,1t-'ü' ^'e ^CA acute angê, RTA- r ght angie, 08A- obtuse

»ng'e, STA .(faßnt (laC degree' ,i"-;e. SäA- stra.gnl acute »ng-e, SWA straight r.ght

\270 degreei angle, aâ SOA- st'a.gnt obtuse a^t; e

■\r> ANGLE e ement has t*o internji ve-te« directions a«.iOt'ated with 't. DIVl and

01V2, which Are inherited frOfn the t*o XIT e'e'oenti" p'Operlies *hich reference it.

This is illustrated m figure 111.6, DIV1 of t2 s RT a^d P< references A3, DIVl o» Kfl

-. Ui* and uP refcrcr.e'. A3 According:/, j;vi of A3 is UP and UP references X2 ;

DIV< o* A3 ■■■ n1' ana -*' re'cences Xfl Fnere s no '.gn,fiance to the cho.ce o*

i-.'.fnrêrt of ('»e t*o intern^ e'te« drpctions to DIV1 and DiV? The convention for

the asstgnfine,,t oMê "'e* • <* er!e» arectons of an ANGi E e'en ent fac' fates

"lrev»fs»r of tê image bod/ structure

iÂGE aOOY ACCESS - "PAVlPSA,-

To access tê symboi'C structure of an image chunk's iâge body, a process must

firr-t gain access to the imnge cnunk as a whee ana then to one e'ement of the image

bod, (the means fo' tht$ are o-.cuS'.ed in Chapler \At The process may then access

I

49

In» contents 0» ine 'wage n03v structu'e Py seujentijlly "I'jvjrsing" .t {(rew tn«

mini »emeiti lm»g» boo> iltmanti »'e tccessea D^ "'»versal o* a.i jce

'Pte'êiatir,; cope'tie^ 1 ,■ ifâge cody «'ewents of a chunn are immediately

accessible IchunK aptntion) DLJ not accessed in parallel An irrage body element is

'..iid lo DO "tracer jed" ^nen it .'. o accessed n, tne actwe process

VV tn reference to tne V'^TX ch^nn, a process may traverse the structure trom

one O e'e^-ent to aôtner », us-r,; •■ •? same ^nterreiat^ß direcliOâi property t^tce

In Figur» I'.lfc. RT ot «2 s ^3 ana RT o' A3 is X4 or »quivtlfnlly iBT o* (RT ot X2)) is

<-i '.ote tnat a VES'tN tn^nk s compete> tra.ersat e m t«o seqjeni ai courses

l»itn«r X2 to A3 ;o « i to A5 to X2 or X2 to Ab to X4 to A3 to X2i As such, Ih»

ttructur» s a semantra , aetj'mined. oouS.-inêa (douoiydrected) circular list.

Tns typ» of st'uctur» will «ere oe caiied a dO-b y-dire:iea rng ot elements

Th» nage oody slfoctur» ot tre VERTEX cn^n« rep'esenls th» v.sual feature

.onf ?ura' o" at one spat a. 'Ocat on Tnus. tnere s oni» one Pos.t,on type t ement in

tne VERTEX type cnun^ facn «âge ooa» t.en-en: refe'ences tnat element by its

asso'ialed p'(üV property not ..nown n f.gure [US) A Pos tion element (liters from

a" ' âge body eeme^t in tnat it s not la'ong witn tne Chunk Header e'empnt) a

Ira '■".aoie eiement o' 'no "a^.e struct i'e of the cnun» A Posit on element it

ndrectly access be t'oni any 'mage oody eement *hicn references it oy In»

manadatory P'.„^ propert»

09JtCT CHor*<

An OBJEC type image Chun« I schematically illustrated by Figur» 111.7 . Th»

image uody of «n OBJECI cnun» n aga n a doubly direcled ring of elements. This

!

.

,9*

Fl|ur. III. 7

I It«

H

c4

i

e

H

H

,

60

tine tu» |i«m«ntt if» of types INTERNAL and ANCLE. Tha cemmen cenfi|ur«tiOn (non

hwrarcWctl sub-structu'*) o) - aj» body «lomcntt which it ut»d n th» buildin|

block o< tha OBJECT chunk't ima|a body it tha *cori-«f' conlnurat.on. Tha lowor loft

'corner' of ti-t Fif-'a III 7, it shown m datail by Figur» III 8 Thu confifuration

roprestnts an ob;act comar, but a corn«r it not an •>phcit, hierarchical tub-

compenent o' l^e OBJECT c»unk ITJI» body ttructur».

The corner conffurafon i "r'i sgmficanlly from th« mage body Of a VERTEX

churk detcribea »sove T>-e angle ei'e' - to th« oh «ct't corner it not included in

the Mrnar'i 'rprttentaton An INTERNAL elantent he* only one internal direction

P'OpsMy (OIVII A process travartmg tha OBJECT cnui kt .mage boo/ ttructura can

not ' ■-« outtida or around the cornar* wlhoul accessing ei liner image chunk. Thit

charactenttic of tha mage representation of an object ceutet a eieda of vnual image

eccestmg which providat e bast for tha eipananca of figure - ground phanonwn»

(Ko"kj, 19361

fach corner configuration reprs. >II vitual features et one tpatai location Thua,

an ob.ect chunk hat at many ,--• ■ jn alemanlt at it nt« cornar coi guraliOns in itt

image body structure (see Figure 111.7) Tha ANGLE eien-ent mhantt the value of its

mtarnel traversal directiont (OIVI and DIV2) from the INTERNAL atemanls of a corner

m the tame manner at from the KIT elementt of a VERTEX chunk.

Two interrelated INTERNAL eiemantk span tha «patiei teparaton of two adiacanl

object 'cornart* and at tuch are repretanlativa of an obiect "tide' (which alto it not

en aipicil image component) In Figure 1117, It refarancat 119 by ill LIX property

Tr>a direction (OIX Of It) i« down (00) and the range or length (RIX Of I«» it 'ong (LO)

Invartaly, US referancat It by iti LK (link Internal eXit property, with OK (Direction

Intamal aXit) bam« UP and R« (Ra<«e Inlemei exit) being LO.

Figure III 8

"toRUU" UH? \^>nklVT\»fk ^£1 IS\^\

X*t x.

TH»fc lt»T

Owl «.t

RT ^3 Ov». VJP

R\* to \.»> tb

il t-

51

're so-vO'D^'C »e Jl o-?tiip ot a p'ocesi's I'aversji ot iwjge BOfl/ e em»"!« to lh»

oce'iit 0" of »«>'"a «KIMI sc«"'1'; aifl ^tormjt.o" jcce«in( (criltnoi »51 Become»

cur *ith the intraä;clon ol the .^J.'ECT cnunn The conterH o' »n ooject'* imege

'eo'u'.entatton aê accessed by the sequential tfavers»! ot the iâge body element* in

a manner which is seân»^rfi.^ eajivaient to the ot'.erved no'e movement behavior

The image reprcentat on and this operdt.onat reiationth^ ate straight 'o'*a'ö ^

extendable 'a acccmodetf "orma1 eye mo.ement behavor (Chapter lb)

i üMhermore. this traversal ot tt* image booy structures sho*s a ciose oeha.iorai

real ohship to the ..cliyity n/o .eO m Ih» generation ot dra«n reproductions Th«

-on-h»rarch cai njtjre of earn .mage body representation »nj Hit spat ai m«»n.ng o'

the ihterrei itionai propert-es ot the element', ar« two basic 'epresentation

charactt'olici whch mane possible I i straight-lo'waro apo'caton ol th s

Denavora:iy somorphic trave-sai operation lor image accessing The delinilion ol

s,mboiiC e'eênts as property groupc a'so lac itates traversal »hi, signilicanlly ellecls

System operat on by eiimmat ng mean.ng frpm chunik Surl8<e structure (order ol

•••manU),

Llf.E CHUNK

A îr.E type ch mk .s illustrated by Figura 1119 II is aga^n a doubly diieded ring

Ol image body elements (a orcuar list structure) The L1N£ structure aiso introduces

tê use o* the END and QUlOSEE type» ol Image Body e'ements Fht booy ol a LINE

type chjnK includes 'wo END type e-ements fach ENO element relertnces an

assropnate POSITION eemenl which serves to spat ally locale that nne end. Each END

piomont nas an associated property arhtch ser«es to ink that line end to the visual

■

■

Mrit cVovO^

Figur« III 9

UIL ?i ** pn

out jy oo

1»* X

Xj: **.

:/

— ~r~zT-i x^-j ,*

'>9l i «

Tips (^«.«see

t*o^ one M

u^ ?a ti ?w\

» x^ -> t«-

b2

co"!»«! embod ed »i anotfief ""jje :ijn» 'h» TYPE p'Opcrl/j value v»'.«s with lhal

e«:e"n«i cont««!.

E«ci END eem»-; ha? 'wo •nte'"»! t-a. -si a'ect:Ons »socaled wth it »LSI and

. S^ li 0* ^g travefijt o* each "Vde" ot the une Each i.If4E vhunk "side" «mpio^s

'ntg're a'«d INIEBNAt. ».p» tltmcnti to span tp«ti*l locations as in the OBJECT type

chuh». At app'opriate locat'Ohs, /e'ie«-hke :0hti|u'«t.ors trt rep'esehted by either

b/ i'e'-eated KIT »nd ANGLF a^d INTE9NA. eetientt (as ihoain in Figure ULI (a) )

or by « tmgw QuICKSEE type •lenient, as snowh m F gjre IIH (6). A QuICKSEE

e e-'-ent Ohly part ally represerts In» vertea irtormation ensitmg on that lina "sde" 11

on'/ eôodies the number o* verte« ents ieav ng tne ê ot f-at location ifrom that

side I. A QjlOSEE e ement doei reference a petition e ement -iy its associate:) P\JM

O'opert^. Two tra/ersai a rert'Cs are also assoc aled vnJl and TD2), which are

inherited from its neighbor ng IMERNAt, elements

"he QüIC<SEE element s ntroduced to recesent the incomplete information

aca 'ed b/ a suoiecl in tne race that tne hole is movea through a verte» on a line

without stopp ng This mcompietness 0( visu«: feature represenla' on a so typ lie»

(jer.pheral vis on input mformaton As such, an entension (generalization! ot the

QUICKSEE e.ement is later proposed as a means of symbolically representing such

ppriphera / accessed visual information'.C-apter ;bi

1U1NF

*hv iLIfÊ chunK is an Incomplete LINE type chunk which m»/ occur as p»'t ot •

part ai visual imege enuting at some i^'ermeda!» ponf of t"» v sual pe'cep'ion

A cnunh of this t /pe is never )art ot the tmalized visual »mage (perfep*iOn)

■ ■-

tAZ XWIH« <-Vo»JU F'fur« 111.10

__L

^

t K|A 1

±^ 4««. ^w» «^

^

_x AJ:

—^—■%

"t^Tt VlHE

whici s the reû'l 0' th»t p»fceptuil Rtnnty Ai such, it m not on» o( tti» live DiS'C

cnunk types «s • >a Mriitr, but it is used by VIPS l> i'ômpiish perception.

Figure II! 10(41 presents l" .stril'On at jn iL. J£ '. ) ctlunK. This chunk t/pe

wakes a dptir^te spec tu- use ot the C^ property o* its Chunk Header eeênt CW

nd'tates the MTCRNAL ee^fnt when is to be inked to elements representing the

•nm^nent visua "to'âtion during it' ncorpo'at-on into and the compietion ot the

maô ooay (o* the line». Figure 11! lOtb) i ostrates Ine addition ot turtner lOtormat.or

mpletinf the line and cnang.rg »he iLi*«t chunk to a LINE chunk Note that the

.er'-r» Mke configurat on .s part ot tne resultant iVJi tfpe ti>unk

'ne CP prppe'ty ot tne Cnun» Header eifi-ent is ttmitAriiy used t>f the îsua<

perception p'oce-s m tr-e tonstrudon ot CSÄCf t,pe chunks. Incomplete OBJEC'

chunks are not made "to su.-n a soe; a "aje l,pe -es lOBJECTI though, as tne object

mcoi-p eteness s always e-bodea «>tlun l"e ait .e pe'cent-ai goal A- ILINE chunk

may occur m con.unct on win goa'S wh.cn oo rot specit ca'iy note ts ei'Stence

SiOt CHUNK

A S10E t,pe chunk is j-.ej 'occurs* oni, n con „ret.on w Ih an associated OBJECT

or FACE thunK. I"e reiation'.iup is jstraleo n the sehen ate sketcn ot Figure III il

"•■' ' ,-e ntroduces a 'ew picton*! repre.e^tat on convention Each image 0od(

e en-ent n only 5pe;'t ea u^ one ol tiv» le'ters ndica' ng its type il INTERNAL, X-EXT,

" "■. . I, E END, . "jUICicSEEi Inis abb'evulea octonai 'epre-enlation is used

t^ro ignont the rest o' tne thesis The "usual" mtrachunk I nks (those de' ned

previOusl/i »re impi.ed to e>'.t On;/ links between image chunks a.-e nflcatea (by

the .irrows» No Posi'Oh e!eTents are r,eluded in these d'iwn rep'esentatons e ther

Figure HI 11

SI

Mli x'

/

54

In« END titmantt, when u%ed m • SIDE chunk iixa|* body, «Kh hav« only on«

intrKhunfe linn aviiljbi* lor tr«vers*i (LSI) Thus, • SIDE chunk tllowt Utwui over

only or* '(ids* of th« hne-itka m»g» «tructurt it rtprtMntt. At with LINE chunks, •

QUICKSEE •lamtni may occur in a SIDE chunk to partially rapratant an ncludad

(attmiiatad) vet« It <t th« only .'»g« bojy ttructura which it not a doubly-dir«ct«d

litt ('ing) ot e en-fits Th« olri«r 'tid«' (of th« ob|«ct't tid«) it travt'tabl« Only within

th« * «ted OBJECT chunk. Th« SIDE miy f«pr«t«nl vitual nformation to th« outtid«

0* th« object at thown by Figur« ül ■ I Or it may r«pr«tanl inlormation occu'r.ng

with n th« ob|«ct CPMOur (at thown by F.|ur« 111.19) Onl/ a rapratantalion 0» th«

ob^ct contour it m an OSJECT chunk. An, contoitual mtaraction with «n obi«ct 't d«"

it r*pr*t«nt«d in a SIDE chunk.

PACE CWJNK

Th« FACE lyp« ir a|« chuiK hat >mat« chunk characlanttict «quivalant to Xhm ut«

Of «n OBJECT chunk Ch«pt«r 15 (on aatpntiont lo tt-e <mpl«r>«nt«d VIPS) tlaUt that •

Ihree-a--- .'Onji pr0|«clicn ol a pntm-lyp« obi«ct it vitually percaived as contittmg

ol a "prim» tac«* and a«ro or more related *t«condary* )ac«t Thit prim« l«t« it

'epret«nt«d by an OBJECT tyr« chunk, with t>-« DIM (d>m«nti0n) pro, erty of th*

Chunk Header specified at THREE. All tecondar/ facet inclu4«d >n th« mage «r«

repretented m r«let«d FACE chunks Th« Chunk Header element ol e FACE chunk do«t

not have a NAME prop«rty assoc ated with it. Th« name ol a thr««-dim«nvon«l ob|«cf

it determined by th« n«m« ol th« prim« IK« chunk. Figur* 111.12 iHuttr*l«t th« uM 0*

FACE typ« chunkt m th« cont«it ol a cubic mag«

Th« Chunk H«ad«r «lamanl ol a FACE chunk end el I thrM-dimcnaion OBJECT

!

I

i

■>

I ..

3

a» i

Figur« 111 12

I

99

cnu^n h« two tpec t «»socaled orop^rê», BDI" »ifl FD1C fD!R »ptcifw» Iht titi»!

e»1e-von d'tc'o" ot l-e pf •J">»lic p-c/'-tor. »nd BDI" tptcit'«i Ih» deplh

fl 'jctioilst «"Oc at»d win tn» ob;»cf>, p»'c«pl 0" TD1B M4 BDW »'• tn» »»m«,

««cept *•?'' FOR M do«" t»« Oap'e' 15). If« until DOS/ of * FACE cnunk it

•Jf j gut - (Of*»'*/ gtr«',itea •'0* • sp»c •■c»l M 0* fDW »"0 tn« ontntil.or ol Iht

''»>» '.eg**'«* 'ot th« prime t>te) tro*« Kfh»fh -t eitends

''e'teoHî/ -'etttd deptn '»utiOM ttfing * Ih Ih«^ < It r d dimension to- >oc*t.on

tpo*. ' C^J vpecittcation Aj luch, 'ete'^nced Position l^pt element', jre modited by

the «dd'tion ot Ihr»» rew p'Ope-te'. P.W, PoDP, PrBP (Perceived Front Ba-n

Pos tion' PIBP »nd PuOP a'.s.ime vjiue-. ttom tne ume ciisi as LPP »nd UOP S »'

to tr e bind'n^ ot a seven-byseven ! *o a rntns ona' grd to \^9 visua1 *"t;d ot .nte-est,

tne pcteptj»1 process D nds a sevt» .a'ued oepm s:ae to tn» vnual deld trÔ (Fronl

■ ,.<r. F5H, 0»1, BV» (Bac«. SHort), BME. BLO) These symbol constitute th» das«

ne .aues to' PFBP Th« adwition oi tn» tnre» n»w positon iji»m»nl

prppe'' es ~eans tnat a (rOuD J* • lutl t»»ljr»s ot • p ctu'» et v»rt»>/ is p*rc»iv»d

", ■ • A' two interrelated iocat ons On» location <\ in ttrrr» ol th» p clur» plan» (LRP

ar-n i.DP) a-d on« it in lermt ol tn« per;eptu»liy-cr«at»d thr»e-diin»ntionai spac»

(P.P^. PUDP, PrBP).

'he bnd'i; ol this depth teal» adds th» tri.ra oimens'Onal ant to th» d m»nsion»l

6'd del.ned b, the LRP and I.'OP binding Th« resultant pro,eclionai p'an« Upac«)

dillers tro-n the usual (mathematiraiiy d«l ned) one n Inal the 0"jin ot the depth »mt

need not come de «m in» two . ■;-. c-i T ir r 5, 'e III 13 n1../rates Ihit idea,

the depln origin being bound to tne UJH üSH) p'anar location. Th« bacn dir«cl,on

'BOWi ol Inat axs in Figur« ULI] >s up - nght (URi. Tn.t . ■nction pla/t « special 'Ol«

, '

•. Figur« III

ruo

• T>WO

Figur» III 14

'7

.

to

in th» .— • rp-.., js'.ign-rent o» locitiom 1P1.RP, PJDP. PFBP) Om/ line segments ,n

lh« wm# orientation *s f»1» oe^'•, a«i$ (UR - Dt) m»y mot an >'») o» issigned aept'i

n-ean-n^ and aicofflmg!/ a'tect pe" ■■ . J cication This necessarily adds a diinension

o' pi"-'eplual amb'g^ty (duauty) to tn» p^clu'e p-ar-e

gjr» 111.1^ iilîfates ^"at 'Ot all hrt segments .n tne depln a> s orentition are

nognc^ depth trtaning |. re segment "a" s pound to tne pri-n» ifapeiO'dall face,

wnich it percrved ■ be pa'ai ci to tne P'Ctj't pane F gure ULIB illustrates tne

Otd onal amBiguity o* Hn pe'ceplua' pro.ectiona p'ane 3ta't at pont "o" Mo^mg to

pomt "A* on line segment a (as part ot the cuBe' H pt eptually interpreted as a

movement m depth (bacO Wovmg l-o-n "o" to pomt "A" on side b Inen en s.da c las

part of tne triang e s a mo/ement on tne picture pane S^D,ects did per t.ê this

p.cture as nterreiated cube and ■' ange (see ' gjre 111.16 >■ '<■*■■ descriptions and

drawing behavior mdttate a duality of locationai specification (PLPP, PUCP, PfWf and

L«P, LlOP).

Anecdotal e«p»r menta" results led to and HUM support these proposed sroperty

aad'tions and the-r Mean.ng Thret dimensional <ocal on specifications were used d.e

oacn there", "in front of tnat") KVnen traversing mes M the BDIR diretton, subjects

often would s*/ "gomg bacn" or "now bee» nert" Yet. perceptual nferences were

made wl eh indicated t ê manlenance of the picture plane location features ■

conj jnci'On with the three-dimensional features used in tne protocols verbalitatiors.

Ai«o, the rbal descrip: sns emplciêd three-dimensional terms white the drawing

behavior ndtcated picture plane positional knowledge Several picture perceptions

n'erspersed three and two dimensional no »t's, aga'n mterreletng two and three

dimensional picture features (see T gure IV15) Chapter 1.5 discusMt three

uimens<onal picture perception and relevant protocols

/ I

St..

1.12.S

vrua: i sec.

Figure ill 15

Ficur« III 16

okay

now there's a uli

It looH

basically tV shape of a

p.irallclo

rectanj-.u.ilr parallclpiped except In

down In the lower rif.ht hand corner

an e- Ira

an CKira tttaacl« has been

has been drawn on

I.I2.C

VTIMtv

>:'< • rectangle In perspective and the botto

of

bottom part on the rjRht

Is made Into a trlanglr

I ,J ^—.

..

b?

INTERCHUW R£LAT10NSHIF»S

A visu»! 'mage (in V1PS) i »n inltrr»l»ltd group (itructurt) Ol im«t» chunK». T1 *

chunK types have been delied It remains to specify Ih« inttmUting property

connections wHich are used to tie th» chunks together as - omplet» visual image

Two oavc types ot imKs are used, equivalency links and spa^ 'raversing links. These

links meamnglu"/ interrelate two irnage L:ay elements, 0'.e in each ot t*0 image

chunks kS

Two varieties 0* equivalency Imks have ueen introduced Ithcugh not discussed) in

the de' - I orv, at SIDE) and TACL chunks aoove figure 111.11 illustrates how an

INTERNAL element of an OBJECT chunk may be equvalent'y linked to an END element

ot a SIDE chunk. Figure HU1 illustrates the use ol equivalency links between

INTEBNALS Ol dillermg chunks ol three •dimensional ob.ecl image. These links serve to

"strap" Ih* image together

Kquivaiency linM serve to relate two image oody elements ol dillerent chjnks that

represent tne same physical picture component This one physical (eidernal) visual

component II represented as oeng part ot two dillerent image concepts (chunks) The

links ol III 12 nnk INTERNALS which represent one line segment that is shared by two

facial images (EFL - Equivalent Facial Link). Figure 11117 illustrates similar Imka (Imks a

and b) between obiecl imafcs which share a common picture line (EOL - Equivalent

OBJtCt Link).

Another visual (picture) feature which may be represented within two imaje

chunks is the angle lealure. Equivalent ANGLE elements ot two chunks may be linked

by a pair ol associated, inversely specilied (directed) EAL (Equivalent Angle Link)

/

')6a Fl|ur« III.II

'

/

. -'

'Kb

Flpjr* ULI!

/

■ 7« Figur« 111 17

■..

•.'

properties. F.gur» 111 IS illustrittt the UM ot this mterchunh relttion. An ANGLE

element of • VERTEX ctunk it linked to one m an OBJECT chunk n » me»n« of

representing the context «I an obiect 'corner*.

The two INTERNAL elements of en OBJECT chunk 'corner* configuritien may be

equivaiently linked to two XIT elements of a related VERTEX chunk. This occurs in the

case of an object being perceived as containing a line (inside the contour) eriguiating

at that object corner, figure 11119 illustrates the use of these links (links a and b).

This f gure illustrates the use of a SIDE chunk to represent the 'inside' edge of an

object's side. This figure also illustrates the equivalency link (linns c and d) which is

used between an XIT element and an END (of a LINE type chunk) element. The

evte'nal Ml of an END element of a LINE chunk is an equivalency link

The other type of mter-chunk links are space-trivarsmg in meaning These links

occur between two XIT elements of differing LINE, SIDE, or VERTEX chunks. Figure

III 20 illustrates the use of these links (V) between a LINE af several VERTEX

chunks. The three properties OVX (Direction of Vertei eXil), LVX (Link of Verte« eXit),

and RVX (Range of Verte» eXitl serve to specify these links.

EQUIVALENCY AND REDUNDANCY

The use of equivalency links to mlerrriate image chunks introduces a necessary

degree of redundancy into thu visual image representation This redundancy is a

fundamental aspect of the semantic nature of the visual image A line segment

between two objects is meenmgfully part of both image concepts Figure - ground

phenomenon considerations reqmre thai this pert be included m each of the two image

chunks. Similarly, angles ere seen es part of en object end a* perl of e comple«

M

it, Figure III 20

1^ t

/

Vi

-e'te« where several object corners may meet The use Of equivalency l<nKs are an

enentia' factor m the reai la. on of '"put miWiHtmi * compiei v^rte« is readily

«SS-M'ated as ODiect enviro-" . ' :onte»t) Ourmg parccptja. proce.smg Tnese

equ'alenc/ links <■ so proviOe Hit necessary means of .mage traversal (pass.ng)

bttWNM chunks (concept«). Tint trivtrtal a ows the oeiav.O' necttstry to »pia'n

the perceptual (veroel) descnptiO- and drawing activitie«.

iMAGt t*tPKt»d.«iAriON rLEXIBI.rv

To satisfy the design criteria 1, 2, and 3, a most necessary characteristic was

fleiioiiity of ir.age representation. Vlenibilit/ of image representation* means that

one single line dram ng must be representabie in more than one way, reflecting the

diversity of sul t behaviors and resultml paneptont observed with regards to a

single line drawing

Th« fgures 111.17 • 111.20 illustrate tne fien.bility ol the proposed image

ropresentelion. Figures Hit7(a) • 111.20(a) exemplify the general ctess it verbal

description which is associated with each respective image repre »ntation of that on«

line drawing.

The redundancy end tle>ib<lity of the meg' '«p-esentation, the non-hierarchical

nature of the image body structures, and the .pati-i end equivalency meaning of the

element interrelations are the mam design feeture;. which allow adequate satisfaction

of the design criteria specified. The propo-ai of th.. venous image body i

their associated interrelationships yield these representation capabilities

h .. U

59«

Flpjr» III. 1 TW

Thero Is n snuHrc next to a trlanel«

tho square is to the loft of the trianrle

1

Fi|ur«III.18W

Ther^ is '■ jinuire which nrot^ i trianglt to th« rir't neotir;, ^l :.Y.e top anl bottom cornorü of th^t ait*

Fifur* 111.19(a)

i'hora is <i trapozoid which haj J line from its obtuse corner to Lh; tiotton

Fi|ur« 111.20(a)

There is a ri]-,ht an-;le in tho lower l«ft abov« that in another riiht nnilo then tu tl o rirht is a throe-exit vertex lines ^o iown anl lown-rinht fron there to hit tha botton

^.

^ •l

3. The Im.ge m VIPS

Chapttr 1.4 will discuss how th« visual im*|« Mrvtt to guidt th» pjrcaptual

bahavior of VIPS as chunks STM, and how, as t»ch STM chunk it visually conlirmod and

m«anm|(ully >nte|rat*d into th« mag», the«« chunks art transtarrod to ITM. 1TM it

th« residence of the complete »malted visual imai« (perception) resulting from th«

activity of VIPS.

TH« image chunKs ol STM are interrelated by equivalency and space trav«rting

inns, as discussed above When these chunks are incorporated into ITM further

relational links are added. These new Imks are between the Chunk Header elements of

related image chunks. Th« incorporation of image chunks is sequential at indicated.

The Order of object image chunk incorporation is represented eiplidlly by the placing

Of a (NCKT-OM relational property on the currently last ITM obiect wwch is set to

reference the new object image chunk upon its incorporation Furthermore, an object

image is >ncorparated together with its immediate en, ronntent as determined b. the

«msting equivalency h *■* of its image body elements. A prope-ty (ENV) is added ts in

object's Chunk Header dunng incorporation. This prope't/ has as value a list of thoia

image body elements which have an inter-chunk equivalency lirk. These elements

th«ms«;/es become properties of the object's Chunk Header. Each has as value th«

Chjnk Header of the image chunk which contains th« image body «lament to which it it

linked by equ .aiency.

One perceptual strategy (see Chapter 111) ir,.olv«t the perception of the picture

Outline. As chunks representing parts of this outline are ncorporated environmental

links are added between Chunk Headers. These involve the use Of the ENV property

, ^»■w •

61

^

•nd In» imtga body properties «s w<th ooj«! incorporation but tns inter-chunk linkt

in thit c«se may be space-traversng alto

Figur* 21(a), (b), c) and ' ju-e ??(»), (b), (cl IHusirat* two image representations

produced by VIPJ during the eiplanation c' !»• proUco -> upon the same line drawing

The component (a) of each figure presents the subject's verbel description

Component (b) pretentt the image's piclor ai representation as shown ■ »'o-o

Component (c> presents the ■'■..-■>. Header st'ucture produced by chunk incorporation

into ITM. The doubly directed kMfei are environmenta1 ;>nRt The uni-directionai dotted

links ere the NEXT-03 Imki mentioned above. The figure also indicates the order that

the visual concepts (cr\i^> ■ ol the image are noted in the subje't's description.

The fle«ibiiity ol tne representation is again illustrated by these two enamples.

Furthermore, tr« use of botn the equivalency and spatial links between im>we bodies

and the relational imks between Chunk Heaoei-s appears to be basic to an enplanation

of tr-e verbal and drawing descriptive behavior

Figure 21(c) includes a -e-oj ealion by VIPS which it based upon NEXT-OB link

traversal only. Figure 21(a) shows that these ab,ect concepts occur in the same order

(by d), (n), (m) and dv)) Section A of Ih» ve'baliiation is derivable from the Chunk

Header (environmental) links Section 9 indicates image body traversal ol the

recl.mgie (0184) image and at the equivalency link oetween that image and that of

S10; Section C again is de' /able solely from the environmental link» of the Chtnk

Header.

Tne verbaii»ation of Figure 2?(a) »npioys tn» wage body Imk« to a greater

degree. The first section (A) is derivable from Chunk Header links All of the rest (B)

of that verbal description it the verbalmtion of a traversal of the image chunks

according to the mter-chunk image body links jommg tnem.

;

6:

Tbe OunK Header re <l<ons in ITM add a dimension at hierarchy to the "aje

■-epresantation beyond that impi.ed By the chunking ot the visual information The tinal

form nt the visual image in VIPS (the perception found in ITM) is « helerarcttical

symDOi structure.

rijur. 111.21U

okay un I have a three-sidoi trianKlo (1) which Intersects a square on the right (ii) there IJ a rect3;'.';,le (iii) on to; of the square on the ri^ht un thlj roctaniUe un has OH«* side that is the sane slle as the square that's on the loft of the square anl then the rectanr.lc goes to the Fight anl cones down und Intersects the square urn on top of the square and then conin« off this rectangle is a four-sided object (lv) which p'jlls the whole drawing together the fuur-sided figure has aides on the rectangle the triangle and the square

^

'..'a

Figur* 111.21(b)

X

065

z A

Mas

y I

«b FIfMllLllW

tl

H n

i e 1 «

« M-i O

«Isf OU.O

•» Slfc MS « < <

ill!

I I c

i r.

-•

15 J 8.

1 1- * * t

^

^ * -

•Oc

Fi|ur« 111.22(a)

okay tho wholo thinr: wo have uh wo hivo i trlanglt in the lower left hand corner ar.i we II.T/O a vortie.-il coming up to that and it i.its a horizontal over there on tho top in 1 (pauao a verticil (;oes down -u the right a vortical i-oas down and it hitj a horizontal you «ro over to the right and there ia a right angla you nov« down to tho ie:'t there's a ripht you Mva town there's a right anglo ani there ia a bottom

I ^ >

^

bid

Figur* 111.22(b)

X X

, —*J A—**

>

63e Flfura 11122(0

*r***i*i

0

5

1 0 «

1

SK

Chiplar L4 TN» Form »nd Activity of Vlf>S

^

Th« purpose of Ihn chapter i> two-told It tir;' prttentt I tp«cific*t">n of th*

memories and processes which are coordinated participant« in visual perceplni. It

then illutlates these components m «lion by presenting an eiample segment ei a

trace of VIPS activity The image representation it also demonstrated it a guide lor

this activity

1. System O «rviow

T

T

5 «•

5 5

I i

Throughout the development ol VIPS the proliferation et memories and processes

was accepted, indeed considered valuable, when such proliferation enpedited system

design, function, and description This proliferation was tempered by the requirement

that favorable eipenmental indications for any memory proposal emst. At a result, the

p-opoted system it composed of tia memories and four processes, named at folows:

Memories:

1. Picture (PIC) (an eaternal memory) 2. Visual Register (VR) 3. Short Term Memory (STM) 4. Long Term Memory (LTM) 5. Recognition Long Term Memory (RLTM) (long term memory components) 6. Intermediate Term Memory (ITM)

Processes:

1. Assimilation - Accomodation process (AA-SV$) 2. Visual Input process (VI-SYS) 3. Recognition process (REC-SYS) 4. Incorporation process (!NC-SYS)

>

: ■*.

S4

TM£ MEMOniES

Th« mcmonet of VIPS diltff in «tveril pnmi'y ch»r<ct»ri»tic». whic" •■ -v» to

di$tirgui«h »nd at1'*» ttch êÔ'y. Tn«:» chjrjcttr.sucs «r«:

1. the a&soC'ated ovi"ai> (s^D'a-e'emental) information structure; ? the internal character:st-cs and structure of the contained

memory elements, 3 the variabi:>ty im If we Q' adOition o' alteration of, and

■ oss of contained eirênls) tnrougn the performance Of a perceptual task;

•V the «Mowed means of informalon accessing, b the «ssocated processes (those which can access the memory,

and now each can effect the "»mory).

The memories are not separata storage compartment', of the cognitive processor

though computer mpiementaton fosters trvs interpretation. Each active m»mO'y »

defined by the functional rpi« which its content» piay in the perceptual activity

undertaken by the system A symooi ..• symooi structure may be said to b« m one of

the active memone! (STM ^r a ceil ot Vf) when it plays the associated processing rol«.

I gure IV 1 indicates Ihe accessibit, relationships between the constitutnl

memories and processes ot V!P$ An arrow trom a memory to a process indicates that

the process can access n'c-a'on trom that memo'/ by that memory's associated

accossmg mean« An arrow '•(■•• a process to • memory indicates that tne process can

alter that memory by •ntcnrf new tlemen i or changing ••itling o-»s (Not* that LTM

is not shown, its elements p*rm«at ng iDemg) a>l memories and proctsset)

Figur» 1V.2 shows th» poss - • «tor-memory transfers Ot mformilion within the

I

I

■I -

Fifur« IV. 1

> Ü

Figur« IV?

*! 11\ « H fi a; 515: 7

1 i {

/ 1

65

tyttam. Each irrew it l»b«iltd w.th tht p'octi« cipabl* ot parlormini Ih« indicitad,

di'tcted mfcflition transltr This ligura mdicalat tha How o< viiual intermatien

with n vi?S It i> radundant with F,gura IV.l but amphMint a diHaranl tyttam atpact

1. PIC (PlCtura)

PIC n an aitarn«! memor/ (Nawall «'id Simon, 1972) and Ih« jourca of visual input

mtormation m VIPf Due to ;ne nature ot pauaptuai procatsmj. whith V1PS medals,

tha &ystam must raprasant botn subjact and anvironmanl in ordar to anplam th»

bahavior. *s such, PIC it Inat part ot ViPS which rapratantt tha anvironmant.

Elsawhara I hava dafmad par'aption to ba tn« active process by which an

organism interprets the slates 0' a subset ot its calls (Farlay, 1971) Given suKicenl

organism complenty, thata ceils are tubtats ot an organism's nervous tyttam, baing

called sensory receptors. Tha significant feature ot sensory receptor cells it thair

direct, or altactiva, link with tha organitm's surface Thit laatura Itadt tha organism

to believe that tha sensory receptor ttatat indicate conditions el • surrounding,

impinging anvironmant That this baliat it reality or illusion appears phanomanally

mdeterminanl.

In tna human organism. In« receptor cell slates which are interpreted during

visual perception are those ot the rod and cone cells el Ih« eye at organired 'o

"receptive teids* at the ratma (Laibovic, 19721 These cells (stales) form the v' jai

envonmenl Thit it the environment rapratenled by PIC. Tint it the moat calarnal

that any memory can be said to be It it the environment in term Ot tentory rather

than phytical qualities

Since involvement with actual camera mput waa to ba avoided at necessarily

.. .-

M

poking «dd't'Onj. p-sbiems jj\' ie tê rf ^ m o* lê tfie-. s . a" ite^n^di*!» ot» '.pt .e

'•P'»»»f>t*t or o' tr>» pictu-e wai "««ate Hn 'ipfese'tat.or cnos-" tp' th.i

oesc- p' o ■ w • M c' vfte» deiciptici, »«•> .e'lei aes;- p! on De-rg » "»*? sst o'

verle« 'eatjres This vu e* 'ep'esenlaton ha» me cna'acle* stc o< Deng co"s stent

wit»- feature mtlytit ar,' utractiO" cooosais to' tre roie o* the e/e n vsu»1

pe'cepto" Va'ou» "ej'eOiOg'Ca' aô ps.cnopi,! cai »ludes âê "-dcalea Hw

appa'eht feato'e e«trac! c- tapao ' es ot the e>e iMb*l>tt**i o* t"* v tuî processor

(•or 'ett'ftn it* Chao'fr ;il. Trese st^des nd.cate mat this analyt'S me/ 6«

ettectcd by a h.gh-orae' Of'cept-o"- «e prutess IMJ-U, lt7I' Uhf 119731 d<scusscs

n-eehs for thi^ :ompufer trnp-eweMat'Oh o» this "ônt-end* of vtiu«. for^ percep' 0"

act v I» Each .erlei repreie' 'a' Oh o' »"iC s P'ooosed as oe hg analogous to a nt of

(eator»» which tn« e.e tOjd "et-e.» at that verte« ocatio« The M of verte»

oesc plon» rompr.s.hg PIC reâ-s co'stah' throughout fh« pe'eept^*' act < ty o»

V!PS,

G>bson li966) h»» d»1- ' bed th» serses as tie act .e s/ste^s wh.ch -egaler tie

".hvarieht structures of a-a »0* st.mu'atio** furh^nâ j» tne »eceptors" The theory

of ViPS agrees that structure does e«'St m ir*Ml it ru at on and that t s registered

during perceptua act »ify out i" argues that l" ■ s omy an .n|iei «ve. of P'Ocessing

Structure exists «s potenf-ai iftjrpiat'h m the envronment The ■n.tia. leê of

pe'ceptuai process-g trans'O'-r. ' at structure nto Srôcs and re at o^s »nci «re

«"own Oy me orgervsf 'n« ,'oogca "lof*»* 0*1 W reiuits of this aired an«iy»n

are 'ou'd m PJC. «"d pots o, VI a» t'« icon ■« automat can» co structed The MMMl

"'*• produced Dy visu» p«rcept>eh ■ STM ana I'M >s I « 'etuit o' constructive

etti.ity »foin % hfiuÄncno By go»s met a-e oeyono m« mere r»gistr»»iOh of

st.mullt On «tructur« (retpn« .e)

1

17

'"• P'Ottis v;-S*S '» tf» only P'Octss «itn «cctt» 1» th« Piclyr» m«mory. Tr>n

■MMt • a: COT' '■•■•a by means ot '"e P ctu't mainory't KiOCKlfd r«(tr«nct BO<n1sr,

••»t CJ"»"' Pictu'« Pointer 1CPP1 '■ • pO'n'tr t'wlys r»lertnc»s on« Of tn« v»'te«

aetc D'On i tts. tie ng uneiogout to '■'•» Current no« pOit'On ot in« primary

-.o-r.mentai tat» vtuat on facn ve'ten oe«CriptiOn litt aoo tonlam» tne neceiia'y

spat 4 r'ormat>on to facilitate tne repovtion ng ot CPP in a way analogous to that o*

hole movement That n by '.peciticat o" ot a direction ot hole movement (See

Appendu A PIC? lor an ena^p.e 0* a 0'iC representation and aetai'S 01 the verte«

teaturet ana spat ai interreiettonshtp« used.;

2 VR (Vnuei aegnter)

The v sj*l re(isl«r cons sts Ot ' ve noependenl con« Ot mtormal On, t-ese bein|:

A DIB ■ direction lot eye-hoie moyement» 3. »AN - range (ot eye npie movement! C. tXP - eipettaton 0. ATT - attention E. VI - visual mlormatiOn

Thi« memory s utiized n viPS as a cofnmunicatien regute' between t>-e VI-S^S

process and the AA-S*S process «nd, as such, s h^hiy vanabt« throughout in«

performance df a perceptual 'ask. «.th both procatMs r-avmg the aomty to inspect

and ater its component ce is OIR and ATT may be null, or contcin a di'tctionaily

nea .ngfui mage symbol RAN may be nun or contain an mage symbol represtnting

d stance. EXP may be nun or contain an image ang'e symbol or li»l of vert««

specification symbols VI may MMNM Oe njii or contam a partial or complete imaf*

structure navinf Is origin m Vi SYS process operation

• -

VI

Th» VI ctll is propostd n the iqmvaltnt of |i t to-cjlled Sperling (Snarling, 1960)

or iconic (Neuser, 1967) visual memory. Upon VI SYS activation V! it always eiipty

(!L- to a null value) At the tim* of VI-SYS dtactivation, the cell contains ai image

representation (chunk) ol the new visual information acquired by the changing of

(mation (hole) location. This iconic image in VI is the result of the first (two) of several

active stages of information processing and abstraction (Posncr, 1969) Slemberg

(1967) observed reaction time differences indicating the presence of such a stage of

visual representation prior to the application of recognition operations

Visual information, as it appears in VI, has not yet been spatially integrated into or

m any meaningful way associated with the current perceptual image contents of STM.

This is one basic characteristic of the visual icon wnich has been inferred from

eaperimenlal results (Haber ; 1971). Another i« the independence of its contents from

the influence of any active perceptual goal. Although perceptual goals play a prim«

role m VIPS, the functioning of VI-SVS is only dependent upon the contents of PIC and

the ViMjjl Register This provides for the desired goal independence of the resultant VI

cell contents. Given visual register specifications for the movement of CPP (the hole),

the ■■ncodmg of information into VI (the icon) is 'automatic" (Shiffnn and Geisiei .973).

Finally, the results Of visual masking eipermentation indicate that Ih« icon is

susceptible to erasure from Overwriting VI also has this characteristic as it is set to

null then reconstructed with each activaton of VI-S^S The representation of visual

information m VI in the present implementation is that of an image chunk. A possibly

better choice it that of juM the vertea feature litt itteif, allowing greater fiembiiity of

STM representation

..

EXP md ATT

Th« EXP «nd ATT cell« provid« lh* >nlerm*tion nattuiry (Or th* eparation ot

"prealtantivt functions', wuch tha parctptuai tytlpn (thf9u|h VI-SVS) l>nd(

advantageous to apply The "praattanli.e tunctons* ot V1PS clil'ar from tna «holistic

lypa described by Neisser (1967), but they serve similar purposes

'he EXP cell allows the Vl-SVS process to apply a function capable ot

immediately determining whether a specified visual feature or feature configuration is

found within the newly acquired information. The function application is immediate

operating in conjunction with iconic image construction II precedes any effect by the

new input upon the current image coments of STM The contents oi VI ere not affected

by the operation of an eipectetion function. The use ot enpactalien operations in

visual perception has been indicated by venous enpenmental results (Aderman and

Smith, 1971). In VIPS, the EXP ceil is leaded with the «upected visual feature va!ut(s)

prior to VI-SYS activation An appropriate preatlentive function is applied by VI-SYS

whenever this cell has been prespecified (by AA-SYS). The results ot the function

activity (YES , NO , or CONIained) is placed m EXP prior to deactivation of the VI-SVS

process. In sor ■• cases the returned value of EXP is sufficient le determine

subsequent perceptual behavior (by AA-SYS). In such case . 1 is not accessed nor

incorporated into STM. The entenl of evaluation ot newly arriving sensory input

depends upon the predisposition of the system.

The ATT coll allow« the VI-SYS process to bypass vertices el negligible interest

to the present perceptual goal when moving to « new luation location (vertei). The

1

70

e. ewovetient resjits ct VarCuS i'.lb''' „pirate Irs lb -ty of tê vitual svst»rn. in

VIPS. the ATT cti1 ijy De specified win t diretlic ,1 JB perpfflicu^r la that o'

the specified movement dTect on Oi«?» prior to VI-SVS actuation. As suc\ ATT

specifies a side of the I ne segment whicii is being traversed Any verle» enrou-'te'eo

during hole mo-ei-enl wmen is stra't,hl on Iht soe QI the i^ne speci'ed by ATT is

scanned througn ino hail) on me way to a luMner ne» ' ■aton location Werte«'

3'M and RAN

Th» CIS and BAN t» s a-e those nfernxtion units *no pro^de for iha necessary

communication oetwe.'n th» ■.■sjai mtormjlon processor (.isua. lone«1 and the moto^

conl-ol p-ocessor (ce:eDe.ium or Dasai ganglia) (E. V Evarts, 19T3I. «nich controls the

soecitiea bod/, head, or «.e .hole' movement act vity 'hese --ovemenl'. a'e •■pccifiea

m trrms of drecton (üi«i and ra'-ge (BAN) at lh>t com-o: level Neu'Osh/s oiogica.

'esearcn iProram. 197li has ."dcatea such an at'Sl'act »eo'esentation of motor

functions at Ine corte« eê

yM and BAN noicatc Ine mlr.nsic roie of motor lei'erent) aclv 1, and 'hfor-aton

in vsuai perception 'ôve-'-eit s ne:e5sary »or tne finaton o* new ei'e-nai

information Bjt têse ceils do not oni, provide nôrn-ation for VI-ST5 to efiett s.icn

mo.L'men' Their spatially meaningful vaês (sy.boit/ are incorporated >nto the v.suat

image structure 'tseif by AA-5YS BA^. s a v» ue roturned from fê motor system in

the hole movement tasn iso j'O in ViPSi iVurophysio og ca' results h.i.c indicated

that the cortev can "Ol be part tio â soleiy on the b.isis of se^so'y or efferent rêrve

input connections 'he .nterpre'at on of sensory nerve states 'oerreption) involves

th« inttrpntjlion of associated o'lerent n«rv» stills (Eitlinger ct ai, 196~' Eye

' !

71

mo.emenl rMMTtH njt mdcatca In« •Htclt Of tyc mov*m*nlt upon p«rc«<v«d

position and motion

3. STM (Short Torn Momory)

Th» SHO't Term tMmory o» VIPS corrfpond» to tho notion ol »NOft tfrm ntamory

under d>scust<on in cofnitivt psychoofy todty (Miiltr, 1956, Ntwoll >nd Smon, 1972)

it reprostnts that limttd part ol numan memory which is activ* or has 'ecantiy Dean

active and is still readily accessible As such, STM is an ordered list ol < conslant

numb-.-r ol independent chunks A chunk is a collection ol symbol ir'ormatiOn such

!r~a! access to any constituent e ement ol a chunk implies the immediate accessibility Ol

ali other constituent elements. A chunk is not an independent unit nl memory, though

U is rather a pseudo seii-contameo symbol structure II is a selective activation el the

symDOis ana relations ol LTM Eacn srrcted symfoi ""aintams the potentia' use

(activation) ol <li ol its LTM assocations by the active process Tne njmeer o* chunks

in STM nas been set at nme m V1PS This numoer it «nth - the limits ol current

est-males Ol STM chunk rapjc ty Chapter ß.i snows that the "ufbe- n.ne is

necessary to eipian tne observed behavior with the present VIPS process

inrpiementations The three processes lAA-SVS. «EC-SrS, INC-SVSi other than V1-5YS

an have access to the chunks ol STM

The order ol chunks m STM m the result el th« ac' on ol two basic STM

operations The lirst is Ire insertion el a new chunk at the head el STM This chunk

may be created by the currently active process or may be translerred irem ITM or tne

VI cell ol the Visual Re|ister This insertion results in the 'pushrni* ol the enstrng

STM chunks to the back end ceusmg the lest chunk to oe lost, or 1or|ett*n* Thit

M

72

Keeps the number ot STM chunks constint. The second operation is the movement of

a current chunk of STM to the front of STM. This results from the "attendance"

(accosting) cf the chunk by the active process (either AA-SVS, REC-SYS, or 1NC-5YS).

Chunks are only lost from STM by displacement. There is no explicit decay over

time, though the oldest, non-attended chunk is the one to be lost and forgotten. This

proposal is consistent with those ot Waugh and Norman (1968) and Newell and Simon

(1972). Reitman (1971) and Shitfnn (1972) have eicpenmentaily shown that loss of

information from STM is not merely a function ol elapsed time. Reitman says:

"Forgetting is produced by characteristics of the events of filled time, not by time itself." (Reitman, 1971, pl94)

The order of STM not only is the prime determinant of chunk loss from STM, but

also plays a role m the accessing of STM. Chunks in STM are accessed by an

operation which sequentially searches (scans) STM for the first chunk satisfying a

given condition. Access (attendance) is then accomplished (or that chunk. This search

traverses STM from front to back This gives front chunks priority, possibly screening

less recently attended chunks in STM which satisfy the same accessing condition. The

conditions used to access chunks m ViPS are defined later m this chapter as common

feature« of the three processes which may access STM

It remains only to discuss the internal characteristics of an STM chunk to complete

the specification of Short Term Memory. A visually-meaningful chunk of STM is either

just an image chunk (as defined in Chapter 1.3) or an image chunk with additional

perceptual control information included. This control information is embodied within e

Special Type element , which may be appended to the head (linear lilt level) of en

)

\

(

i

.r J 1

tu

1

O

3

i i.

V

1

1

T

S

^ 5 ir 1 *•'-

•* T« «•

^»N.

73

image ctiunK of STM (see Fiju'e i/3) Ti-»re art <ouf luch Specii Type eleme-ls used

wilh.n ViPS, lêse Deing GOL, COM, LAST, »nd OGOL. t*-h will h:,,e reie>*r>l tinlrol

properties *ss^c d!ed with it ror eianpo, the G(X e ement ôirts the name ot the

*ctive peceotuai £0*1 HI its associated MME property A Spec J Ttp» element M

i/ ated at the head of a chunk w tn spec-ai 'eevance Is the p-esent perte ' ,ai goal,

facilitati ig th» future access (attendance) of that clunk. Tr-ough these SoeC'al Type

elements are incorporated direct'y into an .mage Chun*, their constituency is not

permanent and is strictly for control purposes. These eiements are never paM of the

final image rppresenlat on ipercept'Oni

Components of i Ong Te"r \Vmory

~

.

Long term iremory ce'ês the act'vty of visua. percept on both as a source of

relevant representat onai •■■;• -ige a-d processes and as an avaiiab'e storage

'Oca*.on for selected mean:ng»i. oerceptuai results Tne i TW, RL,TM, and '.Tw memor.e ,

of VIPG are all proposed as Deng o ffer nj, necessary componer's of Ihi» muili-

pu'pose 'ong '»rm memory LTM i« a set of interrelated pe'ceptuaiiyme^n ngtui

symnois R^TV i$ a soecaily sl'uctureo component of long term memory facilitating

object recogn,t,ons and evpertafions. jTM is an ewfension of STM which servos as the

a a.iabie long term storage area 'or seeded, resLfant mage chunks of the current

perceptual activity.

,

4. LTM lLOng Term Memory)

Th« Long Term Memory o' VIPS K»$ no overa' information structure associated

y

. ..

•4

w.tn it, Tnoug" mulmnrttd -i the : -oir»!»! » • line«' list, it it •art-', to be

cO"S'ae'e<l as t^e set c* s>mboii i.i»Die throujiout the syjtem Oy »" processes end M

a -remo'ies Thi» mciuäes f-ose »ymoo^s inlroflucea m Ch4i,;er 1.3 which delmed the

r-age representelion Thus, m s-e .-nte L^M does not tmsl »% » teperete entity at

en, but ,-r—pji»'. ell the other o'Ocesses end memories The use ot e symbol is en

«ct vet'on o* lh«t element ot ^TM (Anderson and Bo«»r, 1973) lfm set ot LTM

symbos does "ot chjnje withm \ht course ot one perceptual task Performance,

••.-;■■ theoretically t could oe altered sy 'earning processes using openence over

perlc-mancts.

Th« visually-meaningful symbols o* LTM are interconnected through the placement

o* properties representing spatial and *eaturei interrelationships, the retultrng

ntormetio- structure is a form of semantic net (OuiHan, 1HIV The e« stence of these

interrelationships affords a valuable means of 'ndirecliy accessing LTW element» For

enanpie, tne opposite propert/ ("CPPO't interrelates direct.onai symbols, «ith "(OWO

0» LD" being lacce".S'ngi PT i<;ee Apoenfli« AlTM lo' e«DO?it.on of the i«mbo.s and

;^e ^^socatea semantic 'hte're.at onshps )

6 BLTM (»eCOgnitiOn iO"g Term Memor/l

The recogntion long term memory is structured as a no"-b"ary (n-a'?i

0 SCr m "aVon net with |ltenw|| oe^g access oe through traversal from an ,n,tal

cement RMM (see fgure IVSi Tn,s memory aoes not .hange th'oughoi.1 a

oe'mptuai pe'fori-ance oy V!^S Ai noted with i TM , thyoretically it H aiterab e b,

learning processes The bas c "format on structure, operation, and possible learning

(and forgett ngi p-ofev,es of ».TM have been nvest gated previously as EPAM

(Te genbaum and S man, I HA)

■.

fftura IV 4

> .

RLTM ha* »«ocuted with it • r*(*rtnct pomltr, Iht current rKOgmiion mamo'y

pointer (CRMP). It i« uMd to KCt» the nwmery by th* RCC-SVS process, the only

process capable ot eccessinf Ri-TM. The elements of RLTM ere '.»lied recognition

memory nodes (named PMNi, i an integer) RMN1 is the initial node ot the decision

network, CRMP be."! set to il upon activation of the i,cC-SVS process At REC-SVS

acquires new relevant angle feature information from STM, CRMP it made to traverse

RLTM accordingly.

There are two special properties (COM and UQX), which may be associated with

i -•. recognition memory node, etclusive of thai node's position (interconnections)

with>n the recognition network. Either or both of these special properties may be

«peci'ied for any node If Rf -S/S is successful m constucting a complete obiect

image in STM, the COM (COMpiete) property ot the last RLT ' node referenced by

CRM-1 indicates the name of that obiect COM s specified only if a name is known for

the tr*v>rsed image object. If, on the other hard, only partial obiect information it

available to REC-SVS m STM, the UQX property of the ast node referenced by CRMP

yieios a process which will complete the image of the suggested, known obiect UQX it

specified only if a known ob.ect is suggested by the partial information in memory

There it one node acting as a tmk node in RLTM (CRMP is set to a null value) This

node is characterized by its complete lack of any anting traversal linkt and by the

aosence of both COM and UQX properties. The node is reached m traversal when the

current object angle information found by RCC-SVS is not compatible with any known

obiect, nor it part of any known obiect (See Append" A RLTM lor the definition of

the RLTM used m the implemented VIPS) Figure IV4 it a graphic representation of

that »ppendi«.

'. ..

image chunn ot STV I5ee f'tu'« i/3l Th«re t'e 'OJ' . JC« Spet'tl Tvpe elements usea

»■tnn viPS, tt-ese temg ÜÖL, COM, LAST, jnd OGOL twh will i^ve reie.*nt lOnlrui

propet'e» *4>-'c j'sd «itn it Foe e«'->pc, tn« GOL e ement "O'rti Ine n^me of the

«live p^cepluj ioai M il» «soc «tea '.i'Ê prapct, A Spec i '»pe eiemem s

D;»ceä »t thi head 0» < cnun» win •. »ati re»v»rce ro :»-? p-esent pe'ce M goa.

(»C'liHtmg ,ne tutufe «cess (»ttendi-cei 0* (hit chuM ThOugn tneê Spec i 'vpe

element» are .ncO'pO'jtea dirtcti» rilo jn .n><|t cn„n», tf-e.r cO"st'tiiency is not

pern^nent »na n itr.cl., to- conl'oi purposes These eême^s a'e "e-e- part ot tt-e

tin*i tinagt» rrpresenUtOi (percepLo'''

Components o* long *e"r ^»«•T1ory

long term «-emory -.e-.es the tctivity ot vuui. pe-.epten Both a* » source ol

recant represent»» O"»1 knoweoge i-'ü processes »"0 »s »n »v» »O'e slar»ge

oc»' or. lor selected mejnngi oe'ceptj»1 -esu ts Tne LTM, PtrM, »no ITv memc es

0* ViPS »re »li proposed »s o» ng dit'ermg, necess»-y comppn^r's o' tn s multi-

purpose ong term memory LTM H « set 0* interrei»teä oe'ceotu»i'»-me<'ngtui

SynDO'S PtTv it a «per»ly st'uctêa component nt long term memory fKililetiflf

OB,ect recjgn t.ans «no ^<oettjtons. iTM is »n e»tens.on ol STM «hich ser.es »s the

» »liable lon^ term stor»ge »re» 'Z' se'ectert. resjitant . »oe chunks ol the current

perceptu». »c'w l>

4 LTM 1 Long 'erm Memo-, l

tttt Long Ter~ Memory o' ."'S »"»s no Overa.i inlorwalon structure JSSDC »led

M

76

6 UM (Intcfrxii'dte Te'w Memory >

"e e ements ot ;'M »re copes ilrom STMi o» se:ecled ""ige tnun«s Al 'he tarn

o* imtifl VIPS act.vat o". I'M 'S empty set !o .* nun v jue) iTM K unbou^nei-i n sve

and grow^, witn the aaj't.Oh o* rcw e e^ent chuh»^, tnro.j.-.nout the pe'teptudl

pertormdnce WM ho!di tue compete pe'ception i. s^*. rnage1 at the cO'Hiot'On ot

:"e perceptual activity. Ei»in»ntl are entered into ITM I'Om STM Bv lhe INC 5VS

process. An/ -ue. * Type e e""en| {.», &X) u removed ♦•o"' a se'eclea chunk pr or

to buihg copiea mtc ITM

*ne activity ot INC SV5 s egji/a-ent to a "rehearsal" oper.Vion (Waugh ana

^Jorn'in, 1966) ActuaMy V^S p'O.ides two tor-os of rehearsal operations. The

temporary means of Chunk atfjna^nce mantains an mage chunk in STM Dy mov.ng t to

the head of that oraereo "e^'Or,. Tn» more permanent means is the copying of

seieited chunks mto UM a', performed By INC-S^S

IN V!PS, four retere-ce 00 nte's »r« associated »'th ITM ana are uM./ed by VC*

"SYS to access and upaate ITM contents. FI^ST-ITM re'erences the f.rst inaRe ch^n»

enle-ed mto ITM By the cur-e"t perceptual activity vAST-ITM re<erpnies tne last

chun« of ITM FMST-08 oomts to tne first e ement irhunk) M ITM representing an

Object lOBJfCT t/pe chunk). LAS'-03 references Hw last chun« currently M UM

which represents »n oojecl

This UM proposa' is in concert with th« "assumption of unrenaBie STM". which is

discussed by Ntwe'1 11973) STM, as it has Been proposed, 15 a highly volatile,

Iran' lent storage area it »oceives content nput f'om Both intnrnai memor-es and

processes and sensory-der ed dconici scurces. It wiN also contam incorrect or

irrelevant deoris from the active prore'-s-ng of such inputs ITM it a cache like

'I

77

co^noift ot L'M- 1TM .» i rud v tccmoie tittn^.O" 01 S'M, ICsstirg ot

!•'*( tea. mea** nûl '«age cnunns The O'Ote'.'ei which can access STM tan a sn

Kce^s ITM D, UM o* the NiCO ope-nt o" The t*tD ooe'ator e-te-'ü', me -.ea'th ',.■

a ch jn» ât'st, "g a -pecit eo tO"(l ''on to the contenti o' [TM 1' a sat'i'adO' > cunn

5 'cona n ITM, the VEO ooe'at on ifan^te'i a copy to STW A.i .n.rge cnun«

consloct.on of »iteâôn ■* ca"ea Out M STM Se-ectea 'eibüt a'e (opied to i^V" D/

:\C-SyS as «e* cu"eht co'teit mo'-'at on

«■jnt il9'i' D'Opo-e-, a '-.3-e«hjt tmtm ope'at.onji ae^nit on <t |TW «rrtf

•ega'd to '»nguai» iO-'D't-c mtIK ■•» O'OPO'.eS trt tonttnll 0' ITM 10 De mejn.rjtj

n'ormat.on "molefoles". »5 oop-'.ed to tne "atoms" o» STM i" VPS (M goa'S era image

tt'u'tu'es n»ust at soê po-nt fes.dt *t $TM in 0'3e' to act \e y »ntiuence 0' i^termne

nen^vior This d't'e's t'Or tie >k.nt propo-.a. »n'h aiows cOfpie« strmtufes in ITM

to control bena.iO'

Tne "du*1 Ifaie" tneo', o* n*.emo'y pc.tu'ates a sro'I te'm rr,ei>Ofy *hicn s

fe-e'oe'etofy m nature ana a consot'dated iorg term fi.emor^ t'ace whtch s stable

ana constructed »s »n et'eet ot tne rtve'oerator/ Ktcvity This theo'f has oeen

acccniQäatea to Decode a "-«uiti-iract" theory as m.e'-tigaliOf« mto tne el'ects o'

eitK'ôconvu' i.e shoe* and je'tain drugs upon memory conso-'aat'On .na^catt tne

D'ObaD» e- stmce ot an iniermgdiate noang stage between Iht two utrern»» o' lb«

tfud trace tneor, (See )ohn, ;97'i)

Wickeigr»n il9'2i ae/eop- a muiti-lrace theory ot memor/ oa-ed on the

accessibiiit/ (strengtn deca, ot niormatiOn with elapsed time Trough eaosed tim« it

not a 'actor m Ih« definition ot VIPS memnry components, an ITM »ith * tune 'actor ot

several minutes, es is P'ooosed b^ Aicneig'tn, is cohSi»tent with the time

.. *J

- , ■fre-<". for intormdion m«<nltn«n(t which muit b» nxpoitd upon th« ITM 0>

ViPS to saplxn the ofasrrvro Ochiviof

rwE PffOCESSES

l«h o» Iht corst.luent pro e.«s ot VIPS iAA-5VS, »EC-SVS. INC-S*S, VI-SVS) PS

oet'êd m Ih» torm o' t P'Oduc'ci »ystim. t m»«r-s <jf cogn.livt psychologml

••.■-.; which is >d«quatei/ v -•■d, i 'c/ ' I «nd illu«tral«d dstwhare (Newell and

Simon. 19^?, Neweii. 19731 A p'oouclion system is compfised o' »n ordered, fmilr sei

of product or rules, e«ch rnv^g t conation heit »no «n «t oi h*lt. Wr th eech system

ciperif.on cyde. tê ordered set ol P«4M of tne cur-entiy «ive process is searched

«cording to the de' led order MM t production ruie s 'ound whose conaition hell $

lully s*tisli»a by tne current stele ol the '»■»/*"! meûry (n,e*oriesl Thel rule i»

the" te'd to lire; the oper»l'Ons ot the rule's »clion heil .T e>ecuted m light ol the

me-nory ■nlflrmelioh accessed during s«tisl»clion ol lie ru'e's condition hjll The

necessery lunctons which serve lo mped the production s/stew control structure ol

VIPS processes withm LISP it »'» 'nose ir-plenented by Moren (1973) »or his VIS

■./sto-n S'M w«n»gerr.ent »no done by utility lunctons delmed by Morjn

rne proposed processes ar( oisl ng^sned by several delmlionei criteria, these

being:

1 the rreicO'ies reierenced ano operalons employed n tne conOit'Or naives ot the constituent rule»;

i1. the memor es relereneed and operal-ons employed m the action halves ol the constituent rues;

3 the degree ol process smiarity between subieclt

. •

On« outt(<ndin| op«r«tiontl di*f«r«nc« bttwMn procMMt n thai «I • procMt*

rol* m th* VIFi i /ci» of op«r(tion. AA-SVS (Ih* Mtimilalion - Kcomedttion precM»)

>s cansidcrtd to b« th« m«in proctsi <nd «II thr«« c th«fi «r« suppl«m«nt«ry

pro » - -s A4-' r$ It th« proce-.s imtxlly «ctivited, pnnginj lit« to V1PS It C«n

sub*equ«nlly K' vat« jny of th« oth«r thr«« tuppl«m«nt*ry procmti, which upon

th«ir d«>ctiv*' on yi«ld control (gtm to AA-SVS (tM fgur« IV.SI Upon o«rc«ption

con,'l«lion -'A SVS is d««ctivat«d, killmf VIPS its«if

To mitiit« th« usu*l cyclic cours« 0» VIPS activity, AA-SVS lotdt th« visual

'«g>'t«r according to Current SIM contents and th«n actvatat Vl-SVS Tt.if K

»<f«ct.v«ly « request tor n«w visual 'nput VI-SVS r»f»r«nc»s th« «at«rnal Pictur«

-■•- jry PICi, altars |h« visual r«g>st«r accordingly, and daactivatas, r«lurnin| control

to AA-SVS AA-SVS , or-oe". th« rtsuitant Visual Pag star call contants in light of

'j'rent, relevant S^M iwage chunks fith«r tne re* information can t.e consiit«ntly

assimilated Mia STM or the mage contents must b« acconodated to rea'u« th«

incorporation of the new input AA-SVS mav activate BEC-SVS to perform object

■e-c;- ! on o' iNC-SVS to incorporal« sa'<ctad STM chunk» into ITU It than reloads

■• * V<suai Register and agam activates VI-SVS Th s continues until a saliatactory

perception has been constructed as a visual image >n )TU

I. VI-SVS (Visual Input Process)

Hn VI-SVS process has several dxtrnfuishng cheraclenslict The most notable of

thes« is that it is propos«d to b« eiactly the same tor all subjects. This is the

consequent of several factors the mam one being a result of a stated goal of this

th««is Tn,s goal s l.-e development of image «l«m«nts and structures capable of

M ■..

> i o i

i

-* o

''epr9Jei* "g »' subjec!'" co^D-e'e «ra ^tefêa^'e 'pa't.a I lint dra* ng percept ons

'u't'te',^0',e, the •■si o* wwtl (••lo'ti ODtanase *T a .e'tc» t>^ (h» tyM s

cons defed to be eî. .»en! ♦or a< sv *s ♦O'' *ê |ivtn hrw d'a^mg envfonrnent

AnOth#P tactor w^'cn 'eadi to ts UI<QU« uniform dettnition -s the process" access

0* 0'ity tr>» ViSua^ Pe^ ^Te' aid Picture mtmories a-r.ng activjton Tre process -s Inus

• only "a-ect1/ ***ected by a"; act ve pe^ceptua jcas, wn.ch are lh# mam source o*

I tS iub.ect beâvio'' d'**erences. 're use 1» *hicn tne process -s put m,», and does very,

but ill def nt nr aoe-. "Ot

Vi-SVS •$ WM ioecji n tmt it i$ Ine only proce» «■Ih access to tne P.ctu'e

J memo'/ Thus, the Visu* inpjt process is tnt only .nle-'ice Det*een In« en. romient

'•Ktcnji visual nforiiat'On o* PJC' ana an .nt«rna. Temory (Visual ScgiSte'1 ot tne

P'Otcoed perceptual systerr , "e process s not dêctiy ana^gous to tne rjn-an efe,

Itnougn Satner, Vi SVS s a cembmition ot me motor p-ocess cont-Oing eye t •o e)

movements and l^» process wn.ch operates upon tne eye-p'Oduced teatjr«

jS nlormat 0" to produce (construct) the MMMl iCOn

H Process |MMitrt(iM

"ne rules of tne olner Inree P'ocesses iM reference STM » their condition ha .es,

»nd are ai. primarily dependent upon the nati« ot tne current goal lor aetertimat on ot

the rule to De fired Thus an rj'es. but (or a fe« «oecal e«ceptiOns, start with two

bavc operations m their condition halves, these being "(el: GOU" (or "(el. GOL ll)">

and "((rwAME OF GOD • "I" The "tel: GOD" fondit,on operation Kcesses the STM

chun« to which the Special Type element GOL has been appended. Tne local (to the

rule) vananlo "el:" is assigned Ire accessed chunk as its value (when the variable "ll"

81

is added, "tl* <t locally «S'gnad in« viij« of t"» Cijnk Hraoe' eêmtnt o* the

•cc«st»d chunk) Tne "((NAME OF GfY)»"»' open! on deti'w.nei il tn.s fule it to be

tired m issociation • tn the current goal (e.g. ■( the n»i»ie ol the current goal K ") If

these two condition operations «re satisfied, the further conditon opera! ons of that

rule are sequentially appfO to 3TM for possible satVaction Such ru<e definition

creates a valuable parM on.rg of th« mlM of a process (oy goals), c>peditin| bom

wstem operalion and rule de* '■■".on

A "iecono similarity is tne -«edns D/ wn ch these processes gam access (give

attention) to the chunks of mfor" at'On in S'M Tne 'ui«s of lh«5e processes achieve

th.s access m only two basic wa»s Oê "eans of access has been ii-ustrateo above

by tê "(«]■ GOD" cond.ton operation. This means of cvnk accessing depends upon

th« ensterc« Of « Special Typ« «>«>r«nt (>« SOU which has pr«viou(ly been

appended to Ine ape op' ale chun«. This 'S pre oele-mmed ipremeoilatedi attendance

of a chunk which is relevant to tne current perc*pt'jai gcai

'he other me.rs of atle-9'nj to a chunk m STM I through th« use the "(ej; II

(HAS "I)" condition oprraron. '. ot • g an integer The "lal: tl '«AS ,'')i" operat.on

locales and al* -nds '0 th« ».rst i'M chunk, if any, which contains the element "' within

• ts mage body structure Th« acc«s5ir<| operation only "vj consider the chunks of

aTM al th« top i'near lift) «vei to determine simple element containment A

successful search results m the oca binding of "•!:" to the accessed chunk >na "11" to

th« Chunk M«<d«r »i«f»en> of !"«! Chun». Th« "(f f 0 «1: (HAS "))" condition Operation

««tends tn« -.earch 'or tne de» -hunk to iTM. The operation automatically

establishes a ôpy o' th« accessed cnun» «t tn« head o' ' TM ('f found) and lotaüy

bind-, th« "el:" and "li" var ae e- as noted abo/e

I

This Kccssing of chunks by either im*|t element containment or Special Type

e'ement appendrrehl again greatly improves system operation and definition m terms

of ■ oeed and simplicity. The attendance at a chunk is achieved without encountering

the < ompte* semantic stnjcture being 'eprc-ented in the image body. As noted, there

is no attempted syntactic matching of any e ement sequences at the linear list level

and no attempted schema matching to the whole or any part 01 the image body

structure to accomplish chunk access The definition ot the symbol'C elements ol tue

T-age chunk as property groups which embody the meaning make this possioie.

Proc«s Control Structure

The position ol current goai as the primary determinant ot rule linrg implies a

definite control structure tor these production systems and thus for the cognitive

processes they represent. Upon eaci. system cycle, the GOL-appended chunk is first

attended, and the name of the current goal (NAME Of GOD is matched. Any further

relevant chunks are then attended. Chunk attendance does not involve consideration

of the chunk's info-mational content. Finally, conditions based upon the information of

the accessed chunks (and the MlMry register, if perception) are evaluated and a rule

fires producing the "desired" activity.

The current goal is an internal (mternally-denved) state which influences the

perceptual activity of VIPS m three basic ways It first determines what of the

aveilable information is to be attended durmg a system cycle. Secondly, by

partitioning the rules it determines the class Of actions possible during a system cycle,

finally, by determining actions it influences the final representation (perception) which

is realized.

f

'J

83

2 AA-SYS (Assimilation - Accaôj.** jn Proctss'

Piaget U96''', \9^0) âs defied ^"d a-scussed '-e tu^damentai ^ssimi.jtion-

accümoaation •Ctn ty of any itv.ng syütem wf1 en i^tcacts with its environ-pent. The

activity of visual perception 15 a pfimary f^-.'" o* Such intefaction. In the

interaction, the iyste^ rrj-it

" 'assimiiatf' tê tyterntl wo^ld mlo t^ structo'es lh*l n^ve a^cady oeen cOflStructa) *nd secondly to read^st tnese structures as a 'unction of subtie trans'orniatiOns, e to 'aaomoaale' thtM to enlernai ob,ects" traget, ^ö"*, p8i

'he assinviat.on-accorôaation process s the only p'ocess w th access to both 4he

newy acqured visua nfo'TatO", 'ouno -n the Vsâ Peg'.te'. ana the inage meÔ'y

Currently -n STM. Given tr s ne* «iSuJl in»orn*at'On, tne tasK o( AA-SVS s either to

assmiiate it into the current image n S'M O' to aTOôdate this curren» mage *o

accompiisn integration of ne« CO"' cting v<su«< 'nforâtion The new intprmar on may

be c . imitated by tittering tne contents of VI into S'M as a new imaê tnunk Th*«

involves the i-nKing of (he ■cor c image to the cur'-ent mage of STW by crea! ng

approp' .lie spatai Or e(|u*vatency reiatiO"'. The as*.'miatiOn ây be rfctompiisned 'o,

jutt marKing app'op'-atp •l*rn«ntt Of an emsttng (hypcH^Miffftf) "Âge Chu^h <»■. De "g

conf rrred. Finally, assimâtôn way 'nvO'.'e no action jpo-- tne ei st.ng STw cor'tenrs

W^PI enpectat'Ons conce'^^g t^p new visua' input are not fulfiHed, i*e magt w»tn 01 »•

of S'M mutt ne acoôoafed to ach.»vt cons-stency wifn tn^ input Such e«pec:at o"s

derive from a n,pot*eweä one''* •'age , frtm a pre.'Ousi-- constructed "aê cnunK

thought to reprp'pnl ?ê pa't of the /-suai ♦'eld currently f'na'ti, or from other

> •1

posi o e pe'ceptu*1 inferences The source o* tnt nco'rect eipecl»tion --uit be

» 'e'ed or »nolher e>'5l.ng coniite"! ^jge chunk must be 'Ound to iccomodale STM

to tt-e contiictihg 'hput. PEC-SV5 «"d If»C-SVS "*, be »PD'opruttly activated by AA-

S>S to acco^pl'Sh its task

AA SVS ■■ the most h.ghly variable proress bet*reh subjects It is here that the

subiect's pe-ceptua1 »trateges a-e pmMnly represen'ed A strategy is detirpj oy a

«et ol oossoe goals, t-e ross o'e ''i-ttions between the goals, and the conditions

assocated w tn each ros ibie trans.ton AA-SVS i» the generator ot most act.ve

t.e".eotua> goa^ IO» tner trans,t onsi, and as sucn, $ tne primary •■nbodiment ot

stategy Two ;enera stratejes nave been interred to account lor the Observed

suo.ects' behavor, and a'e a-stussed n Chapte- il i

3. "EC SVS 'RECogn.tion Process;

When tne '9cogh,i,on process s actwated Or AA-SVS, it wm proceed to a ;e>s ano

*raverse various re e.ant m-aje cHunks o' snort te'm r^en*ory 9aseo uPO" the mage

n*0'mat'On encountered, t'-e process ''a.erses tne current recogntion memory

oo n-er (CVP' tn-ough »^'^ il imuittnNwdy constructs • partial or complete

Obj#c1 'mage as possbe upon ^jmpetion of th.s mage t'a.ersal an obiect naiie, a

k-o*n oo.ect goa, c that nsu'fx »nt mtormat.on s aviiiabi* l.v eitner WMI be

(Jecnted by the process, acco-ang to the COM or UQX propert, ol the recogntion

memory node Imaily relerenrfLl 0, C^M»'

'he pas c oper At c"s *h(h tra^e'se tne mage and ^ 'M do not vary with distinct

suojerts, due to th!« "act that the image s'',:tures employed by all sub,ects are the

same 'he rule with tne co"ect memory t'avers.ng ope'aton action part is

1

determined by the condition pvl beted upon the type of image (Iructure the currently

Kctsstd chunk embodies, the type o* image element rtterenced within thet image

chunk, and the currant perceptual |oai (p'tipec ' »a by AA-SVS) The depedenca ol

rut« dring upon a current goal results m REC-SVS varying between subiects Th«

regularity ol image body and ». TM structures between subjects restricts this

variability to a level Deo* IM 0* AA-SVS

« INC-SVS (INCo'poralion P-oc»ss)

When the incorporation process is activated by AA-SVS, its task is to enter copies

ol the appropriate image chunks mlo 1TM, eliminating any outdated version ol the same

image structure that may eist n iTM It it th« only process which may altar th*

contents ol ITM. (Whether a copy should be made or only a relerencing pointer

established to the chunk is KOI dear) This process may also be activated to improve

upon an enstmg ITM representation This may -woive the realization ot a more

<or, .e image or an attenipt to ei - "ale possible inconsistencies These lunctions are

di-.cwr.sed lurther in tue neit chapter

Th« basic Operations tor copying image chunks into ITM do not change with

di'lerng subjects With dillermg perceptual strategies, dillerent image chunk types will

he marked lor incorpora'ion, though Thus, similar to KC-SVS, INC-SVS hat torn«

limited variant« beiween subjtct modelt.

'

:

2. Th« Syslan w Act««

A PROTOCOL - PROCSAM TRACE SE0O£NCE

The 'est o( lh« cncptcr present« in wljstraliv« ti*mpl« ot VIPS in op«'»l'On Th»

•■•mpl« cti-'F'.ponds 10 Ih« initi«! protocol M|m*nt ot Figur« 11.14 Th« •>«mpl«

illuslr«l«s not only «yit«m op«rition Out »no )«*tur«« of protocol - profram

correspond« nc«

Figur« IV 6 pr«t«nlt Ih« two nititl protocol IrtiMt, VI «nd V2 Figur« IV7 thowt

th« compiot« hn« drawing ttmuiut involv«d with th« v«rt«i nunbenng convention that

i« n \n» Fram« VI indicates tnet vertea number 1 it initially in view, that being th«

> ,•.-' angi« v«rt«i m Ihe lower left of the line drawing Th« »ubiect censidert thu

avaiiaol« visual mlormation and ndfcales by stalem«nt [S3] that it is sufficient to

suggest (hypolhesm) a square 8y statements [i*\ [SSI •"* [Ml ,h* »ubiect

md'Cates th« invOlv«m«nt of tn s obiecl hypothesis in th« subseouent hoi« movomont

activity of fram« V2

Figur« IV 8 presents th« mitm i«gm«nl of th« COrrotpondmf lr«C« Of VIPS

activity. VIPS it activated by an «itarnal activation Ot tho AA-SYS procott a*

indicated by th« first lin« of th« tract Initially STM consists of nin« «mpty col t a*

indicated by th« hn« labelled by '0.0" This number it th« system cycle number. It it

us«d to label STM listings and will b» underlined in th« trace «Ofmontt. Upon thit

mtial activation, rule RAACO firat which activatat Vl-SVS to obtain Ih« fust viow of

Ih« lino drawing (from PIC). In VIPS, Ih« initial goal it NIL

/

-■.,

Flgura IV 5

—\

RT

'ooK'- 'ke 'h» corner [SI] HM pjrl • ,-ht t-er» loau I kc th» co'i-er o» a uh [Sc] ol a iqu.vc [53] r-OW, Vt'i IM ' 1 tan [it]

if if 'S (t ng to be a ■.qj.ire [5^]

t^is wouij be the i-ot'o" o' Hw -.quj-e [S6]

Fifura IV.7

II ,„

>^ 7

^

5 1

/ ■t

Figur« IV I AC' «1 AA i.tS

3 ■■ IS: ML

0,0 S'V I' (XI

aU-t »AAOO: TH!S ii *'-- STAH- • ■

ACT .2: VI-SVS.

": .-; v:;:GET fiosr -:;• ■ ., .,

■JA-, ;s •.:.

:

ATT ;s UP

Vi ::- V3 P-: «"i As «• A6l

30* :'> '.. 2,0 STM ■

AC »J: AA-SVS

RULE »AAO: St' FiRST i/; •• IV

i •■•. j e^'.

.10 STM:(QX ) 'LAST V3iC»x; -'..V .,; ^SP£C ," ■.- S^tC V2 TVPE VEBTto»

■'. ■- AS X7 A6» )

(»oo o o i» o

ACT .9: REC-SVS.

RULE RECO: BEGIN RfCOCNIT! . • V« 8,1 .'

COAI IS RNO •1,0 r.iM:(Grn 010i31MTV» . •.' •.■ ■••': MJECTKP4 Hi A17 !'

1')) )

M VSiCCX5! P-. ,W P.; VSPtCOJ'A-;. >'jPfC V? TYPE VFimxK» '.. ■•> AS « ' Abl )

(1000 ()()(l

■ .•.».•-■ '.' '.' •' ,•.. ■''.'.■••. •,

. . IS: SlfOJ STM. .(»I NAM 5Q0ARI I R Rl WANGLE OIM TWO TYPE OBJE^

CT/il ') ill A12 113 114 Al1) 116 ii' All 119 120 Ai . . ■ ) . /'JiCP Xb Pf.uV P4 y/i?EC (RTA DLI $Pt: V? TYPE VERTEXKP4 X5 Ag»

^ .6) ; O0 0 000o

'■

:■

Pule VII of Vt-$VS firti and conttructt th« initial iconic rniagt in VI m iccordano

with VISJ*I fi^g-Ar' and CPP valuat Ml P"or to V1PS activation. Figuro 1V.9 ■> a

schematic pictorial rtprotontalion ol th» vtrt»» iragt 'laboi'cj by tht Chunk Header

•leinenl V3) which Vl-SVS develops m VI At indicated by the STM littin| '2,0*. STM n

not affected by VI-SY5 activity

Upon VI-SVS deaclivation, cor'roi K returned to AASVS and rule RAAO fires. This

ruie "sees" Ihe first view "Ow in the Vl cell and transfers tn.s information to STM at a

new image chunk Ihe ruh a'so appends the Speial type element LAST to this chunk

and creates another STM chun« whicn consists so'eiy ol Ihe special l,pe element GOL

(tee "3.0")

Two general perceptual stategies have been inferred from the available protocol

data This has resulted in tie implementation of two corresponding versions of AA-

SVS (see Chapter 112) The strategy currently under AMUMMR " ,h<' successively

recognitmg objects until completely representing (percevrng) i-e line drawing As

such, the active goal, "(NAME OF GOD", is set to PW »nd REC-SrS is activated (ACT

.9i

Prior to a PEC-S^S activation >«ilh goal PNG, one chunk is always marked by the

element LAS! to indicate the fir-,! image chunn lo be traversed by PiC-SYS A chunk

M al.o always created containing only the eien-enl GOL That chunk is the site of the

construct-on of the new objc ' im^e

Rule PCCO (of REC-5VS) fires, .mtially settn.g CMP to RMM The 'ule traverses

the right angle Of the verto chunk V3 and accordingly sets CRMP to RMN2 (see Figure

IVfl) Furthermore, the process begins constuchon of an object image (010) in Ihe

GOL - appended chunk (see "4,0"). Figure IV 10 iliustatet Ihit partial object image

\

. ■-■

A«

87«

Kt

1— »i At

*l CV^

FiprälV.I

XiS

I I»V

o\o CV^

Figur« IV 10

M» "• X« *« xtx 10

JM tA ** u M^

Fi|ur.lV.ll

016

i*A

^-

e oêÎ Treê ^ê LINK a^d POW *Pr"*t Oi»??r( of ^ ;\* 'e*e"»«cei *n imjge bod,

tfrfver»»! Dy rf£C-SVS du^'^g J 5ys*em ;yce A'f" «0 »u.tHe' imjge chunks e«.sl rn

S'W 0' I'M' •»'€" *'e •ee*»"'. !o ti« d."»»! OD.CCI 'fcognition, Ll'V 0' üOL '4 Ml to

oQV Tht» PCi^ prope'ty o* GOL "j-t^t^s the a-'ett'O*' (oe'P«no ;u'*' to trte traversal

o -eit on'i *•■ fh ,5 "pe'-ced" «■• re "g "o '"e "^ a* o' ("t Oö.ect Th» eil»ct ot P";'?

upor WEC-SVS atti^ t> 's rer '••e"*-' « o* ' .;ufe gÔoâ ivOgeê^ts PDlfl |ut0««

t'e I'a»e'4*' o' "'*g* cl uh^s jfj o^tef'-.nes *" ^h fncou^te'ej fMlure« Unglî) a'e

■ nte' or to tr* ou ect ano t"us fe o *hl to ts recogh'to«

In "h» prtsent CJI«. »tCO -.el» LIM O» BX, to UQ« <s the »e't»< chur« (V3) « tn«

Ohy t-«e.«ht) "•»g» hfor^«IOh iv* If» FOM 't "*• . Stt »«terhjl^v but ll'

■• .asequrht v*uei *'e Oet»'"- -ej B. V^S S^c» LI'* ot CXt. >i L^K, rut« »ECl ».r«

'0' t'e -e«l <y'.t»>r cyt'e '"e i .'« r'hpe'tv C SvNZ ito'-ent CHMP .»'ue1 . e'Oi »h«

p-oce'ii iî *hieh (O-P'e'es '-e '«rotêsêa "»g» s* t «q,n'e-0'--i 'apg» *h ^

4 hfjcjtej 0/ S'W 't h,-, • >• .■"• jst'jtea B< "g^'e IV il 'he rj.e sets tne

curreht goji to S»0? (St«r| »"cnh Objett ? «.meîOh» ' 9fC-S»S aeactiv*tes i-a

cOht-0 Jgjh returns t.1 AA $V5 • û»e IV 121

*-e 1X021 'o' AA-S^b' • •«•.. :'»"g-« "ê go»' to *<jl »h« 0*1-4 t-« Ex^, A'',

.i-a 013 ce so' t>» Vs^» Pe>: 4te' » th viioes t»«e" It«« f-e oo.ett ■•"»ge 010 4ee

■ gu'e IV 121 The4« .»iv.e4 »'e ootj'"eo Oy *M o* tne C» p'ope-t, 0' C«.i. -".»

currenl'v re'e'ences "»ge Doay e e-e"! ill ity» MTtMALI 3)' '4 set to th» r«iu*

ot tr« Di» prope'ty ot 111 A" •. »•• to t-e .«ue ot the Div; proee'ty 01 111 ExP

■s s-t to 'he v».ue ot the A'.So'Cpe''. ■< *15. «he« s (Af.G ot '.ATT of (1,9 ot lit»)

• -

Figur. IV. 12

A;- .1 .•..'. • .

-. =.■■:,. ;TAI>T LOO«!NGi ^ •■. .%•.OBJ-:" INFO,

• : v ■ i KP « •■••• ,>. ■.: s'^iii"' 5;:r5 fOuV)

DIR :ä ='

BAN IS NIL

tu.' ;3 s-A

ftIT |S J?

V! IS V.

AT VE«'. ' .;-3

Dl»; ••

RA-.;-, LC

t»? :s -.0

ATT ;s jP

VI IS V24 P2b X2(, A3i X30 Ai9 HJS A27,

Le.

G

»•1 [57] ook . '.kt *e ■»■■gM hj.» « tf i-gu'jr object [58] "itnd Ot » ^qL«f^ [St] Ml wou'd b»

lh« teco-a »de o' '"-e tr i-|ie [SlO]

(sooty*

Figur« IV 13

llhrOuljh vertu 8)

>

■.

In th« |*n«rth(«d rult tpccilictl.on, II t i« (CR «« OOt) T)w rul» than aclivrtt* VI-

SVS (ACT .23)

Fi|ur* IV 13 raturn« to th« rw<t Mgrnant o* th« Irtmcnbad protocol. Th« ■ub.rcl

r«Kh«i v«rt«> numtwr 3 it protocol trim« V3 . Hi not«», by «l»l«m«nt [S7J, •

ditcr«p«ncy b«tw««n •■p«ct«tiont «nd th« n«w VIIU«! information. Tha Kuta anfla,

Man at mtarior to tha "lura*, ouMt tha »ubiacl to Kcomodata th« pr«vieu«ly

hypolhatitad Objact (»quir«-or-r«ctin(l«) >mi|* '"t "O* information load* th«

«ubjact to now hypothaam a tnanfia, a* indH-tiid by st«l«mant$[S8) and [S9\ Tha

•ubjact movat tha hoi« ta bagin contirmation ol Ihit now objact imifa (ttatamanl

[S10]). Tha tubjact mova» through vartan numbar • (trama V5) without hatitation.

Corraspondinfly, Vl-SVS rul« VI9 lirat, which i ate CPP to tha vartan daacnption

lit! ol vart»« nunbar thr«« (VER3 ol Appond» A.PIC) Th« ru« than altar« tha visual

ra(i(t«r accoroinjiy (t«a Fijur« IV. 14). VI contain« tha imaga rapratantation ol tha

now varta«, which it illualratad by Figura IV.15. E)" it tat to NO M th« angla laatura

ACA diflart from tha aipactad RTA v«lu«. EXP it tat by tha pra-attantiva function

CAX which is «ppliad by rula VI9 ol VI-SVS. Vt-SYS daKtivata« and control raturnt

«tain ta AA-SYS.

Rula K024 (el AA-SYS) lirat at a ratult ol tha NO valua ol EXP. K024

-•

Kcomodatat ti» objact iiM«a chunk 010 m accordanca with tha ima(a ol VI. Imaga

body alamanlt 117, Alt, 119, 120, A21, and 122 tra ramovad from tha chunk. Tha

alamantt AI8 and IK ara tltarad to torractly ambody tha iconic input in VL Tha ANQ

proporty o« AI5 it changad to ACA and tha OR and DIV1 propartiat ol II» ara

changad to UL and OL ratpactivaly. Thia action it ind««tad by STM titling tfi' «nd

illuttratad by Figur« IV.l». Tha Potition typo alamant, P29, it tddad le tha Objact

■>»■» .1

84* Figur* IV. 14

GOAL-IS K02 7.0 STM. (00L 010(NAM£ SQUARE-OR tJECTANGLE DIM TWO TYPE OBJE-

CTKP4I11 A12 Ii3 1l4AI5ll(II7 A13I19I20A2I 122) ) (V3(CH X6 PNUM P4 VSPEC (RTA DD SPEC V2 TYPE VERTEXXP4 X5 AS«

x; A6) ) ()()()()()()()

ACT«1: AA-SYS

RULE K02«: VI IS NOT AS GOAL REQUIRES

GOAL-IS: RKI 8,0 STM; (V24(CR X26 PfJUM P25 VSPEC (RL UL) SPEC TE TYPE VERTEX)-

(P26 X26 A31 X30 A29 X28 A27) ) (GOL 01(Xf:»ME SQUARE-OR-RECTANGLE DIM TWO TYPE OBJECTXP« •

Hl A12 113 114 A16ll5P2b) ) (V3(CR X5 PNUM P4 VSPEC (RTA Dt) SPEC V2 TYPE VEBTEXKP4 X5 A««

X7 A6) ) 0 0 0 0 0 0

ACT »32: REC-SYS.

RULE RKI1: A KNOWN GOAL INTERRUPT CAUSES RE-REC0GNIT10M

GOAL-IS: SK02

9.0 STM: (QOL 010(NAME TRIANGLE DIM TWO TYPE 06JECT)(P4 111 - A12 113 114 A16 116 P2S 133 A34 135) 1

(V24(CR X2i PNUM P25 VSPEC (RL UL) SPTS TE TYPE VERTEKXP25 X2- 6 A31 X30 A29 X28 A27) )

(V3(CR X5 PNUM P4 VSPEC (RTA 01) SPEC V2 TYPE VERTEXKP4 XS A8« X7 A6) )

(>()()()()()

ACT «li AA-SYS.

RULE ^021: START LOOKING FOR KNOWN OBJECT INFO

DIP IS UL

RAN IS ML

EXP IS ACA

ATT IS OL

VI IS NIL

'

I

-.',

M8

xiv, ^ fso

riffjr« IV. 15

ViH ca.o^

Figur. IV 16

1(1

Mt Ti\ A^ o\o (3.0)

Fijure IV. 17

ovo ^0)

■

I

^

.- f i

90

chur.K, associated with th« »itered "comer" The verte* image, V24, is entered into

STW from VI. The image body elements Ai5 (of 0101 and A27 10' VZJ) are nnnea 0/

•qU'vaience D'Operly XEA (Known Equ . > enl A^Gtt)

Furf-ermore, ruie K024 changes the current goal to "Ki ("erecogn ze, Known

ln'."rupted), sets C» o' GO. to Itf, ana activates RtC-SVS to aid in ■"■sf.c

accomodation. W^h rule HKI, rule RKU (of REC-SVS) (.res. Th.s rule tirU sets CSVP (o

RMNi. The rule then traverses tne oa'tial ob.ect ^mage of the GOL .ippended cnunK

(010) commencng at 116 (CR o' G0L1 CPMP accoramgi/ i. moved through the

discrimination net of RL TM. in tns ^ase, RMN1 s the noae referenced b> CHMP Ir,e

associated DO« properly yields t-ie process TR3 *h(cn f.nsnes a n.potne- zed lrang,e

■mage This is mocated Dy STM "9.0" (r.gure !V 141 af'd « i.iusliated by Figure IV.17

S'hfc a known object is again sugGested. RtC-jVS sets the goai to SK02 and

deactivates

Ruie S'<02i 'of AA-S^S» fires, setting Visu»' Register . aiues accord.ng to the

accomodated ob;ect (tnangiei "age as descr ceo aoo e, changing the goal to K02, and

act.at ng Vl-SVS 'ne trace of 'gu't IV 18 ni cates t-at rult Via f res as a resu.t of

the straighi a-g e On the AT* s,ae Of It»III njmper 8 Vi-SVS continues to mo.e CPP

m the OIR drection, 'each ng .crtt« number 2 Rue Vill fres, whicn co-pletes the

■ conic image n Vi that is 'i.ustrated By Fgjre iV 19 EXP u set to CON. which nocates

that th» e-pe ted ar-^e feature was found but s par" of a compiei ve'te« (more than

2 e>i| d.recd >s, A OuiC<SEE eiement '0431 ^s used to represent verte« 8 m the

iconic line mage

f iurt IV 20 returns aga^ to tne neit segment of protocol. Th« subject also

reaches vertei 2 as a result of tn« role movement Me indicates »«pect?-- ■

/ i

90a Fifur* IV. II

ACT .35: Vl-SYS.

WXZ VI8: ATT & EXP SPECIFIED ANO STRAIGHT ATT SIDE.

AT VERTEX VERB.

MOVE THROUGH VERB

RULE VII1: EXP « ATT A END OF LINE.

AT VERTEX VER2.

DIR IS Ui.

RAN IS LS

EXP IS CON

ATT IS DL

VI IS <L37 P42 P49 E38 WO 141 0« 144 139 145 146 E47 V48 P49 X50 A55 X64 A« 53 X52 A51)

Flfur* IV. 1»

'•

-

:■

rifur« IV.20

® fl

0 00

and «hi» it lh» third (id* [Sll]

Pigur« iV 21

ACT«1:AA-SVS.

RULE K028: EXP IS PART OF VERTEX WITH SIDE

GOAL-IS; K02 14.0 SIM; (Vfl8(CR X5? PNUM P49 VSPEC (UO DR) SPEC TE TYPE VERTEX)»

(P49 X50 A65 X54 A53 X62 A51) ) aarjc» >«*? VSPEC DIAGONAL TYPE SIDEXPAS P25 P«2 PIS ESS MO -

111 Q« I« M5Efl7) ) (Ga 010<NAME TRIANGLE DIM TV. 0 TYPE 0BJECTXP4 111 A12 113*

114 A15 I16P26I33 A34I36P49> ) (V24(CR X26 PNUM P25 VSPEC (RL UL) SPEC TE TYPE VERTEX)... ) (V3(CR Xo PNUM P4 VSPEC (RTA DL) SPEC V2 TYPE VERTEX)... ) 0 0 (> 0

DIR IS 00

RAN IS NIL

EXP IS RTA

ATT IS »T

VI IS NIL

ACT (56: VI-SVS.

RULE VI9: EXP » ATT » NO STRAIGHT SIDES FOUMX

•

) I

9.

sH' '.»«lion and tontinu*)ion of 1h» ci,r'»nl (a«l (ird ob|»ci hypol"»-.») b, stjlemenl

[tUl

Fi|ur« IV.21 prsscntt tqu w>tnl Ktivity M (*• IrKt 0* V1PS »ult "Oti (Of AA

SVS) tires du« to Ir» CON (C0M»'n«di v»iu» 0» EXP »"d th« LM VP« O« the iconic

im»g« ot VI, The 'ule tpiilt tne trjge o< VI .nto two ci''i. verte« V48 »nd he .3?

Th« vartti i"-»ge ■« entered mto 5TM. fh.s s .ndicjted e/ S*v ■ it.ng ";4,0" »"rt

illustrated by ri|ure Iv ^2 Imajt Body eie-ent» IJi (o» 010) ano AS: M VAgl be.n|

linked by the ">A equxie":/ properly 'ne -e -j;e iL37) t chanfed mto a SIDE

type image chunk and ent'eJ nlo STM 'See "1A,0" and Figure IV 23) Tne tND

elements £38 and £4' ft ■ n»ed to INT£RNAt e*me-iis 116 and 133 oi 010

respectively Position type et»ent P49 n ncorporated nto O10, assoc i'ed « tn me

"co'-ier" of 133, A34, and IJ6 Fmiii/, the rule upases C» ot GOL to -e'erence 13%

and oads the Vsjai Peg'Ste' acco'dng to 1 -e object -age conte.t ce'ore activating

vi-srs

; igure !V 24 s'-ows tne asl protocO' segment cons'de-ed he'e Tie subject

ndcates co^peton o* tne . sj« contirât on ot tê prcrosea '-ange ot),e;T »"ape

oy statement« [Si?' and [SIS" In I'ame ViO ne «-oê^ to the r ght to cegm another

•t the comple» «erte« (nun.Be' 3 «hich ne »no«s s tne-e 'VEPTEK chi.n, v?4i

'Tor-espondingi,, rule VH 'o' VI-S^S) sets CP? to V£B1, constructs me 'con,c

verttfi -"aje V*i7 m VI, »nd'.el ' «i1 to VE$ bet0r, cjeaiiwjting nee Mgure IV ?5) As

a hypothesi/ed ob<ect 'ir-age '. he ng visua1,/ foni,rm#d, AA-SV5 accordingly marks

Image Body element., ■,, MAP« p'operty is set lo VES) Thus, rule KOi7 lot AASVS)

tires «nth th« completion ot 010 co-1 rmaton, as £X^ is V£S and I'. 3. be^ng (UX ot (CR

ot CJOL'I, has oeen previously -i ••] 'e rule changes the active goal to 120

I -

' >

'

^.

MH

IM

»«»

Figur« IV 22

v^e i*fy

Tijur« IV 23

^A

I

•Ik

Fl|ur« IV.24

^

vio

Q Ü ftT

«^ gixl

^w* \» «.^«vftNiAi *\*^ thi]

Fifur» IV 25

AT VERTEX VEB1

DW !S DO

RAM IS LO

tXP IS VES

ATT IS »T

VI IS (V57 P^g Xb9 A«2 X61 A60)

ALT «1: AA-SYS.

RUE *027: COAL COMPLETED

GOAL-IS I?0 16,0 STM (GOL OI0(NAWE TRIANGLE DIM TWO TYPE OBJECTXP« 111 •

Al? 113 114 A16 II6P7S I33A34I3SP49I ) (V4WCR X6? PfAJM P49 VSPEC (UO DW SPEC TE TYPE VERTexXP4t XS»

0 Atb X64 A53K52 A5I) ) (I 37(CR »2 VSPEC DIAGONAL TYPE SIOEHP49 P?5 P42 P49 ESS 140 -

Ml 043 144 146 E47) ) (V24<CR X?6 PNUM P25 VSPEC (RL Ul) SPEC TE TYPE VERTEX) . ) (V3(CR K6 PNUM P4 VSPEC (RTA OL) SPEC V2 TYPE VERTEX). ) 0 0 0 0

'

-•

I Hv

92

(Incorporat* 2 • Omantional ebjKl) md Ktivdat 1NC-SVS Th« conttnU ot VI •'•

not Inntfarrtd to STM. Th« YES v«lu* 9l EXP it (ufficitnl input in this CM«.

Rul« 121 01 INC-SYS «irat to >n<aroorit« th« ob^oct 010 ot th« GOL-tpp«nd«d

chjnii «nd <tt >mffl«di«t« vi«u«l conttit Tigur« IV 26 indicttm th« b«IOr« «nd ■tt«r

ttilet of 1TM md Fifur« IV 27 pclO'iu/ illuttratot tn« n«w 1TM contonl« Th«

mcorporjton it KCOmpliih«d by rei<o^n| GOL (ram tn« 010 chunk and copyinf th«

Chun« mto ITM. Th« imag« body ot th« chunk K tnan tfav«ri«d, incorporiting any

chunk containing an |ma(« Body «lamant «n.cn it mkad Dy «quivalanc« to on« m th«

mcorporalad ob.ect imaf« Ounng this travartal, a ne« (tart location it alto chot«n

Thit it on« ot th« contoat chunkt, which hat an unknown X1T »itmanl (typ* UCX) It it

markad m STM by «pp«ndin| th« Spacial «lam»nt LAST to notify AA-SYS If no chunk

with an unknown hnk it found, th« |oal b«<om«t N0M0 (NO Mor« 0b|«ctt) In th«

curr«nt cat« V24 it markad with an app«nd«d LAST, «nd th« |oal b«com«t SNO (Start

N«w Obj«ct) at thown by Fi|ur« IV 2«

Thit protocol - pro|ram trK« companton it contingpd in Chaptar 11.2 «a MctiOn

API

*

THEORETICAL IMPLICATIONS

Th« «>ampl« protocoi-profram trac« («iiMnt illuttratat motl of th« th«or«tical

implication« iwb«ddpd in VIPS. Th« int«|rativ« «nd |«n«r*tiv« procatt Of vwud imat*

ccntlruction batad upon «y« tantory input (p«rc«ptien) it illuttratad Th« uM of

c jrrant imafa contantt to |uid« hoi« («ya) iiwv«n«nt bahtvior and input int«rpr«tatiOn

t iliuttratad Th« batic activity el attinwlation-accommodation n itluttratad. Th«

propotod ima|a ropratantation it thown to b« both adaouata tor and lurtharmar«,

-.uit«d to ita rol« a« a |uid« tor p«rc«ptual activity

/,» i .—«.

-. I

Fi|ur« IV 26

ACT .63: INC SVS

Hu : U . ■..:■■• 1ATE FIRST . ij rCT

16,0 UM

16,(i ITM . .; ■■ -: ..■; A; _ '. ■• ' ■■•.'. : • ■■< ECT) ... ■■ • ■ pr, ■.' PJ5 . ... it ryff vtPii «i , ■ ;Ri •. .• . , ■:■■•., ■.;. rvPl .::• < \ . , ■> .'. j -. . / P-O VSPtC (UO C-1. SPtC TE TVPi VtRIi xi

MS

ASS"

**> l«l

Fifur» IV 27

ACT .1: AA-SY1:,

PULL SNOO: START r.iW 03JCCT AT IMJNKCO POSITION.

WILL START NEW 03JECT AT RSH 0*M

DIRECTION IS RT

AT VEWTEX WO

Fifur« IV 28

/ I ...

G0&. HtlATf 0 EmooEt

'h* p'O«.««« ot Vl^S teicept v;-SySi J".« the ij-e ot ■■< ■ o*. *■ '

pr war, condition 'o' (Oetf" ",'-t O'» 'u*e ♦''■ng Tni ,11 p.,o' *n -(.;■. il ,i'- o? * e

P'OMtO' (pe'Cfptji') DfM. a' as com.it.rj o' a i»'.ei ot goa -o .>"■ I ip ou»'.

^gj-e iV ?9 j'«pn.ra > austrat»'. Itis nterpfeia! o" 0' IX« eumpe p-Cü 3. •.<?t;rr»"t

n |h| <0f"v c' i 'p.ca1 rpisoit» thvl'

Th« chart «nd-cates tHo-e p'OtCKQ. t-arres a»n.cn corrf.por') 10 iare concurrent

«thi th« interred goa. trjns.iio- po.nt» o' tne oe^a- 0< t\/i. V3, VJ and Vll ot tn«

tigur*). Th« vertical i.rvs .na.^a'p a ^«-(jjente o! one O' "Ore no.e le>ei rro.enents

'o t.ie !ett ot e*cn I ne HI t"e "-ame ot tn» current go*, «mch s «cti.e dur ng that no e

(•/ei mo;enent scduence Mid a',sOc ated ben»<iOr ep'Ode To the r.gnt o' »acn

included Irame nur.oe' loraocteui n ..sted an* cur'fl goa1'- «h.ch art active at tnal

protocol pomt, rut mhcn peton-e n»ct .* past) pnor to comwencement ot tn»

subsequent hoi« t .e mo.e'nenl sequence

trfner*»/ rev.e».nj t"e eu'oe, goa s S",3 ano S"<02 «r» «ssocattd wth th«

mM HtC-SVS activation u, AA SYS Upon ret^rr to A*.SYS t-e goa. s cnanjeo to

KO? and tiol»-mo*emenl act ..t,' Begn-,

At tram« V3 conl.ict.ng npu' causes AA-SvS to read <ate R£C SYS « Ih goal B*;

in oidrr to accorrmiodate Hie object .n.age Cioa |K08 results, «hth is changed t,

AA-'jYS to KOi and no'e n.o.cwen| agan beg.n»

Ths goal remains acti.i* until protocol trame V9, «hen tr.e hypotnesi/cd object hat

been tun.p.etc , conlirmed. lt<C SYS s Ktuatea w th goal 120. Upon deactivat.on ot

•

>

Ko2

KOI

5H0

>/l (

VI«

«HO

«Ä

V^ {X2tt

Fi|ur»IV.2»

RMO - Hceogniza Hsw Object SK02 - start Known Ob.ject 3-41iiienslons

K02 - Known Object ^-dimensions RKI - Htrecogniz«, Known Interrupted I2D - Incorporate 2-01atnslonal

INC-SYS lh« tyilM M«VM to th* new lecdien with |0«l SKX Al Uam VI1, RCC-SVS

i« •clivttad to «Ittrnpt rtcogmtien UuftMtion) e< • ntm ebjKl (ged PNO).

Th« goal •pxod* chart« «r« • cembinalion of protof mlormation {Um» nutnbart)

•nd tract inlermttien (interred current |0*l*>. That« chtrlt IIMtrtt« lh« interred

»»ctonntion (ptrtitioninf) el the observed behevior «nd, t* »uch, in impertrnt

Iremeworli lor the evtluelien et prolocel-trtce correspondence. These charts are

used throughout the thesis *s a condensed representation el subject «nd system

behaviors «nd their correspondence. The «valuation section of Chapter 112 uses this

epvJdai nt«rpr»t«lion «t a basis lor ludgmg the enplanalory ability ot VIPS

' I

Cr.opter 1.5 . .. V'.PS E*t**lWW

VIPS >*, Urr- ied m scope oue to the specrf't, t«K - rttaM beha/ior ! r«prtMffttl

and enplans Sever»' n-emory e.v- ■"', and general.batons are necessary to

complete the tneoreticai definition o* tê visual (cOfrutivt) processor Arotner

component o* long Ter"! Metnory '5 defned and »he conlenl and lünct'On ot ..TM ot

rflPS «»'e genera^ycci and eitennpd The i""aee 'eprp-jenlation and processes -nvO'-ed

n th'ee dimensional vi&wri torn- percept-on must he aeocr-bed A represent at on

genfa'iâtion s necessary to de'ihe a fnore universal v sual irnage'y ability Finally,

thfl processes 0* VIPS must be jene'* zed to e<pia'n the eê-movemert and

per.p^cra' <ivon factors ot visual percept on

I, K/eÔfy r»tensions

TCL'M '.Te^pca. - COTpiUa1 Long T»rv Ml wry |

'errporal - Conte«*uai io^^ Te"Ti Meô-y (TCkTM> is the co^pone^t ot 'Ong le"n

mennory whicn scr ,es as a pe'rânent repository *or tne ep'.oaa' and cünre^tâi

■ ntorn>ahon 'epr*>spnt^' on-, I - agft) wh-cn are mti^ly con'.t'ucted a*, the contents o*

|TM (see ( gure VP Tneretc^ the e'eênts o* TCLTM »re image-, or othe'

mtef.ratfd (tnterrelated» '.»ructur«»'. o* seeded 'mean ngfuO past chunks pi S^M

f ach elemental âge ot TCl TM nas en 4',soc-ated lane' e'eê^t ** s laoei a'tords

I

• -1 Figure V.l

Zi:\

the two basic nwins Oi accsss to the inemory image's content. For one, the label

element hat associated properties which specify information as to the time and place

associated with the initial realization of the mafe m ITU These temporal-contextual

information features (Shiffnn and Geisler, 1972) may correspond to properties of a

later, current situation specification. This correspondence affords access to the label

element. Each label element also has properties which reference content element»

withm the associated mage structure. The^e references afford access to the memory

image's content after access to the label element by temporai-conteituel

corre-ipondence has been accomplished. The content -eferencmg properties provide

the other means of accessing the contents of the memory images of TCLTM Just as

tbe features of the temporal-conte<tu*l information may bear correspondence to

cur-jnt STM contents, content elements of the image struc.ure may also be equivalent

to elements of current STM and facililete that image's retrieval.

In the eitension of VIPS, the *inal image representations (perceptions) of ITM could

become TCi-TM elements. Prior to ViPS deaclivation, by a final activation of INC-SYS, a

label element can be created. The final values of the FIPST-ITM, LAST-ITM, FIRST 08

und LAST-OB reference properties of ITM could then be transferred to the label

element as content reference properties. Situational properties (temporal-contextual

information) could then be specified for the label element, also Upon VIPS

deactivation and the accompanying disengagement of the cognitive processor from

percepluel ectivity, the perceptioi. (mage) can become an element (the most recent) of

TCLTM.

Retrieval of TCLTM mage dements is accomplished by an active, searching process

(Shi'fnn end Ceisler, 1973). Ths search attempts to locate an image with temporal-

L I

97

contsiituil or content tdtures iquivdeM '.o tho',» provided to th« process from the

current contents of STM (* search-set). Thau|h en element it entered mto TCLTM

pe-menently, forgetting may occur as a result of the failure of this retrieval (search;

process.

Accessibility of an image element of TCLTM decreases as a function of element age

(Shiffrm, 1970> Tulvmg, 1970). With the equaling of image accessibility to trace

strength, WicKelgren (1972) provides further support. With the passage of time,

features of current temporal-conteitual information change. Thus, the longer an

element it a member of TCLTM, the lest similar is <ts temporel-contentuai information

to that of a current search-set (Shiffrm, 1968i 1970) With regards to retrieval by

content correspondence, the probability of a TCLTM element with similar (equivalent

features) content being m TCLTM increases with elapsed time. The existence of such

an element(t) decreases the accessibility of the initial by being a 'ource of retrieval

competition, confusion, and interference.

Recent episodal and contentual information (memory images) play an important role

>n Many (most) eiperimenlal tests of memory. Due to the capacity limitations of STM

(Miller, 1966), moil typical tests, such as the recognition of c currei.t stimulus at an

element of a prev.outly presented set, necessarily use a recalled element of TCLTM.

This image is readily retrievable at it n usually a recent or th« moil recent entry of

TCLTM, Or may ttill reside in 1TM

When an element of TCLTM is retrieved, it becomet th« current innge of ITM

From ITM, the structure is recallale into STM in part or n a whole (cluing by chunk)

for comparison with new current STM contents. Such comperiton is template-iiKc in

nature being en etlempt to directly match possibly equivalent image structure schema

y i

Su£> equivalency would depend upon correspondence of ''«age element prouerres

which specify wsual features and spat>al inferre'al'Onships During perception if a

n.atch to partul inpul -.ucceedi. the retrieved image it used to guide t'-.e perceptua

behavior as are newly created m/pothewent images

Statement [til] of F'gu'e V2 macates One of tne rare instances of th s Dehavior

wifhn the protocols This scarcity n due to the oscrete 'discontinuous) natu'e of tne

e»periment»i visuel field wh-ch consisted of a series of distmcl (only generally reiafeot

Imt drjw.ngs. In more usua^ continuous contt«t s.tjations, R£C-S>S retrieves images

from TCLTM (»nd ITM) wiln greater frequency. TO.TM was not implemented in VIPS

du« to the rare use of its v.suai image elements <n tne protocols.

The use of retrieved TCLTM images to guide the perceptual activity can account

for Ih» results of Noton md Siarn (19^0). Their results indicated that subjects use

similar eye-movement sequences during th« recognition of a previously presented

drawing. This indicates use of the visual image result (perception) of pr.or behavior in

a subsequent perceptual situation. Furthermore, Noten and Stark propose that a

perceptual (visual) image's content strictly reflect (mc ude) its generating eye-

movement behavior. This is not proposed here. It K proposed Only tnat the sequence

of input views influences image ccntents, as do perceptual goals. In later perceptual

use. th»»t influenced image content« inversely affect th« eye movement behavior

SLTM (Semantic Long Term Memory)

Semantic long Term Memory (SLTM; is an eitension of the LTM implementeu in

VIPS It is thus not a new memory component, but replaces LTM in the final memory

systjm proposal (see Hgure V.l), SLTM IS a semantic net (Quillian, 1968) of a

■« r

III

)

mm I—*• ■ iwMiM ■ w yr '

■n

conceptjal-reist'On^l nature IKintith, 19.'?; Bo*e' a"d Ander'.on. 19731 SvTM hod'.

the Zysten-"* symbolic reo'esppiiton et aö^trac*. (;f?ner^!i/eü, tactuai Knowledge As

such, it contains (as acttvslaWi suo-structures) associat.-e, heterarcn.ca-

rep'esentatiors o' visual informal.on iW^.ton, 1970*

Similar recesentations ol visual intcmation ha^e proven adequate to realize ana

exp'.nn behavior on vsually related, cognitive IMM i3aylor, 197?; Woran, 1973).

Those tasks are o* a more ab'.tr^_t nature t'lar the perceptual activity represented D,

VIPS Ser.'ients o< the iore aostract contents o' SL'W became part.tioned and

activated as chunks of STM (Moran, J973I As chunks ot S'M, tnese segments of

abstract "la.ls" determne (ämde) tne subsequent visuaii/ related cogn,twe acl.vily.

The contents ol SUM ana P.TM are aite-ed b/ learning process Dased upon

(accnmodatmg tol current experience (STM contents) EPAM investigations suggest

RLTM altr ahon means, Winston (1970) investigates a means tor the updating

(learning) ot the visualiy-meamngtui contents 0* SlTM.

2. Three-Dimensional Picture Percept on

Picture perception ditters from other v.suai perception activity as the visual

environment is two dimensional A presented line «wing is known to be ol two

dimensions as an object itsell Thal tome straight line drawings are perceived in

Ihrea-dimensiona; terms i*ilh depth) is • prime enampie ol what E. K Gombnch refers

to «•. the "beholder's snare" ol visual picture per ption in his most interesting book,

Art and Illusion (Gombricn,1960) The th'ee-dimensionai perception ol pictures occurs

m the absence ot the posit.e etlprent indications ol accomodation and convergence.

What are the basic aspects ot the processes and memor/ representations which

I • -

-

100

bacom« involved in th« d»v»lepi—nt Of • thr»»-dim»ntiOn»l p«rc*ption ot t P'«$»nl«d

tlraight line drawinf T What charactanstits ot a irna drawing Itad to its inttrpratalion

and raproaantation in thrM-dmamional tar mi ?

RELEVANT PROPOSALS

A prim« targat for allampti «I quantifying Gattait organnational lawi hat baan to

««plain tha parcaivad thraa-Oiman»ionatity of certain lino drawing«. Thoir belief i« that

th« batic organnatienai lawt of perception will attempt to realize a detcnption of

minimum complomty for a preaented »limuli ("Pragnanx"). At tuch, a 'timpla* three-

direntional perception of a line drawing result« et favored over an otherwise

necessarily 'eomplei* Iwo-dimentional perception. Several studies by Hochberg

(Hochberg end BrooM. 1960; Hechborg and McAllitter, 1963) resulted in the

development of a compleaity meature for ttraight line drawing stimuli This complemty

measure demonstrated significant positive correlation with tha relative perceived

thre«-dimensionality of various presented stimuli tett. Atlneave and Frost (1969)

carried the investigation of "minimum principle1* implications further. Their

e<perimentation produced results which indicated that the perceived slant m depth of

a tridimentional perception was highly predictable from basic simplicity criteria.

These studies all considered the "minimum principle' lo apply to the presented line

drawing as a whole. This was necettary at Getlalt theory offers no enplanation for

the integration of successive 'partial wholes" ot a stimulus to realm its perception. If

such a "minimum principle* were the only source Of three-dimensional hypotheses and

the resulting perceptions, it is predicted that mention of three-dimensionality in the

hole-moving U-.K protocols will o:cur only after the whole line '-iwmg has been

/

'

101

IrtvarMd »t l*Mt one«. V*l, »ubjact« d*tinit«ly mention IhrM-dimantiond idan with

only partial picturt information tvailaol*. Thu it claarly toon in th« Ihr*« op«nin|

protocol MfmonU protontad M F furoi V.2,V.3,ana V.4.

From lh«M thro« initial protocol Mfawntt it it tpparait that local pictura

information (avan ona varta«) it «officiant to illicit altamplt to raalita a thraa-

dimantienal lina-4r»wing parcaption. Simon (1N7) notad tha ability of an attantion

thift to Hip tha parcawad onantatien of a pratantad Nackar CUM tlimulut. Hochbarg

(1961) notad tha ability of local dapth cuts to |anarata propetad thraa-dimantional

intarpratalient. Tha arlitlt MC Eschar and Hoiarth (Saa Gra|ory, 1970) wara both

adapt at craalmf "mpottibla" picturat threu|h a combination of incontittant lecaiitad

dapth cuat (Saa Figura V.5 for an anampi*). Grafory (1970) invatti(atat tavarai local

dapth cuat and propotat that thair parcaptuai af'act ratultt from the mamory of patt

enpariencat involving tactual - visual ceordmalion.

A THEORY

Sinca a Una drawing it itsaif a Iwo-dimensionti obiact, tha initial perceptual set it

naturally toward the realization of a planar or Iwo-dimentional perception (visual

mage representation) Thit perceptual attumption remamt m effect until a to-called

"trigger* vertaa (or feature configuration, in general) it encountered. A "trigger*

vert«« it ona having three e>it direction!, no two being m oppositely oriented

directions (in other wordt, *T* vertices are not included). No trigger* vertices are

encountered by tubjectt >n the tour protocols ditcutted <n Chapter 7. No mantion of

any possible three-dimentionai mterpralationt occurs m those protocols either In all

three initial protocol togmantt of Figures V7, V 3, and V.4, a 'trigger* varta«

,.

MV

v»a

Ml

vi

V«

VW

(D

!

Ml

XJO

^

0 0.

UP

0 (y)

KT

DR

IM«

oiiy [Si]

I IM • corner [S2]

Fi|ur* V2

V-n |ein| le |0 ceund th» •<<(• [S3]

•nd SM wh*th»r I c«n [S4]

il loot»« Ilk» «n uppor cornof of • Mock [SS]

•nd |0 up [M]

• .. «round hör* (S7]

•nd • iMek cornor ef ■ block [St]

_ _ ><

V-

I bot you thi« i« • Mock [SI]

JOWMm ^^ ^^ ^K^m ^M^ ^B^M ^^M

bKk hör« [S10]

th«« worktou»[Sll]

IM flnl drnrtna Ihit I IM [S12]

•nd (S13) • trtpoxoidd bleck [SM] okiy, roTimg down hört ooking for [SI5]

y»th .[Sl«]

(horo't tho bKk ornor el it [S17]

I i - ^

vV

VI

_ ^

- v»\

v<

01

®

OL

— vU

— ^I

v5

1 DOI

10th Fi|ur«V.:

wall, it leoKt Ilk* th* cernar of »omalhmg m partpacliva [SI]

and a iina meva« up '.3 my lalt [S2]

latt [S3]

and I hit ■ ternar whara [S4J •our hnai inlartact [S5]

and I coma back down [Si]

RT

m Lt

1 varlical Una [S7]

than acroaa a ho» «aotai [H]

«0, t raalita that lhara it *

tfLnil. [S9]

with a right [Sio]

with »rijM ingla [Sll]

• 1

M

»X

**>

-A

sS

iW

MH

N«

0 (2) 0

0

0

UL

10lc

MM IM« look* Mw «MI - (S2] lh« bH-nntxt* of • *eM objMt [S3] ceuMbotcuk« u»... ($4) W» «M, which way »houM 1 go [S81

PH try goin« t« hör* [M]

•h. . ($7]

•h» .. [S«I

it leak» lit» ■ tub* »t.M [St]

Fifur«V.4

[tlO]

d»fiflit»ly tw» th» tMUmt* el • cub» (SII]

I 1

■

10M FI|ur*V.B

. '

i 102

cnnviJenlly (kcttl 'mmed *te tn-ee-aimensiOij: ccsde'al'Ons. The perceptuJi .-tfect

of a "trtgäer* ("onf.fJu'.'t on is consistent *iln tne e*per ence-based theory (Gregory,

1970) and wi!n the local application ol the Goctalt "mmimuti principle"

In the u'.ual case, t*o êrte« eiiit'j of tne trigger .-ertei are oound to an object

face, the "prime face", *h.cn .s perceêa to De paraiei lo tne picture plane The

third e«'t a-reclion !'. perceived to oe e<tena ng forward or backwai-d m space tdeptni

and oemg the edê bet*een f*o "secondar/" 'aces. Tng phrase "m the usual case"

was included in tne descr.pron ol "trigger" verle« perceptions above. Note that when

the perceived deptn direct On .s down, tne usual interpretation is rejected and the

other two vert«« emt directions (St II ol the prime lace) are assigned depth meaning.

Thi.s m»y be »n nnerent result ol tne "support hypotnesis", an assumption resulting

from the norm»! inability ol an object to hang n space. Support is usually Irom below,

denying down as a viab'e deoth direction in pnysical space with gravitation. Figure V.6

shows a "solid octagon" w.th ail eight seconoary face «»tension directions illustrated.

The starred ("•") drawing shows the laces e>tend ng down. In this case these laces

are not percieved lo e<tend m oeptn as uSja. The octagon (prime) lace is percitved

•s the ob,ect top and ent^nds In depth itself.

Tne decision to consider a presented picture in Ihrec-dimensional terms is 1

primary perceptual decision This decision retuits m the apoiication of a set ot

perceptual goals and associated object hypotheses ol currently active goals and

associated object n^polheses and dillenng Irom that realised in conjunction with two

diitensional considerations. Aubrey Beardsiey, m his ornate art-nouveau drawings,

contraposet comple« border patterns and comple« pictorial scenes, both olten sharing

equivalent components (See Figure V7). These illustrations afford introspective

.

.. '

1112» Figur« V.S

/ I

Fifur* V7 >02b

MnlinTakcih the Clnld Anhur into Hit Knping.

..

103

apprKiation el th« «(ftct of th* p»tt»rn or thrM-dim«nsional intorproUlion decmon

upon Ih« VKud «iporwnc*. Thou|h (imlar vituti •l«m«ntt occur in both bordor «nd

picturt, th»y «r« t>p«r,tncad di»*r«ntly duo 10 Ih« dilftrtnct in usumod

dimoniiontlily.

Now m» imitl contidar Ih« «ctivity ol 11« v.sutl processor »ft»' encountering a

"Iriggar* varta«. Al Ih« >tral«|ic avel. Ih« goal K03 Becomes active, which wi,.

attampl lo recogm/e a IhrM-dimantional pnim-type Object Such objeclt are

rtcognmd m terms ol a prim* laco, which lerves lo ntm* the object, and tovoral

associated ucondary 'aces, which usually »re pe'ceved a» entendmg in depth

At with Ih« two-dimensional casa, an iir.üge -epresenlal.on ol the objocl is

constructed m STM EKh fece it represented in a dillerent chjnk. Cnapter 13

d'.cusses the VIPS image representation ol Ihrae-dimensional prism-typ« 0B,ec!s in

conjunction with Ih« dalmition ol the FACE typ« chunk. That« image rhunks s«rv« as

th« source ol tactical mlormal on to g«n«ral« vitja> 'ealur« eipectat.ons and hoi«

(eye) movement specilicalions An assimiUt.on-accomodaliOn process equivalent to

that of Ih« imp'emenleo system is used 10 ether conl.rm ««pectatons Or ailer and

abort Ih« object images (as conliictmg information s encountered)

PftOTOCCk. INOICATIOMS

Tn« action of assimilation-accommodation is well iHuslratad by Ih« initial protocol

segments ol Figures V.2, V 3, and V.4. In Figur« V.2, a block (cub«) image it

h/poltwtmd at a result of Atm V3 (Stal«m«nt ;S5]). That image it accomooaled to «

Irapetoidal block image at V7 (Stal«m«nl [S14]), du« to Ih« cenllicting «■l«rnal vitual

input ol that view.

v *—.——•

10«

In the protoco! seftrrient Of r"<güre V.3, comrnenc.ng a! a afferent ve'te» vocation,

th» tmtial three-dimension^1 interpretation is dropped due to conflicting .rputs

encountered m subsequent vcrte)« views. This o a mo^t severe accommodatton due to

the primacy of the dimf "-..onal dec^.on as notej

In Figure V.4, the subject scans the p'<Me "dee of the proposcu cubic imeg*, so

far acceptrng (assif 'at^g) tne e«t'a verte» extt encountered at V7 into the thrue-

Jimensional perceptc"

SPATIAL GONUfteNCV

fhtrt « one complete-y ne* perc-ptuai factor wnich enter«, mto the 'ealizalôn of

a th-ee-oimensionai irâge represe^tat'On and perception. This new factor n tnat of

sâtâ' consistency. T "e delerrn>nation ot spat a< consistency involve* tne

consideration of two tacto's One »s the constancy of aepth direction, *ithtn the 'r»age

M a who-e and more importantly for any given ne secn^nt withm the image. The

other is thi» consistency of thr n-depth locatonî i'Verreiationsh.p^ between tr>i

various feature p/Oupmp.s uert»cns) of the image Chapt« r 13 dscusses tne inherent

arnbigU'ty of an/ I'iree-dtmen-tpnjl interpretation of a pianar surface fht perceplu^1

•.yste'" must construct (by cno'te) a non-amhi.juous consistent vis iai 'Tige

TiRurc V8 illustrates the two poss'bie mconsstency ârtors m «»ample line

dr^w-ngs, Alt of the example^ p'e'.rii ted there a-e incon^stent when perce'/ed as two

• ntprracting cubes. Tâmp'e ti .nvOives oniy the ^consistency of perceived deptn

direction for fhe picture a« a whoie riamoe i mvOves both MMNMltncy of dept^"

direction for the who'e picture and ^conM^tenty of perceived verte« locations. This

involves the added irregularity in the perception of pfHW projections when the fac.î

1

/

-.'-^ *

,'

Fi|ur«V8 i .na

u

III

.- 1

106

•aUntion dirtttion K down. Thu«, wh*n contidarinf lha to» cub«, b it tbev* a, «Mt

whan contid«rin( lha bottom cuba, b i> bahind a. Not« tha inlretpactiva 'laalinc* of

band el tha iquara prima lac« n tha dillannt m-dapth diractions act t« warp that

In aiampia« i and iv, * ftca i« tharad which i« net tha object'« pnma lace. In

!>|ure MI, the »pecial ci«e with down i« «gain illuttnt i. A« with eiampla i, ju«l

d.tcut«ad, the edge« a, b, c, d ol tha «harad tic« >r« incomittenlly perceived to be

«»tending in-depth m one (tha top) ob|«ct related perception, j -d to be parallel to the

picture plan with regard« to tha other cube perception. Again incenfittenciat o)

«patial location« re«ult. Enampla iv involve« the incon«i«tencie« ol perceived depth

direction« lor lire «egmentt « «nd b and the a««Ociitad ravertible depth relatie ship«

perceived between the vertica« «t their and«.

FURTHFR PBOTOCOt INDICATIONS

To illuslr*ta the ellactt ol incomittancy upon tha vitual precast, three protocols

are presented which «how subject hota-movement behavior upon Eiampla iv (see

Figure V.9). Each appandm include« a luliy tran«cribad protocol, an active-goal

api'Ode chart, and a pictorial representation ol tha Imal ITU contents a« interred. The

ac've goal episode charts are presented at ligurat here and indicate the possible

course ol VIPS implementation to account lor these protocols The co.npiete

appendices are net included in this report but are available Iron the author il thit

detail i« detired. Dot« occurring in tha coal epiaeda chart indicate epiaode« ol activity

net straight-lorwardly aiplained.

Con«ider protocol A.P9 whose goal episode chart i« Figure V.10. The «ubject

I

II». FlpjraVJ

i I

002

*»(a

VI

KOJ

wn

Kos?

vis

IW5F

VW ^«0

^HO

«IH

10^b

^3^

Fi|ur. V.10 VT\

KD3

VWV

VH1

^55 ^x«o

SK%

K^C

\fc^

ttCI

vn

Ml^

K3CF

vn

isc

iKf

VM

S«.5

V^ \X10C

¥0

virt

/■

1D">c Fi9iraV.il

/

^«N. '.I

;06

«ttampU to rttogmtt « twO-dimcntion«! < ga't, with goal J02 (nolh^ rt iu((tfl*d ny

th« p»rti»l intermslion) until V9, tMmg vtrlti S. Thu "I'.gger" ve'lr- general« I'*

lhfie-dim«ntion». goal K03 This go*l and tn« accompanying cube "<>4p.p p.Liide'.

behavior until V33 This results tn the full eiternai visual scan Antl cont>r^-ed

perception of the proposed cube At V39, by ttetements [S44] 'i 'Ough [Sie,], tt<e

subject mc cates the realized perception ot the cube and staten-pnt , -• •, nri'fates

attention it now to be directed to recognnmg what N beo« that cube

Al V41, the subject sues ve'le« «, another "trigger" uertei aid '.littetrient [Sbi]

indicates that another cubic goal has been gene'ated to' rons>deraton and

confirmation This guides behavior at the strategic level until V%6, where statements

[566] and [S6o] indicate that tne incorporation process it nav.rg d'ticulty due to tne

inconsistencies of depth direction ana spatial locations of the two cube mages The

behavior from this point on is an mterractiOn between the incorporation (INC-SYS)

process end the AA-SYS P'Oce-.s n an attempt to resolve inconsistencies

Reconfirmalions of the two separate cuues are reaii»ed, but the inconsistencies are

never resolved, as shown by the pictorial representation of the fmal ITM contents

(Figure V.ll). The dotted arrows indicate the conliKlmg depln directions perceived

This representation allows the verba ned report ol two cubes, but tails to be

satisfactory for reproductive drawing generation, as shown by the appendm

Considering protocol A.S3 neat (see Figure V 12), the MM goal here is to search

the outside. The "trigger" vertices don't overcome this goal, which is active until VI1

At that point, the subject moves n-s.de, possibly m an attempt to link up with verton 7,

which he has seen. When this fails he nioves to the Outside, linking this inside verte«

with an outside chunk he has kept. From view Vib to V6I, an eaact goal structure is

' I

VI

106i Fifur. V.12

S€0

,4*1 \«i

K«Z

Nw MV) ^xi»

Tfl

Tfl

MM

N\f

«Mo

M *u»

m

iH-^ (n*

MW at

m

..

106b Figur« V 13

•

> .. :

10?

10 möuce The iobject gone'jiV '<1»y» to tue Sutvoe contou', constjnti, nol^g

'U« lbr»«-ait •,• iOn»i ■»M--'D'et»t 015 01 th»t* ve'l'tes Though tfi» «ora cube it

Oned, the'* does not »roei' to Be My specit.c cubic irnjês generateo tor

'«-»lion U« «ppa'ent ."to^sMiteiciev 0' !•■■ soluble cuoic co'neri i4 noted n

ment tS721 *t V33 Thus, • appta-s In« ."convsttnce» o* deptn direction!

rated b, 'ne trigger vert ces j-e 'Oted without c-nitr^ctirg compete ■ncontut»nt

images, or at least without attempting to 'ir»t con),.™ these cubic images

it V6i, tnt subject hmMy decde» to colder the p.cture in ".oca'" terms

ements [Sill] to [SI 1 Jj' ThiS .s edji alenl to a aeision to perce..e the picture

vo dimensiona' terms, instead ot Ire th'ee-dmeniiona; concepts •men appear to

■^consistent Th.s is an mdicat-on adth.n tn.s protoco', ot ti-e tundamental nature ot

a decisin from V6; on tne suo.ect operates mtt* tne goais to recognije t»o

■nsionai obie'ts and to "".O'oo-ate trem into i'M with the^r «nown pictona

• onments T<W| mterpretaton s ndcated by tre acln« goal epsode -hart ot the

nd'i l*".ieed, *ith on / silent mooitcaton, tne c^ri-enT .«rpementaton coua be

• to generate beâ-O' 'epre-eniat .e ot in»: toi 3w «g V6i Tn.s activity resu'l^

nc ereaton ol the lira I'Vt repn cental on rs Osp aêd b, rg^re V 13. which

»s correspo-lenre win the veroai and aa«n desc pi ons ontaned trom (ne

ect

ime final pcjlj o ••, convdereii, &B3 Isee f tst V 10 Again the .niiia' goal here

; sea'ch the outs de iStOi upon completion ol this, tne subiect recojn,?es the

me as tnat ot a cubic prO;ect on, w-ln eitra intema: nes This image is -ncof pora'ed

1TM Th« subject then a'eels attention to beg n n. ng uB the mside directed

I The trigger vertices encountered now do result m the three-dimensionai ntid»

•

^

M

107.

M\ Figur* V. 14

MW

tolilt

SCO

MO (V toc

<au

L00

L10

V^

m

Mil rno

K031

>IV\

Sl«tl

^w ^tx^

\h«l

^l( «to

WH^

Xo^lf

KMlf

>»H1

MS5 (t

MW

X"M

> i

107b

Fifjra V.15

I

«-

108

Ob|*ct proposals. A Mnts of perceptual ^t-atej c |0*is bxemtt »etive. as shown in

'■•» »p sod» chart, which rtsults m th* scannin| and o*rc«iv<n| ot th* two mtarnal

cubas. A(ain In« final Mtcnption is not fro« of tfflbi|uity or mconsistancy (SOP ~>gur«

V lb). Tha tact that th« ITVi representation contains tn* out'.oe contOk' .mage allows

th* tubjtct to anchor the drawing witnm this cunsiStanl two-dimonsionai framework

and achieve a correct d'awmg The verbalitations dunng drawing end the sequence of

drawing (outside contour firsts favor the inferred 'epresentation.

Consider rf, these three protocols in full, one is afforded a greater appreciation of

the ability of the proposed mp.emenlation (perceptual theory) to assiimlale the

entensions necessary to generally account for the perception ol line drawings in

three-dimensional terms. The fieubnily of the proposed image repretentalon is well

illustrated by the e>amples, also.

'

.-

109

3. Can*r«lmd Visual Imat* and Percaplion Sytlam

What ara Ina ailantieni a.id mo4ilicat«n« naMMary to tramlata ViPS into a

syatam rapraunting, and thut ejpu.n.nj, tha compiala numan vitual mtormation

procaisin| lyslam ? fit%\ of Cbncarn 1% \r.» imaga raprawnlalien ittall, in tarmt el

what altaratiant and additions -utt ba mad* Givan Ihasa base imafldry

(rtpratantation) changa», th« nacataary mediticatiOfl« to Ina propoud visual precassas

to accommodat* and us* tnas* aitaratiens can ba considarad

IMAGE GENERALIZATION

Tha imaga reprasantation must ba a'tarad in two lundamant« ways. First, it must

ba suflicwnti,- ganaralnad to ba capabla ol amüodymg all pessiWa (p'obabia) visual

term parcaptions, net tust the restricted environment et straight line drawing»

Secondly, th* mate reprasantation raowres an alteration or addition to adequately

represent th* incompiet* informational input provided by peripheral vision. Th* hole-

movement teak which hat been modelled by th* implemented system a«eiudes ail

peripheral mtcmat'On by masiung

Th* course tahen to realm th* genaralitation ot reprasantation ; to propose

ganaraliiad image chunk end OX classes. Figure V.l» presents the chunk end

image body element types Ot VPS end their associated g*nerali»ed «lasses Th*

general image chunk classes are not dascrib*d lurther below, aa their neewe indicate

th* concepts represented. Th* mate body —I generalneliens deterean* th* form

ol the mage structure ant are t|—t

110

ELEMENT GENERALIZATIOMS

Th« im«t« body •■•ntvnl CIMIM «r* dtfintd by lhair iiwmbart' function within an

im»|« body «tructur* and «r« r»tu- I throufh • |*n«r»li|ttion el the«« «Itmcnt typM

UM4 in VIPS. InvarMly, «Kh VIP. •l«m*nt typ« it a tpKiiic in«t»nti»lion o» on« of

th« |«n«rilii«d function»! CIMMI to b« d«Mrib«d h«r«. Thi« Mt et ■•nardind

element class*« and th« >nt«rr«l(ting mlerconnection» which ar« allowed ar« »utlici«nt

to produce ail visual form image representations

Th« X|T type «lement 01 the implemented system it an enample ot th« functional

class of elements which inlerconnec' ima|« body »lemenlt of chunks rapresenling

spatially disjoint information. An «lement A of this class normally r«l«r«nc«* another

•lament B el this das» through an interconnecting link of spaca-lrsversing maamng.

Element B relerence* «l«ment A through a hM of accordingly inverse spaca-lraversing

meaning. Element A and element B are in separate mag« chunks. Each «lement

references a Position type element which specifies its location withm the currently

bound locational frame.

Each element of this class will have properties which adequately specify this mter-

location (Spec«) traversal Using th« X1T element as an »«ample, each KIT element

specif.}* the direction (OVX) and range (RVX) of the tpaca within the visual field which

it representationally traverses. These two properties are sufficient to define a

straight line segment, given the perceived location of the nitial KIT element es e

starling location for the line segment. The referanced KIT alamenl (by LVX) embodies

complementary traversal information to allow th« link to be meaningfully traversed

(•massed) in either direction.

/

. •

lit

This tnversal of space or change of iocalion m»y be across figure of ground. The

XiT elementi »s prooosed art consistently ut.Nzed lo tra.erse the figure, emDOdymg

an enisling line segment Elements Of the i^nerai ciaS5 mjy r_,pan "empty" or grour.d

space lo interrelate altering irr ge chur-s of differing petcoived spatiai locations

An element of this functional class also prov.des tne necessar, no' ^pa^e-

traversing links to otner image eements within the same chunK. An XIT element

provides the links named »y the propert-ei DiVl and DIV2 to interrelate it with other

(ANCLE) elements of the verte« or Ulm chunk i ■ which it beongs.

The functional element class representing a genera nation of tne -mp emented

irjItHNAL type ^mage element is similar to that iust described. The elements of this

functional dass are pnmarny used to again span lor<- ions within the visual field

(image), e«ceot tnat this link is now between elements ol the same chunk. The

1NTEP'*AL image elements within OBJECT image chunno epres^nt and allow traversal

of Jbject i ne-segment sides Again, the Imki are between two elen.enls of the same

clat', with complementary spatial information allowing meaningful traversal in either

direct, m. These elements alle v the image representation of visua concepts which

span locations by tieng tcgether spatially dt.ont groups Of visual and spatial

features.

These mtra-chun» space-traveling elements provide local (Same location) links to

other image elements of the chunk which are embodying other feature information at

that perceived location. These local links necessarily maintain attention withm the

chunked concept when traversed ("figu'e - ground" distinction). These elements allow

Iheimage representation of visua concepts which span locations by tiemg together

spatially dis/Oinl groups of visual and spatial features. The INTERNAL type e^menls of

M

112

the implemented system provide one tuen unk, named by 01V1, within «ny line or

Ob,eel chunk.

The tunclionel class wt en Ine -NGLE element ol ViPS »«emp.il.es is Ihiit class

which embodies the se! ot "iterestmg visual features found at some location wilhm the

v.^ual 'ield (mage). What (e»:ures are ot Merest, ana thus embodied «.tr.n such a

feature element, s determined By the act"» vt%utl perception or image D'Ocess.

These feature elements also provide If« necessary means for thtir traversal by

direded attention through ll-e mage representat.on. Tue ANGLt type elements of the

propO'.L-d .mpiementeo ^ysl«?". pro/.ue the i.nks n« .ed by DIVi and DIV2. *hich aliOw

theirconsideration and through-lra^ersal to an .nterre1 ted 1MEBNAL or XIT type

element Traversal of a feature eement within an image rep esentation does never

invo.ve ary change of perceived location. Traversal of tne .nte'relating links which

they provide anows access to elements or elements of the ruage oistmg at the same

localon wlim the same chunk Fe<ture eiemerts of dif ering cn-inks may be linked by

equivalency.

'ine last generalized funcl'onai dass is discussed "-Ow. This n a generalizal'On of

the EM) type image element of the impemented system Elements of this funct.onai

class are u'.ed m .mage chunks *h.ch represent space travers^g image concepts

wh.ch cannot be satisfactorily specified solely by properties of spacc-tr^/ersmg

elements Each sucn chunk has a pair of tnese End-class elements, wh.cli are

eitemally leqjivalenti/l mterre ated to eithe» a pa.r of mtra-chun« or a psir of inlra-

churk spaee-lraversmg elements. Tne EfJO e ements Of the implemented

representation are linked to XIT elements when in UNI chunks, and linked to INTERNAL

dements when utilited >n SIDE chunks Their function is If. link the > implen space

^ I

113

trtvarting concept which it« chunk tmbodits (SIDE or LINE) to the «ppropriett

•Icmim» o* other chun)" «t its ends.

The Petition typo element M 'I het been defined, dxcutted, end implemented it

alreedy sutliciently lonerelized. The epplicetiOn of the futzy plener location reference

frame in cO' junction with a timuariy bound lutzy depth reference provides the ability

to a'.sigi perceived or imagined locations et observed. The Chunk-Header element it

provided as a meant ol gaming reference to an image chunk and to embody general

chunk information, such as the chunk type. As such, with an apprupriele extention of

utefc'e symbois, this element it Sufficiently generalized aito

Thus, an of the image elements (eicept the vJolCKSEE, to soon be discutted) have

been generalized to realize d>si'nct functional classes. It it proposed that these

general element classes may be slraght-forwardly instantiated to realize a visual

mage representation of any probable v.sual fom environment The image

representation of ViPS li an <nstaniis*'On for tne env.ronment of straight-line line

drawings

*>

114

PERCEPTION SYSTEM GENERALIZATION

Th« memories, th« proctitM, *nd th* inl«rrtl»tion»hips e«ithn| Mtween th»m

which art discusstd in Ch«pttr 1.4 form th* bmc system ttructur» 0< th« human visual

processor (FifurM IV.l, tV.2, 1V3) TCLTM «IM play« an important reit, at ducuitri

••rhtr in thii chapter (Fi|ur« V.l).

Th« perctptual theory slated |«n«r«lly it that success.ve ptrlial '•pr«s«nt«'..o-n

of th« ««tarn«! visual environment art mtanin|lully inttgrattd by th« assimilalion-

accommodation process, with appropriate aid from m« recogr lion and incorporation

procets«*, to r«alit« a complete, visual imafe representation. Th« tmal image

i epresentation it capable ot generatinf verbal and drawn descriptive outputs and ot

generally guiding behavior within that given environmental content II resides in ITM

at a structure ol interrelated image chunks. It it necetsary to reca1 nto or maintain

in STM the image chunks ot interest to actively guide or produce such relateo activity.

THE PERCEPTUAL GOAL

Strategic control it maintained by an ever-pretent internal state, the currently

active goal. Tht» currently active goal it fundamental m determining what information

of that which it currently accessible and available it relevant and worthy of attention.

This goal also influences the c'iss of image or other representational structure into

which the currently interesting information it to be integrated. The active goal, m

coniunction with tne currently attended image content, it basic to the determination of

•yemevement and fuation point choices. Thus, the goal influences the structuring and

attending of the perceptual image.

'

115

'he questron «ri^es: What is the source of th«se goai 1ypesT The in<t>al gcal lypt

to become active li pnmeniy a der<v«t ve ot the current overall cognitive goal t/pe

active prior to the mit ation of the v tja> percept.on. An/ sensory stimulation is

interpreted in light of the pre-eostent ana reactivated slate of the system The

subjects of the hoie-movement tis« naa as their pre-sel cognitive goal one reflecting

the desire to achieve a perception c the presented line drawing siftioent to enable

subsequent verpal and draw.ng reproduction. From trvs goal were derived e tner the

goal SEO or me goal "NO, bemg tne first active goals of the two implemented

perceptual strategies

Given an initial goal cer.ved from a pr«-p«rceptiOn condition, the sequent« of

currently active goals is generated through an interaction of the active goal and the

available visual (com and mage (STM) information. Tmt i< the essence of any

»ssimilation-atcommodaton scheme; 'he stncl mterdeoenHjnce between currently

active goal and the currently available information of the image representation.

At any point, the interaction between active goal, active image contents, and tie newly

fiirated visua' .nforn-ation may result in the initiation of a new active goal A network

of uni-ieveMed BO*1 transition'., was inferred from tne observed behavior of the hole-

movmg task. With the avaiiab'lil> Of penphcra. information, some . arkmg of goals,

due to the muliplicity of hypotheses possible w<ln more input information, may occur.

It it proposed that the stacking of hypotheses and goa s withm the v sual proress is

still very shallow, probably of a depth of at most two or three. Tn t is a direct result

of the strong interdependence between the icon and accessed image and the acti/e

goal during as^ mlation - eccommodaton. This interdependence redcces drastically the

value of any long 'ange plan of attack embodied «ithm an elaoorale slacking of future

goals.

11*

Support tor the rolt ot in Ktive goal ((Oil typ«) in the human processing ot vituil

mtormation comes trom several sources eatemal to Ihs th»»is. E/emovement

record'ngs ot reading activity mdcale the goal-onented direction et attention across

hres of presented te«t (Yartjus, 1967). Yarbus reports thet varying the instruct on»

concurring the eventual questions to be aswd about a presented complex picture

grtitly ailers me iubject's eye tuation Ktivity. In more rudit.entary visual search

iMkl involving target location <tNiil ams, 1967;, search patterns wer« «hewn to display

random charactenttics only m tne absence ot nlormaton about tn« search target.

Th«s« studies indicate 'he atlect ot a pre-set cognitive goal upon the subject's

direction of attention withm a presented visual environment Th«ir results indicate the

clot« interdependence between the act ve perceptual goal and the presented visual

environment throughout the Subsequent visual orocessmg activity Area^ e» th« visual

•nvi ^nmunt ar« luated in accordance with their believed relevance to the perceptual

task.

A p »msiing goal liMwis« has bean shown to hav« an «lt«ct upon the

represenUi.on ot th* visual perception. Cnase and Dark (1972) conducted an

e»perimenl mvol inf the comparison ot picture* and sentences tor meaning

equivalency . When the sentence was provided first, the subsequent encoding ot the

picture appears to be contingent upon (influenced by) th« lorm of th« sentence. The

Mnt«nc« provides a pra-emstent goal dnternai state) wtv n guides th« development et

« picture representation suited to the required comparison.

PERIPHERAL VISION

Peripheral vision input, IN prmtary informational ditlerence between the

H-» .

/

117

implemented and |*n*r*lized procttsinf system, appe*. to play two '.igmficanl roles.

First, m conjunction »>lh any currently proposed perceptual hypothesis or Ktiv* goal,

it is instrumental in deleririmng the necessary pre-set range and direction for

performing saccadic eye-movements Hebb (19491 noted tnis role of perpherei vision

input. The use of cutra-foveal information m the selection of a new fmation position

has-been contirmed from data obtained in several visua search tasKs (Williams,

1966:1967). Either the direction and range of a succadic eye-mo/emenl is pre-set by

AA-SYC or « peripheral element of the -jrrent icon (see below) is marked as the area

ot the visual field to neit fmate Vl-SYS, with access to the icon (VI), could then ittelf

generate the direction and range m terms of a f.>ed retina> location relation. VI-SYS

would then deactivate only after proper.y t »at.ng the prior peripheral area, this

posibly involving one or more corrective saccades

Secondly, peripheral vision appears to play a significant role m both generating

and confirming proposed hypotheses concerning the eiternai visual environmunt,

supplementing the more arcurate information Obtained m the fmation point area, in •

visual search tasK involving pattern discrimination (Gould and Dili, 1969), peripheral

vis'^n appeared to supply sufficient information to allow superficial judgements ot

pattern "similarity" and to effect accordingly the probability of toveal fiaation of a

paltorn in a matching task Entemal research indicates support for both processing

roles ot peripheral vision that are proposed above. Directly acquired date ot

E«perimcnt II will be seen to provide data favorable to this interpretation of

peripheral vision's roles m perception.

'

M

118

PERIPHERAL INFORMATION REPRESENTATION

Tha propos»! for the represenl»lion of the panphcnl vision input to th« visual

perception system is to lenerdite upon the QUICKSEE type imige body element. This

type Ol element has been introduced into the proposed representation to realize the

inferred incomplete embodiment of verlea information developed m the case of •

subject moving continuously through an encountered verte« It is this characteristic Of

incomplete representation which is proposed to typify the available information of

peripheral visual input. As such, an appropriate generalization of the QUICKSEE

element is proposed as the entension sufficient to embody peripheral information.

This element, in its generalized form, will be called the Peripheral element.

Elements of this class are proposed to embody a density measure of possible

interesting visual environment character tics at locations of high discontinuity in the

periphery. Which ol the ava.lable peripheral elements ar* considered at any pent is

again a function of the active perceptual goal An element of this class references a

position type e'ement embodying its fuzzy location m relMSr- to the fixation location.

The imagmai space of perceived locations is not known at this («fOmci stage Of

processing These elements fail to provide any interrelating links to otfw image

•laments of the visual input. These two stated characteristics ere the results of a

consideration of eipenment II data to be discussed below.

'hu adequate representation of peripherally available visual information by one

such symbolic element type is admittedly doubtful. This is due to the indistinct

dichotomy eaistmg between foveal and peripheral visions There are not two separate

and distnct levels of visual acuity enisling, as such vision dichotomy appears to imply.

_*..' y—»..

I

Ill

Instead there s a continuous, tnough rapio^ cc ■■■ i ■ ■; level of visual acuity with

input visual ang i eccentncit/ (Mandelbaum and S ojn, ;947). There is not agreement

as lj the actual area ot the visual field consia.red to t5e tOveal vis'O". though

generally the est.Tate s somewnere oelween a i to 3 degree central angie. As such,

thero Tn« distuiSiOn assumes ttiat visual acuity n reialed .0 the amou't ot toaturcs

available tor reoresenta! on and thus to lha type C symbolic elewent which nay be

util.?t'd tor such encoomg. As sucn, tnere may not oe one spent.; eiement t/pe which

is used to represent ^npnerai vision intorrmation.

In tne discussion to toilo* concern.ng tht proposed visual processor, ine

generalizeu QuiCKStE (per.p'ieraO element .s used ihd vonlroversy concerning such

a proposal is simply oemg duly noted r.ere. The basic hypothesis is that peripherdi

v s.on content can De '..'ticient.y represented, oy oscrete symbolic means. The

discussior ot data to loiiow indicates support tor th.s nypothesis.

THE SINGLE (INITIAL) FIXATION

Part 1 ot Enpenment II was designed to give some results relevant to mtemng

what information oecome'. ava labie from an imt.al fmat-on upon a presented line

drawing As such, and as noted previously lOapter 121, each line drawing was

presented for one quarter to une-third of a second duration with the fnation point

beinj pre-set. Immediate', upon removal ot tri» stimulus the subject was to

simultaneous!/ draw and veroame his pa''iai percept on of understanding of the

drawing. Thus, the results not so much reflect the mmediately available ".conic**

memory as they 00 the rttultt of the processing of this input information by the

perceptual system. There is nc attempt to interrupt the processing to get more direct

I«

indicitio^s ot the iconic reo'esenUtiOn (the con(er>ts ol VI in the proposed s/sterp) as

done b/ Sperling (1900). Th» pnmjry .nteresl h»r» s to oetermne whit are the

possini« '«suit» ot th« process"-! ot th» inititl jl»ht». This can yield indications as to

its intluence over the subsequent viiual processing which would tollow

The results mncate that th« mtist glance is rdeed a val.abi« source ol perciptual

hypolhesL-s, in the lorm ot constructed wages »nth hi(|h torrespondenc« to tne

features ot the input mlormation These images serve as tre basis lor the operation ol

the assinniUtion-accommodation procedure, which accordingly directs attention and

develops a tmal consistent representation ol the presen'ed stimuli

The discussion to to o* relerences Appendu A. ■ nation. The appendu conttun

several groupings ot data and associated interpretations Each grouping begins «IWI

the presented stimuli, with a star (•) servir; lo oenote 'he P'e-set li>a!iOn location

The tollc«ing page displays a sub;ecfs .eroa and dra*n response to Ihi presented

stimuli. Following this is a pA^e ol intermed'ate >nltvpreiation ol this re'.ponse in the

lor-n ol pictorial representations ol the mages tonstructed and their reatonship to

Itie proposed icon image

To begin, consider group I ol the appendx As can be seen the ' ..n on pomt was

m the lower tell. Figure (a) ol lh« interpretations page (page 3) « the .nlerred

contents ot the visual mlormation cell (VI) at KM l.iation point There 4 • tun

represenlaliCi) Ol the inmediate, Imated corner ana tne circles indtate per phtral

mlormation elements wh ch embody visual lield oitcontmuitiet as discussed previous

n the chapter. As noted above, no attempt was made to get more direct indications ol

this input representation Through the discussions to follow, 1 hope to snow that this

representation (involving the peripheral elements m coniunction w tn a lull luated

..

121

verluM rapraMnlation) bears some function«! r*l*tionship to th» oblainod rotultt Thit

is still *n uncortam araa, natdmg furtha' aaparimanlation.

As can be seen from tha «afbal and drawn response (p^a 2), the subjact reacts

to tha "trigger* verte« that has been Imated and accordingly proposes a cubic image

for verification. This is seen to lit fairly well with the inferred input information, as

shown in Figure (b) of peg* 3 of the append.« The subject apparently further

notes the amslance of tha peripheral element net accounted for by the regular cubic

projection shown in tha middle of the middle edge of Figure (b). This lead» to

uncertainty in the initial proposed image, and so to the transparent image development

as noted m Figure (c). Tnis response indicates the influence of peripheral vision m the

development of the perceptual image proposals. With no peripheral vision the

proposal would have been only that of Figure ib), as occurs repeatedly in the

protocols of the hole-movement u < W.th the peripheral vision a problem with »hat it

noted, possibly resulting m two rompeting images for possible confirmation This could

serve to direct attention i-Mmediataly to th* trouble spol to determine if that can easily

be assimilated mto the initial sond cudc D'Oject on

Group II is now considered As can be seen the fnation is m the lower left, and

the inferred input is snown M ' s-.-e tal of the ihltrpretations on page 6 of the

■ipprndu Tre subjecl notes that the ealernai outune * that of a square, again noting

the importance of tnat strategy o' . suai perception, as previously embodied by RAAS

for the nole-moving task F.gure lb) indicates how I'M! image proposal could be

related to (drnved from) the interred input representation

'ha "trigger" verte« tnat has been I nated leads to an attempt at three dimensional

interpretation again. Figure (cl indicates a possible attempt at Mtmg this perception

/ :■

m

propotll to th« input r«pr«vtnt*tiOn. Th« sub.ect doct ptuM «pprtotbly |)t*r nodnf

th« thrct-dimtmional pouiDility. Th*rt «ppttrt to h«v* Been too m*ny

>ncen(itt«ncits •■i»tin| ottwetn Ihit im«|t propo»»i and th« input mtormttion. Thus.

th« subject rat irnt to th« im«gt 0) Fi|ur« (bi to gu.d* th« Htimild'On-trcomodotion

procest. Th« need to d«t«rmn« th« interractiOn et th« mwtrd dir«ct«d lin«t *pp«*rs

to be th« jo»! which neit would h«v« oeen utilized, as in RAAS lor th« holo-moving

Again, peripheral vision appears to have a valuable position in the procev.mg It has

provided ■.utticient inlormation to load to an apparently ralh«r certain "sq_.are"

propose lor th« «iternal ed|e w thout lurth«r &cannin| rtou>r«d The imai«

hypot iiiii without penphera vision input wOmd h«/« oeen tne cub<c pro^ction imag«

Group til turtn«r |wes noications Ol both p«riph«r»l vision's power and ts

limitations Two subject respo> ses arc included in this group As seen the I nation is

in th« lower corner ol a Cubic j-o eel or Figur« (a) Ol In« interpret«; Qns (p«g« 101

indicat«s th« inl«rr«d input mlL fnadon

Both sub|«cts report seeing two '.and B-o-• t,pe OD,P Is Figures ID) «nd (c) on

page 10 Ol th« appendm moirate possible "'»"»jt.ons' >■ oelween In« two

proposef object percept O'i and in« mput information There on« 0D|«ct has b««n

COmpl«t«ly bound only to p«r.pn«»al ««■"«nts '.t s not c«ar |h., ,c • , de'i/ed

Irom those «l«m«nts, as th« 'i' ;ge'" v«rt«> ol th« • >al on ar«a has «a to «n attempt

at a thra«-dim«nsiOnal int«rpr«1atiOn n tn« lor«gouno Ths tOu-s« Ol inl«rpr«tatiOn

sur«ly hat som« elt«ct upon tn« d«v«lop'n«nt ol th« proposes cub>c image

interrelating th« oth«r p«riph«ral elements 0* th« visual inlerination Ths ino««d s «n

indication ot th« ability ol p«riph«rai vision to »d m th« proposal ol p«rc«p'uai

imag«s, at on« object proposal mterr» ates toi«ly p«rieh«ral information «latMntt.

/ !

,1

123

êl, botn ^^Djects were wcet' coice'nmi lb» bpat il mte'relationshp ■ ■ sing

Del*een the two ob,ect prcpo^»l4 (See drawn responses) It appears tnat tne

periphera, elements JO not adequately etaoay all Of the mformat.on nertssary' to

propose or rea'ê the eaj ••êncy ana other spatial n'erractiOn re at ons whth »ay

occur betwee" oojects Tyrtner eve tiial.ons are rejy red to tully atveop these

object interract Oh repre'.p^tat ins

In conclusion, the -mt.a ' lat'On -s a source ot perceptual hypotheses Um9$ß

chunHo» These i>ace cûnkl pro..'je a b(M 'o1 sjOsequent assimnalion -

accoroaatio" ^-.-rpnerai "'or-hatiOi P'a,'. a jign.lcant role ■ (orxung t-êse

proposal. The represental on of perpneral i-pul mat is proposed appears to be

tuncVonally adequate as a bMH 'or th« erp'anat Oh ot the be'a.iO' obse'-eo

EVCMOVEMENT SÔUENCtS

Attenl-on n-w turns to a dsCuss.on ol several ol th« «>e moveh-e-t protocols

obtanea through »art 11 o' E^perirrenl II, ippen:.i AxVEMOVE contains tght sets of

data Each set to-sists o' a page iiiuitratmj the eyeôvement sequence ooserved for

a suhject upon '"e I ne drawing shown An tnit at sect on o* the eyrhove^tnt sequence

has ueen approprate'y mlerconnec'ed by aotled IMIM Two numbers are associated

with each dotted fmat.on po M Tne »at On number (•> tne sequence is given, and then

n parehtnesis the dur. i.on of the fnation m smtieths of a "econd s indicated,

following each »yeirjvent ■.eq„ence it a page presenting the resuming verbal

descriptive resp"ns • obtained and the subject's drawing 'rom memory As mentioned,

there are eight s'.ts, two subjects on 'our line drawing stimul. These ime drtwings

were used previuusly m the hoie-movng task No subject recall ot th« compiet«

pictures occurred. This md cates tnal TCLTM images did not p ay a significant rol«.

/

k ^—.

;.

124

On* Eenerjl data d'^ension to consider a th» di.'aliOn of *y* ImatiOn. The g'apn

o* F gure V.17 ind'Catei that (nation duration varies. The activity o' assimilation -

acco-oaation requires vj'/ng j-rjunts ot processing at oach i.nat on point, a'i

enempiifie'i by V1PS Asso^mg that i.iat an duration s directl/ related to tr.e amount

ol ■.■■■■■.■■■.) done at a f'>at<on, this genera< <evei of data consideration does not

discourage an assimiialion-accomodaton eapianatiOn

More specifically. Figure V 18 presents the imation aurationt (or the first four

tuations of t^e eight sequences. In an out one ca'.e, the first fuat'On is tonsistently

longer than the second (actuany the largest of the first four) and th« difference

be'A en their averages is significant The initial fmation net been described as a

source of perceptual hypotheses The duration comparison indicates W such

entcnsu« processing may be occurring at tnat po.nt The eiceptional case nvolvcs a

line drawing which «eludes two overlam objects (as per« ved). As the equivalent

exampes of V1PS ectivity mdcate, this may cause re-recognition (image accomodatibn)

which results m «ppropr ately longer fmation tmes during the ob.ect scan tor

ci nfirmation

In general a relatively lengthy fuation it followed by several shorter Imation^.

This is favorable to th« behavior interpretation proposed here. Recognition activity is

followed by several (nations for hypothes s condrmation (assimilat on) or reiection

requiring image accomoJ..* on. Tn« variability ol hypothesis success and necessary

•nvironment assimilations during confirmation yield th« irregularities m tn« cycles et

fmation durationt.

To facilitate discussion below, th« livation durations hav« been cass'fied

Durations ol 8 to 16 lirtatN of a second «re short (See th« bottom ol Figur« V.17).

/

Hv M

124«

• • >••••••• rifur«

._.

M

124b

Fifur. V.lt

1 2 3 H %i | is to \f IS 1 f» HO to \a •ss ^2 19 o w n 1

«»qwfiK.1

%* \5 \\ i« |

-il 10 U \\

*4 1 as tt av \% !

H3L 1 %0 HV tb

1 H1 1 XX Ho 1 vi !

«4

^

,. ■

\n

fi*i\iOni from 17 to 27 s;«l'«ln5 of ieco^ t'l "(»mea'ttt Fmlions o' 28 to 4?

5i<tiol1s of a in i t'9 leg a'-o tiose tntt fe tor^- iMI *rt v»ry lor-j Tnu it not

a ci«5sific»liO" based uoon (tttittical iiusief 'g

'40w considering *r,p ftr5t e/e-n'Ove'^^nt .ilustration SI In tfrmt 0* fnatton

••rgths the first 'S rntern edâle, 'oitowed b/ two s'ort t'<at.on*. Th« f-rst f.» <• on nas

been noted abo.e as being j provtaer o' propo-.ea pe^-epfual (visual) tmagt". fha

two foiiCwmg QL.C« ' .atics can te tên interpreted as lunctiOneUy confirn.i'-g feature

group'ngs as proposed The fourth ■-nation is aga-n mterrnt jiate i« length, followed

aga ' by two snort ft»a*ions Thus, as interred with tie hole-moving ta'.h, the subject

aopears to be engaged m t c/c.t*l aopcaton of the -ecogn t on process n

lOoperat'Or with subsequent er«?■'nove»»^^^ g^ded by (he assn iat on - accomoaat cr

process on tn» besis of mo'e "nages p-opose': icorstructed) in STM 3otn f «ations 7

and a a'e nterêfliete n 'e-gf-, 'oiiowea r>/ a long tuaton 9. Tn s coud .-dicate a-

incorpo'a: On pna-.e »or f-ose 0B,ects tnus far sat stactonly confrmed The suD)e:t

t'-en commences to rescan the picture, vewing fu-tner parts jf the pclure p'e'iOus/

seen on:/ Ihro^g- pe-pne'a / I oi- Tn.j could be to fully deveiop "e rep'eser-tation

to b'> suffcie-l for orawing purposes

'urnmi to sequence PI, it 4 noted trat the sta'ting fiiaton po^t offers. This

was no' inlenoed, but did ye'd an nfe-est ng rjsu t Agam the subject engapes in a

long first 'iitation, followed by two short • »atons "he higner 'cat on o' tê m t a

fi»at>cn has apparent:, »lowed a oe"e' oe'ceptud "iê b'ODO«..! 'or tne top fifu-e

of tne ine drawing man .n '»qênce SI 'n s has J'awn tne attention of t-e

perceptual process to that figu'e »a'ner men m SI Ths difference 'S not only

indicated m the ere-morecent sequence, but also is carried through mto me seqjence

of fre verbal description

•

> .. '

kH

XYtn subject (P) ulilifts long t<iat)Ons more treqêntl/ than «»bjec* S This couiO

Oe >'idic»tive of a no'e pece-meai «pp'Oicn 10 ■ncO'POf»lion. Tne top obiecl mty oe

.ncorporattd at fialion 4 ana tne •,..- r»ctan|:t '~ tne rrght may oe recogniea ana

incorporated at t.aion 6. This wouid imp;/ an mi a ly heavy reLance bpon peripheral

intorrr.ation 'or obiecl 'ecojni! on from a genera analyse ol the sequences recorded

and those ii'uslrated • the appendu, it appears that srch miti*l reliance is utilised

This is foi'Oaeo b/ a '»scan o"en ^ sit ng teatjre ocations previous^ not tmatea

Ott»" 'a'er al'ention .s reo'ected to areas ol oS,ect mterract on several t.mes,

apparent!/ to conf.r- the proposed maje nteâctions. The .o«er right corner ot the

ngnlnand saua'e s ne.er I »atea • H, «hie other mit -act on areas near Ine tenter

ot the p'ttiê a'e re-'.ialed t'equently Tne sijD.ec! fas ditticull/ «hen ara«.ng th.s

pcture are». T" s «ojid cceiso-o to ("e naa. ;, o' pe'pn»rai .niorrration to

emcud/ oo.ect image mterract o-s accjratey . rotta trom th« singie 'nat on data

discossed above

3? and PZ involve tn« pertepvon ol an mposoioe 0'a«ing *nen con'.iaered three

OimensOn.'l/ Hoie-mo.eme-1 protocol» nvoivng tn.l stimuli «ere prtviOiMly

n • i.'.sed with regards to tne 'nree-d.menvona. eitenson ol tne orcgramêd system

One thing ot interest -n the S? sequence ■'- the sô ect's renance upan per pne'a'

. Mon tpr tne perception ot [he bottom ûbe Ine ''ont face ol tnat c^be s never

t.iated Atten: o' is primari , arected upc'n tne *"-DgÔus lace and edges ot t'at

cube n an apparent attempt at d sampigât on Dsamoguation <% not 'eaied As with

the lO'e-movemeni protocO' ''•'I. tn» .mpiguV caes not nref<»(e w tn |ne .erb« zed

descr.ption, b^t does taose tne j'aaung prpceij** to have prooems

Eye »o.emenl sequence ^2 "as been aspa/ed on two pages, PJia) and P?IDI

■

127

P2(»» thowt the first twtlve ty«-movtin«nt( connected 0/ dotted line«, the fiaetion 12

being a very long daition. This mitiel eyenovement sequence may be interpreted a«

related to the behavior which produces an image which K capable ol living nse to the

initial segment of the verbal'Zed deMnplion, bracketed by "«" Again the front (ace d

the bottom cube has not received any significant fnatien attention. This m.tial

sequence it followed by ten more fnations, these connected by dotted lines m P2(b)

In this sub-sequtn'e the bottom cube <s completely scanned, and then attention is

focussed for two Ic .g fiaations along 1.« middle line of the upper part of the drawing.

These eyemovements appear to bear a correspondence to the second part of the

varbalixed description bracketed by lb). II appears that the subject develops two

distinct picture representations (perceptual images) here, reahung the madequecy of

the ambiguous description for drawing purposes. Again evidence of the pre-set

cognitive goal (the drawing task to be accomplished) upon the perceptual process i«

domonttrated.

Both S3 and P3 snow in« alternation of fnalion durationsd and the frequent re-

fiaat'ng of object interaction areas. An initial scan of the complete picture, which

apprars to rply heavily upon peripheral indications is followed by a rescan to insure

the proposed image's correspondence to tne presented drawing.

Protocols S4 and P4 are important for their similarity in the use Of peripheral

vision to reaiite tnree-dimensionai perceptions In oeth instances only areas of the

front faces are fmated The three-dimfsionai "t- gger* vertices ere fnated and the

n'eraction between the cube and sloped plane receves the eapected consideration.

Peripheral vision he'e is deemed sufficient by the assimnation-accowodation process

as a source of facial confirmation .n)ormat>en

IM

jn1. ff-*» con«..a»-»;o- •»< rw jiv»' »PC« 't HM »y wamimwi .■'•ot»,-fi'<

»••emp»»e *•■'»■ lom» ijf' oes,-j:ont i.-.-o sau Nr " »»■"* c- th» *' v.;!»» o'

furltw »• ■■» o»'» p'H»"'»; •« •»»"> viijs* pa-'i

"•>dt. ',l•0Jg•■ i» ot;oia- o* '** •we »»»»•»a'C»« o' l>B»-'"<»"t :. ott» "v

p-orswo "»o-. o* > 4w* •;>•» Pt'ctpt-O' i»;*»-» •u-'h»- »«e;oa;» or .^♦»•»■■t »

!-Br»'t Ai ^*c»!»a. "^u;•■ -n»»-;- i ■«•are •; |tNw IN Mi o»t* ippMtM '^

•h« r»ti"»m»'»t o' to;' i ••»o-. 0' > f.«» "■*£» ■^p-»4»-•^• o- »>« pe-{»p,^»

P'OCHi "g

/

129

Chtptar 16 Conclusion

This chapter considers sever»! olh»r recent sluQits involving th« memory ot

prifnjnly visual concepts and discusses these proposals m light of this thesis An m-

deptn discussion o' general ct-aractenstics of the numan cognitive representational

system follows, fiitt'y, several suggested directions tor further research will be

ncled as a conclusion lu ne paper presented here

1 Study Comparison

Any choice of studies for comparison must be n.gniy eidutive. At such, three

recent studies have been selected to be contrasted with VIPS AH three involve the

use of a symbolic representation of visuel nfomation m a computer-implomanted

Simulation of cognitive benavar

BAVLOR'S BLOCKS

George Baylor (1971) proposes mat an image representation of a cub« i* en

integral part of the proressrg machinery involved m the solution ot a block

vitualnation task. The subject is given a pamted block description end instructions as

to now this block it then cut mlo pieces The tubiect is required to answer various

questions as to the number of nnultanl pieces w.lh given pamted condition! (i.e. how

/ .

130

many h»vt on« blu* tic«?). At t r«sult ol Ih« «palytn of • verbji protocol, Btylor

propOMt th« «iist«nc« Ot two inl«rractiiig r«pr«unt«tien«l proDltm tpK«( which

bacoma mvolvad in th« problem telvirg Klivity.

"S-Spac«* (symbolic) holds trua |«n«raliMtions (tacts) cencormnf blocke and alto

is us«d to hold an «ncodad (parsed) representetion ol the question lo be answered

concerning th« segmented BlOcK. This encoded question representation is applied to

th« block r«pr«s«nUtion oi 'i-Space* (mage space) by available matching operators

which locate image components lor counting. Fina>iy, an answer is (Mpesilad ir S-

Spece Thus, S-Spece acts as a transiationai butter memory betwdpn th*

v«rbeliiationt and image representation (STM) and as a semantic component ot long

term memory Baylor's proposal K admittadly not a complete cognitive model

Th« block rapresentadon retidmg in l-tpace s hiererchicel m nature. This

structure retlectt the hierarchy ol part containment de block, to taces, to edges, to

vert tes) At the initial block it segmanttd according to the prescribed cutting, other

tpecialixed mterrediate hierarchical groupings become applicable and are used (i.e.

corner, border, center cubesi At tne bottom ;evel, vertices ere interrelated by

spetielly meaningtul unks Although these spatially meaningful links are incorporated

into Beylor's image (I-Spacel representation, this mlormetion appears 10 be irrele ant

to th« taak't tolution and thut alto to the model's operation. The mput question it

parted into a hierarchical semantic structure which then serves as a goal slack. This

hierarchy ot goals directs the altering and accessing ol the hierachical cubic

representelion found in l-Spece Through e matching ol structure schemes, the

relevant information it obtained and placed in S-Space as the answer Thus, though

tpatial intormation it a part ot Baylor's image reprasenlalion, it it net put to sigmticanl

131

UM. Furlharmor«, Ihit imag« it not «cctssed by mtam rtltttd to that of »cce '.mg

e«lfn*l visual mformtlmr TRtK, Baylvr's imagt is not a vitual unaga as dodned in

Chapter 1.1. Baylor's image representation's structure closely resembles the usual

(his) encoding of verbal informat on. I-Space as defined dees net merit the claimed

separation.

NEWELL'S STIMULUS ENCODING

Newell (1972) develops an encoding representation for colored bottles. Ha than

daiines several associated processes which prove sufficient to accomplish a visual

senes entrapolalion task. The salient features for determining the generating

characteristics of the senes, and thus for proposing the nent series element, are the

bottles' orientations and colors Not surprisingly, the representation proposed for the

visual input (and memory) of each bottle is merely a list of (ust these features. For

etample, "(09J BTL VT RED)' represents a vertically oriented , red bottle.

Newell doe» not propose a visual image representation of the visual environment,

even though the information source is spatialiy structured (the series is presented by

a ieft-to-right row of bottles) The spatial structure is representative of the bottle

sequence in this las* A visual image representation which must contain spatial and

form characteristics, would be superfluous to the subject's accomplishment of Ine

given task, and thus is so for the inferred (ystum also. The task can be .nterpreled at

being that of dalermmming the bot' • sequence's generating syntao. A representetion

whiih is processed syntactically has been appropriately inferred. This representation

does not satisfy the visual image definition either.

Two special situation« which are encountered by Ntweli's system during solution

132

0> th« Ink indicil« tht ipplicability el in is«imil»tion-*ccomod»lion procatl. N»wtll

proposes • con$t»ni hierarchy of leitu'e relevancy from en enelyti« ol tubjec»

verbeliteliont on twenty-three tenet entrepotetiont. Thit hwrerchy determnet the

order of feeluret et Kquired on input and et tubtequenlly considered in determnin(

the generatin| tynlan of the tenet Thit constant hierarchy leadt to teveral

erroneous tenet proposals by the implemented system

The implemented system also encounters trouble m achieving the overall senet

organization Newell teyt, 'There mutt be a delay m actually organmni the perceived

sequence, since subsequent objectt have not yet been observed and they may affect

the organization* (p 21). When encountering two l<pe bottles for input (X and V) at d

the first four era at XYXY, the system prematurely orgemm them et ((X Y) (X V) ). If

enolher XV peir it encountered the final tenet structure will be (((X V) (X Y)) (X V) ),

which it inappropriate. NeweM ditcuttet and implements further precettet to perform

the necettary reorganization at ((X Y) (X Y) (X Y)).

These problemt relating to feature relevance and overall sequence organization

are symptoms of the proposed system's failure to use emsting STM contents es the

source of organization and e<pectations The most relevant stimulus feature (or

features) is net chosen on the oasis ol a static hierarchy of relevence. It it (thould

be) chosen on the Lietit Of the current repretentation of the tenet in STM, the current

content. The partial tenet image, at repretented >n an intermediate STM ttale, it «ltd

used to propose eapected overall srnes organizational characteristics. Any current

regularity of the incomplete input serves to suggest a structure! representation of the

complete input. This proposal provide« eipectations end determinet feature relevence

with regard* to tht newly tuated input. An assimilation-accomodation procett can

-

v.

133

than operjt* to not« consisttnc/ ot mm inputs with «apectttionj «nd KCO'dngly

eltect «Ittrttiont, general* new propoult, end determine new >*ture relevancies as

necessary.

For eaampie, fiven XYXY the process constructs an overall series representation ot

( (X V> (X Y) (X Y) ) prior to the input of the lest two elements No *dela," *

necessary, as NeweH proposes. Instead, stimulus encoding (perception) entails early

(hypothetical) structuring which laoiitates subsequent assimilation - accomodation.

MORAN'S PATH IMAGE

In another recent proposal, Moran (19^3) develops a representation to account for

observed suDiecl verbalizations during a path imaging task. The representation

developed there is again hierarchical m nature (as Bt, or) The sequence of line

segment inputs ««ists at the ootlom levei ol the structure, with an organnmg structure

of visual concepts developed over lh,s. The structure is used as the basis (means) for

the "chunking* of mformelion. A smglc symboi of the hierarchy m STM is capable of

representing and activating (recanmg into STM, if necessary) all of the elements which

are below it m the structure

Several task requirements are agin particular y relevant to the design of that

proposal. The sequence of line segments to be maged retains importance throughout

the task. Indeed, the task s staled m terms of "imaging a path*, not a picture (ime-

drawing). The line-segment elements ot the pa;i »re determined randomly. Thus, the

subject has no oupectation thai a coherent, easily recognizable path would be

presented. Actually, the opposite characteristic (of pith randomness) is probably

natu-ally aisumed As such, this appears to have inhibited dependence upon object

/

• -

m

e»pect*lion proposals and forces the Siib|«ct to dovalop « conwrvativ« imige

representelion at all times Partial objects are actually mere to be enpei-ted than

completed ones. This yields a hierarchic repreaentation m term» el realized part*

similar to Baylor. Randomness does not prevent enpectations 'Feldman, 1961), but m

this case it introduces a readiness for partial concept representation as a useful

available continfency.

Some difficulty emsts as to the representation's ability to realize inferences based

primarily upon spatial (locational) interrelationships. This results from not including

localionai symbols m the image representation. The scarcity of protocol evidence of

such inferences allows the inefficient (not straight - forward) implementation of l.iese

inference raalitalions. In the protocols of this thesis, inferences based upon locational

relationships occur frequently. As such, thj visual ima|e it bound to a IramewO'K of

locational (positional) symbols which create an imagmal space

REPRESENTATION COMPARISON

Behavior on three tasks involving the representation of what is pnmaniy

considered to be visual (or visual image) information yields three fundamentally

differing proposals In two tasks (Newell, Moran), the sequence at inputs retains

importance and is carefully imbedded into the memory structures. In two tas^s (Moran,

Baylsr), partial concept represenMrons (due to culling ol a cube or enpected,

frequent incompleteness) are ol importance and a hierarchical structure retlecling

component part subordination is proposed Two proposals attempt to fully represent

the cognitive processor (NeweH, Moran), and their visual representations reflect a

concern for STM research None of the three visual representations satisfy the visual

image definition of Chapter II.

/

.. '

135

In «ach study, tht tMk Mtarmirwt wh«t ttaturct and rtl«t>ont of Ih« visual

information art nacasiary for the succtssful «tcomplishmant of its raquiramanls. Th»

visual modality factor appears to have had much lass affect upon the form of those

thro« proposals than do other task-related considerations. The task of this thosis,

bomg the realization of a porcepton of a given line drawing has likewise resulted in

another differing proposal lor the symbolic (cognitive) -epresentalion of visual

information. In this case the modality factor is the primary task feature. This has

rasulted m a representation satisfying the visual image definition.

2. Flembility of Representation

Behavionsts have long attempted to reelne a parsimonious theory of human

internal information representation They propose that all internal representation is in

the form of mental words Associationitts nave also been in this fight. Recent

proposals state that an memory is -eali/ed M the form of concept - relaton based

hierarchical structures iKmtsch, 1972; ÜOwtr ahd Anderson, 1973)

in contrast, it is proposed here that the representational aspect of human cognition

is a very fienbie aspect The apparent need tor concise representation within our

limited operational Or active memory precludes tne development of a parsimonious

theory of human mformat'On representation consisting of a s<ngie or several satisfying

universals of form "0 content The ability to M f e active information representation

to the goals at hand is proposed as being the primary characteristic of the human

representational system As George Miller has said i

"It seems to me that the ve'y fact Of Our limited capacity for processing ntormation has made it necessary tor us to discover clever ways to abstract the essential features of our universe' (G A Miller, 1967, p49).

!

.M

13t

LANGUAGES OF ART

Tht ditcuttion to follow rtltltt thit propM«! la t mott mltrttlinf trodis« on lh«

raproMntaliont md teuren el ma«nin(. || it « boon by Ntlton Goodmtr (1968) called

Lanfuaget e< Art. In the boon ha aiaclly dadnat a tat of tarmt and precaadt to

exlentivaly compare and interrelate thete into a coherent tyttem of maanin|. Savarai

tuch termt and thair mlarrelationthipt are relevant to thit attempt at describing the

telectivity of repretentatien which n propotad nara. Though Goodman wnlet

primarily to aaplain the rapretentative power of art, tha concepti which ha deveiopt

are utelul to tha undarttandrng of human cof nitiva (mlarnal) repretentatien.

An ob)*ci of the environment 'pottettet* til of thete propertiet for which tha

corretponding predicate applies ano it true. Thut, m Figure Vl.l, objett 0 hat

propertiet A.B.CD. Thete trua pradicatet (« "HAS A*) apply to the object from the

property at a maamnjful reference. An object necettarily eaemplifiet all trua

propertiet which apply at opposite directed referencet. An object symbol (or

repretentatien) pottettet all propertiet of tha object which it repretentt. (See

Figu'e /I.2.) An object tymbol may furthermore eaemphfy any property which it

pottettet. At Goodman putt <t, "Eiemplification n i>ov.cssion plus reference* (p 53)

In Figure VI.3, object tymbol 0 e<emplifiat only prope ' et A and 8 ol those which it

pottetses.

Goodman tayt that "just which propertiet ol a tymbol era eaamplified depends

upon what particular tyttem of syntbolnation it m effect * (P63); and further,

, , ... _*~v A—i » i ■■

.

136«

Rgur. VI. 1

njur»VI.2

I

■ *

(

IHb

Figur« VI.3

Ftfjr.Vl.4

/

* » M r m m*

.

137

"Cdablithmanl of th« i»i»r»n\ »I rtlttiO^s^p il « matttr of smglmg out ctrtam

proparlios tor •ttontion, of s*l|ctin| «soc »I ons * tn ct't»n othtr obitcts" (p88)

Puttinf th«M two st»l»m»nts tOflthtr, ctrtun prep«rl>*s th»t «ft pottcstid by «n

objoct will ba o* >nt*r«(l, which propcrliti I'l •■•mplifitd by th« chostn objtct

symbol (r«pr«t«nt«tiOn) i 1 MJOC'itod, p*rt>cul*r tyttpm o» iyoo ,z»'. o* will b« >n

•ftpct M » rotutt.

In th« Ih'ee comp«rativ« stuo^e», «nd m thit tn«t't itMlt, th« Ink l««dt suB^cts to

dotcnun« which prop«'ti«t Ot In« >nvolv«d vKuli mtormalion «r« n«c«ss«ry for its

successful compl«tion Tn« iMk d«t«rmin«( which prop«rt>«t rt;«iv« «tl«nlion «no «r«

«■«mplifipd by th« nwmory r«pr(t«nt«tient. A syit«n ol tymboliiation '«Jull». For

«■«mpl«, only th« prop«rli«> ol coior «nd er>*ntat.on ar« «i«mpli|i«a by In« botll«

Ob,ecl r«pr«t«nt>lion« ol in« sy>Kbo>iiali«n lytttm propOMd by N«w«il <see Figur«

VI 4)

Goodman defies Ih« uselul concept of *r»pr«t«nt«tion-at* Tht t«rm a t'e's

from just plam *r«pr«t«ntaliOn' Whil« *repr«(«ntaliOn* involv«! Ml«ly an oporatipn

ol (»«notation, "raprpMntation-a»" mvolv»» ooln d«r>otaton ana ciass'lcation.

Classilication it i«l«ctivily o' «>«mpiilical<on Thus, dass'licalon naturally alters th«

term ol r»or«»«ntalron at thown by th« study ««ampi«t. Th« human «b'i<ty to

"rap'«se"t-at", which it w«ll d««onslral«d by artitli' accomplishments M noted by

Goodman, it «»actiy th« llanBil.ty «I reo'tsantttion which it b«in( proposed.

In th« visual image rapresantation prepetad by thit th««it, a block it

"reores«n!eel-as" a tat (tlructur«) el mtcrrtfatad, non-hiararchic, laciai-proieclion

repress ationt (image chunks). Thit form el symbolic representation facilitates visual

recognition and process »g as hat '»een discussed A complt» hierarchy ol Obiact

/■ M

m

tor »»'c •"! ust 0> th» . >u«l oroctiSO'

As Ouu. IB pr»dicts, tf» iyjtltri ot «y«*0< Z»t'On w" ttl htvt M«'' nfe"«0 10

«ctOj^t «0' ^» oos»'.ea s-o^ct Mh<v<er on f»« t»»m o' e«" il*a, a"*'

»'|n.(ic»"tly from »Kh otM' V»t »K^ .n»#»r«d f»p'»i»'M*t'0" MtQwüt , fcooet

tn« n»o"<>Jt'OB wich if »uft'C»"! fO' t»» «CCOmp^jUmer, of !"« g .e« lasts - •ac

O* PJ'S» nj in jrju'»«"t 0' COit-ct h«f« ts 10 w :■< propOS<> s C OS»' '0 I«« COitt"!

»«0 'Or"" 0' » 'ul'vtrs»'" r»prts«nt*t>ei ( w»»»1 6* vi»u* r'O'wjt.O". 1 el*"« Ii*t all pf

t"«s« StuO'M «t'v». fi cone»'t, »s i«it.«. r»Si. ts SuPOO'l nj • |*n«r» I-«Of y 0*

•»B-fS»»:jt'Onj (»■ 6 ' !,

A TMEOSV Of COGNriON

Wh- • SOOOmc's :tf- "»v» >>l#f.t. h» 3C»S ng- .», »"Ojg" H» sots *ot afta'pt

»o desc'>e« !■* rOfK'tvt syst»» »"e" '»«•s poss o» f» us» o' ;-• '»e'»s»-'«tOB*

• n • »s mrtt* h» proposes. ►• uoos -ol 30 t- ? <> -e <s Otn^f g3»s '•'» (OJ 0'

MM tr«s s, on tht otn«r -j-a. s »n;t / lo Msc s« ■s.- y oot'tliv» coint..*

t>»t»"i Th«f»(or», i"« fO'0»'"| ti#o'y » p'^s»»!»« *"• •''»O'y t<"B0*»3 D» VI^S

s « so»: ' C Mt»«ti«l on 0' •- S I»"»'» IntO'y 0* tO|" t on i'O»»«, '"» sp»c • c»' on

0* j ln«0', 0' *ny ciiss 0* .3J-" 0" mud 6» I'O.-oea n in Ok>'< •-eo-»' . • Das s

Of »li cognit on

Th« Das<t o* a. :;;-•'- s •»0'»<»-ra* o-» «nowi»3t» 'fS'fs»-'«! o-a

Kno«l»0(» -, C<nb00'»d Of O't t»"n ~r~C-, .O'J •«'"• •■«-•0'( S a CO>np«>

(•"•nt'C StruClu'» 0' S/fnOOS »no •» at On». A 5r-;o s a "00» m In» -«t.o n-'ikt

lonf tprm -e-^r^ ttnxlu'» A '»lai.On s a a '»dta conn*cton o»;.«- too IwO

'■

i39

Symbol» Bting t Mmantic ttructurt, long tirm m«mor/ s < rtpr«wnltt<on of m««nin|.

Th* mtcnjng ol * svmbol or rilat>on it dafintd by (to M) it« lotjtion witnm tha long

term mcrrory ttructjrn Relations »r» tlwa/t pa>'td A pa<r 0' ralations is said to ba a

properly of the symbol from «hicn both relations ari|inata One relation of the

properly pair references a symoai which labels the Ml between symbols vtadl the

other relation constitutes. A symbol is sT^J y a group of relational properties A

tymool may be COnnecteo oy relations to communicable components of a langjage-

based substructure Of loig term memory which allow its eitemai enpression. A

symbol may a<>0 be connectao *o components of the various modalty-specific

perceptual systems whicn allow it to be used in tne perceptual act vity and to be an

etoment of the resu Unt perception

The Symbols and relations of cog-'lon are physca f emoooied m the ttructjrr

and tne patterns of activat.on o' tne neurons of the brain Bram neuron act.vty can

be ds) effected by the activity of tne compete centra nervous System Human

benavior not invoiv. ^ the use of syrr.Donc represenlat.tn is not cognition For

eiampie, sample relieir act<ons da «nee tern -e'?■ appear to be based solely upon

iower-order ner.e ceil stales Mm (sensory, motor, ana spnai)

The symeols, relations, and structure Of long term memory develop as the product

of In« organism's (person'si continuous attampl to adapt to (represent' ts

environment The p.ocess of representartionai adaplal On s an evolutionary process

At such, ong term memory is a function of an innate MM slate, of mnate potentials,

and of the history of its involv ient m all cog" t on Due to the evolutionary

character of long term memory, If« cmttence and meaning of any symbol s

necessarily temi-permanent

'

•

140

To Ml*pt tc «n •nvironmcnt i> lo 6e c«pat>'* Of •»•ctin( tuccttttul (Ml«qu«t*)

b«h«viOr withm lh»l environment At lh* bMit 0* cognition, long term memorir must

roprosent not Only an •nvironmonl but «iso tht "mint of r|tpondin( to *nd Kt'ng

upon !hjt onvironmcnt Thcrttor«, COfnitivt procesMS •'# thomtolvot ttruclurtt Ol

tymbolt *na rolationt th«t >rt D»'t ot long t»rm moinory To b« op«f»tiv», cognition

ha» on« roquiromonl Mttrnd tc long torn momery Cognition roqui'O« • <ytt«m«t>c

Cycle Ot long torm mtmory KtivitiQn «nd int*rpr«t«tion. It it tnit th«t lit« »no tint«

P'Ovid« (or «ra).

At p ocitttt »'• tmbMiM witnm long torn momory, it it BOtn tn« m*tnt and

product of its Own avolulion Long tarm mamory e.a -et by tha action of ihr»»

procat» typat Tha procattat o* r»-namearing incorporate selected e-viron«n«ntai

tactors, created by other task-related procettes, mto the long term «wmory structure.

Development» processes determma the state o* availability ol innate potential*.

Learning processes altar long lam ■namory m tnrae ways. On« is the alteration et

easting symbol and -e'll o" meanings b^ tne »oa Ion et new r. '«tiens which

restructure o* >ong term memory Two >s by tne creation ot new symbo's and th«

incorporation ot these into long term memory The third s by developing »ctivalaO •

structures as rules and environmental factors suited to tne oipecled tasks

At any point m time (dur ng any cycle of Ktivat.on and interpretation) only a small

traction ol long term memory it active or teiectivei/ attended Th« active memory is a

representation ot currant contot. Active memory tonsstt Ot a set ol »nvironmental

factors and an active rule ol a cognitive process (the active process). The

envi'onnenlal lector is tne un.t of cententual environment representation The rule is

tha unit el cognitive process. At e part ot long tarm memory, th« environmental factor

I

'■

141

and lha procttt ruii art both ttructurn ot tymbel» *nd r«ialiont To dafin« »n Kt>v«

raprtMntttiOn*! ty(t*m (tg vitual imt|*ry) K t« tpKily tht tymbolt, lh« r«l«tiont,

and th« ttructur« typtt which contlilula itt unit« o< Ktivtlion (•nvirenmanltl factor»)

To dahna a cofmtiva process it to do tha tama for its ruMt.

Th« tat el anvirormanlai fKlors whicn ara Kliva «t tny point in tin« conttitutot

tna ar/ironmanlal contaul lor tha activa ruia dunnf lhal cycla of activation and

mtarpraUtion. Each activa anvironmanlal factor play« a precau-ralatad function anu,

at tuch, it taid to ba (ba m) a carlain cowpenant ol Ktiva mamory Tha potubla

functions ara definad by ana cutt with ragards to lha Ktiva procatt rula. Ganaral

charKlaritlict of lha ttructura and conlanl el an active anvironmanlal factor are

datarmined by the function*, 'oa it playt. Thut, a currently Ktiva rule datarminat the

general nature ot it« repretentalional anvironnent. COfnitive procetta« eutt en th«

basis ol a task to be accomplished (adequate behavior). At tuch, general

characteristics ol the current environmental repretentation are indiraclly related lo

the current let».

The llenbilily of the anvronmantal repratentalion to «ml the currant conteil to

the Us« at hand s necestar ly 'ettrided and imperlect At any lime, lleaibilily it

bounded at the eilreme by Ina cunantiy available symbols, relations, and «tructure ol

long term memory. Tne flenbiiity is a>«e limited by the evolutionary «late ol

sophistication ol the active rule« (procettet) «nich become involved m the task,

solution. The tiate ol procatt tophitticalien and spaoa'-iation it ilteii inversely

allecled by the tymbewt and raiationt which are avanabia lor activation at rule Or

environmental factor contents The state e' erganttm development delermmet the

availability ol innate potentials which alto allact the range ol llenbility Selectivity of

activation it the operational äquivalent ol Goodman's teieclivily ol aiampiilicalion

'~

'ww .1

142

Upon th» coinnwnctoont 0* «Kh cycl» el tctivition «nd intcrpnlation, a rula and a

sal ol »nvironmantal '»cto's ara activatad by »alacliva attantion. Thara ara savaral

fanaral cnlana which delarmna this opoction Tha rula % talaclad on tne basis ol

th« currently actva procats (a partition ol tha cognit.va rulas) and on tha basis ol tha

contantt el environmental lactors which have been active durin| the iiwedialaly pnor

cycle (primarily) or during one ol the peat several cycles (recently active) The

environmental lactors which ara activatM initially are determined m conjunction with

the rule selection. They are a selection I'om the recently active environmental lectors

which determine tne rula selection and which are the'elora activated to play functional

roles with regard to tn« selected 'u« Ounnf tne cycle ol activation and

interpretation, further symbols, relations, and even environmental lectors may be

activated. This selection is determined by tne active ruie and by the meanings ol the

already active environmental lactors

An active rule or environmental lacior remains ellectively imeedded m the Overall

long term memory structure, thus lacmtating activation el any closely related

knowledge The recently active environmental lectors and tne long term memory

closely related to the currently active memory constitute a readily activatable Innge

ol consciousness" As the phanemenologitt Huaserl steles, the local it girl about with

• 'zone' ol '.he marginal^' (Hussarl, 1962, pl07)

Perception it the cless ol cognition which it the active mterprelation by the

orgemsm ol the stale el a subset ol its ceils The cent which ara interpreted ere

either a part ol or have a direct, allective im« with the organism's surlace. In an

organism ol sullicient compie>ity, these cells are modalily-tpecilic sensory receptors.

The ttetu* Ol the sensory receptor cells it the one lurther determinant 01 the

143

•.elective Ktivttion of environmental tKtors which occurs during perception An

acliv* rule of i perceptual proce» can activate ne« mvironmenlai tactcs on the

basis of currently active en.ronmental factor moanings and the states of selected

receptor ceils or recepto nl comomations (receptive fields). The result of this

interpretive activity is a Symbole representation which it constructed as an

mterrelateo group Of environmental factors

Conscious experience at an/ point in time is me internal phenomenon which

accompanies (results from) the activation and mterprelütion of the active rule and

environmental factors. Conscious enpenence is not the contents of active «mory. It

is not the active and causal "stuff' of cognitive oehavior but is merely the

epipnenomenal creation o4 that benav.or Tnis is not to der that conscious

eapcrience may itself form a oomam of representational knowledge m long term

memory The activation Of any part of that representation >n the tonte«! of an active

rule and Other environmenUI factors mM necessary result in a conscious enpe'ience

wh.ch differs from the Oftfinal (that represented).

Conscious eipcrence is reialed to tne meanrgs of the symbol structures of

active nemory Differences hefween conscious experience have two sources One is

an actual diffe pnei m the contents of active memory (m terms of activated symbols,

relations, and st'uclure'i T"* otrer is that tne meanings of me activated long term

memory elements have been alle'cd Dy the intervening evolution of long term menOfy

Due to tne changes of symool meanings whicn accompany this evolution, it may not be

possible to recreate (reenpe'ience) a conscious event even though the contents of

active menory arc identical with that of the past experience.

.

144

PSYCHOLOGICAL INDICATIONS

A study by Trabnto <nd Bower (1968) illustntis trie flimbility of «clivt

memary O' the 'eleclivily o( "representation-«'. Ley presented subjects with tirds

showing four letters >n a row. The task given was to sort the cards mio two piic. on

the basis of the second ieter being L or B, for enample In learning trials, letters were

randomly paired with L and B m Ine olner positions In further trials following

learning, tne letter m the fourth position was consistently paired with the second

position de. 0 with L, E with Bi During these trials the subjects were required to

ret te all letters while torlmg the cards on the basis of the second position as before

Following this test, trials were given m which the second position was left btan» (no i

or B). No subject could correctly sort the cards even though the letters m the fourth

position (0 or El were shown md could serve as a basis for sorting Thus, see ng,

recognizing, and verbally repeating the letters did not ensure (cause) sanction of tne

letters in the fourth position as a part of the active environmental factors upon which

the action of the active rules, and thus be-.. was based

Recent research m cognitive r.schology has oegun to provide evidence (and

proposals) for the multiplicity of internal information representation. Tversky (1969)

hat produced results which indicate the ability ot subjects to represent the same

stimulus m visually and verbally detem.ned structures m STM. The mode used reflects

tatk requirements and thus indicates llanibility. Paivio (1971) also presents results

indicating the use of both visual and verbal memory representetions as mediators m

association and recall tasks.

The human ability to produce an internal representation which represents (hingt

/

•s is nece&sar/ or suHtcienl tor the t«* ^, h^na ,T. mo'.t vÄ'uAOie A', wth an/

orgamsmic charartenstit, Nut abnity it only «n mrAte potentiit> tt * predicted that a

person without a "ei'bij representational iystew may not pe'torm as *eii On some

task'.. Such lasKs which do not easily conlorm to the • reguUr mode ot representation

may prove ditticult or insurmountable L.euem-an U9'? Cti'^ed Out a study involving

a task which requires mental imagery (ci a cuuei n coordination win sequent.a' goal-

diret ted behavior to solve a tiiree dimensiona. r, a;e Pre-e-per.-nenlai tasks were

conducted to classify people as beng good spa' a magtrt< good eroai representers,

or both Preliminary results indicate that having ooth ab-iities, thus representational

lleimility, shows postive correlation to the degree ot success realised on the compli»

ma?e t>sK, These Imorngs are not over a statistically significant base and thus are

only preliminary.

Two other recent studies appear to indicate rep'esentalionai lie«ibiiity Trost

(19711 showed subjects line drawings which varied both in spatial orientation and m

semantic category The instructions led the subjects to eipecl either a recall or

recognition test following the mitiai learning per oo Tests were conducted to

dete'ime it the instructions had affected memory organiiation (representation). The

resets indicated that they had LoMus (i9'Ii conducted a similar comparison and had

similar results (or a task involving continuous paired associates

RELATED PflOPOSALS

Morowitt (1970) fits proposed !hre« basic modes Of memory representation. The

"enactive" mode is used to represent actions, enemplifymg features of direction and

force. The 'image* mode it used to represent spatial information. The "lewical" mod*

'■ ,♦1

Hi

CO"S St« a« g-ä-~»'<J whic» Cli 'tprttant »«ntmctt d-g»<|l< «nd sea^n! i,

.nlOfmitÔ« •« f»"»'»l Tr«$t "-oa»« *'f d»rmtiv»t 0' th« "»n»cliv«", "cOmc". »nd

"»yoo^c" -oa»i w c '»d D«tn dtscota D, BruW (;964).

94s*d upon a lu'vty 0* r«'»v»-r piytioiog :* »na n«ufOiO|'C»i rt%»trri, John

'iSfc""1 OfOpose» th« e« st«"c« 0' two 'ep'eMnUton* s,»ltm citMM Th« "soec'ic'

iyi'.e-* it tieo to seise/ istimu-i - oojiol »ct.vil/ n «'« PIC »id VI income memo',!

0' VIS'S. Th# gene'J1 sy»t»m 'e' e:t5 'epet t >«, MMMM »ct.vity not a"e:t ^ t ed to

ttnsO'y nput leg RlTM «no LTM 0* VI^Sl A sp«c I'C .,ll«T may mtarr«! with «

|tner»i »yilam du' "g ct't»." sti». o' dt. pt'eept o" o» VIPS)

Witn tn» -»tu'n 0* COwplfi nttrn»; 'eprtt«it»tiOn to C't*0ility t'Oi" ts .0n|

ce- o3 of iot>ng eatt«t » 11 ntâviort'«, rttaa^n nat producad stva-a Doo«t daai>n|

witn tha «pp. c»o r < o* var Out "t3'-at 0" raprasantat'Ont to tattt s' tn«

anv.'On"i»nt Vnja' Tn.nn'fg C/ A'nna.n (HTli »ttawp!» to OasC'ip« tn» JB I«» 0*

visual imaga'y and ■■ -st-ata» '» »ooa-ent uta 0/ "ta'»$! "g aaampiat l*o»'*<K»i -

Vnuai ~hinkin^ Oy Mc<im i;372i p'etant« fra raada' «nth a tanas o< tai^s to oa

parto'mao us rg -age', rap-esantat ons ana dtcutsas tn» »pparant appicao ty ot

fis moo« 0* rep'asantat on to f-esa Synacttt by Go'don iJH;1 d'Stussat tna

'so cab I, ot "rap'asantal'O' by anaiojy" to tna MMW o* 'at»»f co-npai caativa

(angnaa"n|i ias«s > '"a lâg» 3' '"a City, ^>ncn liitO) nvastnatas tn« natu'a o'

paooia"s -natrofy rapratantations o* citias ana a.c.utt tt faiavanc» to »utjâ city

aasen Ciauda L«vi-St'autt dtc.tsas ;*• natjra o* culturally basaa tetamc tymboi

ttfuctur«» and th« 'orcat wnc- causa tn«if a:ta'lt'On n "-'S boo» Tna Stvat» Mind

/

1«7

THE TOtE Of REPRESENTATION

This thesis proposes that the symbolic rtprescntat.on or image of any body of

information is ustd to gu>de behavior with regards to tnat mfurmalioa Behavior at a

global O' -'r.-.teg e level H based gpon tnc structural character.sties of the information

rppresentatiCi being employed. The oca (actual) 'values' of the information

structure's elements determ-<e the behavior at the tactical (specific silutional) level.

The structural characteristics of an active representation, the types of relations

dna symbois emp oyed, are fundamental M oetcrminmg the classes of inferences the

cognitive processing system can -ei' re These readily available inferences, proposals,

or rirpectat'Ons are m turn fundamental determinants of behavior The inferred

representational structures o' this thesis (and the others do not only embody

efficiently the information relevant to the tasK given. They also determine what

inferences may be easily made concerning that information and serve to guide (shape)

tne uehavior at the strategic ievei

Computer science research hat investigated and demonsl-ated the important role

of information representation n the «complishn-ent of a given task. Indeed, anyone

who has done any computer progra-nminj at ai soon becomes aware of the important

function of information representatiori Various representations have been formally

studied and shown to have '^po-tant effects upon the efficiency (lime) of p-ogram

operation, upu" the amount o* memory space requ red, and even upon the ability to

successfully comple e a i;<vrn task Tnrse results have appeared m the area Of

artificial intelligence (Amarel, 1968) and m iNi computer science discipline m general

(Knuth, 196S).

) .M

.

148

3. Futur» Rtttirih, Conclusion

All aspects ol visual perception, ima|try, and inlormttion reprtttntation require

further investigation If any progress can D» sad to be mad« by any ctudy now, it is

that the study suggests or begins to dalimit areas lor future eiper.mentation

E«p«rii"entation is morl fruitfully earned tut in light of an enstmg theory. This serves

to generate questions and hypotheses (guides behavior at the slategic level). Though

subsequent eipenmentai result« may eventually lead to the Iheor/! final discredit, the

theory will already have proven its value as the source of investigation, of new

Knowledge, and Of the associated "scientific revoiut.on" (Kuhn, 1962)

This outlook is at odds witn the recent statement by R t Shaw:

"To a theor'St B, mach ne A» is a mode of a psychological phenomerpn A to the e>tint that B can use A» to answe' questions that interest him about A" (Shaw, 1971, p )

This is not my understind<ng of scene». Rather, a machin» - > model to the entent

that it generates nterestiig questions and provides hypothetical answei- agamst

which empiricjl results can be compared ana m light ul wh.ch empirical results may be

interpreted. A machine is also a model to the ettonl 'hat it can be altered (can evol/e)

to account for subsequent confLctng indications wmch do not merit rev': ' cnary

measures.

By providing a needed ana well specified theory of visual form imagery and

perception, this thesis can serve as a significant source of research ideas The theory

/ •

■..

149

h«s 'h« backing of lh« io<*l d«l« t'C wn.cn .1 hn bean mferrad Alto, a< indicated m

earlier cbapler», m« attempt h«s ee«n made to make the interred procetting tyttem

consistent with ealernal, relevant ptycholot'cal retearch and to eirplam the visual

perception and image'/ phem^mena observed therein

In terms of general cognitive t/ttem characteristics, further memory research it

necessary Further STM (active memory) research with visually presented (timuli that

are not jut) letters or woras which transfer eatily to equivalent verbal code» is

neeoed to heip determine the amount of mfgriration retainable and to fain further

ideas concerning its possible reprrsentadon Further research is needed to better

determine tne structure ana operating charactensitict Of recognition long-term

memory To answer such questions as, "What partial information is sufficient to

suggest an object's enstence ('»cognition)'", 'HOW easily can new objects tor

recognition be entered and now is this accomplished»" "Is the operat vt of Ul 'M aerial

(seqoenliai traversal of a dec<s on net, as proposed ne'e) or parallel1" further resu ts

are needed

Active eipermenlation s j>so suggested witn regards to the determination of tne

enstence and characteristics o* an nifmediata te'm memory This memory has been

proposed ne'e as it nta pro.on useful in accounting *o' tne observed behavior There

it st il msuffic ent evdence ot 1(1 enstrnce and seconaar.iy of it» characteristics The

e*.stance of an intermediate 'eini memory w tn the rapaOmtv 0* niaintammg recent

IO-'.'II (actors in a readny access.Df stale appears likely The eotMMM of TC, 'V as

def'eo in Chapter 8 also appears ineiy to me Tn, conteit capability (characteristic)

o' cugmdon is not satisfactorily eip amed by a memory proposal soeiy m.oivmg the

classic snort-term and long-term i^e^nes

'

' ..

;60

At for tha propotils rttovint to th« •■pitnation ot human vituai information

p'ocestmi (imagery, perception), tavtral araa» for rttaarch ara "d cataa Furthor

mvast galion of tha roi* piayad by an Ktiva cognif,.» goal in visual procatting <t

nacattary. Th« «ffact of goa's upon tna fraction of attantion and tha rapraianta! on

0* tna raalnad parcaption tea- ■<;•. turlhar mvattigation and tpacilication

Rataarch with ragariH to th« functional rola of panpharai mfocmation m vsual

perception <% necattary Oa aiparmam coua nvolva tha masking of a pra-set

ti«at<on araa to help detarmna tne type of informal.an contained m peripheral inputs

ana to what use this information can be put by the visual system Indeed, can vis.ai

fO'm perception be 'ri tri when only peripheral input $ allowed * If SO, how is the

process a tared * More neurological studies to determine nerve and nerve-complei

detection abilities of the eye can also yd some needed mput to theory development

Finally, further a>per<mentation is needed to investigate the information

representation capabMies of the human Besponse time eiperiments, operating under

tha assumption thai tha length of time to derive an answer it directly related to the

directness o' the answer's representation, can yield vaiuaole results Etperimentt

which induce one n<ormal>onai goal and then prooa the ability to answer uneipected

quaslons concerning the s*-e body Of information, may yield further interesting

results as to the fieubnty and specificity ot of human memory repreteniationt

Thus, by developing a completely operational visual system bated upon mferencet

made from observed subject behavior, a more fully developed perceptual theory i«

here proposed than >t possible 'rom more restricted eipenments Though much of the

theory it highly questionable, itt value lies m the area* of research which it outline«

(or further inquiry toward unde-sta-amg.

v v^..

' .. '

151

REFERENCES

[Adcrman 6 Smth. 1971] EipMUncy at ■ Mterminanl o* (urKtional ur>t% in pefteplui' recognition. Co|niliv P;ycholO|v. 1971, 2, 117 129

[Amartl. 196B] 5 Am«rel On repre^e^tat oris of problems of reasoning about actions Mjy ninf Intglligerce J, New York: American clsevier, 196i

[Anaerson Ä Bower, 1973] o-n R. Anderson ( Gordon K 9o«er Human as^otntive merwor)/. Washington, DC: Wmston, 1973

[Arnneim, 1966] RudO'Pli Arnheim fax JQ(J v.mal perception Berkeley, Cal.: University ol California Press, 1956

[Arnneim, 1969] Rudolf Arnheim. V.sua: Inrnking Berkeley, C»i: Univernty of California (Vets, 1969

[Attreave, 1 .54] f Attncave Some nformat on atpectt of vitual perception. Psyrholagical Review. 1954, 61, 183-193.

[Attneave, 1957] F Attncave Physical determinants of the judged compienty of shapes Journal of E»Berimenlal Psychology. 1957. 63. ??l-?27

[Attneave A Frest, 1969; "ne aete'^nation of perceived Indimensional orientation by minimum criteria Perceolion gflj PtvihOBh^sict. 1969. 6. 391-400

[Bar;iett, 1917] Fredenc C Bartietl An enperimentai study of tome probiemt of perceiving and imagmg BM.sh jayuji ei Ps^cnology. 1917, 8, 222-266

[Bertielt, 1932] Fredenc C Bartel! Remer.pering. g iU^ a eiaer -nenlai gefl jaiui psychology. Camordge. Cambridge University Press, 1932

(Baylor, 1971] George W Bay or A treatse on the mind's eye M empirical investigation of vtuai mental imagery PhD. Thesis, Camegie-MeMon University, Department of Psycnoogy, 1971 Also issued as tn'ee reports from Ine umversite de Montreal, Institut de Psycholog«, 1969-197J

[Bower, 1972] Gordon H Bower Mental imagery and associative learning In [Gregg, 1972], 51-88

[Brooks, Hit] ce R B'oons Spatial and verbal components ol 'he act of recall Canadian jiitlDii ii Psychology. 1968, 22, 349-368.

>

152

[Bruner, 1964] jcromt S Br ,-e' Tn* iOu'%t 01 cogmtwc groaith Amencjn Psiicnoôgitl. 1964, 19, 1-15

[Btjgeltlu, 1971] 9 R BugeitKi The dstmilion ol th« im«(t In [S*|*i, 19711 49-68

[BU^MCII, 193b] Ilia BiJB-S ICSi ll pictiif^. Chicaio. Univertity ot OitigO Prm, .936

[Chi««, 1973] W'lii*" Gu ChaM, »oto' Acid«»': Pre»», 1973

nlBrmilian or8;ittin|. Nt« yof»

[Ch«»« A DfH, 197?] Wltiim Ü Cha»e t He'Cert H D»fK Mtnlel operation» m me compenson ot »enlence», and pictures in IGreiJ, 1972], 206-232

[Clar* < Cna»e. 1972] nerbtrt K Oe»» S Wiltiem 3 Chase On the process ol companni »ententes agarsi picture» ^Qg^;tive Psvcholn^v. 1972, 3, 472- 517

[Cr*>, 1943] KJW. Crai» Itt mature al eiip,an|i:3n Cambridge- Uni/ersity Pre»», 19743

[tbbirghause, IbSb] MtHSU. ' to-V B-itiOn ^ enpe'imfntal P'j^hP'Jly 'ranslaton- New tor«.: Dover, 1964

[Fagan, 1972] J. F Fajan Intanf» recogntion n-emory tor face» Jßütfl*. fil S«per,ênla; Cr_a P'-^polog^, 1972, 14, 463-472

[farey, 1971] Arthur Taney Toward »n underttano.ng ol vnu»! depth perception: a »urvey, Unpub>i»hea report

(Fe'.dman, 1961] Simulation ol t.ehavior in the bmary chO'ce ejpenment Proc.

Äeilicn Äü Ca=a. Cai. H61,19,133-144

[Fernald, 1912] Mabel f Fernaid ""• diagno»is ol mentel imagery ■>'.jt:'.UiJiik* tAmogrtf^, 1912, 14 ,A' oe No bi)

[Fe%tinger, et al, 1967] tllerence »nd the con'.ciOu» experience ol pe'ieption

iULOii 8l LtfifitJtiatil "•AtLa.vg* MOOUUSIL '• 967, 637

[Fro-il, 1971] Interaction o' visual and semantic codes in long term memory Unpublished PhD the»», Univer»ity 0» Oregon, 1971

[Gib-.on, 1966] Jame» j. Ribson. XUt '-«nse» i,o*: dered JJ p^rêptual jy^ltm» Boston, Mass Hougriton Milti,n Company, 1966

[Gonbrich, 1960] Ernest H Gombnch C^ |Qg :iii.i,on. Ne« York: Pantheon BOOK»,

1960

[Goidiamond A Hawkins, 1966] Goldiamond, I and Hawkins, WF Venervertuch: Ihe

I

;b3

log relationship Mtwem W0'il-tr»qü«'><y »"0 '•t?,.,iiliOn oblamel m in* »bi^ntt ot shmulji «OrS» .'Qufnil ti E«p«- fitritti PifLiia.aff. 1966, 66, 467-483

[Goodmjn, 1968] Nenon Gooam»n jn^êj Bl Sri, el dCBIflitÜ tfi i ICSSlt Qi symbols Indnn^po ■*, Inaanj Boot^-Mtrr,.', ;9o8

[Go'don. 19*1] Si>n«tlirt. [rjt o«/«IQp-^f-t Qi er»*:, e miS.lt. N»« *or« i-arpe'. 1961

[Gould A Oil, 1969] Eyt movement parameters jiU pjuef amrKmnjt.on PtrcepliQn

«nd SwtfiflBtUiitS. 1969. 6.311-3?0

[Gregg, 197?] Lee W Gregg, editor Co*BiLfi£l in ItitSlEt «üd Bernau '«■," Vork: Wiiey. 1972

[Grejory, 1966] »itnwd L Grfjo'/ L^t inj kUK 'he psyrho ogy ot leeinj ".e* York McGr«w-Mill. 1966

[Gregory, 1970] Bith»rd L Gre'.or^ Iflg inttiliital tit '•• Y0'»; Mcüfiw-K.l, 1970

[M»o«r, 1968] Pjpn ^ô•">«'> >i<oer, »ator Cfir.'v?C«2UIi 'htBD enfl retf«i;>i ^ Wiu*! eeutBliOl Neur V.rd «oit, Bineh»r| ( Winston, 186">

[Heber, 1969) P«lpn ftoti*** i-ioe'. editO' Irfornulion nrocei^mg jpprg^chet tfl i.-.»f pe.'UPl IP New <or« Holt, Rinemrt X W.niton, 1959

[Mebi"' * üennpn-.on, 1973; Bîph No"n<n Mjoer S Meorice Henhenion Itj p^^tt'P'O^f «1 ■ 11.»! oercepl.on t»» Vor« Moit, Pinehert 8 Wmston. 1973

[Heyek, 1962] Treaerir Ht/ek lüg amflt* Slfle: Cn.cegO: University o» Chicego Preti, 1962

[Hebb, 1949] Donald 0 Hebb Ire orjanâlion of Behav.of. >. York Wiley, 1949

[Hebb, 1968] Donard 0 Hebb Conr«rniBg iwajery Ptycrioieg til Ht^.tM, 1968, 76, 466-477

[Hochberg, 1968] Julian I Hochberg In the mnd't eye. m [Haoer, 1968], 309-331

[Hociberg, 1970] Attention, organ./at.on, and const Outnett In MotloHky led1, Ajtfption: uettMBOUU llitOl* iOi anil|Hn, New rork: Appleton, 1970.

[Hocnberg, 1973] f'rixpntary umtt m the visual perception ot ob/ects In Mehlev <ed i, HetKtea&ft el Cogniliwe Psychology. Engiewood Ditts, New jersey Prentice Hall, 19'3

(Holt, 1964] Pobert R MO I Imager r the return on the ostracized Amencn Psychology. 1964. 19, 264-264

I

K

•" ^«fci r 'i.:: ui -i 1 .■»» K."^* .*»•" -. *^ .< <• ■»

. f . t»' r n. • «*■.* » v r- ..'**fc^. ^ **'' i' ;n V î ;\i! Vf -'fc-

•<j%if .9}.] »Ji '«r» •.• » .",- r ••»»» «. »i

JO">- .I'.! t *t. *•»- a-»- ^»;-»">»-> .-• -»«o . - a^,-^--- -■sog. <«• ».• » A.»a»- ; '•»it .5".

• —tc*. .>*».' *»•»" »-».- W» .-■• 'i» »#-*-. >'■.«'.» .•• -♦-.■-.

•••-, .»te; rte^»i i

.» r: c. ;9'21 « V .» »j. .' \»'.a-» tft;»»i •.-ârf. §2 "IraaMtUrt kîi ^»

[wttt,.«. •• • , ;»69; .tv. «, v*>.'t'i McCîoc\ »K i Mt« W»>»t t>i# ••og'i •>* t»ii» '.*» "oj» o'«« 2iiuti^ü '-»f *'.pp it*o ;4M. ;*•."»

•«»• ^"PuB 'fPOf?. CSfpot»' Scfnc* P»pt. i"*'"»*» V»»inin U"«»i».l%.

3*6, »971

Uyncn, 1960] «»vm lynch lit .•nig* gl Ulf Ub Cj-xhrirtj», M*v> Mil »Nrv». 1972

[M.chalt *nd Zutn«, 196S] Mtt"ct ot vitu*> to"« EtoUMmm UnuiLa •>.•. pp '< 86. 1965.

/ .

ISS

[Millar, 1956] George A Milltr The magical number seven, plut or minus two: tome limits on our capacity lor processing mtormation. PtychalB|ital Re/.e». 19Ü6, 63, 81-96 Reprinted m several OOOKS

[Millar, 1967] George A Miller. Itu ps^er-.j.agv al cammumcation tmw York: Betic BOOKS, 1967

[Millar, 19/3] Robert J. Miller Cross-cultural research m the perception o' pcto' * materials. Psvc-oo; cai a....e!,n< ;973üO(?i. :3S-I60

[Millar, Galanter, K Pnbram, i960] George A Miller, Eugene Ga>anter, i Karl K Pnbram Plan-, j-.a the slri-ctur« jl bahavior. New Vorn: Molt, Rmenarl S Wmslon, 1960

[Mini»y, 1968] Marvin L Mms»/, editor. Samantic .nforma' on processing Cambridge, Mess : Mi T Press, 1968

[Minsky A Paoerl, 1969] Marvin L MnsKy ( Seymour Papert Perceolrons Cambridge. Mais ; MIT Pre«, 1969

[Moran, 1973] Thomat P Moran Tie s/>xbolic rjtjre of visual imagery Stanford, Cai.: Proceedings of the Tniro Internalonai Jomt Conference on Artificial Intelligence, 1973.

[Munti, 1971] IMR.A. Munti Sensory processes and behavior In Psvchobiologv. Mew YorK: Academic Press, 1971.

[Naissar, 1967] u- c '.eisser Cogn f.ve psfchnlog,! New YprK: ApFeton-Century- Crofts. 1967.

[Neuser, 197?] Unc t^isscr Changing conceptions of imagery In [Sheehan, 1972], 233-251.

[Neweii, 1972] Alien Newell A theoretical eipioration of mechanisms for coding tna stimulus Ueoartment of Computer Science, Camegia-Mailon University, 1972. Reprinted m [Meiton « Martm, 19721 373-434.

[Newell, 1973] Allen Newell Production systamt: models of control structures. In [Chase, 1973], 463-526.

[Neweii A Simon, 1972] Allen Newell « Herbert A Simon. (Uun arflflltc solving. Englewood Cliffs, NLJ.: Prentice Han, 1972.

[Noten A Stark, 1971] David Noton I Lawrence Stark. Scanretnt m eye movements during pattern perception Science. 1971, 171, 308-311

[PaiviO. 1971] Allan Paivio J-najer^ and ^gCAll »racasses New York: Holt, Rmehart A Winston, 1971.

' tM

.'.4

He'«/. 1910] C.W. Pe'Ky An tipcnmentai itudy ot imafination Arrenttn Jo„rra\ Piychology, 1910, 21, «2-45?

Pneet. 1967] Je*n Pugel Sn p^^foiugicil ilufl-ti New Vor«. Rjrdom House, 1967

[Pvf,et, 1970] Jean Pagel tlrM^yr^liym He* »ork BJ-, c Boo»i, 1970

[Pokier, 1^69] M.c"aei I Posne' AB^t'aetO" »nd lie process Ot recogntnon. In Bower and Scence eds), tf^ p'jychQiQgf fli learning %£ moti /^tion. Volume 3 New fork At ade-" t Press, 1969

[Po'.ner, 1973] MchMl I Posne' Coo-inal or o< internal codes In [Chase, 1973], 35-73

[Posner and «eeie, 1968^ 0" tne geness ot aBstract 'üea^ T'9jfnai Ql ^«Pfr menla' Ps/ciholog), 1963, '7, 363-363

[Posne and Mitchell. 1967] Chronomet'.c ana^S'S ot classification Psyc.nq'ogica: ■■',-..,*, 1967, 74, 392 409

[Pnor«m, 1971] (fan PriDra" w*'i»i!4£S ttl l^f BliiT F-g.ewood Clitts, f» j Prentice Han, 1971

[Pyl/shyn, 19'3) Zenon W P/irshr" Wfat the mind's eye tells th« mmds Drj.n: a critique ot mer'ai imagery P^/'.'y c; :a B-.i|el n. 1973, 80, 1 24

[Qui'ien, ;968] M »os-, Ooniia- Semantic emeifo-. In [Mins»y, 1968]

[»ab-o«, 1967) J »abmo« Optca co ncioence deuces üS Patent 2, 795, 705 June ||, IW7

[Peei. 1973] Stepnen K Berd htfMMliU. PlfltSliti in BiUfitC Pfiiatau^C f** ôrn Academic Press, .973

[Beitman. .971] Judith $ Pr tman Mecnar ^m^ of torgettng .n snort term merrorr Cfl»niluS P'-rOpiOgy. 1971, 2, 185-195

[»■rriard-.on, ,969] Alan Pitârason Mtrii. ■ IV.'J '*• ,'0,* Sprnger .enap,, 1969

ii'oborls, 1960) L G Poberls Pattern >ecogn lion win an adaptive nelwo-» LHi. Con!. PeU 19b0, .n [unr, 1960)

[Segal, i9/ij S/dnr/ Joe'.on Se,',ai, eu lor Imaêr / current cognitive approaches .'«■w yprr Ac .idem.c Pre',s, 19',

[Seltridge 1959] üü Seitr.oê Panderr.önium. A paradigm tor leam-ng Meprint in [Uhr, 1966)

It?

[Shj«, 197!] Pobert F VIM). Cognition. &-nu «ton, <nd the problem of compltaity. JfiUUUl o; StriiCtufji êifnmg, 1971, 2, 31-44.

[Sh»»h»n, 197?1 Pete' W Sêen»", ea-lo' Ißft furctior ja Qiluu el lOiSMU N»w York: Acedemc fres». 1972

[Shiltrn, 1970] R M S^.'tr.n Memory 4e»'ch. In 0 A Normen lytoaelt ai humj- memor,. New Vo'»: Acedcmic r're»», 1970,

[Sîltrin <nd Atmnson. 1969] ^ M Shittnn «no H C At» -,oi Storige end ret'eval processes m long-term memory PsKciQiog c», Ret.e». 19Ö9. 56, 1 79-193.

[Sh'Hr^n < Ge s er, 1973] Pcî-aV Sii'-'n ä W ison U Geiler V'SUJ1 recognition in t tneOry Ot mtorrrjlon prQCeS^ng Jn [SiJISO. 19?3J, 53-101

[Sirr.on, 1967* Hprüe't A Sf"on An ,ntormat Oi-process.ng ewpi^nat O'l ot some per.eptu* pnenon ft ä'ilin ^n'nj ai -""s-c-olai^. 1967. 58, 1-12.

[Simon, 197*?] iieraert A Si'non. Whet is visue! iiragery' an informeton processing ■ nlerpretetion In ;j'e5g. 1972^ 1Ä3-204

[Soiso. 1973] iôoert I So'-o editor Qoclsz'AäUlx .UuU ifl CSiDlUii PiytîOi* the LO/OU • fmpO'. J-I We»'.inglon. OC . Winston, 1973

[Sperling, 1960] GeOrgr Sper ng the .nlormel.on «^«'leoe n Onel vsuel presentjt.ons Psrcio ojice, Mpnograpn. 19D0. 74 >! 1. Who e 'ô 498),

[Sie-noerg, :9B7] Sa - Stemuerg Two Opereta-s m character 'etOünrlon see e^.dence t'j-i -eaction f M« measure-en;t 3frcyp: o- tlfl r'sychopnys^s' 1967.2. 45 DJ

[Soaring, 1969' S Ste-nocg Th» ascj e'y o* proce«'-"f, stages £<lenso-s ot Donoer s r-elnod *:li piai"8 •Jiti. i9o9, ?'o 316

[Strcimeêr .■ P-.otna. 1970] ':e nota ej !e»t«rr o' e Oftic r-ages ^lîit, 19'0. 225, 34t

Jitcnener, 1909] iB '•ce'e' »gU^ti 8= tut i-SKtZtSUi iXuLJliSSi. Bl Um L'.v.^ 1 a.. >.I..L. Htm "O"» Ma,^ 'an. 1909

i"'eijasso X Bo»e'. 19oo] " ■•,.,■ .is-o ano 3" 3c»f ilie-van j -earp..-^. I'lgflU. *xia tt;(;gik2 're» »o-». A e>. ISoo

[Tvlivmg, i9""2] tnae 7„ , ■•.; fp sOO C end semant ; memory in [TÂ.ng ( Janaidson, 19■.,]. jil -lOS

[TuK ng Ä Donadson, 19".''] f e \, »inp. < Was ne Oonanjson, editor» ^.rjjni^^ljn 0» ^"_ßrj \e» >ü'» A(a*itm,c Pres». 19'^

y I

IM

[Tvirsky, 19(9] Barbar« Tvtrtky. Pictorial and word encoding m a «hört lorm rremory task. Percaption änd Ptythophyiitt. 1969, 6, 225-233.

[Uhr, 1966] Leonard Uhr, «dilor Pallern racogmtion. New York: Wiley. 1966.

[Uhr, 1973] Leonard Uhr. Pattern refo[nilion. Ie«rnin| tau, tnnufM Englewood Clitts, NI: Prentice Hall, 1973.

(Weisstem, 1973] Naomi Waisstem Beyond the yellow-VoKswaien detector and the grandmotncr cell: a Eenaral strategy for the «aploration of operations in human pattern recognition. In [Solse, 1973], 17-51.

[Waltz, 1972] David L. Walti Generating semantic descriptions from drawings of scenes with shadows Pn.O. Thesis, Oaparlment of Electrical Engineering, M.I.T., 1972. Project MAC, Technical Report TS-271.

[Watson, 1913] J.B Watson. Ps/chology as the behavionat views it. fc| :hoiogieai Review. 1913,20, 158-177.

[Waugh t i>torman, 1965] Nancy C Waugh i Donald A. Norman. Primary memory Pt^holagical Revia«. 1965,72,89-104.

[Wickelgren, 1972] WA. Wickelgren. Coding, retrieval and dynamics of multitrace associative memory. In [Gregg, 1972J.

[Willems, 1967] La Williams. The effects of target specification on objects fiiated during visual search. Ada P»vcholo|ica. 1967, 27, 355-360.

[Winston, 1970] Patrick H Winston. Learning structural descriptions from eiamples. PhD. Thesis, Department at Electrical Engineering, MIT. 1970. Project MAC, Technical Report TR-76.

[Yarbua. 1967] AL Yarbus. ixt mavaments and v^ion. New York: Plenum Preis, 1967.

[7utna, 1970] Leenard Zutne. lüiuu aerceatian Q| tOCA New ^ork: Academic Press, 1970.

I-

Arthur Melvin Farley Ca rnegi e - Me I Ion University ...

Documents

Transcript of Arthur Melvin Farley Ca rnegi e - Me I Ion University ...