CHAPTER 8.NEURAL NETWORKS: THE NEW CONNECTIONISM

Bodrov Alexey

2

OUTLINE

1. Computer Simulation and Artificial

Intelligence

2. The Computer and the Brain

3. Symbolic and Connectionist models

4. Neural Networks

3

1. COMPUTER SIMULATION AND ARTIFICIAL INTELLIGENCE1.1 BASIC CONCEPTS

Artificial intelligence (AI) – field, where scientists try to device computer systems that could

accomplish the same things as humans (it is a branch of computer science that tries to make computers smarter).

Computer simulation – attempt to mimic the functions of the human (including errors and

biases).Reasons for making computer smarter:

Computer might do marvelous things for human (for ex. assembling machine parts) This may clarify questions about human cognitive process and mimic functions of a mind.

4

1.2 CAN MACHINES THINK? Sternberg and Ben-Zeev: “Computers cannot think,

although they can sometimes be programmed to respond as if they were thinking”.

Turing test’s scheme: If A can do x, y, and z, and B can do x, y,

and z exactly, then B must possess whatever attributes A has that allow it to do x, y, and z. Conclusion: Machines can think.

Searl shown: Turing’s test reduces easily to absurd.Conclusion: There is no answer whether machine can think or not.

Modern view: Computers don’t need to think. Their lack of “passion” does underscore that hey are not human.

5

2. THE COMPUTER AND THE BRAIN(1)

Basis computer-as-cognitive-processor metaphor:

Opponents of this metaphor claim, that viewing humans as machines robs them of the most important aspects of humanity (machines have no emotion and no volition).

Penner point out that metaphors are just comparisons and we need only accept that computers and humans sufficiently similar that some features of one can be used as a sort of pattern for other.

Information processing

Function Structure

S

Cognititive acts (thinking, problem solving, creating, other cognitive processes)

R SensesWetware or nervous system

Response system

InputSoftware (programmed operations)

OutputSensors (keyboard)

Hardware (chips, relays, switches)

Printers, screens

HUMAN

COMPUTER

6

2. THE COMPUTER AND THE BRAIN(2)Differences between brains and computers:

o Brains are very slow; computers are lightning fasto Brains are smarter and storage of information is virtually unlimitedo Human nervous system is incredibly more complex than even the largest and most sophisticated of modern computerso The computer’s ability to retrieve flawlessly from memory and to perform arithmetical computations rapidly and accurately far exceeds that of humans

Conclusion: Brain is more like a parallel distributed processing (PDP) computer.

7

3. SYMBOLIC AND CONNECTIONIST MODELS3.1 SYMBOLIC MODELS

Basic assumptions: o all information can be represented in symbolso learning is explicito information processing (thinking) involves the application of

identifiable rulesHistorical illustration of this model: Newell, Shaw, and Simon Logic Theorist, which is capable of

finding proofs for theorems in symbolic logic. General Problem Solver (GPS) – is designed to allow comparison

between the desired end state and the current state. The only thing it has revealed is that far more flexible than GPS.

SOAR – a model of cognitive architecture. Similar to chess programs.

Modern chess programs: Use brute force, coupled with few key strategies Different “thinking procedures” with people.

8

3.2 CONNECTIONISTS MODELSNot all learning is explicit (as symbolic model claims), for

example skill in darts.Cognition occurs in the brain not as a series of process but

more as patterns of activation (Hebb).

Assumptions of a model: brain’s collection of neurons is like the processing units in a PDP no central organizer or processor governs activities of neurons

Neural Network – connectionists model of “mind”.

9

4. NEURAL NETWORKS4.1 INTRODUCTION

“A neural network is a general mathematical computing paradigm that models the operations of biological neural systems” Learning of neural network: New connections might develop. Old connections might be lost. Probability that one unit will activate another might

change.

In cognitive research, neural networks are not physical arrangements of actual networks of neurons !!!

10

4.2 ILLUSTRATION: NETTALKTask: Learn to read text. Machine learn itself by using back-propagation rule (uses information about the correctness or appropriateness of its responses to change itself so that the response might be more correct or more appropriate).

Result: NETtalk could read not only studied words, but texts it had never seen. It learned rules, exceptions, had learned to generalize and made some sorts of errors that children alwaysmake.

11

4.3 ADVANTAGES OF CONNECTIONISTS MODELS Neural network can make inferences without being given

specific rules for so doing. This models allow for a fuzzier kind of logic (more peculiar

to human). More accurately reflect the actual physiological structure

of human nervous system. Present a functional analogy for the notion that experience

alters the brain’s wiring. The applications of neural networks stretch well beyond

the cognitive sciences and psychology.

12

4.4 CRITICISM OF CONNECTIONISTS MODELS Computers don’t simulate human emotions at all. Computer simulations don’t reveal the insight of

which human solvers are capable. Tell very little about how the human nervous

system works (the successful functioning of connectionist models depends on certain properties of their units that are not properties of the human nervous system).

Too big interference (second test of paired-associate learning).

13

QUESTIONS Can machine think or not? What is the main difference between

symbolic and connectionist models? What are main advantages and

disadvantages of artificial neural networks?

14

THANK YOU