lllllllllllllllllllllllllllIlllllllllllllllllllllllllllllllllllIIIIIIIHIII _ USO05434913A

UIlltBd States Patent [19] [11] Patent Number: 5,434,913 Tung et a1. [45] Date of Patent: Jul. 18, 1995

[54] AUDIO SUBSYS'I'EM FOR COMPUTER-BASED CONFERENCING SYSTEM

OTHER PUBLICATIONS

Computer Conferencing: IBM scientists demo proto type of affordable computer conferencing system, Nov.

[75] Inventors: Peter Tung, Beaverton; Ben Vrvilo, 2’ 1992_ EDGE’ on & about AT&T’ V7, 11223’ p, 22_ Portland, both of Greg.

Primary Examiner—.larnes L. Dwyer [73] Assignee: Intel Corporation, Santa Clara, Calif. Assistant Examiner-Scott Wolinsky [21] A 1 N 158 246 Attorney, Agent, or Firm—-Steve Mendelsohn; William

pp . 0.: , H. Murray

[22] Filed: Nov. 24, 1993 [57] ABSTRACI‘

[51] Int. 01.6 ............................................ .. HD4M 3/56 An audi° task ,residing °n 3,11 audio/communicating [52] us. (:1. .................................. .. 379/202; 395/800; Pwd °f a“ “(11° ‘Subsystem “1 a COmPuF“ °°Y%fe“?“°'

395/162 ing system. An audio manager and an audio applications [58] Field of Search ______________ u 395/800’ 162; 379/202, programming interface reside on a host processor of: the

379/205 203 204 computer conferencing system. The audio task receives ’ ’ local analog audio signals, generates local compressed

[56] References Cited audio signals corresponding to the local analog audio U S PATENT DOCUMENTS signals, and passes the local compressed audio signals to

' ‘ ' a communications subsystem of the computer confer

4,475,l93 10/1984 Brown ....................... .. 379/202 encing system for transmission over a communications 4,333,795 12/1989 AndO e} 31 -- 379/53 link to a remote computer conferencing system. The 5,014,267 5/1991 Tompi‘ms ct a1‘ " """"" " 370/62 audio task receives remote compressed audio signals

snuzuktllet a1‘ """""""" from the communications subsystem and generates re 5Z231Z492 7/1993 Dangig:al:":::............12: 358/143 mote decompress“ audio Signals correspmding to the 5,315,633 5/1994 remote compressed audio signal for local playback. 5,319,793 6/1994 5,335,321 8/1994 16 Claims, 32 Drawing Sheets

102 102 104

CANERA MICROPHONE CANERA MICROPHONE

ANALOG ANALOG ANALOG ANALOG

VIDEO AUDIO VIDEO AUDIO

V V V V

100 ' 100 1 CONFERENCING ISDN NETWORK CONFERENCING f

SYSTEN SYSTEN

A (DIGITAL) B

1 1 0

ANALOG ANALOG ANALOG ANALOG

VIDEO AUDIO VIDEO AUDIO

V l l V

KINITOR SPEAKER NONITOR SPEAKER

106 108 106 108

CISCO SYSTEMS, INC. Ex. 1031 Page 1

CISCO SYSTEMS, INC. Ex. 1031 Page 2

US. Patent July 18, 1995 Sheet 2 of 32 5,434,913

2: o H ~ No“ M26525; :5 5:6 55 65>: 5:

we“

52% T 22 228532 is 22>

Fvom

EKR _ _

wcm ma <2

2%.. 2: 11+ “Maw:

“058% 5%

E

NQNR

CISCO SYSTEMS, INC. Ex. 1031 Page 3

U.S. Patent July 18, 1995 Sheet 3 of 32 5,434,913

wow m2 <2 65>: BEBE 2m <2

mg mg 22> 1.1.6:“ luv @558 :22 .2; “8&5;

SE 3 82> 25: 82> E:

won mom won Non

vow

CISCO SYSTEMS, INC. Ex. 1031 Page 4

CISCO SYSTEMS, INC. Ex. 1031 Page 5

US. Patent July 18, 1995 Sheet 5 of 32 Y 5,434,913

F IG . 5 .

100

502 AUDIO/VIDEO DATA CONFERENCING 5 04 CONFERENCING APPN APPLICATION

506'\ CONFERENCING API

5 10 I‘ 5 1 Z 5 1 4

508 in A_, r‘, [J ‘\- VIDEO API coMM API AUDIO API MAvE API

1 5 1 6 ‘L VIDEO coMM AUDIO

MANAGER MANAGER MANAGER 5 24

g 522 518 520 ‘J

‘1 VIDEO CAPTURE NAvE DRIVER DRIVER

5 26, HOST INTERFACE DSP INTERFACE

5 28 530\_ VIDEO BOARD DSP I532

NICROCODE INTERFACE

5 36 5 34 % H

AUDIO HOST DEVICE NAME

5 3 8 f TASK DRIVER TASK

cGNN

TASK 1'5 40

CISCO SYSTEMS, INC. Ex. 1031 Page 6

US. Patent July 18, 1995 Sheet 6 of 32 5,434,913

2e: -H 5c I 22: F mamlm wON

wON ma <2 51:2

3

E8 052 55:5 2.2 v.2 5m 55528.5 552 ,2 52m : _

a E 922

. 5.0m 5%

855

5 .NM

“z: SE8 2%

:85 EU 8:: ~55 5:52 22 :3

a 22:62 as? miss.

5 E:

E: w x

$22 2 \ E2

E2: 25 was: as: 55:5 .52 :2

a 22:62 was: 25$

.@ AIL

CISCO SYSTEMS, INC. Ex. 1031 Page 7

CISCO SYSTEMS, INC. Ex. 1031 Page 8

CISCO SYSTEMS, INC. Ex. 1031 Page 9

US. Patent July 18, 1995 Sheet 9 of 32 5,434,913

\oLummQ

\obcou \SEQBQESW $520k muLaommm 2QoLm>oomLtb ngmbui

A9395

0. .UNK omkqoum.\tgmx IESQ Qocm. \o?cou mmbol Loicoz @Eq?mbé? 3.0339963 .uLbIQb. moLaommt mgoLmioomLcb .WSQQKBM. QQGQQ

CISCO SYSTEMS, INC. Ex. 1031 Page 10

US. Patent July 18, 1995 Sheet 10 of 32 5,434,913

33> ERFMEM. v3 v5» "3% MEQSQK

t3

QB» ESQSQ.

335 §

5e 32§§ CISCO SYSTEMS, INC. Ex. 1031 Page 11

US. Patent July 18, 1995 Sheet 11 of 32 5,434,913

F IG . 1 1 .

5 1 6

1 102

VIDEO MANAGER 1 108 LIBRARY

[nu] \ REcvv

NETW SENDMESSAGE [on] m INTERFACE 1 106

1104 H ‘\- VCAPT VPLAY [EXE] [5x51

m0 Rm 8 I I

1 1 10

xm

Vf'W: VIDEO CAPTURE DRIVER

PLAYBACK (CODEC)

1.522 I

CISCO SYSTEMS, INC. Ex. 1031 Page 12

U.S. Patent July 18, 1995 Sheet 12 of 32 5,434,913

FIG. 12. I1]

CISCO SYSTEMS, INC. Ex. 1031 Page 13

CISCO SYSTEMS, INC. Ex. 1031 Page 14

CISCO SYSTEMS, INC. Ex. 1031 Page 15

CISCO SYSTEMS, INC. Ex. 1031 Page 16

CISCO SYSTEMS, INC. Ex. 1031 Page 17

US. Patent July 18, 1995 Sheet 17 of 32 5,434,913

F IG . 17 .

UPPER LAYERS

HOST (moons) m.o

202 \ LL RDULDLL DULDLL

532 ‘\- DSP INTERFACE

comm (0 cm) 0m com TASKS

mum/com BOARD (Sm) :1 cm DRIVER s CHAN DRIVERS

206

CISCO SYSTEMS, INC. Ex. 1031 Page 18

CISCO SYSTEMS, INC. Ex. 1031 Page 19

US. Patent July 18, 1995 Sheet 19 0f 32 5,434,913

END sass/01v BEG 1N SESSION

REJECT c0/v/v / \\ c0/v/v REJEC TED / \

/

corwv REQUEST

REQUEST CONN I

/ /

CL OSE CONN / /

/ / co/v/v ACCEPTED /

ACCEPT CONN

CONNCTED

REJECT CHAN \ \ \CHAN REJEC r50

\

@ OPEN CL OSE CHAN CHAN 1

ACCEPT // CHAN CHAN , ACCEPTED

-—— ACTIVE REQUEST 0 STATE

“""-' RESULT OF REQUEST

FIG. 19 CISCO SYSTEMS, INC. Ex. 1031 Page 20

CISCO SYSTEMS, INC. Ex. 1031 Page 21

CISCO SYSTEMS, INC. Ex. 1031 Page 22

CISCO SYSTEMS, INC. Ex. 1031 Page 23

CISCO SYSTEMS, INC. Ex. 1031 Page 24

CISCO SYSTEMS, INC. Ex. 1031 Page 25

CISCO SYSTEMS, INC. Ex. 1031 Page 26

CISCO SYSTEMS, INC. Ex. 1031 Page 27

CISCO SYSTEMS, INC. Ex. 1031 Page 28

CISCO SYSTEMS, INC. Ex. 1031 Page 29

CISCO SYSTEMS, INC. Ex. 1031 Page 30

CISCO SYSTEMS, INC. Ex. 1031 Page 31

CISCO SYSTEMS, INC. Ex. 1031 Page 32

CISCO SYSTEMS, INC. Ex. 1031 Page 33

CISCO SYSTEMS, INC. Ex. 1031 Page 34

CISCO SYSTEMS, INC. Ex. 1031 Page 35

CISCO SYSTEMS, INC. Ex. 1031 Page 36

CISCO SYSTEMS, INC. Ex. 1031 Page 37

CISCO SYSTEMS, INC. Ex. 1031 Page 38

CISCO SYSTEMS, INC. Ex. 1031 Page 39

CISCO SYSTEMS, INC. Ex. 1031 Page 40

CISCO SYSTEMS, INC. Ex. 1031 Page 41

CISCO SYSTEMS, INC. Ex. 1031 Page 42

CISCO SYSTEMS, INC. Ex. 1031 Page 43

CISCO SYSTEMS, INC. Ex. 1031 Page 44

CISCO SYSTEMS, INC. Ex. 1031 Page 45

CISCO SYSTEMS, INC. Ex. 1031 Page 46

CISCO SYSTEMS, INC. Ex. 1031 Page 47

CISCO SYSTEMS, INC. Ex. 1031 Page 48

CISCO SYSTEMS, INC. Ex. 1031 Page 49

CISCO SYSTEMS, INC. Ex. 1031 Page 50

CISCO SYSTEMS, INC. Ex. 1031 Page 51

CISCO SYSTEMS, INC. Ex. 1031 Page 52

CISCO SYSTEMS, INC. Ex. 1031 Page 53

CISCO SYSTEMS, INC. Ex. 1031 Page 54

CISCO SYSTEMS, INC. Ex. 1031 Page 55

CISCO SYSTEMS, INC. Ex. 1031 Page 56

CISCO SYSTEMS, INC. Ex. 1031 Page 57

CISCO SYSTEMS, INC. Ex. 1031 Page 58

CISCO SYSTEMS, INC. Ex. 1031 Page 59

CISCO SYSTEMS, INC. Ex. 1031 Page 60

CISCO SYSTEMS, INC. Ex. 1031 Page 61

CISCO SYSTEMS, INC. Ex. 1031 Page 62

CISCO SYSTEMS, INC. Ex. 1031 Page 63

CISCO SYSTEMS, INC. Ex. 1031 Page 64

CISCO SYSTEMS, INC. Ex. 1031 Page 65

CISCO SYSTEMS, INC. Ex. 1031 Page 66

CISCO SYSTEMS, INC. Ex. 1031 Page 67

CISCO SYSTEMS, INC. Ex. 1031 Page 68

CISCO SYSTEMS, INC. Ex. 1031 Page 69

CISCO SYSTEMS, INC. Ex. 1031 Page 70

CISCO SYSTEMS, INC. Ex. 1031 Page 71

CISCO SYSTEMS, INC. Ex. 1031 Page 72

CISCO SYSTEMS, INC. Ex. 1031 Page 73

CISCO SYSTEMS, INC. Ex. 1031 Page 74

CISCO SYSTEMS, INC. Ex. 1031 Page 75

CISCO SYSTEMS, INC. Ex. 1031 Page 76

CISCO SYSTEMS, INC. Ex. 1031 Page 77

CISCO SYSTEMS, INC. Ex. 1031 Page 78

CISCO SYSTEMS, INC. Ex. 1031 Page 79

CISCO SYSTEMS, INC. Ex. 1031 Page 80

CISCO SYSTEMS, INC. Ex. 1031 Page 81

CISCO SYSTEMS, INC. Ex. 1031 Page 82

CISCO SYSTEMS, INC. Ex. 1031 Page 83

CISCO SYSTEMS, INC. Ex. 1031 Page 84

CISCO SYSTEMS, INC. Ex. 1031 Page 85

CISCO SYSTEMS, INC. Ex. 1031 Page 86

CISCO SYSTEMS, INC. Ex. 1031 Page 87

CISCO SYSTEMS, INC. Ex. 1031 Page 88

CISCO SYSTEMS, INC. Ex. 1031 Page 89

CISCO SYSTEMS, INC. Ex. 1031 Page 90

CISCO SYSTEMS, INC. Ex. 1031 Page 91

CISCO SYSTEMS, INC. Ex. 1031 Page 92

CISCO SYSTEMS, INC. Ex. 1031 Page 93

CISCO SYSTEMS, INC. Ex. 1031 Page 94

CISCO SYSTEMS, INC. Ex. 1031 Page 95

CISCO SYSTEMS, INC. Ex. 1031 Page 96

CISCO SYSTEMS, INC. Ex. 1031 Page 97

CISCO SYSTEMS, INC. Ex. 1031 Page 98

CISCO SYSTEMS, INC. Ex. 1031 Page 99

CISCO SYSTEMS, INC. Ex. 1031 Page 100

CISCO SYSTEMS, INC. Ex. 1031 Page 101

CISCO SYSTEMS, INC. Ex. 1031 Page 102

CISCO SYSTEMS, INC. Ex. 1031 Page 103

CISCO SYSTEMS, INC. Ex. 1031 Page 104

CISCO SYSTEMS, INC. Ex. 1031 Page 105

CISCO SYSTEMS, INC. Ex. 1031 Page 106

CISCO SYSTEMS, INC. Ex. 1031 Page 107

CISCO SYSTEMS, INC. Ex. 1031 Page 108

CISCO SYSTEMS, INC. Ex. 1031 Page 109

CISCO SYSTEMS, INC. Ex. 1031 Page 110

CISCO SYSTEMS, INC. Ex. 1031 Page 111

CISCO SYSTEMS, INC. Ex. 1031 Page 112

CISCO SYSTEMS, INC. Ex. 1031 Page 113

CISCO SYSTEMS, INC. Ex. 1031 Page 114

CISCO SYSTEMS, INC. Ex. 1031 Page 115

CISCO SYSTEMS, INC. Ex. 1031 Page 116