LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over...

23
Proc. IEEE, vol. 102, no. 4, pp. 460-497, April 2014. Foundations and Trends in Machine Learning, vol. 7, no. 4-5, pp. 311-801, July 2014. Course EE210B Spring Quarter 2015 1 Professor Ali H. Sayed UCLA Electrical Engineering INFERENCE OVER NETWORKS LECTURE #6: Mean-Value Theorems

Transcript of LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over...

Page 1: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Proc. IEEE, vol. 102, no. 4, pp. 460-497, April 2014. Foundations and Trends in Machine Learning, vol. 7, no. 4-5, pp. 311-801, July 2014.

Course EE210B Spring Quarter 2015

1

Professor Ali H. Sayed UCLA Electrical Engineering

INFERENCE OVER NETWORKS

LECTURE #6: Mean-Value Theorems

Page 2: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 2

References

Appendix D (Mean-Value Theorems, pp. 744-748):

A. H. Sayed, ``Adaptation, learning, and optimization over networks,'' Foundations and Trends in Machine Learning, vol. 7, issue 4-5, pp. 311-801, NOW Publishers, 2014.

Page 3: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 3

Setting

Page 4: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Proc. IEEE, vol. 102, no. 4, pp. 460-497, April 2014. Foundations and Trends in Machine Learning, vol. 7, no. 4-5, pp. 311-801, July 2014.

Course EE210B Spring Quarter 2015

Real Arguments

Page 5: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 5

Real Arguments

Page 6: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 6

Real Arguments

Page 7: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 7

Real Arguments

Page 8: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 8

Real Arguments

Page 9: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 9

Real Arguments

Page 10: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 10

Real Arguments

Page 11: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 11

Real Arguments

Page 12: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Proc. IEEE, vol. 102, no. 4, pp. 460-497, April 2014. Foundations and Trends in Machine Learning, vol. 7, no. 4-5, pp. 311-801, July 2014.

Course EE210B Spring Quarter 2015

Complex Arguments

Page 13: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 13

Complex Arguments

Page 14: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 14

Complex Arguments

Page 15: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 15

Complex Arguments

Page 16: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 16

Complex Arguments

Page 17: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 17

Complex Arguments

Page 18: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 18

Complex Arguments

Page 19: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 19

Complex Arguments

Page 20: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 20

Complex Arguments

Page 21: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 21

Example #D.1 21 21

Page 22: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) 22

Example #D.1 22 22

Page 23: LECTURE #6: Mean-Value Theorems - ASL · 2 Lecture #6: Mean-Value Theorems EE210B: Inference over Networks (A. H. Sayed) References Appendix D (Mean-Value Theorems, pp. 744-748):

Proc. IEEE, vol. 102, no. 4, pp. 460-497, April 2014. Foundations and Trends in Machine Learning, vol. 7, no. 4-5, pp. 311-801, July 2014.

Course EE210B Spring Quarter 2015

End of Lecture