INTRODUCTION TO PROBABILITYyunus.hacettepe.edu.tr/~nadi/Statistics_5.pdf · INTRODUCTION TO...

29
STATISTICS INTRODUCTION TO PROBABILITY Instructor: Prof. Dr. Doğan Nadi LEBLEBİCİ Source: Kaplan, Robert M. Basic Statistics for the Behavioral Sciences , Allyn and Bacon, Inc., Boston, 1987. SENTENCES IN THIS POWER POINT PRESENTATION ARE USUALLY BORROWED FROM KAPLAN’S BOOK.

Transcript of INTRODUCTION TO PROBABILITYyunus.hacettepe.edu.tr/~nadi/Statistics_5.pdf · INTRODUCTION TO...

  • STATISTICS INTRODUCTION TO PROBABILITY

    Instructor:Prof.Dr.DoğanNadiLEBLEBİCİ

    Source: Kaplan, Robert M. Basic Statistics for the Behavioral Sciences, Allyn and Bacon, Inc., Boston, 1987. SENTENCES IN THIS POWER POINT

    PRESENTATION ARE USUALLY BORROWED FROM KAPLAN’S BOOK.

  • INFERENTIAL STATISTICS In sta7s7cs, there is a dis7nc7on between a popula7on and a sample. We sample to project conclusions about popula7on. These projected es7ma7ons are subject to error. Inferen7al sta7s7cs are used to make educated people that take the chances of making errors into considera7on.

    © Copyright 2005, Doğan N. LEBLEBİCİ 2

  • INTRODUCTION TO PROBABILITY Gambles in Everyday Life Life is a serious of gambles. Although we are some7mes aware of it, nearly all decisions require an assessment of probabili7es.

    © Copyright 2005, Doğan N. LEBLEBİCİ 3

  • INTRODUCTION TO PROBABILITY Gambles in Everyday Life A probability of 0 means the event is certain not to occur. A probability of 1.0 means the event will occur with certainity. For example, the sun will rise tomorrow.

    © Copyright 2005, Doğan N. LEBLEBİCİ 4

  • INTRODUCTION TO PROBABILITY Gambles in Everyday Life For most decisions, it is necessary to use some es7mate of probability that is between 0 and 1.0. In other words, many decisions are bets against uncertainity.

    © Copyright 2005, Doğan N. LEBLEBİCİ 5

  • INTRODUCTION TO PROBABILITY Inferen7al sta7s7cs are used to make inferences or general statements about a popula7on based on a sample from that popula7on. The major concern is whether the sample mean is equivalent. Inferen7al sta7s7cs are used to es7mate the degree of correspondence between these two.

    © Copyright 2005, Doğan N. LEBLEBİCİ 6

  • INTRODUCTION TO PROBABILITY Basic Terms Random Experiment: is the experiment that the results are

    determined by chance. Set: is a collec7on of things or objects that are clearly

    defined by some rule.

    © Copyright 2005, Doğan N. LEBLEBİCİ 7

  • INTRODUCTION TO PROBABILITY Basic Terms Element: is any member within a set. Empty Set: is a set with no elements. Union: is all elements that are in two different set at the same 7me or in any of two sets. Union is symbolized as (A U B)

    © Copyright 2005, Doğan N. LEBLEBİCİ 8

  • INTRODUCTION TO PROBABILITY Basic Terms Intersec7on: is the subset of all elements that are commonly in two

    different sets at the same 7me. It is symbolized as (A ∩ B) Mutually Exclusive Events: Two events are mutually exclusive if they

    share no common elements. e.g. genders are mutually exclusive. Complement: is made up of all other elements in the set outside of the subset.

    © Copyright 2005, Doğan N. LEBLEBİCİ 9

  • UNION

    © Copyright 2005, Doğan N. LEBLEBİCİ 10

    P U Q

  • INTERSECTION

    © Copyright 2005, Doğan N. LEBLEBİCİ 11

    P ∩ Q

  • MUTUALLY EXCLUSIVE EVENTS

    © Copyright 2005, Doğan N. LEBLEBİCİ 12

    P Q

  • COMPLEMENT

    © Copyright 2005, Doğan N. LEBLEBİCİ 13

    P

  • INTRODUCTION TO PROBABILITY Basic Probability for Independent Events Probability is the study of odds and chances. To calculate the probability of an outcome in an independent event, it is necessary to know all possible outcomes at first. For example, if you flip a coin, there are two possible outcome: namely HEAD and TAIL. Either of outcome will occur with a certainity. If we try to calculate the probability of an event in more than one independent event, we have to know about the number of all possible alterna7ve outcomes. For example, if you flip a coin two 7mes, you may have outcomes like HH, HT, TH, TT. There are four possible alterna7ve outcomes.

    © Copyright 2005, Doğan N. LEBLEBİCİ 14

  • INTRODUCTION TO PROBABILITY Basic Probability for Independent Events Calcula7on of all possible alterna7ves can be formulated as such: (Xa) Number of Possible OutcomesNumber of Independent Events Example: For three independent coin tosses, it is 23 and the number of alterna7ve outcomes is, thus, 8.

    © Copyright 2005, Doğan N. LEBLEBİCİ 15

  • INTRODUCTION TO PROBABILITY Addi7ve and Mul7plica7ve Rules Many problems in sta7s7cs and probability require us to combine two independent probability es7mates. For many 7mes it is difficult to determine how to combine independent probabili7es to make a joint statement. We use addi7ve rule and mul7plica7ve rule. According to addi7ve rule, we add the two probabili7es together to calculate the probability of the occurance of either of events. That is to say, probability of A OR B. In summary, the addi7ve rule expresses the probability of UNION. Example: For a coin toss, the probability of gebng either a head or a tail. ½ + ½ = 1.00

    © Copyright 2005, Doğan N. LEBLEBİCİ 16

  • INTRODUCTION TO PROBABILITY Addi7ve and Mul7plica7ve Rules Example: What is the probability of drawing an 8 OR a King from a standard 52-card deck? 1/13 + 1/13 = 2/13 = 0.15 Example: What is the probability of drawing an 8 OR gebng a five in rolling of a die? 1/13 + 1/6 = 19/78 = 0.24

    © Copyright 2005, Doğan N. LEBLEBİCİ 17

  • INTRODUCTION TO PROBABILITY Addi7ve and Mul7plica7ve Rules When calcula7ng the probability of joint occurence of events in totally different events, we use the mul7plica7on rule. According to the mul7plica7on rule, we mul7ply the independent probabili7es together. Example: For the chances of obtaining both a head in a coin toss AND a six in the roll of a die, the probability of gebng the result :½ x 1/6 = 1/12 = 0.08

    © Copyright 2005, Doğan N. LEBLEBİCİ 18

  • INTRODUCTION TO PROBABILITY Permuta7ons and Combina7ons

    Permuta7on is the list of joint occurence of all possible outcomes for independent events in a specific order.

    For example, there are four aces: spades ♠, clubs ♣, hearts ♥, and diamonds ♦. What is the probability of drawing a ♥ followed by a ♦? We can list all possible outcomes for this joint occurance as such:

    ♠♣ ♠♥ ♠♦ ♣♠ ♣♥ ♣♦ ♥♣ ♥♠ ♥♦ ♦♣ ♦♠ ♦♥ SC SH SD CS CH CD HC HS HD DC DS DH

    © Copyright 2005, Doğan N. LEBLEBİCİ 19

  • INTRODUCTION TO PROBABILITY Permuta7ons and Combina7ons

    The probability of drawing a ♥ followed by a ♦ is ¼ x 1/3 = 1/12 = 0.08. It means 8 percent. Permuta7on is gebng the joint occurance in a specific order.

    © Copyright 2005, Doğan N. LEBLEBİCİ 20

  • INTRODUCTION TO PROBABILITY Factorials When we ignore gebng the joint occurance in a specific order (i.e. either of events may be first or second) the number of possible alterna7ve outcomes changes. For example, the number of possible outcomes for the probability of drawing a ♥ AND a ♦ without specific order is 6.

    ♠♣ ♠♥ ♠♦ ♣♠ ♣♥ ♣♦ ♥♣ ♥♠ ♥♦ ♦♣ ♦♠ ♦♥ SC SH SD CS CH CD HC HS HD DC DS DH

    © Copyright 2005, Doğan N. LEBLEBİCİ 21

  • INTRODUCTION TO PROBABILITY Factorials Thus, the probability of drawing a ♥ AND a ♦ is 1/6 = 0.167. That means 16.7 percent. This approach, which does not consider the order, is called combina7ons.

    © Copyright 2005, Doğan N. LEBLEBİCİ 22

  • INTRODUCTION TO PROBABILITY Factorials There are formula7ons to find permuta7ons and combina7ons. To understand these formulas, we must review the concept of factorial. The factorial for a number is the product of the integers from 1 to the number. The factorial is signified by an exclama7on point. For example, the factorial of 6 is expressed as 6! = 6 x 5 x 4 x 3 x 2 x 1 = 720

    © Copyright 2005, Doğan N. LEBLEBİCİ 23

  • INTRODUCTION TO PROBABILITY Permuta7ons The formula for complex permuta7ons is N = Number of objects. P = Permuta7on M = Number of objects taken at a 7me.

    )!(!MNNPMN −

    =

    © Copyright 2005, Doğan N. LEBLEBİCİ 24

  • INTRODUCTION TO PROBABILITY Permuta7ons Remember that the permuta7on for the probability of drawing a ♥ followed by a ♦ is 12. We can test it with formula: N = 4

    M = 2

    12224

    121234

    )!24(!4

    24 ===−=

    xxxxP )!(

    !MNNPMN −

    =

    © Copyright 2005, Doğan N. LEBLEBİCİ 25

  • INTRODUCTION TO PROBABILITY Combina7ons The formula for complex combina7ons is N = Number of objects. C = Combina7on M = Number of objects taken at a 7me.

    )!(!!MNM

    NCMN −=

    © Copyright 2005, Doğan N. LEBLEBİCİ 26

  • INTRODUCTION TO PROBABILITY Combina7ons Remember that the permuta7on for the probability of drawing a ♥ followed and a ♦ is 12. We can test it with formula: N = 4

    M = 2

    6424

    )12(21234

    )!24(!2!4

    24 ===−=

    xxxxxC )!(!

    !MNM

    NCMN −=

    © Copyright 2005, Doğan N. LEBLEBİCİ 27

  • INTRODUCTION TO PROBABILITY Winning 7cket names the first, second and third place horses (There are 8 horses).

    0030.03361)( ==wprob

    MN Pwprob 1)( =

    © Copyright 2005, Doğan N. LEBLEBİCİ 28

  • INTRODUCTION TO PROBABILITY Probability of winning 7cket names the horses finishing in the top three.

    0179.0561)( ==wprob

    MNCwprob 1)( =

    © Copyright 2005, Doğan N. LEBLEBİCİ 29