Pre-exam2 Discussion

1

Pre-exam2 Discussion

Exam 2 Thurs, Nov 15th

150 pts, 2 crib sheets allowed

841f07exam2preview23nov13 1

2

Parnas - question


In Parnas' Paper, the table 1- you said in the class we should be able to estimate "h“ but in the article "h" is given, so how we can estimate "h"?do you mean that you will give us "the failure probability", and we can calculate "h" based on "failure probability"? or there is another way to estimate "h"?

Yes, you could calculate h based on likelihood, but I think I said that I would not ask you to calculate anything based on thenumber of tests.

3

Van der Meulen


What is the effectiveness of diversity in calculating failure probability E(Θ) and how does it influence in the calculation of E(Θ)?

4

Van der Meulen


Comparison of formulae’s for E(Θ) for Frankl’s and Van der meulen article?

5841f07Meulen16oct18 5

How does this match Frankl’s (1)

7

Van der Meulen


Hamlet

Does Hamlet create the alternatives before or after seeing the input?

8841f07exam2preview23nov13

9

Hamlet


Can the term rewriting system be developed for any sorts of ADT specifications such as ADT specification of program in OCL, Alloy or some other formal languages?

10

Hamlet


How does the diversity effect E(Θ) calculation in Hamlet paper?

11

Hamlet


Hamlet (page 187second paragraph) explains that a conventional oracle is not needed to obtain the 10^-4 bound in the testing phase (first phase). He explains that in this phase he uses a BTRS to generate a test set of terms. If the starting point of these terms were 0, main should evaluate EVERY test term to 0

12

Hamlet


In (page 187 first paragraph), he says that if three randomly chosenterms agree, the probability if all of them are failures is less than10^-12. Why is he always considering that all the bad case is when all of them are failures? i.e. page 198 second paragraph: "The effectiveness of TRM on TCASis measured as the probability that these ten randomly generated formulas will ALL take the same incorrect value.

13

Hamlet


Equation (2) on page 193. I'm unsure why he uses the value N/2n

14

Hamlet


Hamlet says that a typical practical reliability is 10^-4 but what isthe typical confidence on this reliability?

15

All


Comparison between reliability estimate E(Θ) in Hamlet paper, Frankl and Van der meulen and what is the difference between them?

16

Bertolino’s


Does the bertolino’s dream of achieving 100% testing can be achieved using Van der meulen approach of generating equivalent terms for a program without using test oracles. Briefly explain?

17

Bertolino’s Diagram


Where does all the methods of reliability estimates by Frankl, Hamlet and Van der meulen lie in the Bertolino’s diagram and under what goal/challenge do they fall under?

Parnas’s article 30 pts

Reliability Terms Concepts Evaluation


Van Meulen’s article 40 pts

Terms Approach/experiment Diversity Diagrams Results/conclusions


Hamlet’s article 50 pts

Terms Approach ADT, axioms Diversity Conclusions/results Evaluation


22

Bertolino’s article 30 pts


Terms Practical, Effective Discussion Coonclusions Diagrams

Questions

What questions, if we discussed them in class would help you prepare for the exam?

Send by 5pm Sunday, Nov 11th


24

Unresolved Issues


25

Hamlet


The original ADT program is released in a modified form that evaluates a number of equivalent terms for each original term in the program. Thus in execution, every term is checked. In the example of Figure 2, if main correctly implements the stack, every equivalent term generated by the equations ofFigure 1 treated as a BTRS will evaluate to the same value.


26

Pre-exam2 Discussion

Documents

Transcript of Pre-exam2 Discussion