Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections...

24
Case Study: Correctness and Clarity of Rationale Statements in 35 USC 103 Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist

Transcript of Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections...

Page 1: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

1

Case Study: Correctness and Clarity of Rationale Statements in 35 USC 103

Rejections Case Study

Sandie SpyrouSupervisory Review Quality Assurance Specialist

Page 2: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

2

Objective of 103 Case Study

To study whether Examiners are making clear and correct rationale statements under 35 USC 103.

Page 3: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

3

Data Collection

• 4916 Random OPQA Reviews completed using the Master Review Form (MRF) including the evaluation of at least one 103 rejection made

• Reviews Completed between November 2015 and June 2016

Page 4: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

4

Correctness of Articulated Rationale

Page 5: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

5

MRF Section: 103 Rejection Made Questions Considered to Address Rationale Correctness

Question 1:

Question 2:

Page 6: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

6

Question 1: Correctness of Articulated Rationale Statement

* The wording of the question is “Proper Rationale to combine prior art references” which led to some reviewers to answer “N/A” (not applicable) if it was a single reference 103. Suggestion to change the wording on the MRF to: “Proper rationale for the modification(s)” and/or train RQAS how to interpret.

*

Page 7: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

7

Question 1: Correctness of Articulated Rationale Statement – Bar Graph Comparison

85.7 88.3 90.4 87.774.9

90.276.2

10090.5 91.4

9.6 8.3 4 9.518.5

6.118.8

3.4 4.7

4.7 3.4 5.6 2.8 6.6 3.7 5 6.1 3.9

0

20

40

60

80

100

120

Corps TC 1600 TC 1700 TC 2100 TC 2400 TC 2600 TC 2800 TC 2900 TC 3600 TC 3700

"Yes" "In Part" "No"

Perc

ent o

f 103

Rej

ectio

n Re

view

s

*Percentages of reviews without N/A

Page 8: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

8

“Yes” = All Rationale Statements Correct“In Part = Some Rationale Statements Correct and Some Rationale Statement Incorrect“No” = All Rationale Statements Incorrect

*Percentages of reviews without N/A

“In Part”9.6%

“No”4.7%

“Yes”85.7%

14.3% with at least one incorrect rationale

95.3% with at least onecorrect rationale

Correctness of Articulated Rationale (Question 1)

Page 9: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

9

Correctness of Articulated Rationale to Overall 103 Correctness

Overall 103 Correctness (Question 2)

Corr

ectn

ess o

f ar

ticul

ated

ratio

nale

(Q

uest

ion

1)

OK Needs Attention

Significant Deficiency Total

Yes 3568 311 112 3991

In Part 222 168 60 450

No 36 94 88 218

“OK” = No error that rises to the level of a significant deficiency as defined by the IPED standard“Needs Attention” = Issues present that require attention generally formal in nature and are not found to have a significant impact on prosecution“Significant Deficiency” = Issues present that have significant impact of prosecution

Page 10: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

10

Clarity of Rationale

Page 11: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

11

MRF Section: 103 Rejection Made Questions Considered to Address Rationale Clarity

Question 3:

Page 12: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

12

Question 3: Clarity of Articulated Rationale Statement

“Yes” = All Rationale Statements Correct“In Part = Some Rationale Statements Correct and Some Rationale Statement Incorrect“No” = All Rationale Statements Incorrect

Page 13: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

13

Question 3: Clarity of Articulated Rationale Statement – Bar Graph Comparison

89.1 91.7 90 91.882.5

91.781.4

92.3 92.3 94.8

7.5 6.2 4.5 7.113.3

5.515.8

7.7 2.6 2

3.4 2.1 5.5 1.1 4.2 2.8 2.8 5.1 3.2

0

20

40

60

80

100

120

Corps TC 1600 TC 1700 TC 2100 TC 2400 TC 2600 TC 2800 TC 2900 TC 3600 TC 3700

"Yes" "In Part" "No"

Perc

ent o

f 103

Rej

ectio

n Re

view

s

Page 14: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

14

“Yes” = All Rationale Statements Correct“In Part = Some Rationale Statements Correct and Some Rationale Statement Incorrect“No” = All Rationale Statements Incorrect

“In Part”7.5%

“No”3.4%

“Yes”89.1%

10.9% with at least one unclear rationale

96.6% with at least oneclear rationale

Clarity of Articulated Rationale (Question 3)

Page 15: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

15

Overall 103 Correctness (Question 2)

Clar

ity o

f Art

icul

ated

Ra

tiona

le (Q

uest

ion

3) OK Needs Attention

Significant Deficiency Total

Yes 3761 427 192 4380

In Part 205 120 43 368

No 42 75 51 168

Clarity of Articulated Rationale to Overall 103 Correctness

“OK” = No error that rises to the level of a significant deficiency as defined by the IPED standard“Needs Attention” = Issues present that require attention generally formal in nature and are not found to have a significant impact on prosecution“Significant Deficiency” = Issues present that have significant impact of prosecution

Page 16: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

16

By Action Type

Page 17: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

17

Correct Articulated Rationale: By Action Type

Non-Final - Correctness of Rationale Final - Correctness of RationaleYes 85 87In Part 10 9No 5 4

85 87

10 95 4

0

10

20

30

40

50

60

70

80

90

100

Perc

ent o

f Rev

iew

s

Page 18: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

18

Clear Rationale: By Action Type

Non-Final - Correctness of Rationale Final - Correctness of RationaleYes 88 90In Part 8 7No 4 3

88 90

8 74 3

0

10

20

30

40

50

60

70

80

90

100

Perc

ent o

f Rev

iew

s

Page 19: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

19

By Signatory Authority

Page 20: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

20

Correct Articulated Rationale: By Signatory Authority

Primary Non PrimaryYes 77 93In Part 15 5No 8 2

77

93

15

58

20

10

20

30

40

50

60

70

80

90

100

Perc

ent o

f Rev

iew

s

Page 21: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

21

Clear Rationale: By Signatory Authority

Primary Non PrimaryYes 82 95In Part 12 4No 6 1

82

95

12

461

0

10

20

30

40

50

60

70

80

90

100

Perc

ent o

f Rev

iew

s

Page 22: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

22

Top Findings

• 95.3% of 103 rejections reviewed included at least one articulated rationale statement that was found to be correct; whereas, only 85.7% found all articulated rationale statements correct.

• 96.6% of 103 rejections reviewed included at least one articulated rationale statement that was found to be clear; whereas, only 89.1% found all articulated rationale statements clear.

• Even when the articulated rationale statement was found to be incorrect or unclear, prosecution was not impacted in a majority of instances.

Page 23: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

23

Top Recommendations

• Provide refresher workshops with emphasis on identification of rationale statements and the handling of multiple modifications and/bases in support of the finding of obviousness.

• Reassess TC 2400 and TC 2800 data after implementation of formalized definitions for “In-Part”. If data remains outlying, implement a root cause analysis to develop a targeted action plan for improvement.

Page 24: Case Study: Correctness and Clarity of Rationale Statements in 35 … · 2019. 2. 7. · Rejections Case Study Sandie Spyrou Supervisory Review Quality Assurance Specialist. 2 Objective

2424

Questions?