Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing...
Transcript of Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing...
![Page 1: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/1.jpg)
Paper SM07 ----------------------------------------
PhUSE EU Connect 2019
----------------------------------
Automate Validation of Statistical Reports
Neel PatelDeepak KumarAnik Chatterjee
Disclaimer - Any views or opinions presented in this presentation are solely those of author and do not necessarilyrepresent those of the company.
![Page 2: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/2.jpg)
Agenda
• Ideation• How it works?• Benefits & Challenges• Process (demo)• Conclusion• Potential• Questions
PhUSE EU Connect 2019 2
![Page 3: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/3.jpg)
Ideation – Problem
• Independent programmers validate reports.• Visual comparison is performed with original output.• Some safety reports are 20+ pages long.• Chances of oversight is high during manual comparison.
PhUSE EU Connect 2019 3
![Page 4: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/4.jpg)
Ideation – Problem
• Independent programmers validate reports.• Visual comparison is performed with original output.• Some safety reports are 20+ pages long.• Chances of oversight is high during manual comparison.
Multiply this problem with 10x because we have many studies.
PhUSE EU Connect 2019 4
![Page 5: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/5.jpg)
Ideation – Solution
What can be done???
PhUSE EU Connect 2019 5
![Page 6: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/6.jpg)
Ideation – Solution
Is it possible to convert RTF reports to SAS dataset?
The answer is YES!
We followed two-step process.1. Read the RTF reports and convert them to SAS dataset2. Compare that SAS dataset with independently generated dataset.
PhUSE EU Connect 2019 6
![Page 7: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/7.jpg)
Ideation – Solution
PhUSE EU Connect 2019 7
![Page 8: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/8.jpg)
How it works?
Segregating rows into columns.
PhUSE EU Connect 2019 8
![Page 9: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/9.jpg)
How it works?
Removal of controlled characters and making it human readable.
PhUSE EU Connect 2019 9
![Page 10: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/10.jpg)
Benefits
• Time efficient (human eye vs. machine)• Additional layer of check• Saves time in repetitive checking• Can be reused in multiple studies
Challenges• Initial time investment for writing up QC code• Title & footnote can not be checked
PhUSE EU Connect 2019 10
![Page 11: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/11.jpg)
What is next?
Imagine if there is a SAS functions which can perform all discussed steps and even perform comparison...
PhUSE EU Connect 2019 11
![Page 12: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/12.jpg)
Why FCMP?
• Functions are independent from the main program unlike macros.• Macro variables can get mixed with global vs. local variables.• PROC FCMP written in (essentially) in SAS syntax.• Ease of use in SQL / DATA step etc.
PhUSE EU Connect 2019 12
![Page 13: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/13.jpg)
Show me more!
PhUSE EU Connect 2019 13
![Page 14: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/14.jpg)
Conclusion
• Automation helps in faster output review.• Saves lot of time and efforts (mostly for safety reporting).• Reduce the chances of oversight during visual review process
PhUSE EU Connect 2019 14
![Page 15: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/15.jpg)
Acknowledgment
• Anik Chatterjee (Team Lead, Novartis) for original ideation and assistance. His constant guidance helped through ideation to final paper and presentation.
• Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples in easy language and it heled us a lot.
PhUSE EU Connect 2019 15
![Page 16: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/16.jpg)
Potential
• Automation helps in faster output review.• Saves lot of time and efforts.
PhUSE EU Connect 2019 16
![Page 17: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/17.jpg)
Questions
PhUSE EU Connect 2019 17
![Page 18: Automate Validation of Statistical Reports · paper and presentation. •Sean M. Burke for writing a beautiful RTF Pocket Guide, that small book explains the syntax of RTF with examples](https://reader035.fdocuments.us/reader035/viewer/2022071212/6024edbb88702b003f0dd5b8/html5/thumbnails/18.jpg)
Thanks
Neel [email protected]
Deepak [email protected]
Anik [email protected]
PhUSE EU Connect 2019 18