Peer-Review in Scientific LiteratureALEX FILAZZOLACRITICAL THINKING LAB 2

What is peer-review? - Quality control on scientific research prior to publication

- Expert criticism of experimental work

- Important part of the scientific method

Example of a bad paper

Moss cushions facilitate water and nutrient supply for plant species on bare limestone pavements Sand-Jensen and Hammer 2012

Title

Indicates the main finding Abstract

Concisely written?

Provides a clear overview of the work?

Contains the essential facts from the paper?

Ends by placing the work in a broader context, highlighting its significance?Intro

Provides a clear, concise background to the study?

Outlines the aims of the study and hypotheses

Provides context to the current work

Motivation for the work is explained

Is there satisfactory citation of prior literature?

Methods

Enough detail to replicate study?

Is it clear what measured?

Are the statistical design and analyses appropriate?

Results

Are the results provided in a form that is easy to interpret and understand?

Have results for all the questions asked been provided?

Are the figures and tables appropriate?

Have the correct units of measurement been used?

Discussion and Conclusions

Have the authors answered their research question(s)/hypotheses?

Are the conclusions drawn from the results justified?

Has the significance of the study been fully explained?

How do the results relate to similar studies?

By how much has this study advanced the current understanding of the science?

Universal intellectual standards Clarity

◦-“Education is an issue in America”

Accuracy◦-“Dogs are on average over 300 pounds”

Universal intellectual standards Precision

◦-“Jack is overweight”

Relevance◦- Does a paragraph, section or article stay on target?

Universal intellectual standards Depth

◦- “Just say no”

Breadth◦- Bias

Universal intellectual standards

Logic◦- does this make sense?

Lacks precision

Examples

Examples

Lacks clarity and depthBad writing…

Speed reading an article

Abstract

End of introduction

Methods

Beginning of discussion or conclusion

Example of a good paper

Habitat fragmentation effects on annual survival of the federally protected eastern indigo snake Breininger et al. 2011

Template for analyzing an article 1. The main purpose of this article is: 2. The Key question that the author is addressing is: 3. The most important information in the article is: 4. The main inference/conclusions in the article are: 5. The key concept we need to understand in the article are: 6. The main assumptions underlying the authors thinking are: 7. The main points of view presented in this article are (present both sides of a debate if present):

8. Find examples (good or bad) of the seven Universal Intellectual Standards

Clarity

Accuracy

Precision

Relevance

Depth

Breadth

Logic