The Integrity of Data Management Responsible Conduct of Research Workshop

Howard UniversityFebruary 13,2013The Integrity of Data ManagementResponsible Conduct of Research WorkshopPeggy Carr, Ph.D.Associate CommissionerNational Center for Education Statistics

1Overview of Statistical and Research Standards2Best Practices for the Conduct of Research3Best Practices for the Conduct of ResearchConceptualize Research ProblemOperationalize Study DesignEngage in Peer Review and Networking ActivitiesPublish and Publish Early/OftenBe Ethical41. Conceptualize Research Problem5Literature ReviewStatement of ProblemHypothesesResearch QuestionDefinition of Terms, Concepts, and ConstructsConceptualOperational2a. Operationalize Study DesignThe Concept of Study DesignHypothesis 1Explained VarianceUnexplained VarianceSampling ErrorMeasurement ErrorValidityReliabilityTEL VideoValidation of ConstructsFace Content validation across judgesCriterion Predictive and concurrentConstruct Methodological approaches to validation8JealousyEnvy2b. Operationalize Study DesignDictionary.com provides the following definitions:Jealousy- resentment against a rival, a person enjoying success or advantage, etc., or against anothers success or advantage itself; mental uneasiness from suspicion or fear or rivalryEnvy- a feeling of discontent or covetousness with regard to anothers advantages, success or possessions, etc.

82c. Operationalize Study DesignReliability of MeasuresTest and Retest stability over timeEquivalency consistency across formsInternal internal consistency

9UNRELIABLERELIABLE2c. Operationalize Study DesignResearch DesignInternal Validity refuting rival plausible hypothesesExternal Validity generalizability of findingsChoice of Designs experimental, quasi, survey, correlational10XYQuality Assurances of DataData Checks (e.g., out of range variance, criterion reference checks, replication)Thoughtful and Appropriate Data AnalysisThe nature of your dataLimitations of statistical techniqueDiscuss Findings and Conclusions with ColleaguesRelate back to literature reviewImplications for future researchFlaws and limitations11NEXT2c. Operationalize Study DesignTrend in fourth-grade NAEP mathematics average scores122c. Operationalize Study DesignSOURCE: The Nations Report Card, 4th Grade NAEP: Mathematics, 1990-2011.

132c. Operationalize Study DesignTrend in fourth-grade NAEP mathematics percentile scoresSOURCE: The Nations Report Card, 4th Grade NAEP: Mathematics, 1990-2011.

4. Publish and Publish Early/OftenStart your publication record early in peer reviewed journalsAs first, second, or third author

Publish and/or present oftenRegardless of professional focusAnnually155. Be EthicalBe committed and follow through

Adhere toSubjects RightsInstitutional Review BoardConfidentiality and Privacy Rights16

Questions?17