From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of...
-
Upload
rc-richards -
Category
Law
-
view
390 -
download
6
description
Transcript of From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of...
![Page 1: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/1.jpg)
FROM THE PEOPLE’S PERSPECTIVE:
ASSESSING THE REPRESENTATIONAL
VALIDITY OF A CODING SCHEME OF
CITIZENS’ LEGAL COMMUNICATION ABOUT
BALLOT INITIATIVES
Robert C. Richards, Jr.
The Pennsylvania State University
Department of Communication Arts & Sciences
Presentation at National Communication Association, November, 2014
![Page 2: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/2.jpg)
Purpose
To determine the extent to which measures
used to analyze citizens’ legal
communication about proposed laws tap
concepts that are actually present in citizens’
minds when they think about such laws –
that is, to determine the representational
validity of those measures.
![Page 3: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/3.jpg)
Overview
Previous Research and Goals for This Study
Methodology
Results
Conclusion
![Page 4: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/4.jpg)
Setting
Direct Democracy
• Citizens making their own laws in ballot-
initiative elections
• 24 U.S. states have statewide ballot
initiative processes
![Page 5: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/5.jpg)
The Issue
Citizens often misunderstand legal aspects of
ballot initiatives
Official explanatory statements are citizens’ chief
source of legal information about initiatives
Citizens’ knowledge gap is likely due to
communication flaws in explanatory statements
![Page 6: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/6.jpg)
Theoretical Frameworks
Plain Legal Language Theory
• Effective communication matches citizens’
communicative practices
Social Cognitive Theory
• Effective communication matches cognitive
structures and processes in citizens’ minds
![Page 7: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/7.jpg)
Approach: Descriptive Model
Develop a coding scheme that describes
attributes of citizens’ legal communication
about ballot initiatives
Based on transcripts of Oregon Citizens’
Initiative Review (CIR)
![Page 8: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/8.jpg)
The Oregon Citizens’ Initiative Review
• Public deliberation by a random sample of 24 citizens on a ballot initiative; analysis is published in official voter guide
• In 2010 two measures: (1) Mandatory Minimums, and (2) Medical Marijuana Dispensaries
![Page 9: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/9.jpg)
Approach: Normative Model
Use the coding scheme of citizens’ legal
communication about initiatives, to evaluate
explanatory statements
![Page 10: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/10.jpg)
Coding Scheme of Citizens’ Legal
Communication about Initiatives
Attributes: Topics, Functions, and Discursive
Modes
439 Codes
42 Categories
![Page 11: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/11.jpg)
Cognitive Structures & Processes
Strategic Schema
• Citizens identify goal of initiative, and determine
likelihood of effectiveness in achieving it
Realistic Schema
• Citizens identify unintended consequences of
initiative, and determine likelihood of occurrence
![Page 12: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/12.jpg)
Goals of This Study
1. Assess the representational validity of
major topical codes in the coding scheme
“Representational validity” = Codes match meanings
understood by citizens (i.e., the emic perspective)
“Major” = Most frequently observed in CIR transcripts
![Page 13: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/13.jpg)
Goals of This Study (continued)
2. Identify higher-level dimensions of the
topical codes
3. Identify associations / distinctions among
topical codes
![Page 14: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/14.jpg)
Methodology
Sorting exercise, on online
OptimalWorkshop platform
N = 109 undergraduates
![Page 15: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/15.jpg)
Methodology (continued)
54 cards containing statements by 2010 Oregon CIR panelists, coded as designating topics in content analysis
Three cards per topic, total of 18 topics
The full text of cards is available at:
https://dl.dropboxusercontent.com/u/16652392/SortingExercise1ItemswithConcepts10-6-14.pdf
![Page 16: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/16.jpg)
Methodology (continued)
Instructions:
1. Read ballot initiative on increasing criminal
sentences, plus ballot title, explanatory statement,
and financial impact statement
2. Place cards in piles; in each pile, place cards
“whose statements belong together,” in subject’s
view
3. Then label each pile “with a name that,” in the
subject’s view, “best describes items in the pile”
![Page 17: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/17.jpg)
Analytical Methods
Similarity Statistics
Multidimensional Scaling
Cluster Analysis
![Page 18: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/18.jpg)
Main Results
![Page 19: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/19.jpg)
1. Most codes were recognized,
but extent of recognition varied.
Note regarding table on next slide: Codes
measured with three items, except that ** =
code measured with two items.
![Page 20: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/20.jpg)
-Code
% of Subjects
Recognizing
Code
Experts’ Opinions, Fiscal Effects,
Other Jurisdictions’ Laws≥ 50%
Bases for Legal Challenges,
Delegation of Regulatory Authority,
History of Initiative, Policy Objectives**30-49%
Alternative Means**, Effects on Other Laws,
Language Choices, Means**,
Need for Initiative 20-29%
Unintended Consequences, Effectiveness,
Policy Reasons for Choosing Lawmaking,
Public Administration Effects,
Regulations in Force, Statutes in Force**
10-19%
![Page 21: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/21.jpg)
2. Two dimensions of codes were
identified, but their meaning is
uncertain.
Note regarding table on next slide: Code names
indicate two items loading exclusively on the indicated
dimension with value of ≥|0.400|, except that * = only
one item loaded on the indicated dimension, *** = three
items loaded on the indicated dimension; and † = two
items loaded on the indicated dimension with values of
≥|0.100| & <|0.400|.
![Page 22: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/22.jpg)
Dimension I Dimension II
Bases for Legal
Challenges,
Experts’ Opinions***,
Language Choices†
Effectiveness*,
Effects on Other Laws,
Alternative Means*,
Means,
Need for Initiative,
Policy Objectives,
Policy Reasons for
Choosing Lawmaking*
![Page 23: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/23.jpg)
Unintended Consequences: all
three items loaded weakly [≥|0.100|
& <|0.400|] on Dimension I, and
one item loaded weakly on
Dimension II.
![Page 24: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/24.jpg)
Possible Interpretations of Dimensions
Dimension I Dimension II
Realistic Schema, etc. Strategic Schema
System I Thinking System II Thinking
? ?
![Page 25: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/25.jpg)
3. Codes were grouped in seven
clusters, six of which are readily
interpretable.
Note regarding table on next slide: Code name
indicates three items were placed in the cluster,
except that * = one item was placed in the cluster,
and ** = two items were placed in the cluster.
![Page 26: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/26.jpg)
Cluster 1: Bases for Legal ChallengesCluster 4: Alternative Means**, Policy
Objectives**, Statutes in Force**
Cluster 2: Delegation of Regulatory
Authority, Effectiveness, Experts’
Opinions, Effects on Other Laws**,
History of Initiative, Means*, Need for
Initiative**, Other Jurisdictions’ Laws,
Policy Objectives*, Policy Reasons for
Choosing Lawmaking**
Cluster 5: Unintended Consequences
Cluster 3: Alternative Means*, Effects
on Other Laws*, Language Choices,
Policy Reasons for Choosing
Lawmaking*, Public Administration
Effects, Regulations in Force, Statutes
in Force*
Cluster 6: Fiscal Effects
Cluster 7: Experts’ Opinions*, Means**
![Page 27: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/27.jpg)
Interpretations of Clusters
Cluster 1: Bases for
Legal Challenges
Cluster 4: Alternative
Means of Achieving
Policy Objectives
Cluster 2: Strategic
Schema
Cluster 5: Unintended
Consequences
Cluster 3: ? Cluster 6: Fiscal Effects
Cluster 7: Experts’
Opinions about Means
![Page 28: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/28.jpg)
Conclusion
• Evidence that the codes tap concepts
present in citizens’ minds, but extent varies
• MDS & cluster analysis results are
consistent with view: Strategic & realistic
schemata operative in citizens’ minds
• Replicate this study
• Survey subjects on meaning of dimensions
![Page 29: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/29.jpg)
Full text
The full text of the paper associated
with this presentation is available at:
http://ssrn.com/abstract=2447343
![Page 30: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/30.jpg)
Acknowledgements
•Grateful thanks to:
• Anonymous reviewers
• Professor James Dillard, Professor John
Gastil, and David Brinker of The
Pennsylvania State University Department of
Communication Arts & Sciences
![Page 31: From the People’s Perspective: Assessing the Representational Validity of a Coding Scheme of Citizens’ Legal Communication about Ballot Initiatives](https://reader033.fdocuments.us/reader033/viewer/2022052623/559c2f2a1a28ab670f8b480a/html5/thumbnails/31.jpg)
Contact
Robert C. Richards, Jr., JD, MSLIS, MA, BA
• PhD Candidate
• The Pennsylvania State University Department of Communication
Arts and Sciences
• Email: [email protected]
• Web: http://legalinformatics.wordpress.com/about/about-the-author/