Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
-
Upload
itzcoatl-torres -
Category
Documents
-
view
219 -
download
0
Transcript of Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
-
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
1/31
Joel Michell School of Psychology, University of Sydney, Sydney NSW 2006, Australia
Available online 22 March 2011. http://dx.doi.org/10.1016/j.newideapsych.2011.02.004,How to Cite or Link Using DOI Permissions & Reprints
Abstract
The construct concept occupies a significant place in psychology and, yet its role is
misunderstood. Psychologists think that theorising in the area of psychological testing involves
conjuring constructs, which are operationally defined and measured via psychometric tests.
However, the construct concept is unworkable and laden with confused philosophical baggage
accrued under the hegemony of logical empiricism, and its real function in psychology is
obscured. Via an analysis of its history and logic, I expose its flawed conception of the relation
between theoretical and observable concepts and the way in which it serves the myth of mental
measurement. Finally, it is shown how the actual logic of theorising in science, which entails
that theories are best inferredfrom relevant phenomena, not imaginatively constructed,
oppugns this myth and promises to coordinate theoretical concepts with the phenomena to be
explained.
Keywords
Construct; Theoretical concept; Psychometrics; Measurement; Continuous quantity; Order
The construct concept plays a prominent role in psychology, shaping theories about the
attributes mental tests assess. As a result, its use raises issues concerning definition and
discovery of theoretical concepts, any discussion of which presumes a philosophical framework.
The conclusions reached here presume anempirical realistposition of the kind expounded in,
for example,Anderson (2007)andArmstrong (2010). Furthermore, these conclusions build
upon earlier work on the realist theory of measurement and its implications for psychology
(e.g.,[Michell, 1990],[Michell, 1999],[Michell, 2005]and[Michell, 2007a], &2009a). There is not
space here to defend this framework or theory and, so, I simply signal their relevance.
In many areas, scientists have uncovered otherwise hidden causes, unobserved entities and
processes behind phenomena seen with the naked eye. So, for example, chemical phenomena
http://dx.doi.org/10.1016/j.newideapsych.2011.02.004http://dx.doi.org/10.1016/j.newideapsych.2011.02.004http://www.sciencedirect.com/science/help/doi.htmhttp://www.sciencedirect.com/science/help/doi.htmhttp://www.sciencedirect.com/science/help/doi.htmhttp://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=936&_eid=1-s2.0-S0732118X11000134&_pii=S0732118X11000134&_origin=article&_zone=art_page&_targetURL=https%3A%2F%2Fs100.copyright.com%2FAppDispatchServlet%3FpublisherName%3DELS%26contentID%3DS0732118X11000134%26orderBeanReset%3Dtrue&_acct=C000049823&_version=1&_userid=984461&md5=82cc625c785efea5c49b8dccc8975320http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=936&_eid=1-s2.0-S0732118X11000134&_pii=S0732118X11000134&_origin=article&_zone=art_page&_targetURL=https%3A%2F%2Fs100.copyright.com%2FAppDispatchServlet%3FpublisherName%3DELS%26contentID%3DS0732118X11000134%26orderBeanReset%3Dtrue&_acct=C000049823&_version=1&_userid=984461&md5=82cc625c785efea5c49b8dccc8975320http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib57http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib57http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib57http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61mailto:[email protected]://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib57http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib3http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=936&_eid=1-s2.0-S0732118X11000134&_pii=S0732118X11000134&_origin=article&_zone=art_page&_targetURL=https%3A%2F%2Fs100.copyright.com%2FAppDispatchServlet%3FpublisherName%3DELS%26contentID%3DS0732118X11000134%26orderBeanReset%3Dtrue&_acct=C000049823&_version=1&_userid=984461&md5=82cc625c785efea5c49b8dccc8975320http://www.sciencedirect.com/science/help/doi.htmhttp://dx.doi.org/10.1016/j.newideapsych.2011.02.004 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
2/31
are understood to happen because of processes involving atoms, and biological phenomena,
because of processes involving genes. Few scientists doubt the existence of atoms or genes
and, yet, these remain theoretical in the sense that they are never directly observed. In
psychology, the search continues for theoretical concepts able to perform similar explanatory
wonders, and in psychometrics this search has led to the postulation of constructs.
Interestingly, the construct concept, as such, does not figure in physics, chemistry, or biology.
Scientists there talk of theoretical concepts, but not constructs. Have psychologists simply
adopted a different word for the same thing? An adequate answer requires investigating the
history and logic of the construct concept.
1. The construct concept, part I: philosophical trajectory
The view that some concepts1are composed of others is traceable toLockes
(1690/1959)doctrine that all complex ideas, say, that ofapple, are composed of simple ideas,
like red, roundand sweet. The term, construct, was not used for such concepts untilPearson
(1892), but it wasRussell (1914)who popularised it, prescribing, as he later put it, wherever
possible, substitute constructions out of known entities for inferences to unknown entities
(Russell, 1924/1988, p. 164). Whitehead and he applied it in Principia Mathematica(1910
1913), trying to secure mathematics by constructing its concepts of those of logic. For
example, they attempted to construct the concept ofnatural numberout of those
ofclassand equivalence. Later, Russell thought he could similarly secure knowledge of theexternal world by constructing material objects of sense data (Russell, 1914). While few now
think that he succeeded in either enterprise (Bostock, 2009; &Linsky, 2003), his constructivist
aspirations inspired Carnap, who confessed that Russells attempts made an especially vivid
impression on me because they formulated clearly and explicitly a view of the aim and method
of philosophy which I had implicitly held for some time (Carnap, 1963, p. 13). Consequently,
the dazzling sequel toRussell (1914)was Carnaps (1928)Der Logische Aufbau der Welt
(Quine, 1967, p. 313), which is generallyand rightlyregarded as one of the most important
classics of twentieth-century positivist thought(Friedman, 1999, p. 89).
Later, Carnap applied the method of construction to theoretical concepts in science. This
encounters an insurmountable logical obstacle. To the logical positivists, the method of
construction seemed to provide the only route whereby meaning could adhere to concepts that
are not directly observed, for it was presumed that meaning must flow from the observed to the
unobserved. However, if theoretical concepts are constructed entirely of observed concepts,
then, asHospers (1956, p. 205)noted, to say something about a particular theoretical concept
is only to say something about (in principle) observable phenomena and, so, it is not to say
anything about things existing in a way that is logically independent of those observable
phenomena. But this is incompatible with the empirical realist understanding of the causalrelation, viz., that it can only hold between logically independent events (Maze, 1954/2009).
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib66http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib66http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib66http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib66http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib71http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib71http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib71http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib11http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib11http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib11http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib44http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib44http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib44http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib16http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib16http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib16http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib13http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib13http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib13http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib13http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib68http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib68http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib68http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib30http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib30http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib30http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib36http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib36http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib36http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib36http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib30http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib68http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib13http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib16http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib44http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib11http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib71http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib70http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib66http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib66http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib45http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn1 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
3/31
Take any theoretical, scientific concept, such as, for example, that ofdinosaur. A dinosaur was
a kind of entity, which although never observed by us, had its own characteristics and, while
causal connections to observable concepts, like those of various fossils, exist, saying something
about dinosaurs is not itself equivalent to saying something about fossils, for the connection
between dinosaurs and fossils is contingent and never logically necessary. When it is said, for
example, that a particular kind of dinosaur was a carnivore, something about these past
creatures is asserted, not something about present fossils, although fossils may provide
evidence for such claims. So while propositions involving theoretical concepts may be inferred
from propositions involving observed concepts, the meaning of theoretical concepts cannot be
constructed out of the meaning of these observed concepts. In successful sciences, theoretical
concepts get meaning via inferences, as, for example, the meaning of the dinosaur concept
developed as more and more was inferred about them from fossil features and other evidence,
scientists often reasoning by analogy with the relationship between presently living creatures
and features of their skeletons.
Over time, the logical positivists diluted their constructivist program, but not enough. Carnap,
with Feigl and Hempel, disseminated logical positivism (re-branded as logical empiricism) in
the United States from the 1930s and during that decade Carnap made a fundamental shift
( [Carnap, 1936]and[Carnap, 1937]; andMormann, 2007): he still held that theoretical
constructs absorb content from observational terms, via what he called correspondence rules
but their meaning, he now thought, is never completely reducible to such terms. This became
the standard, logical empiricist view, whichHempel (1952)famously described using the
analogy of a complex spatial network (p. 36), which, in turn influencedCronbach and Meehls
(1955)concept of a nomological network. In Hempels analogy, theoretical concepts are
likened to knots, definitions and hypotheses to threads connecting them and the entire network
is thought of as anchored to observed concepts by strings, which correspond to rules of
interpretation. The theoretical apparatus Hempel insisted cannot, in general be formulated in
terms of observables alone (p. 36) and, so,
Guided by his knowledge of observable data, the scientist has to invent a set of concepts
theoretical constructs, which lack immediate experiential significance, a system of hypotheses
couched in terms of them, and an interpretation of the resulting theoretical network (Hempel,
1952, p. 37).
While theoretical constructs were thought to absorb meaning from the plane of observation,
their meaning was said to remain open to some degree because the connections to that plane
may alter, depending upon the predictive and explanatory successes or failures of the theory
over time. This picture liberalised Russell s model, but the idea that meaning flows from
privileged concepts (i.e., observables) remained.
Feigl, in fact, was most eager to reconcile logical empiricism with some sort of realism
(Mormann, 2007, p. 159) and proposed supplementing the interpretation of constructs via
existential hypotheses (Feigl, 1950), that is, as partly involving real entities or processes.
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib14http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib14http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib14http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib15http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib15http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib15http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib34http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib63http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib15http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib14 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
4/31
Constructs in Russells sense, composed entirely of directly experienced concepts, go no
further than those same concepts because no surplus content is added. Such concepts are
the intervening variablesofMacCorquodale and Meehl (1948). At best, intervening variables
simply say how observable concepts are interrelated and, so, it is a mistake to regard them as
something intervening betweenobservable concepts (Maze, 1954/2009). On the other hand,
when constructivism is liberalised and it is thought that the meaning of constructs is
underdetermined by observable concepts, the way appears open to the possibility of constructs
possessing surplus content. This suited Feigl who wanted theoretical constructs to also
incorporate real entities (such as, in psychology, neural states).
What Feigl failed to see, however, is that realism and constructivism are logically incompatible.
Theoretical concepts serve causal explanations of observable phenomena, and cause and
effect are always logically independent of each other. Therefore, the one thing that theoretical
concepts must not be is constructs, if byconstructsis meant concepts constructed of, even
partly, the observable concepts to which they are causally connected.
This crucial logical point concerning the independence of theoretical and observable concepts
was not just ignored byRussell (1913, p. 1), who saw causality as a relic of a bygone age,
surviving like the monarchy, only because it is erroneously supposed to do no harm, it was
never fully appreciated by the logical empiricists, albeit for a different reason: they wanted to
model scientific theories upon axiomatic theories in mathematics. They were in awe of the
axiomatic method as applied by[Hilbert, 1899]and[Whitehead and Russell, 19101913], and
others. However, while mathematicians may define higher-order concepts in terms of lower-
order ones for their own special reasons, scientists, because their concepts are causally
interconnected, require concepts all on the same level, coexisting in mutual logical
independence.
In erring this way, the logical empiricists embraced a debilitating logical fallacy, viz., that of
confusing epistemic with ontological priority. Just because observable concepts are known prior
tounobservable ones, it does not follow that observable concepts are grounded any more
securely in reality thanunobservable concepts or that the latter, like ontological leeches, survive
only by sucking meaning from observable ones. While we may depend upon facts about
observable things for knowledge of unobserved entities or processes, the latter remain logically
independent of the former.
Thus, it is clear that the trajectory of the construct concept up to the point where it penetrated
psychology shed very little light on the character of theoretical concepts. Beset by logical flaws,
its difficulties resulted from attempts to impose an inappropriate model of meaning; a model
ignoring the logical independence of causally connected concepts. Despite this, and because of
the hegemony of logical empiricism, American psychologists embraced the construct concept.
However, in order to make it serve their special interests, they also transformed it.
2. The construct concept, part II: psychological trajectory
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib69http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib69http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib69http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib35http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib35http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib35http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib78http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib78http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib78http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib78http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib78http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib78http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib35http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib69http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib50http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
5/31
The construct concept entered psychology beforeMacCorquodale and Meehl (1948)(e.g.,
seeBoring et al., 1945). During the 1930s, opinion leaders in psychology sought to boost the
credentials of the discipline by promoting philosophies of science that had associated
themselves most closely with recent revolutions in physics (viz., operationalism and positivism).
The prevailing rejection of mentalism, which was thought to involve not just unobservable but
intrinsically private concepts, created a gap in the array of potential theoretical concepts, which
the construct concept filled. Psychologists of that era wanted to base theories upon publicly
observable concepts and to confine their terms to the behaviourists lexicon. The result was
identification of an array of concepts, operationally defined in terms of behaviour and, following
the positivists, designated as constructs.
Even within the philosophy of science, use of the construct concept was not entirely consistent
(Beck, 1950) and in psychology it was at first assimilated to operationalism. By the 1940s, the
opinion leaders followed the logical empiricists in regardingBridgmans (1927)operationalism
as too narrow and favoured a more liberal version (Boring et al., 1945), according to which
operational definitions were used not so much to define constructs, as to identify observable
criteria for their application (Feest, 2005). The epoch-making papers of Meehl and associates
advocated consistency of usage by promoting Feigls more realist-oriented version of logical
empiricism.2In defining their concept,MacCorquodale and Meehl (1948)utilized Feigls concept
of existential hypotheses (later expounded inFeigl (1950)). Their very form of words
(hypothetical construct) bespoke a marriage of Carnaps construct concept with Feigls. In
extending the construct concept to test theory,Cronbach and Meehl (1955)aimed to rescue
psychometrics from operationalism and to establish MacCorquodales and Meehls hypothetical
construct concept within that discipline. Hypothetical constructs were proposed as an
alternative to operationally defined concepts: Construct validationis involved whenever a test is
to be interpreted as a measure of some attribute or quality which is not operationally defined
(Cronbach & Meehl, 1955, p. 282). Their intended alternative was unworkable, however,
because, like his mentor, Meehl never overcame the presupposition that constructs absorb at
least some meaning from that of observable concepts, which is incompatible with his view that
hypothetical constructs are proposed as real entities or processes linked causally to those same
observable concepts. Despite Meehls attitude, the wider psychological community did not see
any need to abandon its operationalism. It appropriated Meehl s term, construct validity, but at
the same time required that constructs be operationally defined via mental tests.
This approach also found an unintended justification in Cronbach s and Meehls insistence that
the meaning of theoretical constructs is set forth by stating the laws in which they occur (1955,
p. 294). Of course, psychometrics had no laws, only postulated connections between
constructs, and correlation coefficients between relevant tests. Cronbach and Meehl allowed
that a set of intercorrelations, expressed as factor loadings, substituted for networks of laws and
allowed that in psychology, our incomplete knowledge of the laws of nature produces a
vagueness in our constructs (1955, p. 294). If incomplete knowledge produces vagueness,
then ignorance produces emptiness. They believed that psychologists would eventually be able
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib6http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib6http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib6http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib12http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib12http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib12http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib12http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib12http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib26http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib26http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib26http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib27http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib26http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib12http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib6http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib9http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib47 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
6/31
to define constructs, such as anxiety when all of the laws involving it (Cronbach & Meehl,
1955, p. 294) were in, but psychologists took their words as justification for treating constructs
as empty promissory notes(Messick, 1989, p. 23) for theoretical concepts, the understanding
of which might be indefinitely deferred, while in the interim, operational definitions sufficed for
the pragmatic purpose of anchoring them to observable criteria.
However, ignorance regarding the meaning of constructs is a significant obstacle if one wants to
claim that tests measurethem. As I have argued elsewhere ([Michell, 1990],[Michell,
1997]and[Michell, 1999]&2007a), in claiming to measure constructs, psychologists3typically
display a debilitating false consciousness regarding the concept of measurement, on the one
hand explicitly defining it trivially, followingStevens (1946), as the assignment of numerals to
objects or events according to rules, while on the other hand implicitly presuming the standard
scientific definition because test theories, such as factor analytic and item response theories
require that the relevant theoretical attributes possess continuous quantitative structure. In
quantitative sciences, such as physics ([Maxwell, 1891],[Terrien, 1980]and[Wildhack, 2005]),
it is understood that the measurementof a magnitude of a quantitative attribute is an estimate
of the ratio between that magnitude and whichever magnitude of the same attribute is taken as
the unit of measurement ([Michell, 2007a]and[Michell, 2007b], p. 74), that the concepts of
measurement and continuous quantitative structure are logically interconnected (Hlder, 1901),
and that we cannot measure what we are ignorant of because measurement presumes
knowledge, viz., that the relevant concept is a continuous quantitative attribute.
However, if it is ruled that the meaning of constructs is given by relationships between test
scores, as Cronbach and Meehl suggest, the fact that test scores are discrete quantities could
easily lull adherents ofStevens (1946)definition into thinking that measurement, far from being
prevented by ignorance, is already a fait accompli. Psychologists named constructs using
familiar mental terms, such as anxiety, without dwelling upon the construct s meaning, thinking
it sufficient that constructs were operationalized via test scores. A constructs nomological
network became a tissue of operational definitions, often involving scores on a range of tests
as, for example, general intelligence is thought of as operationally defined via factor analysis
of scores on several tests (Flynn, 2007). Thought of this way, constructs are really dispositional
concepts, that is, defined in terms of their putative effects, but, as has already been stressed,
effects cannot satisfactorily define constructs. For example, general intelligence is sometimes
defined as abstract problem-solving ability, which says nothing about the character of
intelligence per se, but merely specifies it as the otherwise unknown cause of successful
abstract problem-solving behaviour. Furthermore, the constructs dispositional label (e.g.,
abstract reasoning ability), because it seems to admit of degrees of more and less, is taken,
fallaciously (Michell, 2009b), to vouchsafe the constructs presumed quantitative structure.
Psychological constructs, shorn of their operational and dispositional accretions, are merely
conceptual simulacra, lacking intrinsic meaning except for their presumed continuous
quantitative structure.Borsboom, Cramer, Kievit, Zand Scholten, and Franic (2009)note that
we have rarely come across a clear description of what something should be like in order to
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib52http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib52http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib52http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib49http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib49http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib49http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib77http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib77http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib77http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib79http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib79http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib79http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib83http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib83http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib83http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib28http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib28http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib28http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib10http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib10http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib10http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib10http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib28http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib83http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib79http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib77http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib49http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib55http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib52http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
7/31
deserve the label construct (p. 150), but it is exactly this characteristic, viz., the construct
concepts lack of definite characteristics, beyond that of purported measurability, that is really
its raison dtrewithin psychology. It gives the appearance of scientific theorising without any
substance while at the same time appearing to support the claim that psychological tests
measure something.
While the construct concept was not universally endorsed and realist-oriented psychologists
like Loevinger saw that a constructconnotes construction and artifice, whereas, traits and
abilities, if real are exactly what the psychologist does not construct (1957, p. 642), the
mainstream view is that literally a construct is something that the scientist puts together from
his own imagination, justified by the misconception that all theories in science mainly concern
statements about constructs (Nunnally, 1967, p. 85). It is supposed that constructs are
deliberately and consciously invented or adopted for a special scientific purpose, namely, so
that they can be observed and measured via psychological tests (Kerlinger & Lee, 2000, p.
40). However, what is not recognised is that constructs, in being operationally observed and
measured via tests, are deliberately left empty, empty that is, except for the requirement that
they be continuous quantities.
It is worth noting that while psychologists have established methods ofconstruct validation, so
called (e.g.,Jonson & Plake, 1998), it is also not recognised that these are insensitive to the
existence or non-existence of measurability in whatever theoretical attributes actually produce
test performance (Michell, 2009a). Attributes are only measurable if they are continuous
quantities, a feature involving specific empirical conditions. Before anyone can safely conclude
that hypothesised attributes possess continuous quantitative structure, it is necessary to
consider evidence diagnostic of quantitative structure and presently, such evidence is lacking
([Michell, 2000]and[Michell, 2008]). While anyone is free to consider the hypothesis that some
particular attribute possesses this sort of structure, there is no scientific advantage to be gained
by postulating its truth a priori.
3. Theorising, construction and inference
Psychologists embraced the construct concept because they accepted the logical empiricists
view that theorising about hidden causes required some kind of special methodological device.
However, theorising requires no special device. Considered at its most general, science has but
two methodological devices,observationand reason, and as anyone familiar with its history
knows, these are sufficient to deal with hidden causes (Crombie, 1994). By observationis
meant the process whereby knowledge of things is achieved via the senses, augmented,
perhaps, by scientific instruments, such as telescopes, etc., and by reason, the process whereby
knowledge advances through deriving implications of propositions already accepted as true,
using patterns of deductive and probable inference.
Given that we can only consider things in terms of what can be said about them, i.e., in
propositions (Anderson, 1927, p. 242), there are only a limited number of ways to consider
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib39http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib39http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib39http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib37http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib37http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib37http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib56http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib56http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib56http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib60http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib60http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib60http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib21http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib21http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib21http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib1http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib21http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib60http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib56http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib37http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib39http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
8/31
anything: (a) observation might show it to be true or false; (b) it might be inferred from
propositions already accepted; and (c) it might form one amongst a set of propositions tested by
the truth or falsity of implications. It follows then that regarding things that we cannot directly
observe, we must come to know them via reason. We have nothing else to reason from other
than what we already consider true. That is, given observations and general views about the
logic of things (i.e., the logic of causality, of quantity, etc.), scientists must reason their way to
conclusions about things not directly observed. That is, scientists can only get to know about
hidden causes via (b) and (c) above.
The logical empiricists did not see things exactly this way. They emphasised (c) at the expense
of (b) because, asBechtel (1988, p. 66)notes, they made a sharp distinction between the
contexts of discovery and justification. Discovery was assumed to be a nonrational process and
so philosophical attention was directed at the question of how theories could be justified, not
how they were initially developed. Somewhat romantically, theories were understood as
imaginatively, and even irrationally, constructed. AsPopper (1959, p. 31)echoed this point, the
act of conceiving or inventing a theory, seems to me to neither call for logical analysis nor to be
susceptible to it. The logical empiricists did not think that theories were in general discovered
via a rational, inferential process and, so, ruled out (b) above. That is, they rejected the idea that
theories could be inferred from propositions already accepted as true. On the other hand, the
appraisal of theories was seen as a rational process, involving only (c) above. This is
the hypothetico-deductivemodel of justification. Despite its considerable virtues, focussing on it
alone is needlessly fighting a battle one-handed.
A successful theory can only be reached by first considering phenomena to be explained.
Because explanation involves a deductive relationship between theory and phenomena,
theories must be tailored logically to yield fitting implications regarding phenomena.
Furthermore, it is unnecessary for any theory to contain more than required to explain relevant
phenomena and be consistent with other, already accepted, conclusions. Hence, the process of
producing viable theories is first and foremost a process of reasoning from phenomena, that is,
ofinference([Catton, 2004]and[Haig, 2009]; &Musgrave, 2009) and only secondarily, in the
absence of sufficient information and only ever in part if at all, one of imaginativeconstruction.
An inference from the phenomenarequires an adequate conception of the character of
phenomena. Phenomena are not the same as data.Woodward (1989)has clarified this
distinction. First, data are particular, while phenomena may be general. The scientist does not
want a theory that only explains a specific body of data. The scientist wants a theory capable of
explaining general facts about the things investigated and, so, what are to be explained include
general propositions, not only particular ones. One important role of data in science is to
indicate the character of the phenomena to be explained. Second, for any body of data, it is
always likely that it contains errors of observation and, so, if a theory were constructed to
explain all features of data, it would likely be false because it would entail errors. It is a
misconception that theories are falsified by failing to account for all features of data. A
conception of phenomena is needed that distinguishes structure from error in data and this
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib67http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib67http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib67http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib17http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib17http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib17http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib32http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib32http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib32http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib64http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib64http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib64http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib81http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib81http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib81http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib81http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib64http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib32http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib17http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib67http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib5 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
9/31
inevitably involves a degree of idealisation on the scientist s part. What features of data are
erroneous and what reflect genuine phenomena may not always be clear and that, itself, is
something that the scientist needs to discover. The scientist seeks structure in data as a clue to
genuine phenomena and eschews as error that which obscures structure.
A complete analysis of the phenomena involved in psychological testing and the kinds of
theories that might be inferred would be too large an undertaking to pursue here. Instead, I will
consider just one, central issue, viz., in general, is it reasonable to infer from the phenomena of
testing that the theoretical concept (or attribute) assessed by a psychological test possesses
continuous quantitative structure?
Note first that, a priori, there is no logical necessity that attributes underlying test performance
must be continuous quantities. Despite this, from its commencement, the testing movement,
somewhat grandiloquently, referred to scores as measures (e.g.,[Binet,
1905]and[Spearman, 1904]), convinced that test scores measure something(Kelley, 1929, p.
86), even though, as Kelley added, it was never clear what. Furthermore, all testing concepts
were brought into line with this conceit. For example, the problem of validity became that of
the determination of what a test measures(Courtis, 1921, p. 80; my italics), rather than, more
neutrally, determination of what is assessed. These were not harmless terminological excesses.
In those days, beforeStevens (1946)proposed the vacuous definition of measurement that
most psychologists later accepted ([Michell, 1997],[Michell, 2007a]and[Michell, 2007b]), in
scientific contexts, the term measurementmeant only what today is called ratio
scalemeasurement (i.e., discovery or estimation of ratios of magnitudes of continuous
quantitative attributes) and, so, the effect of cementing this terminology in place was to
foreclose consideration of the issue of whether the attributes that tests assess really are
measurable quantities (Michell, 2009a).
Typically, test scores are frequencies (e.g., number of correct responses). Under the same
conditions, on the same test, different people may get different scores. It is reasonable to
conclude that such differences result from psychological differences between those involved.
Now, a difference between test scores is a discrete quantity. From this fact, does it follow that
the underlying, causally relevant psychological difference must be a difference between
magnitudes of some continuous quantitative attribute? Considered as a purely logical question,the answer is nobecause a discrete quantitative difference need not be caused by a
quantitative factor at all, let alone one that is a continuous quantity. For example, it is possible to
imagine two families alike in most respects except for the fact that (a) the first set of parents
believes that contraception is immoral while the second does not and (b) the first set of parents
has more children than the second. In such circumstances, it is possible that the difference in
(a), a non-quantitative factor, is the cause of the difference in (b), a discrete quantitative
outcome. That is, differences in belief may cause differences in numbers of children.
Of course, causality is a complex relation, involving three terms, the cause, the fieldwithin
which the cause operates, and the effect(Anderson, 1938). If the effect is quantitative, there
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib73http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib73http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib73http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib38http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib38http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib38http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib20http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib20http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib20http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib2http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib61http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib59http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib58http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib54http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib20http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib38http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib73http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib7 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
10/31
must be something quantitative in either the cause or the field to produce that quantitative
effect. If the causes are non-quantitative, as in our example, they can only produce a
quantitative difference by acting differentially upon quantitative conditions within the causal
fields. However, as in our example, these quantitative conditions (say, the number of
opportunities for conception) may be the same for both couples and what makes the difference
is different beliefs about the morality of contraception, which in the case of one couple but not
the other, allows birth control methods to be applied.
Where an effect is a difference in frequency, the cause may be (a) a non-quantitative difference
(as shown); or (b) a difference between discrete quantities (as, for example, if our couples
differed in the number of opportunities for conception) or (c) a difference with respect to some
relevant continuous quantity (say, consistent differences in body temperature might affect
fertility). It is only in the latter kind of case that issues to do with measurement, in the scientific
sense, arise. So what follows regarding the causal factors involved in testing?
An answer to this question can be illustrated by the case of cognitive tests. Consider the
phenomenon of a person, a, correctly answering a test item, k, and suppose that as response
is not an error.4In such a case, the cause is the presentation ofkto a, the causal field consists
ofas cognitive resources plus other conditions (physical, social, and psychological) needed
forato respond to k, and the effect is as response. Because as response is both correct and
not an error, amust possess cognitive resources (e.g., knowledge, strategies, and skills) that at
least match ks demands. Suppose, now, that on a test of titems, aanswers just nitems
correctly and another person, b, only mitems (where nand mare any two whole numbers in the
range 0to t). If nothing more is known about the structure of the items and if it is assumed
(1)
that apart from their cognitive resources, the causal fields involving aand bare similar
in all relevant respects;
(2)
that relative to each person, the causal fields remain unchanged throughout the testing
session;
(3)
that no errors have occurred (i.e., that the answers given by aand baccurately reflect
their cognitive resources); and
(4)
that the items are such that for any pair of people, getting the same item correct is only
possible through possessing the same cognitive state;
all that can be inferred validly is that apossesses nand b, mof the tcognitive states required to
get all items correct. That is, we are able to infer validly no more than that the difference in
number of correct responses on this test is caused by the difference in number of relevant
cognitive states possessed. The situation looks like a case of discrete quantity caused by
discrete quantity and, so, no issue of scientific measurement is involved.
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn4 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
11/31
The best we can do in such a case is to classify people according to the combination of
cognitive states possessed and, if the items are binary (i.e., scored correct or incorrect),
there are 2t such combinations possible. That is, the relevant attribute is a partial order
consisting of2t cognitive state combinations (a partial order because if one person gets correct
all items another gets correct, then the first person s combination of cognitive states includes
the second persons). The usual expedient of classifying people according to total score is sub-
optimal because it may class together people with different combinations of cognitive states,
that is, people who differ cognitively relative to this test but, nevertheless, get the same total
score.
However, with certain tests, viz., unidimensional tests, things may seem more promising for
those aspiring to measurement. A unidimensional test is one in which all items assess the same
ability, although items may differ in degree 5of difficulty. Consider the performance ofaand bon
such a test under the same assumptions as above. It not only follows
that apossesses nand b, mof the relevant cognitive states, but also, where n> m,
that apossesses the same mstates that bpossesses plus nmmore (i.e., the test is
aGuttman (1944)scale). In such cases, the relevant set of cognitive states is structured, such
that if a person possesses the cognitive state needed to pass any item, then that person
possesses all of the states needed to pass all less difficult items and, so, instead of the relevant
attribute yielding 2tpartially ordered degrees, it delivers t+ 1 strictly ordered degrees. Now
while such an attribute is not necessarily quantitative (quantity also including additive structure
as well as a strict order), it is half way to that goal (Michell, 2009b). But is the goal necessarily
attainable in this sort of case?
Progressing from any specific degree of such an attribute to higher degrees usually requires
coming to possess whatever new knowledge, strategies, and skills are needed to pass more
difficult items. This may be a problem for the hypothesis that the relevant ability is quantitative
because an increase in knowledge, in available strategies, or in skill is not necessarily an
increase in some homogeneous quality, as is an increase in, say, length, where an increase of
any magnitude is in principle possible from any initial length. Cognitive abilities may not be
homogeneous in this way. In at least some unidimensional tests, say, a test of mathematical
ability, as item difficulty increases, corresponding increases in cognitive resources required for
correct responses are mutually qualitatively heterogeneous. For any pair of items of distinct
difficulties, the difference between the cognitive resources required by the more versus the less
difficult one is not just more of exactly the sameknowledge, samestrategies, orsameskills
already required for the less difficult item, for if it were, it would be no cognitive increase at all
and, so, could not explain the difference in difficulty between the items. Thus, for tests of this
kind, the cognitive attribute assessed is one in which differences between degrees are mutually
heterogeneous.
Now, if the differences between the degrees of some attribute are heterogeneous, then such
differences, being of different kinds, are not intrinsically less than, equal to or greater than one
another; but such intrinsic order relations between differences are exactly what quantitative
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib31http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib31http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib31http://www.sciencedirect.com/science/article/pii/S0732118X11000134#fn5 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
12/31
structure requires (Michell, 2009b). Therefore, in what is thought of as a test suitable for
psychometric measurement (viz., a unidimensional cognitive test of this kind), quantitative
structure is ruled out and, so, measurement is not possible.
Of course, with some unidimensional tests, increasingly difficult items may differ from one
another quantitatively (e.g., items in the digit span subtest of the Wechsler Adult Intelligence
Scale). However, the point at issue does not concern item differences as such; it concerns
differences between the cognitive states necessary and sufficient for correct responses. Even
where item differences are quantitative, if it is the case that, for example, qualitatively different
strategies lead to different levels of performance (as different memory strategies may for digit
span tests [e.g.,Engle & Marshall, 1982]), then the hierarchy of cognitive states constituting the
relevant ability may involve heterogeneous differences between degrees and, if so, cannot
constitute degrees of a quantitative attribute.
None of this is to deny that responses to a unidimensional test might sometimes display
statistical fit to a quantitative, probabilistic measurement model. Statistical fit to such a model
does not by itself entail that the relevant attribute is quantitative because it is entirely possible
that such fit could occur when the structure of the attribute is no more than ordinal
(e.g.,Kyngdon & Richards, 2007). Quantitative structure within the underlying attribute can only
be safely inferred from the phenomena when,
(1)
differences between the content of increasingly difficult items require homogeneous
quantitative differences between the cognitive resources necessary for correct
responses; and
(2)
there is evidence for additive structure within the attribute, such as might be obtained
indirectly by testing the cancellation conditions of additive conjoint measurement theory
(Krantz, Luce, Suppes, & Tversky, 1971; &Michell, 1990) in relation to items specifically
tailored to reveal additive relations (Michell, 2009b).
Kant (Sutherland, 2004), in his writings on measurement,von Kries (1882), in his critique of
psychophysical measurement, andKeynes (1921), in his dissertation on probability, all noted
that ordered attributes possessing heterogeneous differences between degrees are notquantitative and, so, not measurable; andCollingwood (1933)explored this matter in more
depth. However, the possibility of ordinal, non-quantitative attributes is not often acknowledged
in psychometrics. While some have recognised, there may be distinguishable qualitative levels
between the extremes (Wilson, 2005, p. 6) of any psychological attribute, and others have
asked, How can such qualitative changes be hypothesized to fall so many units apart on one
particular trait?(Yen, 1986, p. 312), implications regarding the very possibility of measurement
are ignored. While there are exceptions (e.g.,Cliff & Keats, 2003), psychometricians often write
as if, in assessment, just two kinds of structure are possible, viz., classifications (sometimes
called categories) and continuous quantities (sometimes called dimensions or continua) (see,
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib25http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib25http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib25http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib41http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib41http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib41http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib76http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib76http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib76http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib42http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib42http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib42http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib40http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib40http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib40http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib19http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib19http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib80http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib80http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib80http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib82http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib82http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib82http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib18http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib18http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib18http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib18http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib82http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib80http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib19http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib40http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib42http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib76http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib53http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib41http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib25http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib62 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
13/31
for example,[Cronbach and Meehl, 1955]and[Loevinger, 1957], andDe Boeck, Wilson, and
Acton (2005)). Since the time ofStevens (1946), ordinal scales have been widely recognised,
but these are often seen merely as portents of interval scales (e.g.,Harwell & Gatti, 2001;
andNunnally, 1967).
Interestingly, however, the sorts of ordinal attributes mentioned above mesh more smoothly with
current cognitive theory than do continuous quantitative attributes. An ordered attribute, the
degrees of which are composed of, say, knowledge, strategies, and skills, is defined in terms
similar to those already commonly invoked in cognitive psychology. On the other hand,
continuous quantities, while not incommensurate with the concepts of cognitive science, raise
the issue of how the two sorts of concepts are connected. More than twenty years ago,Snow
and Lohman (1989, p. 317)wrote,
The evidence from cognitive psychology suggests that test performances are comprised of
complex assemblies of component information-processing actions that are adapted to task
requirements during performance. The implication is that sign-trait interpretations of test scores
and their intercorrelations are superficial summaries at best. At worst, they have misled
scientists, and the public, into thinking of fundamental, fixed entities, measured in amounts.
That is, within cognitive psychology it has been found that performance differences are most
usefully accounted for in terms of qualitative differences between relevant cognitive resources
and not in terms of differences between magnitudes of the sorts of quantitative constructs
invoked in psychometrics. I suggest that psychological constructs remain empty concepts
precisely because of the difficulties in specifying, first, what the homogeneous stuff is that
people differing in some continuously quantitative construct have different amounts of and,
second, how quantitative differences in this stuff translate into differences in the cognitive
resources that test performances require.
Therefore, my conclusion is that there seems little basis within the phenomena of testing from
which to infer that the theoretical concepts assessed by tests are continuous quantities. Indeed,
the fact that for at least some unidimensional cognitive tests, differences between degrees of
the relevant attribute are heterogeneous entails that the relevant attributes, although ordered,
must actually be non-quantitative. It remains to be seen how far this conclusion generalizes.
Some signs suggest that it generalizes beyond abilities. Consider social attitudes: in cases
where items are so constructed as to ensure unidimensionality, positive increases in attitude
toward some social issue are generally accompanied by heterogeneous differences between
attitude content (e.g.,Kyngdon & Richards, 2007). This suggests that a series of attitudes
towards some social issue ordered from favourable to unfavourable will display heterogeneous
differences between degrees and, so, be non-quantitative as well.
Thus, the hypothesis that the attributes underlying test performance are quantitative cannot be
taken as thea priorior default position for psychometrics. Instead, the quantitative hypotheses
characterising psychometrics require evidence specifically diagnostic of quantitative structureover and above that of mere order. In so far as quantitative structure is taken to be part and
http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib46http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib46http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib46http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib23http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib23http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib23http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib23http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib33http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib33http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib33http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib72http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib72http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib72http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib72http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib43http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib72http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib72http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib33http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib74http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib23http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib23http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib46http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bib22 -
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
14/31
-
7/31/2019 Constructs Inferences and Mental Measurement Critica a La Medida en Psicologia
15/31
o J. Andersonoo Australasian Journal of Psychology and Philosophy, 16 (1938), pp. 127142o
via CrossRef3.
o Anderson, 2007o J. Andersonoo Sydney University Press, Sydney (2007)o View Record in Scopus
|
via CrossRef| Cited By in Scopus (10)
4.o Armstrong, 2010o D.M. Armstrongoo Clarendon Press, Oxford (2010)o via CrossRef
5.o Bechtel, 1988o W. Bechteloo Erlbaum, Hillsdale, NJ (1988)o
6.o Beck, 1950o L.W. Beckoo Philosophy of Science, 17 (1950), pp. 7486o via CrossRef
7.o Binet, 1905o A. Binetoo Schleicher, Paris (1905)
http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1080%252F00048403808541382&_acct=C000049823&_version=1&_userid=984461&md5=5b11991be24736014db75c4a4fef8219http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1080%252F00048403808541382&_acct=C000049823&_version=1&_userid=984461&md5=5b11991be24736014db75c4a4fef8219http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib3http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib3http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=655&_eid=1-s2.0-S0732118X11000134&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fwww.scopus.com%2Finward%2Frecord.url%3Feid%3D2-s2.0-34047094259%26partnerID%3D10%26rel%3DR3.0.0%26md5%3D6f9082b4d78b5b0321889913a7b2ab19&_acct=C000049823&_version=1&_userid=984461&md5=1c2d7356b662ad6370733f297191e4f0http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=655&_eid=1-s2.0-S0732118X11000134&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fwww.scopus.com%2Finward%2Frecord.url%3Feid%3D2-s2.0-34047094259%26partnerID%3D10%26rel%3DR3.0.0%26md5%3D6f9082b4d78b5b0321889913a7b2ab19&_acct=C000049823&_version=1&_userid=984461&md5=1c2d7356b662ad6370733f297191e4f0http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1002%252Fchin.200706079&_acct=C000049823&_version=1&_userid=984461&md5=794e47dc31cdbe8e66709ef7e752c457http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1002%252Fchin.200706079&_acct=C000049823&_version=1&_userid=984461&md5=794e47dc31cdbe8e66709ef7e752c457http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=656&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fwww.scopus.com%2Finward%2Fcitedby.url%3Feid%3D2-s2.0-34047094259%26partnerID%3D10%26rel%3DR3.0.0%26md5%3D6f9082b4d78b5b0321889913a7b2ab19&_acct=C000049823&_version=1&_userid=984461&md5=024cc3cbff3436fbd053f70c22fe8478http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=656&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fwww.scopus.com%2Finward%2Fcitedby.url%3Feid%3D2-s2.0-34047094259%26partnerID%3D10%26rel%3DR3.0.0%26md5%3D6f9082b4d78b5b0321889913a7b2ab19&_acct=C000049823&_version=1&_userid=984461&md5=024cc3cbff3436fbd053f70c22fe8478http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib4http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib4http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1002%252F9780470571224.pse085&_acct=C000049823&_version=1&_userid=984461&md5=4ff3c9e2a8f89d8ed8a88c35a0119e65http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1002%252F9780470571224.pse085&_acct=C000049823&_version=1&_userid=984461&md5=4ff3c9e2a8f89d8ed8a88c35a0119e65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib5http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib6http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib6http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1086%252F287067&_acct=C000049823&_version=1&_userid=984461&md5=db679c83904036ee92e1a01551c87546http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1086%252F287067&_acct=C000049823&_version=1&_userid=984461&md5=db679c83904036ee92e1a01551c87546http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib7http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib7http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1086%252F287067&_acct=C000049823&_version=1&_userid=984461&md5=db679c83904036ee92e1a01551c87546http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib6http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib5http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=3&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fdx.doi.org%2F10.1002%252F9780470571224.pse085&_acct=C000049823&_version=1&_userid=984461&md5=4ff3c9e2a8f89d8ed8a88c35a0119e65http://www.sciencedirect.com/science/article/pii/S0732118X11000134#bbib4http://www.sciencedirect.com/science?_ob=RedirectURL&_method=outwardLink&_partnerName=656&_origin=article&_zone=art_page&_targetURL=http%3A%2F%2Fwww.scopus.com%2Finward%2Fcitedby.url%3Feid%3D2-s2.0-34047094259%26partnerID%3D10%26rel%3DR3.0.0%26md5%3D6f9082b4d78b5b0321889913a7b2ab19&_acct