Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476...

18
portal: Libraries and the Academy, Vol. 18, No. 3 (2018), pp. 473–490. Copyright © 2018 by Johns Hopkins University Press, Baltimore, MD 21218. Research Collaboration by Practitioners in Computer Science, Library Science, and Management Yu-Wei Chang abstract: This study investigated and compared the proportions and trends of coauthored articles by practitioners in the three fields of computer science, library science, and management. The primary practitioners writing articles in these three fields were engineers, librarians, and consultants, respectively. Practitioner authors were scarce, however, in computer science and management. The author of this study analyzed articles published in nine selected journals in each field indexed by Journal Citation Reports between 2005 and 2014. The proportions of articles in library science coauthored either by practitioners only—that is, by librarians—or by both practitioners and researchers were considerably higher than those in computer science and management. Articles coauthored by practitioners and researchers in computer science increased slightly over the study period, whereas such articles decreased slightly in both library science and management. Introduction R esearch collaborations have become prevalent in many fields of scholarship. 1 Researchers form collaborations because of the increasing complexity of re- search problems, 2 the advantages of collaboration, 3 and encouragement from science policies. 4 Scholars have already studied several types of research collaboration, including domestic versus international, 5 within institutions versus between them, 6 and intradisciplinary versus interdisciplinary. 7 Other types of research collaboration have been neglected, however, including joint efforts between practitioners and nonpractitio- ners. One possible reason is that researchers are the primary knowledge producers and frequently collaborate with other researchers. 8 Practitioners contribute practice-oriented rather than theoretical knowledge, and so they make only limited contributions to re- search collaborations. Scholars have explored research collaborations at different levels, This mss. is peer reviewed, copy edited, and accepted for publication, portal 18.3.

Transcript of Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476...

Page 1: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 473

portal: Libraries and the Academy, Vol. 18, No. 3 (2018), pp. 473–490. Copyright © 2018 by Johns Hopkins University Press, Baltimore, MD 21218.

Research Collaboration by Practitioners in Computer Science, Library Science, and ManagementYu-Wei Chang

abstract: This study investigated and compared the proportions and trends of coauthored articles by practitioners in the three fields of computer science, library science, and management. The primary practitioners writing articles in these three fields were engineers, librarians, and consultants, respectively. Practitioner authors were scarce, however, in computer science and management. The author of this study analyzed articles published in nine selected journals in each field indexed by Journal Citation Reports between 2005 and 2014. The proportions of articles in library science coauthored either by practitioners only—that is, by librarians—or by both practitioners and researchers were considerably higher than those in computer science and management. Articles coauthored by practitioners and researchers in computer science increased slightly over the study period, whereas such articles decreased slightly in both library science and management.

Introduction

R esearch collaborations have become prevalent in many fields of scholarship.1 Researchers form collaborations because of the increasing complexity of re-search problems,2 the advantages of collaboration,3 and encouragement from

science policies.4 Scholars have already studied several types of research collaboration, including domestic versus international,5 within institutions versus between them,6 and intradisciplinary versus interdisciplinary.7 Other types of research collaboration have been neglected, however, including joint efforts between practitioners and nonpractitio-ners. One possible reason is that researchers are the primary knowledge producers and frequently collaborate with other researchers.8 Practitioners contribute practice-oriented rather than theoretical knowledge, and so they make only limited contributions to re-search collaborations. Scholars have explored research collaborations at different levels,

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 2: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management474

such as the individual, institutional, and country level. Bibliographic records provide little detailed information about individual collaborations, however, forcing researchers to employ more laborious methods to collect data.

Although coauthored articles have increased in numerous disciplines, this paper will discuss the different rates of increase for articles generated from the various types of research collaboration.9 It will also present the changes in coauthored articles produced by each type of collaboration, to clarify the differences in trends.

This study examined three disciplines—com-puter science, library science, and management. The author selected these three because this study is one of a series investigations and an extension of

a similar study in the field of library and information science (LIS). Computer science and management have a close disciplinary relationship with LIS. Citation studies have indicated that computer science and management were the primary disciplines support-ing the development of LIS.10 Certain LIS programs include a focus on computer science or management, such as business information courses,11 knowledge management,12 and information and communications technology.13 LIS, consisting of library science and information science, is a typical interdisciplinary field,14 but library science and informa-tion science differ.15 In addition, a close relationship exists between information science and computer science.16 Therefore, the author chose library science, not LIS, as one of the subjects for this study.

The main research questions of this study were:

1. Are there trends of increasing article coauthorship by practitioners in computer science, library science, and management?

2. Who are the primary practitioner authors in computer science, library science, and management?

Literature Review

Scholars have recognized researcher-practitioner gaps across many disciplines and have discussed such gaps within computer science,17 LIS,18 and management.19 Ronald Powell, Lynda Baker, and Joseph Mika investigated LIS practitioners’ involvement in research.20 Debra Shapiro, Bradley Kirkman, and Hugh Courtney verified the research-practitioner gap in both knowledge production and knowledge transfer in the field of management.21 Basil Tucker and Lee Parker investigated senior management researchers and found most agreeing that research should engage with practice.22

The different characteristics of researchers and practitioners have led to the research-er-practitioner gap. Practitioners want timely solutions for their real-world problems, whereas researchers dedicate themselves to probing theories over a long period.23 The two groups value different aspects of knowledge and have different knowledge bases.24 These differences mean that practitioners are not the primary collaborators of researchers.

Practitioners contribute practice-oriented rather than theoretical knowledge, and so they make only limited contributions to research collaborations.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 3: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 475

However, G. Jan van Helden, Harrie Aardema, Henk ter Bogt, and Tom Groot reported that, although researchers have a high interest in exploring theoretical problems, some are also concerned with applied knowledge.25 By contrast, practitioners’ research problems are grounded in practice and disconnected from academic research. These contrasting motives influence the types of knowledge created by researchers and practitioners, while also ac-counting for the separate information sources used by each. Although most researchers rely on academic and professional journals, practi-tioners require knowledge from both theoretical and practical sources. Practice-oriented researchers and research-oriented practitioners stimulate and facilitate collaborations between the two groups. Encouraging practitioners to publish and collaborate with researchers can also narrow the gap between research and practice.

Management researchers have discussed the researcher-practitioner gap more than computer science researchers have, including influencing factors and research-practice collaborations.26 Andrew Van de Ven and Paul Johnson divided the researcher-practi-tioner gap into three types of problems: knowledge production, knowledge transfer, and knowledge of theory and practice.27 Among the possible forms of collaboration, researcher-practitioner collaborations have particularly suffered because of the barriers in communicating across different knowledge bases.28 Some authors have identified means of promoting collaboration, such as establishing organizations dedicated to facilitating and supporting joint efforts by researchers and practitioners29 and developing a relational scholarship of integration.30

Few studies in LIS and management have focused on the publications coauthored by researchers and practitioners, and none have done so in computer science. Rick Vo-gel investigated 892 articles on German public management published between 1989 and 2005, finding that only 1.7 percent of the articles were cowritten by researchers and practitioners.31 Researcher-practitioner collaborations were not the focus of Vo-gel’s study, however, and he reported no further relevant findings. Shona Morgan and Carin Lightner-Laws found a higher proportion of researcher-practitioner coauthored articles (approximately 9 percent) in supply chain management, based on articles pub-lished between 2001 and 2010 in 14 related journals.32 Some journals published more academic-practitioner coauthored articles than others. Morgan and Lightner-Laws and Vogel divided practitioners into five categories, namely businessmen, government staff, consultants, foundation staff, and others, classifying them according to their institutional affiliations. This study uses different criteria.33

Methodology

Data Collection

This study sampled English-language research articles published in nine computer science journals, nine library science journals, and nine management journals between

Practitioners want timely solutions for their real-world problems, whereas researchers dedicate themselves to probing theories over a long period.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 4: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management476

2005 and 2014. The author selected management journals from the subject category of “management” in the 2013 version of Journal Citation Reports, an annual publication of Clarivate Analytics that provides information about scholarly publications in the natu-ral and social sciences. She chose computer science journals from seven related subject categories: “computer science, artificial intelligence,” “computer science, cybernetics,’’ “computer science, hardware & architecture,” “computer science, information systems,’’ “computer science-interdisciplinary applications,” “computer science, software engineer-ing,” and “computer science, theory & methods.” She selected library science journals from the subject category “library science and information science.” Journal titles con-taining the keyword “library” or “libraries” were classified as library science journals.

The author considered candidate journals for their five-year impact factor values and detailed author information, such as institution names and job titles. She examined the journal with the highest impact factor first, to determine whether articles published between 2005 and 2014 listed the detailed author information required to classify each author as a researcher or practitioner. The period for the study was limited to 10 years. Because the number of candidate library science journals was much lower than that of computer science or management journals, the author examined the library science journals first, according to the requirements. Most journals provided only institution and department names, meaning that the type of author could not be identified. For example, graduate students could not be distinguished from faculty members. A few journals provided job titles only for certain years within the research period. Journals not providing the required information were excluded. Only nine library science journals met the journal selection requirements. As a result, the author selected the same number of computer science journals and management journals. She identified nine computer science journals providing the necessary details. The procedures for determining the nine management journals were the same.

The nine selected library science journals were

1. College & Research Libraries,2. Electronic Library,3. Information Technology and Libraries,4. Journal of the Medical Library Association,5. Library & Information Science Research,6. Library Quarterly,7. Library Resources & Technical Services,8. Library Trends, and9. Libri: International Journal of Libraries and Information Studies.

The nine management journals were

1. Academy of Management Perspectives,2. Journal of Business Logistics,3. Journal of International Business Studies,4. Journal of Organizational Behavior,5. Journal of Supply Chain Management,6. Long Range Planning,

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 5: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 477

7. MIS [management information systems] Quarterly,8. Organization Studies, and9. Organizational Research Methods.

The computer science journals, selected according to the same process and require-ments, were

1. IEEE [Institute of Electrical and Electronics Engineers] Communications Surveys and Tutorials,

2. IEEE Network,3. IEEE Transactions on Evolutionary Computation,4. IEEE Transactions on Fuzzy Systems,5. IEEE Transactions on Industrial Informatics,6. IEEE Transactions on Pattern Analysis and Machine Intelligence,7. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics,8. IEEE Wireless Communications, and9. Journal of Information Technology.

Eight of the nine selected computer science journals were IEEE journals. Although numerous computer science journals with higher five-year impact factor values were representative samples, they did not meet the journal selection requirements.

Data Processing and Analysis

The author collected bibliographical records of English-language research articles from the Scopus database, a large, multidisciplinary index of citations and abstracts. The basic bibliographical data for each article included its title, authors’ names, journal title, publication year, volume and number, and page numbers. Because the database does not provide job titles, the author examined the full texts of the coauthored articles. The information for a few authors was incomplete. In these cases, the author searched the Internet to find the missing details. If this information could not be found, that article was excluded.

The investigator classified the authors as researchers, practitioners, students, or other, according to their attributes. Researchers were defined as people whose primary task is to conduct research, whether at academic institutions, companies, or other organizations. The data processing in this study differs from that in related studies, which regarded researcher-practitioner collaborations as university-industry collaborations.34 Once the authors were classified, the coauthored articles were divided into seven categories ac-cording to the authors:

1. articles by researchers;2. articles by researchers and students;3. articles by practitioners and researchers;4. articles by practitioners, researchers, and students;5. articles by practitioners;6. articles by practitioners and students; and7. articles by students.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 6: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management478

Results

Research Collaboration by Type

Table 1 shows the distributions of the seven types of research collaboration in the com-puter science, library science, and management fields. Coauthored articles prevailed in

all three fields; however, the rate of single-authored articles was much higher in library science than in computer science or management. There were large differences in the distribution of articles among the three fields, except for articles coauthored by practi-tioners, researchers, and students; by practitioners and students; and by students.

In computer science, 81.4 percent of coauthored articles resulted from researcher-researcher and researcher-student collaborations. Although articles

coauthored by researchers and practitioners accounted for the third largest proportion among the seven types, there was a large difference between the second- and third-largest types of coauthored articles (37.9 percent versus 6.6 percent).

In management, researcher-researcher collaboration also ranked as the dominant collaboration type, followed by researcher-student collaboration. However, there was a large difference between the proportion of articles coauthored by researchers and that written by researchers and students (64.2 percent versus 11.1 percent). The proportion of researcher-practitioner articles in this field was lower (4.4 percent) than that in computer science. No practitioner-student or student-student collaborations were identified. Pear-son’s chi-squared test (p = 0.00 < 0.05), a statistical test used to compare observed data with the results expected, confirmed the existence of a significant statistical difference in the type of collaboration between computer science and management. In library science, approximately half the articles (50.6 percent) were produced by researcher-researcher, practitioner-researcher, and practitioner-practitioner collaborations. Both the proportion of articles coauthored by practitioners and researchers and the proportion coauthored by practitioners were much higher than those in computer science and management. A large proportion of practitioner authors were library science practitioners—that is, mostly librarians. Pearson’s chi-squared test confirmed the existence of a statistically significant difference in the distribution of collaboration type between library science and computer science, and between library science and management.

Figures 1 and 3 show the differences in trends of the four primary types of research col-laboration for computer science, library science, and management by year. Figure 1 shows a decreasing trend for computer science articles coauthored by researchers, but an increasing trend for articles coauthored by researchers and students. Researcher-student collaboration has dominated since 2012. A slightly increasing trend also appeared in practitioner-researcher and practitioner-researcher-student collaborations. For management, the study identified an increasing trend in researcher-researcher and researcher-student collaborations, but a slightly decrease in practitioner-researcher collaborations. No trends could be observed in practitioner-researcher-student collaborations because of the small number of articles. For library science, practitioner-practitioner, researcher-researcher, and researcher-student col-laborations increased, and practitioner-researcher collaboration decreased slightly.

. . . the rate of single-au-thored articles was much higher in library science than in computer science or management.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 7: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 479

Tabl

e 1.

Type

s of r

esea

rch

colla

bora

tion

Type

of r

esea

rch

colla

bora

tion

C

ompu

ter

scie

nce

L

ibra

ry sc

ienc

e

Man

agem

ent

N

umbe

r of a

rtic

les

Per

cent

age

N

umbe

r of a

rtic

les

Per

cent

age

Num

ber o

f art

icle

s

P

erce

ntag

e

Rese

arch

er-r

esea

rche

r 2,

093

43.5

42

7 20

.3

1,94

6 64

.2Re

sear

cher

-stu

dent

1,

824

37.9

17

6 8.

4 33

5 11

.1Pr

actit

ione

r-re

sear

cher

31

7 6.

6 30

3 14

.4

132

4.4

Prac

titio

ner-

rese

arch

er-s

tude

nt

124

2.6

1 0

19

0.6

Prac

titio

ner-

prac

titio

ner

10

0.2

334

15.9

1

0Pr

actit

ione

r-st

uden

t 4

0.1

10

0.5

0 0

Stud

ent-s

tude

nt

3 0.

1 4

0.4

0 0

Sing

le-a

utho

r ed

artic

les

434

0.9

847

40.3

59

6 19

.7

Tota

l 4,

809

100.

0 2,

102

100.

0 3,

029

100.

0

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 8: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management480

Figure 1. Trends of four main types of research collaboration in computer science.

Figure 2. Trends of four main types of research collaboration in management.This

mss

. is pe

er rev

iewed

, cop

y edit

ed, a

nd ac

cepte

d for

publi

catio

n, po

rtal 1

8.3.

Page 9: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 481

Practitioner Authors in Research Collaboration

Practitioner authors took part in four types of research collaboration: practitioner-researcher, practitioner-researcher-student, practitioner-practitioner, and practitioner-student collaborations. In computer science, 620 practitioner authors contributed to coauthored articles, and 98.2 percent of these authors worked as technical staff, such as computer engineers and system architects, in computer-related industries. In library sci-ence, 423 practitioner authors were identified from coauthored articles, and 74.5 percent were librarians. In management, 175 practitioner authors participated in research col-laborations, and 90.8 percent worked for companies, government agencies, or academic institutions. Job titles commonly included “consultant” or “manager.”

Articles Coauthored by Researchers and Practitioners by Journal

Table 2 lists the distribution of article types in each journal. Except for the Journal of Information Technology, coauthorship by researchers or researchers and students were primarily represented in computer science. The proportion of coauthored articles by researchers and practitioners in each journal ranged from 2.8 to 10.9 percent. In library science, except for College & Research Libraries and Journal of the Medical Library Associa-tion, single-authored articles dominated. Four journals had a large proportion of articles coauthored by practitioners, between 31.4 and 36.4 percent. For management journals, except for the Academy of Management Perspectives, articles coauthored by researchers dominated, ranging between 54.2 and 80.0 percent. Each journal had a low proportion of articles coauthored by practitioners and researchers, which ranged from 1.2 to 7.8 percent. The 18 journals were all research-oriented.

Figure 3. Trends of four main types of research collaboration in library science.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 10: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management482

Tabl

e 2.

Dis

trib

utio

n of

art

icle

s by

type

and

jour

nal t

itle

P

erce

ntag

e of

art

icle

s D

isci

plin

e Jo

urna

l tit

le

Coau

thor

ed b

y Co

auth

ored

by

Coau

thor

ed b

y Co

auth

ored

by

Coau

thor

ed b

y By

sing

le

rese

arch

ers

rese

arch

ers

and

prac

titi

oner

s an

d pr

acti

tion

ers

prac

titi

oner

s au

thor

st

uden

ts

rese

arch

ers

Com

pute

r sc

ienc

e Jo

urna

l of I

nfor

mat

ion

Tech

nolo

gy

59.7

11

.0

6.3

0.

0

2.1

20

.9

IE

EE [I

nstit

ute

of E

lect

rical

an

d El

ectro

nics

Eng

inee

rs]

Tran

sact

ions

on

Fuzz

y Sy

stem

s 52

.8

30.0

2.

8

0.0

0.

7

13.8

IEEE

Tra

nsac

tions

on

Evol

utio

nary

C

ompu

tatio

n 47

.6

37.5

5.

4

0.2

1.

7

7.5

IE

EE T

rans

actio

ns o

n Pa

ttern

Anal

ysis

and

Mac

hine

Inte

llige

nce

45.0

35

.9

6.4

0.

4

2.8

9.

5

IEEE

Tra

nsac

tions

on

Syst

ems,

M

an, a

nd C

yber

netic

s, Pa

rt B

:

C

yber

netic

s 42

.7

42.8

5.

8

0.0

1.

6

7.1

IE

EE T

rans

actio

ns o

n In

dust

rial

In

form

atic

s 38

.4

42.9

8.

4

0.0

4.

2

6.1

IE

EE W

irele

ss C

omm

unic

atio

ns

34.5

40

.3

9.5

1.

5

6.0

8.

2

 IE

EE N

etw

ork

32.2

50

.0

8.8

0.

3

4.2

4.

5

IEEE

Com

mun

icat

ions

Sur

veys

and

Tu

tori

als

32.0

45

.1

10.9

0.

6

5.7

5.

7

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 11: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 483

Libr

ary

scie

nce

Libr

ary

& In

form

atio

n Sc

ience

Res

earc

h 34

.4

15.6

9.

6 2.

0 0.

0 38

.4

Elec

troni

c Li

brar

y 24

.8

12.2

17

.0

10.5

1.

1 34

.5

Libr

i 23

.5

10.4

12

.2

2.6

1.3

50.0

In

form

atio

n Te

chno

logy

and

Lib

rari

es

17.9

3.

4 9.

4 34

.2

0.0

35.0

Li

brar

y Q

uart

erly

17

.5

6.1

13.2

1.

8 0.

0 61

.4

Col

lege

& R

esea

rch

Libr

arie

s 16

.9

5.3

13.2

32

.5

0.4

31.7

Li

brar

y Tr

ends

15

.6

6.0

6.3

10.8

1.

3 60

.0

Libr

ary

Reso

urce

s & T

echn

ical

Ser

vice

s 11

.6

1.7

7.4

36.4

0.

0 43

.0

Jour

nal o

f the

Med

ical

Lib

rary

As

soci

atio

n 10

.2

4.2

35.2

31

.4

0.8

18.2

Man

agem

ent

M

IS [m

anag

emen

t inf

orm

atio

n

syst

ems]

Qua

rter

ly

80.0

8.

2

3.9

0.

0

0.6

7.

3

Jour

nal o

f Int

erna

tiona

l Bus

ines

s Stu

dies

78

.5

7.0

1.

2

0.0

0.

0

13.4

Jour

nal o

f Bus

ines

s Log

istic

s 72

.9

13.9

7.

8

0.0

0.

6

4.8

Lo

ng R

ange

Pla

nnin

g 64

.3

9.1

6.

7

0.4

0.

8

18.7

Jour

nal o

f Or g

aniz

atio

nal B

ehav

ior

60.9

20

.9

5.0

0.

0

1.7

1 1

.5

O

rgan

izat

iona

l Res

earc

h M

etho

ds

57.9

18

.0

3.8

0.

0

0.4

19

.9

O

rgan

izat

ion

Stud

ies

56.0

3.

1

4.3

0.

0

0.2

36

.5

 

Jour

nal o

f Sup

ply

Cha

in M

anag

emen

t 54

.2

15.4

7.

0

0.0

1.

5

21.9

Acad

emy

of M

anag

emen

t Per

spec

tives

39

.6

11.0

3.

7

0.0

0.

0

45.7

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 12: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management484

Discussion

This study focused on coauthored articles by at least one practitioner author and determined the occupations of practitioners involved in research collaborations. Co-

authored articles dominate in computer science, library science, and management. Computer science journals contained the highest percentage of coauthored articles among the three disciplines. Among the seven types of research collaboration, most coauthored articles in computer science

represented two types, researcher-researcher and researcher-student. Five types of research collaboration appeared in management, with most management articles being collaborations between researchers. No coauthored articles by practitioners and students were observed. A substantial proportion of library science articles were contributed by practitioner-researcher and practitioner-practitioner collaborations. Practitioner authors were rare in computer science and management.

Computer science and management researchers frequently collaborated with other researchers, which is consistent with expectations because publishing is the primary task of researchers. Students were also primary research partners for computer science researchers. Although students pursuing master’s and doctoral degrees are the primary sources of research assistants for faculty members, the differences in the task profiles of research assistants between disciplines may affect the recognition of authors.35 Findings show that a higher collaboration rate existed between researchers and students in com-puter science than in management. This indicates that graduate students in computer science often contribute to research.

Differences between researchers and practitioners, including logic, time to conduct research, interests, incentives, and types of knowledge required, can result in conflict

between them.36 Although researchers shar-ing their findings with practitioners can help nonacademics gain new knowledge, knowledge transfer is hindered by academic reward systems, which emphasize dissemi-nating research results to the academic com-munity and publishing in peer-reviewed journals.37 This emphasis may explain why researchers frequently collaborate with other researchers and students.

The selection of research collaborators determines the type of collaboration, because collaborators differ in disciplinary back-grounds, institutional affiliations, and research interests. Researchers tend to identify collaborators from their social network, with trust and subject expertise being major factors affecting their consideration.38 Frequent collaborations between authors build trust,39 which implies a closer relationship between researchers and students in computer science than in either library science or management. If practitioners belong to research-ers’ social networks, researchers will more likely collaborate with them. Researchers trust

Coauthored articles dominate in computer science, library science, and management.

. . . knowledge transfer is hindered by academic reward systems, which emphasize disseminating research results to the academic community and publishing in peer-reviewed journals.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 13: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 485

practitioners because of their professional background. Furthermore, despite advances in telecommunication, geographical proximity is still an essential factor when researchers seek collaborators, including academic-industry collaborations.40 T. S. Evans, Renaud Lambiotte, and Pietro Panzarasa reported that management researchers tend to seek collaborators from their own institutions and disciplines.41

This study confirms that the primary collaborators of researchers are other research-ers. The findings also contribute figures related to the proportion of articles coauthored by researchers and practitioners, which are new to the literature. The low proportion of articles coauthored by practitioners and researchers in computer science and manage-ment is consistent with figures reported by Vogel, who focused on public administra-tion, and by Morgan and Lightner-Laws, who investigated supply chain management.42 The low proportion of articles coauthored by researchers and practitioners implies that collaboration presents challenges when participants represent different perspectives toward research. In certain countries, librarian authors are required to publish.43 This fact distinguishes librarians from practitioners in computer science and management. Numerous studies have reported that librarians are the main contributors for the growth of LIS research.44

This study further contributes by presenting trends in the primary types of research collaboration tracked over time, including practitioner-researcher collaboration. A slightly increasing trend in practitioner-researcher collaborations was observed in computer science, whereas both library science and management showed a slightly decreasing trend. Similarities were determined between the types of practitioner authors in com-puter science, library science, and management. Most practitioner authors had a high association with their fields: technical staff worked in the computer industry, informa-tion staff worked for institutions, and managerial staff worked in various industries. A specific type of practitioner dominated in computer science and library science: en-gineers and librarians, respectively. Management practitioners demonstrated a greater variety of job titles. Numerous practitioner authors had doctoral degrees. Given that they have research experience, they possibly have greater research interests than other practitioner authors do, which may explain their collaborations with researchers. These practitioner-researchers cross the boundary by playing both roles and bridge the gap between research and practice.45

The major limitation of this study is that most of the selected journals are research-based, because they were chosen from Journal Citation Reports. The research-oriented nature of those journals was also revealed by the high percentage of articles generated from researcher-researcher and researcher-student collaborations. Researcher journals are not the primary communication forum for practitioners in their disciplines.46 Therefore, the findings that most authors involved in research collaborations are researchers, and the low proportion of articles coauthored by researchers and practitioners, were anticipated. To improve the precision of identifying academic and practitioner authors, this study examined authors’ job titles individually, not the type of institution with which they were affiliated. Most journals did not provide authors’ job titles in the articles; therefore, many journals with high impact factors or reputations were excluded. Furthermore, no attempt was made to balance the numbers of research-based and practice-based journals. Moreover, classifying the authors by detailed affiliation information, including job title, was laborious, which limited the analysis to only nine journals in each field.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 14: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management486

Conclusion

Research collaboration is one form of collaboration encouraged between practitioners and researchers. The differences in their respective knowledge bases are complemen-

tary. Although researchers are the primary knowledge creators, practitioners also con-tribute to the development of disciplines. Therefore, research collaborations between researchers and practitioners benefit knowl-edge creation, and the contributions of prac-titioners must not be neglected. This study examined the trends of coauthored articles

by practitioners, including practitioner-researcher collaborations, revealing that the research-practice gap may be narrowing.

Although the low number of practitioner authors involved in research collaboration was anticipated, the findings confirm that practitioners have successfully collaborated with researchers. The comparative study of contributions made by practitioner authors in computer science, library science, and management helps LIS readers understand the differences in two fields strongly connected with library science. In addition, research results indicate that library science practitioner authors find it challenging to seek other practitioner authors as research partners from both computer science and management. Practitioner authors with doctoral degrees are familiar with both research and the practi-cal aspects of their professions, and thus can facilitate interactions between research and practice. This type of practitioner author, though rare, can serve to gradually improve the relationship between research and practice. Given the limitations related to journal selection in this study, further investigation of research collaboration types in practice-based journals is recommended to clarify the roles of practitioners.

Yu-Wei Chang is an associate professor in the Department of Library and Information Science at National Taiwan University in Taipei, Taiwan; she may be reached by e-mail at: [email protected].

Notes

1. EunKyung Chung, Nahyun Kwon, and Jungyeoun Lee, “Understanding Scientific Collaboration in the Research Life Cycle: Bio- and Nanoscientists’ Motivations, Information-Sharing and Communication Practices, and Barriers to Collaboration,” Journal of the Association for Information Science and Technology 67, 8 (2016): 1836–48.

2. J. Sylvan Katz and Ben R. Martin, “What Is Research Collaboration?” Research Policy 26, 1 (1997): 1–18.

3. Adrian Cherney, Brian Head, Paul Boreham, Jenny Povey, and Michele Ferguson, “Perspectives of Academic Social Scientists on Knowledge Transfer and Research Collaborations: A Cross-Sectional Survey of Australian Academics,” Evidence & Policy 8, 4 (2012): 433–53; Richard L. Hart, “Co-Authorship in the Academic Library Literature: A Survey of Attitudes and Behaviors,” Journal of Academic Librarianship 26, 5 (2000): 339–45; Seongkyoon Jeong, Jae Young Choi, and Jaeyun Kim, “The Determinants of Research Collaboration Modes: Exploring the Effects of Research and Researcher Characteristics on Co-Authorship,” Scientometrics 89, 3 (2011): 967–83; Richard Woolley,

Although researchers are the primary knowledge creators, practitioners also contribute to the development of disciplines.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 15: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 487

Mabel Sánchez-Barrioluengo, Tim Turpin, and Jane Marceau, “Research Collaboration in the Social Sciences: What Factors Are Associated with Disciplinary and Interdisciplinary Collaboration?” Science and Public Policy 42, 4 (2015): 567–82.

4. Hanna-Mari Puuska, Reetta Muhonen, and Yrjö Leino, “International and Domestic Co-Publishing and Their Citation Impact in Different Disciplines,” Scientometrics 98, 2 (2014): 823–39.

5. Radhamany Sooryamoorthy, “Collaboration and Publication: How Collaborative Are Scientists in South Africa?” Scientometrics 80, 2 (2009): 419–39; Hui Xuan Tan, Ephrance Abu Ujum, Kwai Fatt Choong, and Kuru Ratnavelu, “Impact Analysis of Domestic and International Research Collaborations: A Malaysian Case Study,” Scientometrics 102, 1 (2015): 885–904.

6. T. S. Evans, Renaud Lambiotte, and Pietro Panzarasa, “Community Structure and Patterns of Scientific Collaboration in Business and Management,” Scientometrics 89, 1 (2011): 381–96; Davood Gorjizadeh and Azar Eftekhar, “A Scientometric Analysis of Scholarly Publication in the Fields of Management, Operations, Economics, and Business from Iran,” Journal of Scholarly Publishing 47, 4 (2016): 347–61; Ji-Hong Park and Eunkyung Nam, “Intra- and Inter-Institutional Collaborative Pairing Trends of LIS Field in South Korea,” Libri 66, 2 (2016): 125–36.

7. Yi-Hsuan Lin, Yen-Han Tseng, Hsiao-Ting Chang, Ming-Hwai Lin, Yen-Chiang Tseng, Tzeng-Ji Chen, and Shinn-Jang Hwang, “Interdisciplinary, Interinstitutional and International Collaboration of Family Medicine Researchers in Taiwan,” PeerJ 3 (2015), http://doi.org/10.7717/peerj.1321; Frank J. van Rijnsoever and Laurens K. Hessels, “Factors Associated with Disciplinary and Interdisciplinary Research Collaboration,” Research Policy 40, 3 (2011): 463–72.

8. Yu-Wei Chang, “Librarians’ Contribution to Open Access Journal Publishing in Library and Information Science from the Perspective of Authorship,” Journal of Academic Librarianship 41, 5 (2015): 660–68.

9. Maria Benavent-Pérez, Juan Gorraiz, Christian Gumpenberger, and Félix de Moya-Anegón, “The Different Flavors of Research Collaboration: A Case Study of Their Influence on University Excellence in Four World Regions,” Scientometrics 93, 1 (2012): 41–58; Chang, “Librarians’ Contribution to Open Access Journal Publishing in Library and Information Science from the Perspective of Authorship”; Laura Hunter and Erin Leahey, “Collaborative Research in Sociology: Trends and Contributing Factors,” American Sociologist 39, 4 (2008): 290–306; Yong Zhao, Dong Li, Mingjie Han, Chenying Li, and Dongmei Li, “Characteristics of Research Collaboration in Biotechnology in China: Evidence from Publications Indexed in the SCIE [Science Citation Index Expanded],” Scientometrics 107, 3 (2016): 1373–87.

10. Lois Buttlar, “Information Sources in Library and Information Science Doctoral Research,” Library and Information Science Research 21, 2 (1999): 227–45; Yu-Wei Chang and Mu-Hsuan Huang, “A Study of the Evolution of Interdisciplinarity in Library and Information Science: Using Three Bibliometric Methods,” Journal of the American Society for Information Science and Technology 63, 1 (2012): 22–33; Ming-Yueh Tsay, “Knowledge Flow out of the Domain of Information Science: A Bibliometric and Citation Analysis Study,” Scientometrics 102, 1 (2015): 487–502.

11. Gary W. White, “Business Information Courses in LIS Programs: A Content Analysis,” Journal of Business & Finance Librarianship 10, 2 (2004): 3–15.

12. Sajjad ur Rehman and Abdus Sattar Chaudhry, “KM [knowledge management] Education in LIS Programs,” Education for Information 23, 4 (2005): 245–58.

13. Sultan M. Al-Daihani, “ICT [information and communications technology] Education in Library and Information Science Programs: An Analysis of the Perceptions of Undergraduate Students,” Library Review 60, 9 (2011): 773–88; Hong Xu, “Information Technology Courses and Their Relationship to Faculty in Different Professional Ranks in Library and Information Science Programs,” Library and Information Science Research 25, 2 (2003): 207–22.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 16: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management488

14. Fredrick Kiwuwa Lugya, “What Counts as a Science and Discipline in Library and Information Science?” Library Review 63, 1–2 (2014): 138–55.

15. Fredrik Åström, “The Visibility of Information Science and Library Science Research in Bibliometric Mapping of the LIS Field,” Library Quarterly 80, 2 (2010): 143–59; Mu-Hsuan Huang and Yu-Wei Chang, “A Comparative Study of Interdisciplinary Changes between Information Science and Library Science,” Scientometrics 91, 3 (2012): 789–803.

16. Mu-Hsuan Huang and Yu-Wei Chang, “A Study of Interdisciplinarity in Information Science: Using Direct Citation and Co-Authorship Analysis,” Journal of Information Science 37, 4 (2011): 369–78.

17. Elizabeth Buie, Susan Dray, Keith Instone, Jhilmil Jain, Gitte Lindgaard, and Arnie Lund, “How to Bring HCI [human-computer interaction] Research and Practice Closer Together,” in Proceedings of ACM [Association for Computing Machinery] CHI [computer-human interaction] 2010 Conference on Human Factors in Computing Systems (New York: ACM Press, 2010), 3181–84, doi:10.1145/1753846.1753951.

18. Andrew Booth, “Bridging the Research-Practice Gap? The Role of Evidence Based Librarianship,” New Review of Information and Library Research 9, 1 (2003): 3–23; Anne Goulding and Graham Matthews, “Putting Research into Practice,” Journal of Librarianship and Information Science 34, 2 (2002): 63–66; Angharad Roberts, Andrew D. Madden, and Sheila Corrall, “Putting Research into Practice: An Exploration of Sheffield iSchool Approaches to Connecting Research with Practice,” Library Trends 61, 3 (2013): 479–512.

19. Teresa M. Amabile, Chelley Patterson, Jennifer Mueller, Tom Wojcik, Paul W. Odomirok, Mel Marsh, and Steven J. Kramer, “Academic-Practitioner Collaboration in Management Research: A Case of Cross-Profession Collaboration,” Academy of Management Journal 44, 2 (2001): 418–31; Craig R. Carter, “Knowledge Production and Knowledge Transfer: Closing the Research-Practice Gap,” Journal of Supply Chain Management 44, 2 (2008): 78–82; Gerard P. Hodgkinson and Denise M. Rousseau, “Bridging the Rigour-Relevance Gap in Management Research: It’s Already Happening!” Journal of Management Studies 46, 3 (2009): 534–46; Alfred Kieser and Lars Leiner, “Why the Rigour-Relevance Gap in Management Research Is Unbridgeable,” Journal of Management Studies 46, 3 (2009): 534–46; Xiaohong Liu, Yen-Chun Jim Wu, and Mark Goh, “Collaborative Academic–Industry SCM [supply chain management] Research and Knowledge Building,” International Journal of Logistics Research and Applications 19, 1 (2016): 19–40; Costas Markides, “In Search of Ambidextrous Professors,” Academy of Management Journal 50, 4 (2007): 762–68.

20. Ronald R. Powell, Lynda M. Baker, and Joseph J. Mika, “Library and Information Science Practitioners and Research,” Library and Information Science Research 24, 1 (2002): 49–72.

21. Debra L. Shapiro, Bradley L. Kirkman, and Hugh G. Courtney, “Perceived Causes and Solutions of the Translation Problem in Management Research,” Academy of Management Journal 50, 2 (2007): 249–66.

22. Basil Tucker and Lee Parker, “In Our Ivory Towers? The Research-Practice Gap in Management Accounting,” Accounting and Business Research 44, 2 (2014): 104–43.

23. Judith Bishop, Rakesh Shukla, Forrest Shull, and Sagar Sen, “2nd International Workshop on Software Engineering Research and Industrial Practice (SER&IP 2015),” in Proceedings of the 37th International Conference on Software Engineering, vol. 2 (Piscatawy, NJ: IEEE [Institute of Electrical and Electronics Engineers] Press, 2015), 1007–1008.

24. Alfred Kieser and Lars Leiner, “Collaborate with Practitioners: But Beware of Collaborative Research,” Journal of Management Inquiry 21, 1 (2012): 14–28.

25. G. Jan van Helden, Harrie Aardema, Henk J. ter Bogt, and Tom L. C. M. Groot, “Knowledge Creation for Practice in Public Sector Management Accounting by Consultants and Academics: Preliminary Findings and Directions for Future Research,” Management Accounting Research 21, 2 (2010): 83–94.

26. Carter, “Knowledge Production and Knowledge Transfer”; Seongkyoon Jeong and Jae Young Choi, “Collaborative Research for Academic Knowledge Creation: How Team Characteristics, Motivation, and Processes Influence Research Impact,” Science and Public

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 17: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Yu-Wei Chang 489

Policy 42, 4 (2015): 460–73; Kieser and Leiner, “Collaborate with Practitioners”; Tucker and Parker, “In Our Ivory Towers?”

27. Andrew H. Van de Ven and Paul E. Johnson, “Knowledge for Theory and Practice,” Academy of Management Review 31, 4 (2006): 802–21.

28. Jean M. Bartunek, “Academic-Practitioner Collaboration Need Not Require Joint or Relevant Research: Toward a Relational Scholarship of Integration,” Academy of Management Journal 50, 6 (2007): 1323–33; Kieser and Leiner, “Collaborate with Practitioners.”

29. Pratima Bansal, Stephanie Bertels, Tom Ewart, Peter MacConnachie, and James O’Brien, “Bridging the Research-Practice Gap,” Academy of Management Perspectives 26, 1 (2012): 73–92; Kevin Orr and Mike Bennett, “Public Administration Scholarship and the Politics of Coproducing Academic-Practitioner Research,” Public Administration Review 72, 4 (2012): 487–95.

30. Bartunek, “Academic-Practitioner Collaboration Need Not Require Joint or Relevant Research.”

31. Rick Vogel, “Parallel, Transfer or Collaboration Strategy of Relating Theory to Practice? A Case Study of Public Management Debate in Germany,” Public Administration 88, 3 (2010): 680–705.

32. Shona Morgan and Carin Lightner-Laws, “An Examination of Academic-Practitioner Co-Authorship Trends in Supply Chain Management Journals,” International Journal of Supply Chain Management 2, 1 (2013), http://ojs.excelingtech.co.uk/index.php/IJSCM/article/view/706/386.

33. Vogel, “Parallel, Transfer or Collaboration Strategy of Relating Theory to Practice”; Morgan and Lightner-Laws, “An Examination of Academic-Practitioner Co-Authorship Trends in Supply Chain Management Journals.”

34. Angela McCabe, Rachel Parker, and Stephen Cox, “The Ceiling to Coproduction in University-Industry Research Collaboration,” Higher Education Research & Development 35, 3 (2016): 560–74.

35. Michelle K. McGinn, Ewelina K. Niemczyk, and Mary Gene Saudelli, “Fulfilling an Ethical Obligation: An Educative Research Assistantship,” Alberta Journal of Educational Research 59, 1 (2013): 72–91.

36. Jean Marie Bartunek and Sara Lynn Rynes, “Academic and Practitioners Are Alike and Unlike: The Paradoxes of Academic-Practitioner Relationships,” Journal of Management 40, 5 (2014): 1181–1201.

37. Cherney, Head, Boreham, Povey, and Ferguson, “Perspectives of Academic Social Scientists on Knowledge Transfer and Research Collaborations.”

38. Adrian Cherney, “Academic-Industry Collaborations and Knowledge Co-Production in the Social Sciences,” Journal of Sociology 51, 4 (2015): 1003–1016; Chung, Kwon, and Lee, “Understanding Scientific Collaboration in the Research Life Cycle.”

39. Jiancheng Guan, Yan Yan, and Jingjing Zhang, “How Do Collaborative Features Affect Scientific Output? Evidences from Wind Power Field,” Scientometrics 102, 1 (2015): 333–55.

40. Pablo D’Este, Frederick Guy, and Simona Iammarino, “Shaping the Formation of University-Industry Research Collaborations: What Type of Proximity Does Really Matter?” Journal of Economic Geography 13, 4 (2013): 537–58.

41. Evans, Lambiotte, and Panzarasa, “Community Structure and Patterns of Scientific Collaboration in Business and Management.”

42. Vogel, “Parallel, Transfer or Collaboration Strategy of Relating Theory to Practice?”; Morgan and Lightner-Laws, “An Examination of Academic-Practitioner Co-Authorship Trends in Supply Chain Management Journals.”

43. Daniel Opoku, “Academic Status and Research Publication: The Dilemma of Librarians at the University of Ghana,” Information Development 29, 3 (2013): 233–40; Aliyu Gadanga Tsafe, Usman Chiya, and Basaka Abubakar Aminu, “Scholarly Publications of Librarians in Universities in Nigeria: 2000–2012—A Bibliometric Analysis,” Library Philosophy and Practice (2016): 1–24, http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=3826&context=l

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.

Page 18: Research Collaboration by Practitioners in Computer Science, Library … · 2020-05-16 · 476 Research Collaboration by Practitioners in Computer Science, Library Science, and Management

Research Collaboration by Practitioners in Computer Science, Library Science, and Management490

ibphilprac; William H. Walters, “Faculty Status of Librarians at U.S. Research Universities,” Journal of Academic Librarianship 42, 2 (2016): 161–71.

44. Selenay Aytac and Bruce Slutsky, “Authorship Trends of Research Articles Published in Seven Scientific, Technical, Engineering, and Medical (STEM) Library Journals: Analysis of STEM Library Research from 2011–2015,” Science & Technology Libraries 36, 2 (2017): 114–34; Deborah D. Blecic, Stephen E. Wiberley Jr., Sandra L. De Groote, John Cullars, Mary Shultz, and Vivian Chan, “Publication Patterns of U.S. Academic Librarians and Libraries from 2003 to 2012,” College & Research Libraries 78, 4 (2017): 442–58; Yu-Wei Chang, “Comparative Study of Characteristics of Authors between Open Access and Non-Open Access Journals in Library and Information Science,” Library & Information Science Research 39, 1 (2017): 8–15.

45. David E. Gray, Paul Iles, and Sandra Watson, “Spanning the HRD [human resource development] Academic-Practitioner Divide: Bridging the Gap through Mode 2 Research,” Journal of European Industrial Training 35, 3 (2011): 247–63; Darren C. Short and Thomas J. Shindell, “Defining HRD Scholar-Practitioners,” Advances in Developing Human Resources 11, 4 (2009): 472–85.

46. Cassidy R. Sugimoto, Andrew Tsou, Sara Naslund, Alexandra Hauser, Melissa Brandon, Danielle Winter, Cody Behles, and S. Craig Finlay, “Beyond Gatekeepers of Knowledge: Scholarly Communication Practices of Academic Librarians and Archivists at ARL [Association of Research Libraries] Institutions,” College & Research Libraries 75, 2 (2014): 145–61.

This m

ss. is

peer

review

ed, c

opy e

dited

, and

acce

pted f

or pu

blica

tion,

porta

l 18.3

.