The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access...

25
1 The publishing delay in scholarly peer‐reviewed journals Bo‐Christer Björk Professor, Information Systems Science Hanken School of Economics P. B. 479 00101 Helsinki, Finland bo‐[email protected] David Solomon (Corresponding Author) Professor, Department of Medicine and OMERAD A‐202 E Fee Hall Michigan State University E Lansing, MI USA 48824 [email protected] +1 517 339‐0720 Abstract: Publishing in scholarly peer reviewed journals usually entails long delays from submission to publication. In part this is due to the length of the peer review process and in part because of the dominating tradition of publication in issues, earlier a necessity of paper‐based publishing, which creates backlogs of manuscripts waiting in line. The delays slow the dissemination of scholarship and can provide a significant burden on the academic careers of authors. Using a stratified random sample we studied average publishing delays in 2700 papers published in 135 journals sampled from the Scopus citation index. The shortest overall delays occur in science technology and medical (STM) fields and the longest in social science, arts/humanities and business/economics. Business/economics with a delay of 18 months took twice as long as chemistry with a 9 month average delay. Analysis of the variance indicated that by far the largest amount of variance in the time between submission and acceptance was among articles within a journal as compared with journals, disciplines or the size of the journal. For the time between acceptance and publication most of the variation in delay can be accounted for by differences between specific journals. Keywords: Scholarly Publishing; Review Time; Processing Time

Transcript of The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access...

Page 1: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

1

Thepublishingdelayinscholarlypeer‐reviewedjournalsBo‐ChristerBjörkProfessor,InformationSystemsScienceHankenSchoolofEconomicsP.B.47900101Helsinki,Finlandbo‐[email protected](CorrespondingAuthor)Professor,DepartmentofMedicineandOMERADA‐202EFeeHallMichiganStateUniversityELansing,[email protected]+1517339‐0720

Abstract:  Publishinginscholarlypeerreviewedjournalsusuallyentailslongdelaysfromsubmissiontopublication.Inpartthisisduetothelengthofthepeerreviewprocessandinpartbecauseofthedominatingtraditionofpublicationinissues,earlieranecessityofpaper‐basedpublishing,whichcreatesbacklogsofmanuscriptswaitinginline.Thedelaysslowthedisseminationofscholarshipandcanprovideasignificantburdenontheacademiccareersofauthors.Usingastratifiedrandomsamplewestudiedaveragepublishingdelaysin2700paperspublishedin135journalssampledfromtheScopuscitationindex.Theshortestoveralldelaysoccurinsciencetechnologyandmedical(STM)fieldsandthelongestinsocialscience,arts/humanitiesandbusiness/economics.Business/economicswithadelayof18monthstooktwiceaslongaschemistrywitha9monthaveragedelay.Analysisofthevarianceindicatedthatbyfarthelargestamountofvarianceinthetimebetweensubmissionandacceptancewasamongarticleswithinajournalascomparedwithjournals,disciplinesorthesizeofthejournal.Forthetimebetweenacceptanceandpublicationmostofthevariationindelaycanbeaccountedforbydifferencesbetweenspecificjournals.Keywords:ScholarlyPublishing;ReviewTime;ProcessingTime

Page 2: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

2

1 Introduction ScholarlyjournalpublishinghasalonghistorygoingbacktoHenryOldenburg’sPhilosophicalTransactionoftheRoyalSocietyfoundedin1665.Forthepasttwocenturiesthevolumeofpeerreviewedarticlespublishedperyearhasincreasedbyarelativesteady3,5%peryear,withacurrentnumberofarticlesofaround1,8–1,9million,publishedinanestimated28’000journals(WareandMabe2012).Overtheyearsthescientificjournalasaninstitutionhasevolvedinmanywaysandafterthesecondworldwarandtheensuingrapidgrowthinsciencecommercialpublishershaveincreasinglyenteredthismarket,whichearlierwasdominatedbyscientificsocieties.Thedisseminationmediumhasveryrapidlychangedfromprintedissuestopredominantlydigitallydistributedpublishing(VanOrsdelandBorn,2002).Atthesametimethishastriggeredtheemergenceofnewbusinessmodelsfordigitalpublishing,includingbundlede‐licenses,pay‐per‐viewandopenaccesspublishing.ScholarlyjournalpublishinginitscurrentformhasbeentheobjectofincreasedcritiquesincetheadventoftheWorldWideWebandtheopportunitiesitoffersforprocessinnovation,Thedebatehasinparticularconcernedthreeaspects.Firstlythatthereachofthedisseminationthatthetraditionalsubscriptionmodelachievesissuboptimal.Secondlythatthepeerreviewprocessisflawedandfrequentlyleadstoarbitrarydecisions.Thirdlythattherearesignificantdelaysinpublishingarticles.Traditionalpaperpublishinginparticularcreatessignificantdelaysbothduetotheneedtobundlearticlesintoissuesandbacklogscreatedbypagelimitsresultingfromthehighperpagecostofthistypeofpublishing.ThesolutionproposedtothelimiteddisseminationisOpenAccess(OA),whichcanbeachievedeitherthroughpublishinginopenaccessjournals(“goldOA”)orthroughauthor’suploadingmanuscriptversionsoftheirarticles(“greenOA”)tosubjectorinstitutionalrepositories(Suber2012).OAjournalshaveincreasedtheiroutputby20‐30%peryearforoveradecadeandnowpublisharound12%ofallpeerreviewedarticles(LaaksoandBjörk2012).Theopenaccessibilitycanbeachievedviaanumberofbusinessmodelsofwhichthepublishingfeevariantisrapidlyincreasingitsmarketshare.Thecritiqueofthepeerreviewprocesshasledtoanumberofexperimentswithalternativemodels.Thewebmediumlendsitselftodifferentformsofopenreview,wheremanuscriptscanbe“published”priortorevieworwithminimalreviewandsubsequentlyevaluatedbyreadercommentsandelevatedtofullarticlestatusviapostpublicationfeedback.(Björk2011).Openreviewwastriedanddeemedafailureinawell‐knownexperimentbyNature(2006).MoresuccessfulthanopenreviewexperimentsisanalternativepeerreviewmodelpracticedbyanincreasingnumberofOA“megajournals”inthewakeofPLoSONE,whichcurrentlypublishesaround20,000articlesperyear.Inthisformofpeerreviewonlythescientificvalidityoftheresultsischecked,thedecisionconcerningthepotentialcontributionisleftforthereaderstodecide.

Page 3: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

3

AnimportantreasonforthesuccessofPLoSONEisalsothatisoffersaveryattractivealternativetoauthorswhoaretiredofthelongdelaysinvolvedinpublishingintraditionaljournalsandrejectiononwhatarefelttobearbitraryandorbiasedopinionsofreviewersand/oreditor.Thedelaywasanecessaryfacetofthepublishingprocesspriortotheturnofthemillennium,whenjournalswerealmostexclusivelypublishedinpaperform,andwherejournalpagelimitswereaneconomicnecessity.Sincethenelectroniconlyjournalshaveshownthatthedelaycanbeconsiderablyshortened.Alsothetraditionaljournalshaveacknowledgedtheexistenceoftheproblembystartingtopost“inpress”orcompletelycopyeditedandformatted“aheadofprint”versionsofacceptedmanuscriptsevenbeforetheybecomepartofanissueandreceivepagenumbers.Arecentsurveywithauthorsshowedthatthespeedofpublicationwasthethirdmostimportantfactoraffectingauthors’choiceofjournal,aftertopicalfitandthequalityofthejournal(SolomonandBjörk2012).Insomefieldsofscienceauthorshavetriedtopartlybypassthesystembypublishingtheirmanuscriptsinopenwebrepositoriespriortosubmissionasworkingpapers(economics)orpreprints(physics),inordertospeedupthedisseminationoftheresults.Inothercasesexperimentshavebeenmadewithnewtypesofpeerreviewjournals,inwhichonlylightlyscreenedmanuscriptshavebeenopenlypublishedonthejournalwebsites,andthebetteroneshavelaterbeenelevatedtofulljournalarticlestatus(Björk2011),provingthesealofquality.Itisourbeliefthatthelengthofthedelayisnotconstantacrossdifferentfieldsofscience,butdependsonthereviewandpublishingculturesthathaveevolvedindifferentsciences.Forexampleadelayoftwoyears,commonineconomicsandmanagement,wouldbedifficulttoacceptforacademicsinthebiomedicalsciences.

1.1 The Life‐cycle stages of a peer‐reviewed article Duringitslife‐cycleascholarlyarticleundergoesanumberofstages,someofwhichareinfocusinthisstudy.Duringthewritingandfinalizingofamanuscriptmostauthorstendtoshowittoafewtrustedcolleagues,fromwhomtheyreceivefeedbackandsuggestionsforimprovement.Inmanydisciplinesit’salsocommontopublishversionsasconferencepapersandinafewdisciplines,inparticularphysicsandeconomics,atraditionofpublishingworkingpapershasevolved.Atsomestagetheauthor(orauthors)formallysubmitsthemanuscripttoaparticularjournal.Mostjournalsrequirethatamanuscripthasn’tbeenpublishedelsewhereandthatisnotunderconsiderationforpublishingbyanotherjournal.Inmedicinethisrulecanbeevenstricterinthatauthorsarealsorestrictedfromdiscussingtheresultswiththepopularmedia,theso‐calledInglefingerrule.Fromtheviewpointofthewholescholarlycommunitytheruleexcludingparallelsubmissionisunderstandableintermsofavoidingunnecessaryreplicationoftheunpaidrefereeworkdonebytheeditorandother

Page 4: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

4

scholars.Ontheotherhandthiscausespublishingdelaysforauthorswhoseworkisrejectedinthefirstandevensecondjournaltowhichtheysubmit.Thequalityandextentofthepeerreviewthatamanuscriptundergoesvariesconsiderablyacrossjournalsanddisciplines.Theeditorsofmanyjournalsscreensubmissionsandquicklyrejectmanuscriptsthatareclearlyunsuitablewithoutsendingthemoutforexternalpeerreview.Thereviewprocesscanalsoinvolveseveralcyclesofreviewandrevision,apracticecommoninmoreselectivejournalsparticularlyinspecificdisciplinessuchasbusinessandmanagement.Manuscriptsatsomepointareaccepted,rejectedorinsomecaseswithdrawnbytheauthorwhomayfindtherequestedrevisionsortherevisionprocessunacceptable.Ifacceptedmanuscriptsaregenerallycopyeditedandtypesetbythepublisherorcontractor,afterwhichtheauthorisusuallyaskedtocheckthefinalversion.Intraditionalprintpublishingthefinalizedmanuscriptisthenputinthequeueforpublishing,awaitingitsturn,usuallythoughnotalwaysaccordingtoitspositioninthequeue.Articlessubmittedtoaspecialissuearetreatedabitdifferently.Thequeuingcantakeaslongasayearormoreifthejournalhasasignificantback‐log.Ifthejournalalsopublishesanelectronicversionmanuscriptsareoftenpublishedearlieronthejournalwebsiteunderheadingslike“in‐press”usuallywithoutexactpagenumbersandassignmentofissue.Mostelectronicopenaccessjournalspublisharticlesdirectlywhentheyarereadyratherthaninissues,thusspeedinguptheprocess.Ifwewouldtakeamanuscriptandnotjournal‐centricviewthetotaldelaywouldoftenbeevenlongersincemanymanuscriptsarerejected,andinsomecasesseveraltimesbeforepublication.Thistimefromsubmissiontorejection,insomecasesfrommultiplejournals,needstobeaddedtothedelayofthejournalthatfinallypublishesthearticle.Azar(2004)discussesthisforthecaseofeconomicsjournalsandpointsouttheimportanceoffirst‐responsedelays,sinceitisoftenatthisstagethatauthorsneedtofindalternativejournalsforsubmittingtheirmanuscripts.Inthisstudywetakethejournal‐centricviewlookinginparticularatthedelayfromsubmissiontoacceptanceandthedelayfromacceptancetofinalpublication,aswellasthetotaldelaytime.Althoughitmightbepossibletogetdataforotherstagesintheoverallprocessforsomejournalsthesethreepointsintimearecommonforallpeerreviewedjournals.

1.2 Previous Research Thereareanumberofpossiblesourcesofinformationaboutpublicationdelays.Ideallypublisherswouldtrackandmakethisdataavailable.Thisishoweverrare,perhapsbecausepublishersandeditorsmaybehesitanttodiscloselongdelays.Sometimestheinformationcanbefoundineditorialsinjournals,whichoftenalsoprovideinformationabouttheacceptanceratesofjournals.Anotheroptionistogatherarticledataaboutsubmissionandacceptancedateswhichisoftenpublishedindividuallyineacharticleoronthearticles’facepageonthe

Page 5: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

5

publisher’swebsite.Thisisaverylabor‐intensiveprocessbutprovidesprecisestatisticsforthearticlessampled.Afinaloptionistogatherthedatafromauthorswhichwouldbedifficultandlikelytobefairlyinaccurate.Earlierstudieshavemostlycollectedthedataincludedinpublishedarticles.OneofthefewstudiesusingstatisticssolicitedfrompublisherswastheearlystudyofeconomicsjournalbyYohe(1980),whoobtainedstatisticsfromtheeditorsof20journalsandextractedarticleleveldatafor5more.Trivedi(1993)foundthattheaveragetotalpublicationdelayforeconometricsarticlesinsevenstudiedjournalswas22.8months,consistingof13.4monthsfromsubmissiontoacceptanceand9.4monthsfromacceptancetopublication.Ellison(2002)concentratedhisstudyonthereviewtimesonly(submissiontoacceptance)andfoundanaverageof16.5monthsin1999foraselectionof25journalsineconomicsandrelatedfields.HewasalsoabletodoalongitudinalanalysisforasubsetofthejournalsusingdatabothfromYohe(1980)andCoeandWeinstock(1967)andfoundthatthereviewtimeshadmorethandoubledinthreedecades(1970‐1999),forfiveleadingeconomicsjournalsfrom8.7to20.7months.Themainreasonforthisseemstobetheincreasingnumberofiterativeroundsinthereviewprocess.Healsofoundthattheaveragereviewtimesvarybetweendifferentsub‐specialtiesofeconomics,evenforarticlespublishedinthesamejournalswithbroaderscopes,andsuggestthattheexpectationsforthetypeandlengthofthereviewshavebeensociallyshapedwithinnarrowscholarlycommunities.AlsoHartmann(1997)reportsonadramaticincreaseinsubmissiontopublicationdelays.ForarticlesintheJournalofAtmosphericSciencesthetotaltimeincreasedfrom5.9to15.2monthsbetween1970and1997andwhiletheacceptancetopublicationlagincreasedsomewhat(4.4to6.6months)theincreasewasmainlyattributabletotheincreaseinthetimerequiredbythereviewprocess(1.5to8.5months).KlingandSwygart‐Hobaugh(2002)comparedtheevolutionofpublicationdelaysforthreenaturalscienceandthreesocialsciencejournalsbetween1970/1980and2000,inanattempttoseeiftheemailcommunicationwidelyinusein2000hadreducedaveragedelays.Theyfoundthatthedelaysinchemistryandphysicsjournalshaddecreasedfrom6.5monthsto5.8(andevenmoresoforaminorityofarticlespublishedelectronicallybeforepaperpublication)butthatthedelaysintheeconomics,managementandpsychologyjournalshadincreasedfrom9.0to23.8months.Diospatonyietal(2001)studiedtheevolutionofpublicationdelaysintenchemistryjournalsintheperiod1985‐1999,andcouldnotfindanycleardevelopmenttoshorterorlongerperiods,withtheyearlyaveragesrangingbetween6.7and7.5months.Thepapercontainsdetailedbreakdownsofthespreadofdelaywithinjournalsaswellasananalysisofthebreakdownbetweensubmissiontoacceptancevsacceptancetopublication.

Page 6: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

6

Carroll(2001)comparedpublicationdelaysforsixstatisticsjournalsandfoundaslightdecreasefrom25.2monthsin1994to22.3in1999.Hesuggestthatthedeclinemightbeduetoelectronicpublishingbecomingmorecommoninthefiveyearinterval.Amat(2008)studied14journalsinfoodscienceandfoundanaveragepublicationdelayof11.8months(forarangeof6.2‐17.2months).ThedelaysofthreecivilengineeringjournalsreportedbyBjörkandTurk(2006)variedbetween6.7months(foranOAjournal)comparedto18.0and18.9fortwoconventionaljournals.ThestudybyLuwelandMoed(1998)differedfromtheabovebecauseitincludedjournalsfromdifferentsubjectareas.ThestudywastriggeredbyclaimsofDutchresearchersthatarticlesintechnicalsciencesandmathematicshavemuchlongerdelaysthanarticlesinphysicsandchemistry,andthatresearchersintheformerfieldsaredisadvantagedinshorttermbibliometriccomparisons,oftenusedwhencomparingcandidatesforpromotionetc.Inaselectionof15leadinginternationaljournalsintheabovefields,therangeofdelayswasbetween2.5and17.5monthswithmathematicsandengineeringjournalstendingtobetowardsthehigherend.Anotherstudywithjournalsfromdifferentdisciplineswasthestudyof26IranianjournalspublishinginthePersianlanguage(Khosrowjerdietal2011).Thedelayrangeforthesepredominantlysocialscienceandhumanitiesjournalswasverywide(5.8to34.6months)withanaverageof17.3months.ThestudybyDongetal(2006)istheonlystudythattriedtoanalyseifthedelaytimesforOAjournalsdifferfromsubscriptionjournalsinbiomedicine.TheycomparedsixOAjournalsfromtheleadingOApublisherBioMedCentral(BMC)withsixjournalsoncorrespondingtopicsfromNaturePublishingGroup(NPG)aswellassixotherBMCjournalswithelevensocietyjournals.TheresultsdemonstratedthattheNPGjournalswereequaltotheBMCjournalsinoverallpublicationdelay(4.5months)butmarginallyfasteriftheelectronicpublicationdateswerecompared.TheBMCjournalsclearlyoutperformedthesocietyjournals(4.8vs8.9months).Itisnoteworthythattheinthesubscriptionjournalstheprintversionstrailedtheelectronicversionsbyonlyshortperiodsofbetween0.5to1.5months.Yuetal(2004),aspartofthebuildingofamathematicalmodelofthedelayprocess,collecteddelaydataforsevenjournals.Scientometrics,aninformationsciencejournalhadadelayof5.5monthsandtheJournalofMathematicalphysicsadelayof9.0butthefiveotherjournals,fourofwhichwereindifferentengineeringfieldsandoneinthesocialsciences,haddelaysintherange16.4–20.0months.Tortetal(2011)studiedthedelaysbetweenelectronicandprintpublishinginneurosciencejournal,andfoundasignificantincreasebetween2003and2011.Theywerealsoabletodemonstratethatincreasingthedelayincreasesaparticularjournal’simpactfactor,duetothetimewindowsusedbytheISIincalculatingtheimpactfactor!

Page 7: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

7

Table1aboutHerePreviousstudiespointtotwothings.Firstlythattherearesubstantialdifferencesinpublicationdelayswithleadingbiomedicalandchemistryjournalsachievingdelaysofroughlyhalfayearandattheotherendofthespectrumeconomicsandstatisticsjournalstypicallyhavingaveragedelaysofclosetotwoyears.Secondlythatthedelayshaveincreasedsubstantiallyinsomedisciplinesoverthepastdecades,partlyduetoanincreaseinthelengthofthereviewprocess.Twofactorswhichhavenotbeenexplicitlystudiedaretheeffectsofjournalsizeandscientificqualitylevelonthedelays.Mostofthepreviousstudieshavebeenbenchmarkingstudieswithinnarrowdisciplinesofrelativelyhomogeneous,highlycitedjournals.Sizecouldinparticulareffectthedelayafteracceptancesincesmallerjournalsmayappearonlyfourtimesayearoreventwiceayear,whichmeansthatarticlesmighthavetowaitinaqueueforquitesometimebeforepublication.Qualitymightlengthenthesubmissiontoacceptancetimessincearticlesmightgothroughseveraliterationsinthereviewprocess.Ontheotherhandthemosthighlycitedjournalsintheirfieldsmightfinditeasiertorecruitreviewersandaremorelikelytohavealargereditorialstaffandprocesssubmissionsmorequickly.

1.3 Aims Basedonthepreviouslypublisheddata,alotofanecdotalevidenceandpersonalexperiencesasauthorstheaimsofthisstudyweredefinedasfollows.Tostudypublicationdelaysinscholarlypeer‐reviewedjournalsacrossdisciplines,journalsizeandjournalquality.Weexplicitlyruledoutdoingalongitudinalanalysis,duetotheverytime‐consumingworkofdatacollection.

2. Method 

2.1 Pilot study Beforestartingdatacollectionwedida“feasibilitystudy”thataddressedtwoissues.FirstlywecheckedourabilitytoobtaincopiesofarticlesfromjournalsindexedinScopusoratleasttheabstractsiftheyhappentocontainthenecessaryinformation.Secondlywecheckedwhetherthejournalsortheirfreelyavailableabstractsincludedsufficientinformationonthepublicationtimeframe.Itwasnecessarytocheckaccesstoelectroniccopiesofthejournalsthroughourlibraries’electronicholdingsaswefeltitwouldnotbefeasibletogatherthedatafrompapercopiesofagivenjournalorgetthenecessarycopiesviainterlibraryloan.AccesstothejournalswascheckedviathelibrariesofHankenSchoolof

Page 8: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

8

EconomicsandMichiganStateUniversity.Forthispilotstudywerandomlyselected100journalsindexedinScopus.Atotalof66%ofthesejournalswereavailablethrougheithertheelectronicholdingsofourlibrariesortheywerefreelyavailableonlineandweredeemedtobeappropriateforanalysis.ThemajorityofjournalswecouldnotfindorgainaccessweresmallerjournalspublishedinothercountriesthantheUS,UK,NetherlandsandGermany.Sixty‐fourpercentoftheavailablejournalscontainedatleastthesubmissionandacceptancedatesanditwaspossibletodeterminethedateofpublicationeitheraslistedorbythedateoftheissueinwhichanarticlewaspublished.Wealsofoundthatjournalstypicallypublishedthedatesofuptofivedifferentkeypointsinthepublicationprocess.Theseincluded,submission,revisionbasedonfeedback,acceptance,publicationaheadofprintinanelectronicformat,andfinalpublicationaspartofanissue.Thefirstfourwereusuallyincludedasdates,whereasthelastitemcouldoftenonlybedeterminedbythemonthoftheissuewhichcontainedthearticle.Theresultsofthepilotstudyconfirmedthatthereisenoughdataavailabletomakethestudyfeasible.

2.2 Main study ThemainsourcedatabaseforthestudywastheScopuscitationindex,whichcontainsinformationaboutsome19,500scholarlyjournals,includingtheyearlyarticleandcitationcounts.TheSCImagoJournal&CountryRankwebsite(SCImago,2013)providesfreelyaccessibleScopusdataatthejournallevelwhichwasthedatasourceforthisstudy.Elsevier,thepublisherofScopusprovidesafreelydownloadablespreadsheetontheirwebsite(Scopus,2013)thatamongotherinformationprovidesahierarchicalclassificationofeachjournal’sdiscipline.Thehighestclassificationincludedonly4categoriesandwasfelttobetoobroad.Thesecondlevelincludes27categoriesandwasfelttobetoospecific.Wedecidedtomergesomeoftheselattergroupsbasedonoursubjectiveassumptionofsimilarityinreviewingcultureandpublicationspeedresultinginninegroups.Theseincludearts/humanities,biomedicine,business/economics,chemistry,earthscience,engineering,mathematics,physics,andsocialsciences.Wehypothesizedthatthereweredifferencesinthepublicationtimeassociatedwithjournalsize.Westratifiedbysizeinsuchawaytoensureeacharticlewithinadisciplinecategoryhadanequalchanceofinclusioninthestudy.ThejournalswereorderedbysizebasedonScopusarticlecountsin2010.Thejournalscontainingthefirstthirdofthearticlesinadisciplinemadeupthesmallestjournalstrata,thejournalscontainingthemiddlethirdmadeupthemiddlejournalstrataandthelastthirdofthearticlesthelargejournalstrata.Thisresultedinamuchsmallernumberofjournalsinthelargestjournalstratathoughanequalnumberofarticlesperstrata.

Page 9: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

9

Werandomlyorderedthejournalsineachdiscipline/sizestrataandwentthroughthejournalsinordercheckingtoseeiftheywereavailablefromeitherofourtwolibraries,HankenSchoolofEconomicsandMichiganStateUniversityoratleasttheabstractorjournalwasfreelyavailableandcontainedthenecessarydates.Forthosejournalswewereabletoaccess,wecheckedfirstwhethertheyappearedtobepeer‐reviewedscholarlyjournalsandcontainedatleastthedatesofsubmissionandacceptance.Whenanappropriatejournalwasfoundweselected20articlesworkingbackwardfromthelastarticlepublishedin2012.Specialissues,invitedarticlesandeditorialswhereskipped.ForeacharticlewerecordedtheISSN,DOI,orifnoteasilyobtained,title,submissionandacceptancedates.Ifavailablewealsorecordedthedatearevisionrequestwasmadeandthedatethearticlewaspublishedelectronicallyaheadofprint.Publicationdateunlessstatedspecificallywasbasedonthemidpointofthepublicationperiod.Soifajournalwaspublishedmonthly,itwasthe15thofthemonththeissuewaspublished.Ifitwasquarterly,thedatewasthemiddleofthequarter,forexampleFebruary15thforthefirstquarter.AhandfulOAjournalscontainedexactdateoffinalpublication,whichwasusedinplaceofanestimateddate.Whenourmethodofdeterminingthepublicationdateresultedinanegativenumberofdaybetweenacceptanceandpublication,wesetthenumberofdaysfromacceptancetopublicationtozero.Whileweoriginallycalculatedthetimebetweensubmissionandacceptanceandthetimebetweenacceptanceandpublicationindays,forthepurposesofanalyzingandpresentingthedata,weconverteddaysintomonthsbydividingby30.44.Fivejournalswereincludedforeachsizegroupforeachofthe9disciplinecategoriesresultingindatafor135journalsand2,700articles.Forthepurposesofthisstudy,thetimefromsubmissiontoacceptanceandacceptancetopublicationmeasuredinmonthswasusedasthemainoutcomevariables.SourceNormalizedImpactperPaper(SNIP)version2citationmeasureswereobtainedfromtheJournalM3tricswebsite(2013).WealsoobtainedinformationonwhetherajournalwasintheDirectoryofOpenAccessJournals(DOAJ).DatamanagementandmostoftheanalyseswereconductedusingtheStatisticalPackagefortheSocialSciences(SPSS).Mostanalyseswereconductedatthelevelofindividualarticles.SinceSNIPvaluesareassignedtojournals,weaveragedthetimefromsubmissiontoacceptanceandfromacceptancetopublicationforassessingtherelationshipbetweenthesetimesandeachjournal’sSNIP.Thedatacollectedformedabalanceddesignandhenceitwaspossibleusinganalysisofvariance(ANOVA)topartitionthevarianceassociatedwitheachfactorinthedesign.Disciplinewascrossedwithsizegroup.Journalswerenestedinbothdisciplineandsizegroupandarticleswerenestedinajournal.Disciplineandsizegroupwereconsideredtobefixedeffectswhilejournalsandarticleswithinajournalwereconsideredtoberandomeffectsthatweresampled.BasedonthisdesignweestimatedthevariancecomponentsforthetimebetweensubmissionandacceptanceaswellasacceptanceandpublicationusingGENOVA(Brennan,2001).Thisanalysiswasusedtoassessthepercentageofthevarianceinthetimesfromsubmissiontoacceptanceandfromacceptancetopublication

Page 10: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

10

thatcouldbeattributedtoeachsource,discipline,size,theirinteraction,journalsandarticleswithinjournals.

3. Results Althoughmoredetaileddatawereavailableforsomejournals,wefocusedthereportingonthetimefromoriginalsubmissiontoacceptanceandfromacceptancetofinalpublicationaswefeltthesewerethekeytimepointsandwewereabletoobtaincompletedataacrossalldisciplinesandsizegroups.Thefirsttimeperiodreflectsthedelayduetothepeerreviewandrevisionprocessusedbyajournalandthesecondthelengthofthepublishingprocess,backlogduetopublicationpagelimitsandpotentiallyotherfactors.Table2presentssummarystatisticsforsubmissiontoacceptance,acceptancetopublicationandtotaltimesubmissiontopublication.Figures1and2presentthisinformationingraphicformforthe9disciplines(Figure1)and3journalsizegroupings(Figure2).DetailedsummarystatisticsforthebreakdownbydisciplinesandsizegroupsarecontainedintheAppendix.AscanbeseeninFigure1,totaltimefromsubmissiontopublicationvariessignificantlybydisciplinewithbusinessatjustunder18monthshavingpublicationtimesnearlytwicethatofchemistryatabout9months.Largerjournalsappeartohavetheshortestpublicationtimeswithmid‐sizedjournalsthelongest.BasedoninclusionintheDOAJtherewere19OpenAccess(OA)journalsorapproximately14%ofthesample.Ofthese,7weredeterminedtobeOAfromtheirinceptionand12weredeterminedtohavebeenconvertedtoOAatsomepoint.Thelatterusuallymeansthatthejournalmaystillpublishaparallelpaperversionandalsoittypicallybundlesthearticlesinissues.Themethodologyfordeterminingbornversusconvertedaredescribedelsewhere(Solomon,Laakso&Björk,2013).Table3presentstheaveragetimeinmonthssubmissiontoacceptanceandacceptancetopublicationforjournalscreatedasOAandthosethatconvertedtoOA.SubmissiontopublicationtimesappeartobeconsiderablyshorterforOAjournals,particularlythosethatwerecreatedasOAjournals.Thedifferenceswerereflectedinbothreceivedtoacceptedandacceptedtopublishedbutthegreatestdifferences,particularlyforthejournalscreatedOAwereinacceptedtopublishedtimes.Thesedifferencesshouldbeconsideredwithcautionasthesamplesizesarefairlysmallandthepercentagesofjournalswithineachdisciplinearenotbalanced.Wefelttheremaybeacorrelationbetweenpublicationtimesandthecitationrateofthejournal.Sincecitationrateisatthelevelofthejournalratherthanthearticle,weaggregatedtothelevelofajournalusingaveragesforthetimesfromsubmissiontoacceptanceandfromacceptancetopublication.WeusedSNIPasthecitationmeasurebecausethesestatisticsarenormalizedtoaccountfordifferencesincitationratesacrossdisciplines.ThePearsonproductmomentcorrelationbetweenSNIPandsubmissiontoacceptanceandacceptancetopublicationwere0.20and‐0.09respectively.Thecorrelationforthetimefrom

Page 11: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

11

submissiontoacceptancewithSNIPwassignificantlydifferentfromzerop<0.02.Table4containstheestimatedvariancecomponents1fordiscipline,sizegroup,journalswithindiscipline/sizegroupandarticleswithinjournals.Forsubmissiontoacceptance,thevariationamongjournalsandarticlesaccountedforthebulkofthevariation,mostlyintermsofarticleswithinjournals.Foracceptancetopublication,againthevariationwasalmostentirelyamongjournalsandarticlesnestedinjournals.Forthiscomponenthoweverthevariationamongjournalsaccountedforthebulkofthevariation.

4. Discussion Theresultsofthisstudyhavetobeinterpretedwithsomecaution.Themaincaveatisthatwewereonlyabletoincludedatafromjournalsthatpublishedthesubmissionandacceptancedateswhileinmostcasesthepublicationdatewasinferredfromtheissueandestimatedasthemid‐pointofthepublicationperiodfortheissue.Sincethedecisiontopublishthisinformationwasgenerallyconsistentacrossallthejournalsofaparticularpublisher,onlythosepublishersthatchoosetopublishsubmissionandacceptancedateareincludedinthestudy.Thisresultedin54%ofthesamplebeingpublishedbythetwobiggestpublishersElsevierandSpringer/Kluwer.Thiswasnotourintentionbutwastheresultofthelimitationnotedabove.AlistofthepublishersincludedinthestudythenumberofjournalsfromeachpublisherincludediscontainedintheAppendix.Therewerestrikingdifferencesbetweendisciplineswithbusiness/economicshavingaroundtwicethetotaldelaysubmissiontopublicationcomparedtochemistry.Differenceswerealsofoundintermsofthesizeofthejournalthoughtheywerefairlymodestwiththelargerjournalsappearingtobethemostefficientbothintermsofthetimefromsubmissiontoacceptanceandinpublishingarticlesonceaccepted.Openaccessjournals,particularlythosewhichwerecreatedasOAjournalsratherthanwereconvertedfromsubscriptionappeartobeabletopublisharticlesconsiderablymorequicklythansubscriptionjournals.Thisinpartmayreflectthefacttheyareelectroniconlyandtendtopublisharticlesastheyarereadyratherthanbundlingthemintoissues.GiventhesmallnumbersandthefacttheOAjournalsarenotevenlydistributedacrossdisciplinesthesefindingshouldbeinterpretedwithagreatdealofcaution.Theanalysisofvarianceindicatesmostofthevariationinpublicationtimesisatthelevelofindividualjournalsandarticles.Forthetimefromsubmissionto

1Thecomponentsforthefixedfactors,discipline,journalsizelevelandtheirinteractionarenottruevariancecomponents.Sincetheyarefixedeffectstheyarenotstatisticalexpectationsbutquadraticformsthatareaveragessimilarinnaturetoavariancecomponent.(Brennan,2001)Sincethedistinctionisirrelevantforthepurposesofthisstudy,wewillrefertothesequadraticformsasvariancecomponentsinthediscussionoftheresults.

Page 12: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

12

acceptance,thebulkisamongarticles.Thisisnotsurprising.Therearemanyidiosyncraticfactorsthatinfluencethelengthofindividualarticlereviews.Editorsmoreoftenthannotacceptmanuscriptspendingrevisionsandauthorsvarygreatlyinhowquicklytheycompletetherevisions.Hencethelengthofthereviewprocessforaparticulararticlemayreflecttheactionsoftheauthorratherthantheeditororreviewers.Alltheseandotherfactorsresultinsignificantdifferencesinreviewtimesamongsubmissionsforaspecificjournal.Therewasalsoconsiderablymorevariationamongjournalswithinadisciplineandsizegroupthanamongdisciplinesandsizegroups.Thisindicatestherearerealdifferencesinthisimportantaspectofpublishingthatarenotexplainedbyeithertheanomaliesofindividualreviewsorthecultureofreviewofdifferentfields.Somejournalsjustappeartobefasterinconductingthereviewprocess.Thislikelyinpartreflectsthelevelandnumberofcyclesofrevisionstypicallyrequiredbytheeditor.Italsomayreflecthowquicklymanuscriptsgooutforreviewandwhatexpectationtheeditororeditorialteamhasforhowlongareviewershouldtakeinreviewingamanuscript.Forthetimefromacceptancetopublicationthevastmajorityofthevariationisamongjournals.Again,thisdoesnotseemsurprising.Thebacklogsinprocessingmanuscriptsthroughtypesettingandcopyediting,frequencyofpublicationandthebacklogduetopagelimitsiftheyexistwouldalllargelyimpactonpublicationtimesatthejournallevel.

5. Conclusions Webelievethistobethefirstbroadstudyofpublishingdelays,coveringallfieldsofscience.Ourstudyalsodiffersfromallearlierstudiesbyouruseofarandomsamplecoveringjournalsofallqualitylevels.Previousstudies,haveusuallyusedsmallconveniencesamplesoftypicallytopjournalsintheirfields,whichintroducesastrongbiastowardsjournalsthatmayincludelongreviewprocesses.Ourresultsare,nevertheless,notinconflictwiththeearlierstudies,butinstead,addtothem.Themethodologywasverylaborintensiveanditwouldbeveryusefulforfuturestudiesifpublishersincludedthedateofsubmissionandacceptanceasastandardpartoftheirarticleinformation.Thiswouldprovidealeveloftransparencyforpotentialauthorsastothedelaystheycouldexpectinreviewandpublicationprocesseswhenconsideringwheretosubmittheirmanuscripts.Itwouldalsoprovideastrongincentiveforjournalstospeeduptheseprocesses.Theaimofourstudywastoprovideoveralldataonreviewandpublishingtimesacrossvariousfieldsofscience.Wedidnotattempttodeterminehowdelayshaveevolvedovertime.Someoftheearlierstudieshavedonethis,butwemadeaconsciouschoicetoconcentrateonthedifferencesbetweendisciplines,duetotheresourceintensivenessofourmethod.Alongitudinalstudywouldbeagoodtopicforafollow‐upstudy,andshouldideallygobackaround25years,tothetimebeforeemail,websubmissionsystemsandelectronicpublishing.That

Page 13: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

13

wouldontheotherhandalsoimplychallengesinfindingthedatawiththearticles.Itwouldbeveryusefultomakeamoredetailedstudyofwhydelaysdiffersomuchbetweendisciplines,Ourimpressionisthatthecleardifferencesamongfieldshaveevolvedoverdecadesthroughthedevelopmentofintra‐disciplinarysocialnormsforwhatisexpectedfromascholarlyjournalinthefield.Thisincludeswhatisanacceptabledelayforinformingauthorsofreviewresultsandacceptanceorrejectiondecisionsaswellastheprocessingandqueuingtimeonceamanuscriptisaccepted.ThisisinlinewiththeconclusionsofforinstanceEllison(2000).Thesedifferencesinreviewandpublicationtimesmayalsoreflectthenatureofthedisciplines.Forexampleinrapidlydevelopingfieldswhereseparategroupsofresearchersmayberacingtoachieveaparticularbreakthrough,thespeedofthepublicationprocesscandeterminewhichgroupgainscreditforthebreakthroughaspublicationhasbecomethedefactodeterminerofwhogetsthecreditforamajorfinding.Otherinterestingtopicsforfurtherstudieswouldbethedifferencesbetweenjournalswithinadisciplineandarticleswithinjournals.Forsomeindividualarticlesthedelaytimescanbeexcessivelylong.Thedelayscanbeduetotheauthorstakingexcessivelylongtimesmakingrevisionsaftertheoriginalreviewcycle.Theycanalsobeduetoexcessivelylongreviewperiodsordelaysinthepublicationprocess.Asfoundinthisstudy,mostofthevariationinsubmissiontoacceptancetimesisamongindividualmanuscriptswithinajournalwhilemostofthevariationinacceptancetopublicationtimeisamongjournalswithinadiscipline/sizegroup.Sincepublicationdelaysarebothdetrimentaltothecareersofindividualscholarsandretardtherateatwhichscientificfieldsadvance,understandingandattemptingtominimizeunnecessarydelaysinthepeer‐reviewandpublicationprocessisineveryone’sbestinterest.OneofthereasonsforthepopularityofOAjournals,inadditiontothewiderdissemination,isthebeliefthattheyhavemuchfastersubmissiontopublicationtimes.ThisperceptionisoftenhighlightedinthepromotionalmaterialforfullyelectronicOAjournals.ItappearsfromourverylimitedsampleofOAjournalsthatjournalswhichareonlydisseminatedindigitalformandpublisharticlesindividuallyastheyarereadytendtohaveconsiderablyshortersubmissiontopublicationperiodswithmostofthedifferenceduetoshorteracceptancetopublicationtimes.Afollow‐upstudycomparingsubscriptionjournalswithOA‐journalswouldneedtofurthersplitupOA‐journalsintoanumberofsubgroups,suchasmegajournals(PloSONEandcloses),journalsfromso‐calledpredatoryjournalswithspamacademicswithemailspromisingveryrapidpublicationandhighqualityOAjournals.Somecriticsofthecurrentsystemhavediscussedthealmostdefactostandardjournalpolicyofnotallowingauthorsthepossibilityofsubmittingtheirmanuscriptstootherjournalsinparallel(Torgersonetal2005),aslongasthearticlehasnotbeendefinitelyrejected(Piron2001).Thispolicycanresultinlongdelaysinthepublicationprocessofarticlesrejectedinthefirst‐choicejournalpotentiallyrenderingtheresultsoftheresearchoutdatedandoflittleuse

Page 14: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

14

bythetimeitisfinallypublished.Thepolicyisoftenjustifiedbysayingthatitwouldbeveryinefficientandunfairtoeditorsandrefereesifthesamearticleswouldberefereedinseveraljournalsatthesametime.Ontheotherhandexactlythesamethinghappenswhenarticlesafterrejectionorauthorwithdrawalareresubmittedtootherjournalsandnewreviewersgetinvolved.Interestinglythereisonejournalcategorywherethisruleisnotenforced,lawjournalspublishedbyleadingUSuniversities,whichallowauthorstosubmittocompetingjournalssimultaneously.Althoughnoempiricalstudiescouldbefoundofthepublishingdelayintheselawjournals,severalauthorsforexample(Posner,2008)havepointedoutthatthedelaysaremuchshorterthaninotherfields.Ifpublishersaregoingtosticktothedemandthatauthorsrefrainfrommultiplesimultaneoussubmissionsofamanuscriptthenitseemstous,thattheyhaveanobligationtomakethepublicationprocessasfastandefficientaspossible.Electronicpublicationoffersarealpotentialforspeedingupthescholarlyjournalpublishingprocess,butinordertoachievethisjournalshavetostoppublishingaparallelpaperversionandneedtoconverttopublishingarticlesinanissue‐lessmodeastheybecomeavailable.Thisisexactlywhatmostbornelectronicjournalsdo,andastheirshareofpublishingincreases,averagepublishingdelayswilltendtodecrease.

Acknowledgements: WeareverygratefultoCharlottaBjörk,AleksiAaltonenandPatrikWellingforhelpingoutwiththetediousworkofgatheringthedata.

References: Amat,C.B.(2008)Editorialandpublicationdelayofpaperssubmittedto14selectedFoodResearchjournals.Influenceofonlineposting,Scientometrics74,3,379Azar,OferH.,Rejectionsandtheimportanceoffirstresponsetimes,InternationalJournalofSocialEconomicsVol.31No.3,2004pp.259‐274Björk,B‐C.andTurk,Z.(2006).TheElectronicJournalofInformationTechnologyinConstruction(ITcon):anopenaccessjournalusinganun‐paid,volunteer‐basedorganization.InformationResearch,11(3)paper255,Availableathttp://InformationR.net/ir/11‐3/paper255.html]

Page 15: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

15

Björk,B‐C.(2011)InnovationsinScholarlyPublishing–AmultipleCaseStudyofOpenAccessJournals,JournalofMedicalInternetResearch,13(4):e115Retrievedfromhttp://www.jmir.org/2011/4/e115/,doi:10.2196/jmir.1802Brennan,R.L.(2001)GeneralizabilityTheoryStatisticsforSocialScienceandPublicPolicy(series)2001SpringerNewYork.CarrollR.(2001)ReviewTimesinStatisticalJournals:TiltingattheWindmills?Biometrics,Vol57,1‐6.CoeR.K.,WeinstockI.(1967):“EditorialPoliciesoftheMajorEconomicsJournals,”QuarterlyReviewofEconomicsandBusiness7,37‐43.I.Diospatonyi,†G.Horvai,†andT.Braun*,‡PublicationSpeedinAnalyticalChemistryJournals,J.Chem.Inf.Comput.Sci.2001,41,1452‐1456Dong,Peng,Loh,Marie,Mondry,AdrianPublicationlaginbiomedicaljournalsvariesduetotheperiodical'spublishingmodel,Scientometrics,2006,69(2),271‐286Ellison,G.(2002)TheslowdownoftheEconomicsPublishingProcess,JournalofPoliticalEconomy,110,947‐993Hartmann,D.L.“AreAMSJournalsTooSlowtoBeUseful?AnOpenLettertoAMSMembers,”http://www.atmos.washington.edu/~dennis/AMS_Publ_Paper.970610.psJournalM3tricsResearchAnalyticsRedefined.(2013).http://www.journalmetrics.com/Khosrowjerdi,M.,Zeraatkarb,N.,Varac,N.(2011)PublicationDelayinIranianScholarlyJournals,SerialsReview37(4)262–266.Kling,R.,Swygart‐Hobaugh,A.J.(2002).TheInternetandthevelocityofscholarlyjournalpublishing.WorkingPaperNo.WP‐02‐12,RobKlingCenterforSocialInformatics,SchoolofLibraryandInformationScience,IndianaUniversity,Bloomington,IN.https://scholarworks.iu.edu/dspace/handle/2022/148Laakso,M.,Björk,B‐C.(2012).Anatomyofopenaccesspublishing:astudyoflongitudinaldevelopmentandinternalstructure.BMCMedicine,10:124.doi:10.1186/1741‐7015‐10‐124LuwelM.,MoedH.F.(1998)PublicationDelaysintheScienceFieldsandTheirRelationshiptotheAgeingofScientificLiterature,”Scientometrics41(1–2)29–40.Nature.Overview:Nature'speerreviewtrial(2006)|doi:10.1038/nature05535.

Page 16: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

16

Piron,Robert(2001)TheyHavetheWorldonaQueue,Challenge,200144(5)95‐101.Posner,Richard(2006)LawReviews,WashburnLawReview,46(1)http://washburnlaw.edu/wlj/46‐1/articles/posner‐richard.pdfRaney,K.(1998).Intoaglassdarkly.JournalofElectronicPublishing,4(2).Retrieved3March,2006fromhttp://www.press.umich.edu/jep/04‐02/raney.htmlSCIMago.(2013).SJR–SCImagoJournal&CountryRank.Retrievedfromhttp://www.scimagojr.comSolomon,D.J.,Björk,B‐C.(2012)PublicationFeesinOpenAccessPublishing:SourcesofFundingandFactorsInfluencingChoiceofJournal,JournaloftheAmericanSocietyforInformationScienceandTechnology,63(1):98–107,2012,DOI:10.1002/asi.21660Solomon,David,Laakso,Mikael,Björk,Bo‐Christer,2013,Alongitudinalcomparisonofcitationratesandgrowthamongopenaccessandsubscriptionjournals,JournalofInformetrics,Vol7,No3,642‐650.Suber,P.(2012).OpenAccess.MITPress.230p.TorgersonD.J.,AdamsonJ.,CockayneS,DumvilleJ.,PetherickBritishE.(2005)Submissiontomultiplejournals:amethodofreducingtimetopublication?BMJ,330,305–307.TrivediP.K.,(1993)AnAnalysisofPublicationLagsinEconometrics,”JournalofAppliedEconometrics893–100.VanOrsdel,L.andBorn,K.(2002)PeriodicalsPriceSurvey2002:DoingtheDigitalFlip.LibraryJournal,http://www.libraryjournal.com/article/CA206383.html.)Ware,M.,Mabe,M.(2012)TheSTMReport:AnoverviewofScientificandScholarlyJournalPublishing,InternationalAssociationofScientific,TechnicalandMedicalPublishers,TheHague,Netherlands,http://www.stm‐assoc.org/2012_12_11_STM_Report_2012.pdfYohe,G.W.,(1980)CurrentPublicationLagsinEconomicsJournals,"JournalofEconomicLiterature18,1050‐55YuG.,YuD.R.,,LiY.J.(2004)TheuniversalexpressionofperiodicalaveragepublicationdelayatsteadystateScientometrics60(2)121–129.

Page 17: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

17

Figure1:AveragePublicationTimesinMonthsbyDisciplineFigureisbasedon15journalsperdiscipline,5foreachsizegroup,20articlesperjournalresultinginatotalof300articlesperdiscipline.

Page 18: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

18

Figure2:AveragePublicationTimesinMonthsbyJournalSizeGroupFigureisbasedon45journalspersizegroup,15foreachdiscipline,20articlesperjournalresultinginatotalof900articlespersizegroup.

Page 19: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

19

Table1.Previousstudiesconcerningpublicationdelaysinscholarlyjournals.Study

Includedjournals

Periodstudied

Discipline Delay(months)AverageRange

Yohe1980

25journals 1980 Economics 18.9

4.9–28.7

Trivedi1993 7journals

1986‐1990 Econometrics 22.8 19.7–31.4

Carroll2001

6journals 1994,1999 Statistics 22.3 15.0‐26.0

KlingandSwygart‐Hobaugh2002

3socialsciencejournals

1970/1980,2000

Econ.,management

23.8 17.0–29.4

KlingandSwygart‐Hobaugh2002

3naturalsciencejournals

1970/1980,2000

Physics,Chemistry

5.8 4.0–7.4

Hartmann1997

Onejournal 1970,1997 AtmosphericSciences

15.4

LuwelandMoed1998

15journals 1992 Physicalsciences,Eng.

9.4

2.5‐17.0

Diospatonyietal2001

10journals 1985‐1999 Analyticalchemistry

7.1 3.5–12.5

Raney1998

Onejournal 1997 Geoscience 21.8 11.5‐36.5

Yuetal2004

7journals 2002 Mainlyengineering

15.1 5.5–20.0

Amat2008 14journals 2004 Agriculture 11.8 6.2–17.2

Dongetal2006 28commercial,SocietyandOA

2004 Biomedicine 6.3 3.0‐11.0

BjörkandTurk2006

OneOAandtwoconventional

2005 CivilEngineering

14.5

6.7–18.9

Khosrowjerdietal2011

26Iranianjournals 2009 Cross‐disciplinary

17.3

5.8–34.6

Page 20: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

20

Table2 TimeSubmissiontoPublicationTotals

Months Submitted to

Accepted

Months Accepted to Published

Months Submitted to

Published

Mean 6.41 5.78 12.18

Std. Deviation 5.35 4.21 7.17

Std. Error of Mean* 0.10 0.08 0.14

Statisticsbasedon135Journals/2,700Articles*TheStandarderrorsofthemeansareapproximateduetothelackofindependencebetweenarticlesinthesamejournal.

Page 21: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

21

Table3 TimeSubmissiontoPublicationforOAJournals

Created Open Access

Months Submitted to

Accepted

Months Accepted to Published

Months Submitted to

Published

Yes

Mean 4.17 1.80 5.97

Std. Deviation 3.08 1.56 3.77

Std. Error of Mean 0.26 0.13 0.32

Number 7 Journals / 140 Articles

No Mean 5.12 4.76 9.88

Std. Deviation 4.37 5.17 7.90

Std. Error of Mean 0.28 0.33 0.51

Number 12 Journals / 240 Articles 

Thestandarderrorsofthemeanareapproximateduetolackofindependenceamongarticlesinthesamejournal.

Page 22: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

22

Table 4  Estimated Variance Components   

Submit to Accept  Accept to Publish 

Variance  Percent  Variance  Percent

Discipline  3.44  12% Discipline  0.83  5%

Journal Size  0.52  2% Journal Size  0.31  2%

Journal  8.49  29% Journal  12.88  71%

Article  16.46  56% Article  4.20  23%

Size x Discipline  0.49  2% Size x Discipline  0.00  0%

Total  29.41  Total  18.23  

Page 23: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

23

Publication Time in Months by Discipline 

Discipline Months

Submitted to Accepted

Months Accepted to Published

Months Received to Published

Chemistry Mean 4.73 4.18 8.91

Std. Deviation 5.46 3.60 7.30

Std. Error of Mean 0.32 0.21 0.42

Engineering Mean 5.00 4.30 9.30

Std. Deviation 3.68 3.06 5.29

Std. Error of Mean 0.21 0.18 0.31

Biomedicine Mean 4.65 4.82 9.47

Std. Deviation 3.47 4.11 5.18

Std. Error of Mean 0.20 0.24 0.30

Physics Mean 5.21 5.72 10.93

Std. Deviation 3.26 2.66 4.41

Std. Error of Mean 0.19 0.15 0.25

Earth Science Mean 5.74 5.96 11.70

Std. Deviation 4.80 4.66 7.24

Std. Error of Mean 0.28 0.27 0.42

Mathematics Mean 8.20 5.11 13.30

Std. Deviation 6.21 2.45 6.87

Std. Error of Mean 0.36 0.14 0.40

Social Science Mean 6.17 7.93 14.10

Std. Deviation 4.36 5.73 7.32

Std. Error of Mean 0.25 0.33 0.42

Arts and Letters Mean 7.21 7.00 14.21

Std. Deviation 5.26 5.38 7.71

Std. Error of Mean 0.30 0.31 0.44

Business/Economics Mean 10.75 6.96 17.70

Std. Deviation 7.15 3.19 7.52

Std. Error of Mean 0.41 0.18 0.43

All Journals Mean 6.41 5.78 12.18

Std. Deviation 5.35 4.21 7.17

Std. Error of Mean 0.10 0.08 0.14

 There are 15 journals, 5 per each size group and 20 articles per journal  

Standard error of the mean is approximate due to lack of independence among articles in a journal. 

Page 24: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

24

  Number of Journals from Each Publisher Included in the Study  

Publisher Number Percent American Chemical Society 1 0.8%

American Dairy Science Association 1 0.8%

American Physiological Society 1 0.8%

American Psychiatric Publishing, Inc. 1 0.8%

American Psychological Association 1 0.8%

American Society of Civil Engineers 1 0.8%

American Vacuum Society 1 0.8%

Arizona State University 1 0.8%

Australasian Association of Psychology and Philosophy 1 0.8%

Bentham Science Publishers 1 0.8%

BioMed Central 1 0.8%

Blackwell Publishing Inc. 3 2.3%

Butterworth Scientific Ltd. 1 0.8%

Cell Press 1 0.8%

Central Fisheries Research Institute 1 0.8%

Cognizant Communication Corp. 1 0.8%

Consejo Superior De Investigaciones Cientificas 2 1.5%

Copernicus Gesellschaften 1 0.8%

Electrochemical Society, Inc. 1 0.8%

Elsevier 61 46.6%

European Respiratory Society 1 0.8%

Geophysical Society of Finland 1 0.8%

Hindawi Publishing Corporation 1 0.8%

Institute for Ionics 1 0.8%

Institute of Physics Publishing 1 0.8%

Istituti Editoriali e Poligrafici Internazionali 1 0.8%

JAI Press 1 0.8%

Maik Nauka/Interperiodica Publishing 1 0.8%

Marcel Dekker Inc. 3 2.3%

Molecular Diversity Preservation International 1 0.8%

Oldenbourg Wissenschaftsverlag GmbH 1 0.8%

Opragen Publications 1 0.8%

Oxford University Press 1 0.8%

Pan American Health Organization/Organizacion Panamericana de la Salud

1 0.8%

Prolegomena: Journal of Philosophy 1 0.8%

Public Library of Science 1 0.8%

Raptor Research Foundation, Inc. 1 0.8%

Royal Society of Chemistry 2 1.5%

Royal Society of London 1 0.8%

SAGE Publications 1 0.8%

Springer Pub. Co., 14 10.7%

Taylor & Francis 1 0.8%

Page 25: The publishing delay in scholarly peer‐reviewed journals · issue. Most electronic open access journals publish articles directly when they are ready rather than in issues, thus

25

Universidad de los Andes 1 0.8%

Universidad de Murcia 1 0.8%

Universidad Nacional de Colombia 1 0.8%

Universidade Estadual Paulista 1 0.8%

Universidade Federal do Rio de Janeiro 1 0.8%

University of the Aegean 1 0.8%

Versita (Central European Science Publishers) 1 0.8%

Wayne State University Press 1 0.8%

Wiley-Blackwell 2 1.5%

 Publisher names retrieved from SCImago Journal & Country Rank website. http://www.scimagojr.com/