Monday, July 23rddevelopment, the impact of research, collaboration, and thematic specialization....

Post on 10-Oct-2020

0 views 0 download

Transcript of Monday, July 23rddevelopment, the impact of research, collaboration, and thematic specialization....

Monday,July23rdBibliometricsReviewed:History,Institutionalization,andConceptsStefanHornbostel,GermanCentreforHigherEducationResearchandScienceStudies(DZHW),GermanyTheemergenceofbibliometricsiscloselylinkedtothegrowthofscientificinformationinthe20thcenturyandtowhatdeSollaPricecalledtheevolutionfrom“littlesciencetobigscience”.Initially,bibliometricsanditsearlyconceptswereorientedtowardslibraryaccess,bibliographicdatabases,andinformationservices.However,sincethe1960sotherdisciplines,especiallythesociologyofscience,inspiredthedevelopmentofanewandinterdisciplinaryunderstandingofbibliometrics.Inthe1970sand1980stheincreasinginformationneedsonbehalfofsciencepolicymakersboostedtheinstitutionalizationofbibliometricsasanownfieldofresearch,whileatthesametimethisnewapplicationcontextnecessitatednewconcepts.Littlebylittle,aspecificbibliometricmethodologyaimingtobesuitablefortoday’sapplicationssuchasformula-basedfundingsystems,assessments,evaluationsetc.cameintobeing.Thelecturewillpresentthisdevelopmentprocessand,thereby,demonstratecommonconceptsofbibliometrics.IntroductiontoBibliometricDataSources(Part1andPart2)WolfgangGlänzel,CentreforR&DMonitoring(ECOOM)&Dept.MSI,KULeuven,BelgiumJuanGorraiz,BibliometricsandPublicationStrategies,UniversityofVienna,AustriaThistalkisaboutthespecificrequirementsforbibliographicaldatasourcestobemetinregardtotheirsuitabilityforbibliometricapplication.Furthermorerelevantissueslikecoverage,representativenessandselectioncriteriaareconsidered.Anyappropriatebibliographycanpotentiallyserveasdatasourceforbibliometricpurposes,however,comparativestudiesandlarge-scaleanalysesrequirelargestandardizeddatasourceslikebibliographicdatabases.Afterprovidingsomebackgroundinformation,themainfeaturesofbibliographicdatabasesarediscussedwithspecialfocusonthequestion,whichofthemareuseful,essentialorevenindispensableforbibliometricuse(mostdatabasesareratherdesignedforinformationretrieval).Inparticular,theprosandconsofthethreemajormultidisciplinarydatasources–WebofScience,SCOPUSandGoogleScholar–arediscussed.Focuspointsofthesecondpartare:a)toshowthattheselectionofthedatasourceswilldeterminetheoutcomeofyourbibliometricanalysis;b)howtocheckandenrichyourdatainordertoextendthedatapoolforbibliometricanalysis;andc)toconsiderthatdatasourcesarecontinuouslychangingtheirstructure(numberofindexedsources).

Somebasicdatabasefeaturesarealsointroducedexemplarilyfromdifferentproducts.Adistinctionismadebetweensubject-specificandmultidisciplinarydatabases.Inaddition,subject-specificdatabases(e.g.“MathSciNet”,“SciFinder”,ADS),patentdatabases(e.g.“DerwentInnovationsIndex”,Espacenet(PATSTAT))orpilotprojectsforcitationindexingontheweb(e.g.“BASE”,“CiteseerX”–allbasedonopenaccessarchives)arepresentedandexaminedcriticallyregardingtheirdataenrichmentpotentialinbibliometricanalyses.Somefinalrecommendationsondatavalidation,ontheimportanceofuniqueidentifiersandontheuseof„subjective“datasourceslikeCRISwillclosethistalk.ScientometricIndicatorsinUse:anOverviewSybilleHinze,GermanCentreforHigherEducationResearchandScienceStudies(DZHW),GermanyWolfgangGlänzel,CentreforR&DMonitoring(ECOOM)&Dept.MSI,KULeuven,BelgiumTheuseofscientometricindicatorsdatesbacktothe1960sand1970sintheUnitedStateswherethefirstScienceIndicatorsreportwaspublishedin1973.Sincethenavarietyofindicatorsemergedaimingatreflectingvariousaspectsofscienceandtechnologyandtheirdevelopment.Thepresentationwillgiveanoverviewofrelevantindicatorsandtheiruseinsciencepolicyandrelatedrealms.Thespecificfocuswillbeonindicatorsusedinthecontextofresearchevaluation.Inparticularindicatorsappliedtomeasuringresearchperformanceatthevariouslevelsofaggregationi.e.themacro,mesoandmicrolevelwillbeintroduced.Arangeofaspectsreflectingresearchperformancewillbeaddressedsuchasresearchproductivityanditsdynamicdevelopment,theimpactofresearch,collaboration,andthematicspecialization.Optionsandlimitationsoftheindicatorsintroducedwillbediscussed.SubjectClassificationinBibliometrics–Theory,Approaches&LimitationsStephanGauch,GermanCentreforHigherEducationResearchandScienceStudies(DZHW)&HumboldtUniversitätzuBerlin,GermanyClassificationsshapethewaysweperceiveboththeobjectsclassifiedaswellasdifferencesbetweenobjects.Naturally,theyshapebibliometricanalyses,especiallysowhenreplicationandconsistencyarekeynecessities.Theyalsoare,tonosmallextent,aproductofdiscourseandthereforeaspecialformofconventionthatcanbothbeenablingaswellaslimiting.Inthecourseofthissessionwewillapproachclassificationsfromatheoreticalaswellaspracticalperspective.Amongthequestionsaddressedare“Whatdoesitmeantoclassify?”,“Howcanwedeterminewhatmakesa*good*classification?”,“Whattodoifanobjectcanbeclassifiedtomultipleclasses?”etc.Thesessionaimsatprovidingadeeperandmoreinformedinsighttoparticipantsaboutwhatitreallymeanstouseclassifications,encouragingbothacriticalmindsetaswellasprovidingpracticaladvice.BibliometricMethodsinSubjectDelineationWolfgangGlänzel,CentreforR&DMonitoring(ECOOM)&Dept.MSI,KULeuven,Belgium

Subjectdelimitationhasbecomeacentralissueinso-called"domainstudies".Sciencepolicyaddressesnewemergingorcomplexinterdisciplinarytopicsthedelineationofwhichisparticularlydifficult.Thedelineationofthesetopicsordomainsis,ononehand,stronglyrelatedwithinformationretrievalsinceoftenrathertraditional"searchstrategies"usingcorejournals,keywordsandphrasescanbeappliedbut,ontheotherhand,goalsandmethodsofadvancedsubjectdelineationessentiallydifferfromthoseofusualretrieval.Propersubjectdelineationisalsonecessarytofindcorrectreferencestandardsforbenchmarkingtheresearchperformanceoftheactorsinthetopicunderstudy.Thefirstpartofthelecturewillfocustraditionaltechniquesthatcaneasilybedevelopedforandusedintheonlineversionsofbibliographicdatabases.Thesecondpartwillintroduce"bibliometrics-aided"retrieval.Oneofthemainmethodologicalcharacteristicsofbibliometrics-aidedretrievalisthatbibliometricsallowsincluding'metric'componentsinsearchstrategies.Inthecourseofthelectureitwillbeshownhowlexicalandcitation-basedcomponentscanbeusedtograduallyextendtheoriginalcore(orseed)ofsurelyrelevantdocumentspreviouslyobtainedfromtraditionalliteraturesearches.TheWebofScienceofferstheoptionofrelatedrecords(basedonbibliographiccoupling)whileScopususeskeywords.Resultscanbefilteredbytheirrelevanceandadditionalrelateddocumentscanbeaddedtothecoresetusingthresholds.Theapplicationofdirectcitationlinksormoreadvancedtextualsimilaritiesisagainreservedforarathersmallgroupofuserswithaccesstocustomdata.Inthiscase,too,thresholdscanbesettofilternoiseandtocontrolprecisionandgranularity.TheEvolutionofCitationDatabaseswithFocusonNewDevelopmentsJeffClovis,ClarivateAnalyticsIn1955,EugeneGarfieldpublishedapaperinScienceentitled"CitationIndexesforScience:ANewDimensioninDocumentationthroughAssociationofIdeas."Today,Dr.Garfieldstandsasapioneerinthefieldofbibliometrics,andhislegacyofamultidisciplinary,citationdatabasehasgrownovertheyearstoencompassnewtechnologiesnotenvisioned58yearsago.Thesenewtechnologieshavemovedcitationdatafromprinttoelectronicformat,andultimatelyintoaWeb-basedenvironmentofhypernavigation,optimisticandcontext-sensitivelinking,andbeyond.ThispaperwillreviewthewayinwhichthecitationindexeshaveevolvedtobecomepartoftheWebofScienceplatform-anintegratedplatformofnetworkedresourcesutilizedby9,400researchlibraries,governmentagenciesandcorporationsworldwide.StartingwiththeimportanceofDr.Garfield'seffortsinbibliometricsthatultimatelyledtothedevelopmentoftheISIplatform,thispaperwillthenfocusonthreecriticalareas:howtheplatformmeetsthegrowingneedforaccesstomultidisciplinarycontentintoday'sresearchenvironment;thedevelopmentofourfoundation,subjectspecialtyandregionalindexesthatallowcross-contentsearching;andnewtechnologies-theauthentication,access,androutingmanagementsystemsintegratedintoWebofScience.

Tuesday,July24thDesigningEffectiveQueriesforDocumentRetrievalStephanGauch,GermanCentreforHigherEducationResearchandScienceStudies(DZHW)&HumboldtUniversitätzuBerlin,GermanyThequalityofbibliometricapproaches,bothexplorativeaswellasevaluative,isstronglyinfluencedbythewaysearchqueriestobibliometricdatabasesareconstructed.Thisbecomesapparentwhenbeginningscholarsandpractitionersofbibliometricsareshockedwhentheylearnthatthescientificfieldortopictheythoughtcouldbecoveredbyasimplesearchtermisfarbettercoveredbypagesandpagesofcarefullyselectedandintricatecombinationsofsearchterms,journalsetsandclassifications.Inthissessionwewillexploregoodpracticeexamplestodesign“effectivequeries”.Participantswillbeshownhowtogetthemostfromexpertknowledge,howtoiterativelyoptimizequeries,howtocarefullyusetruncatingtechniquesoftermstocovermoregroundandhowtoavoidpitfallssuchasover-optimizationorqueriesthatare“toofuzzyaroundtheedges”.DataCleaningandProcessingChristineRimmert,InstituteforInterdisciplinaryStudiesofScience-AGBibliometrie,BielefeldUniversity,GermanyThequalityofbibliometricanalysesisheavilydependingonappropriatedhandlingoftherelevantrawdatafields.Dependingonthelevelofaggregationandthetargetobjectsunderstudy,variousissuesofaccuracycancomeupwithcitationlinksandseveraldataelements(documenttype,author,institution,country,journal,fieldanddiscipline).WewillhaveacloselookattherelevantdatafieldsinmoderncitationdatabaseslikeWebofScienceorScopustoseeiftheyare“readytouse”fordoingallkindsofbibliometricstudies.Mainproblemsofdataqualitywillbeshownandmajortypesoferrorsandtheirconsequenceswillbediscussed.Standardisation,verificationandtheintroductionofidentifierscanhelptoovercomeproblemsofdataquality.DataprocessingapproachesoftheGermancompetencecentreforbibliometricswillbedemonstrated.JournalImpactMeasures(Part1andPart2)WolfgangGlänzel,CentreforR&DMonitoring(ECOOM)&Dept.MSI,KULeuven,BelgiumJuanGorraiz,BibliometricsandPublicationStrategies,UniversityofVienna,AustriaTheseminaronimpactmeasureswillfirstshedlightonthebestknownandmostcontroversialindicator,namelyGarfield’sJournalImpactFactor.Itsstrengthsandweaknessesaswellasitscorrectusewillbediscussedthoroughly.Moreoverthecorrespondinganalyticaltool,ThomsonReuter’sJournalCitationReportswillbedemonstrated.AlternativeimpactmeasureslikeEigenfactormetrics,SJRandSNIPhavebeenintroducedwithinthelastyearsandwillbepresentedinthesecondpartofthistalktocompletethepicture.

SubjectNormalizationforCitationAnalysisWolfgangGlänzel,CentreforR&DMonitoring(ECOOM)&Dept.MSI,KULeuven,BelgiumSubjectnormalisationforcitationanalysisisafundamentalrequirementforcitationanalysisinamultidisciplinaryenvironment.Recentlytwofundamentalapproachesexist,theso-calledsource-andcitingsidenormalisation,or,usinganotherterminology,theaprioriandaposteriorinormalisation.Bothmethodswillbeintroducedanddescribed.Althoughtheapriorinormalisationrepresentsamoreadvancedmethodology,itsapplicationisreservedforarathersmallgroupofusers.Thereasonistheaccesstoandtheprocessingofthecompletedatabase(WebofScienceorSCOPUS)sinceinthisapproachcitationshavetobenormalisedbeforetheyarecounted.Knowledgeaboutthisnormalisationtechniqueis,however,importantbecausethisfuture-orientedmethodologyisalreadyappliedbylargerbibliometriccentres.Thesecondmethodisratherconservative,butcanbeappliedbyanyuserwhohasaccesstotheonlineversionoftheWebofScienceorSCOPUS.Themaincharacteristicofaposteriorinormalisationisthatcitationcountsarenormalisedaftercountingonthebasisofproperreferencevalues.Advantagesanddisadvantagesofbothmethodsarediscussedandexamplesforthesecondapproacharecalculated.ProductPresentation:InCitesJeffClovis,ClarivateAnalyticsInCitesisacitation-basedevaluationtoolforacademicandgovernmentadministratorstoanalyzeinstitutionalproductivityandbenchmarkoutputagainstpeersandaspirationalpeersinanationalorinternationalcontext.Withcustomizedcitationdata,globalmetrics,andmultidimensionalprofilesontheleadingresearchinstitutions,over9,000sitesglobally,you’llgetcomprehensiveinsightintoyourperformance.BuiltonthefoundationofWebofScience,InCitesusesthemostthorough,accurate,andobjectivedataavailable.InthisshorttutorialwewillfocusonaquicktourhighlightingEuropeaninstitutions.AllattendeeswillreceivecomplimentaryaccessfortheESSSsessions.

Wednesday,July25thBestPracticesinBibliometricsMeasuringScience:EvaluationandMappingofScientificResearchTonvanRaan,CentreforScienceandTechnologyStudies(CWTS),LeidenUniversity,TheNetherlandsWepresentanoverviewofthelatestdevelopmentsin‘measuringscience’basedonbibliometricmethods.Ourcentraltopicistheroleofcitation-andconcept-networksandtheircombinationasanaturalbasisforboththeconstructionofperformanceindicatorsaswellastheconstructionofsciencemaps.Wepresentreal-lifeexamplesofpracticalapplicationsofadvancedbibliometricmethodsintheevaluationandmappingofuniversities,departmentsandinstitutes.Theseapplicationsalsoofferindividualscientistsinstrumentstoexploretheirownresearchfield.Weexplainhowcluster-basednormalizationisusedtotackletheproblemofthelargedifferencesincitationdensitywithinfields.ThestrategicpotentialofsciencemappingbasedonnewbibliometricinstrumentssuchastheVoS-viewerandCitNetExplorerisshownbyrecentworkonSleepingBeauties.FinallywediscussthenewversionoftheLeidenRankingincomparisonwithotherprominentuniversityrankings.BibliometricServicesattheUniversityofViennaJuanGorraiz,BibliometricsandPublicationStrategies,UniversityofVienna,AustriaBibliometricsisidealforlibrarianstodevelopandprovideinnovativeservicesforbothacademicandadministrativeuniversitystaff.TheBibliometricsandPublicationStrategiesDepartmentinViennahasbeenimplementedwithintheLibraryandArchiveServicesoftheUniversityofVienna.Itcanserveasarolemodelforotheracademiclibrarianswhowishtobecomemoreengagedinthisfieldorevenplantoimplementaccordingservices.Thispresentationgivesanoverviewofallbibliometricservicesofferedbythedepartmentandwillthenfocusonthoserelatedtoindividualevaluationandparticularlytoprofessorialappointments.TheViennaUniversitybibliometricapproachreliesonavarietyofbasic,simpleindicatorsandfurthercontrolparametersinordertoaddressthemulti-dimensionalityoftheproblemandtofostercomprehensibility.Our“topcountsapproach”allowsanappointmentcommitteetopickandchoosefromaportfolioofindicatorsaccordingtotheactualstrategicalignment.Furthermore,controlandadditionaldatahelptounderstanddisciplinarypublicationhabits,tounveilconcealedaspectsandtoidentifyindividualpublicationstrategiesofthecandidatesorindividualresearcherstobeevaluated.Bibliometricsonlyshinesalightonquantitativeaspectsandshouldneverbeappliedirrespectiveofthegivenqualitativecontext.PolicyUseofBibliometricEvaluationanditsRepercussionsontheScientificCommunitywithFocusonResearch,Technology,Patents,DevelopmentandKnowledgeTransferKoenraadDebackere,KULeuven,Belgium

Modernsciencepolicyfirmlyreliesonbibliometricdata&indicatorstoassessthescientificperformanceofresearchinstitutions,researchgroupsandevenindividualresearchers.Inaddition,benchmarkingthescientificperformanceofcountriesandregionsisanotheritemontheagendaofevaluativesciencepolicy.Duringthepresentation,therepercussionsofthispolicyuseofbibliometricevaluationwillbedealtwithalongthreelinesofthoughtandreflection.First,recenttrendsandinsightsintodataandindicatoruseforevaluativesciencepolicywillbehighlighted.Second,anoverviewofcurrentpolicyframeworkswillbepresented,takingintoaccounttherecenttrendtolinkscientificperformancetoso-calledsmartspecializationpolicies.Third,wewillreflectuponthemultifacetedimpactthosetrendshave(ormayhave)onthescientificcommunityand(inthelimit)thebehaviorofindividualscientists.ResearchImpactAssessmentAcrossDomains-CombiningStandardsandBibliometricsDataStephanGauch,GermanCentreforHigherEducationResearchandScienceStudies(DZHW)&HumboldtUniversitätzuBerlin,GermanyThereexistsalong-standingtraditionoflinkingbibliometricdatatoothertypesofsources,e.g.patentdocumentsto“linksciencetoinnovation”.Withtheadventofalternativemetricstherehasbeenasurgeofsuchexpansiveactivities.Insomecases,uniqueidentifiersandAPIsareinplacetomakethelifeofaresearcher(relatively)easy.Everythingisneatandclean.Atleastonthesurface–butthat’sadifferentissue.Inothercases,allthereisisugly,dirtyandmessydata–andsometimesnoteventhat.Itisthesecases,aresearcherneedstouseawiderarrayoftools.Butwait…there’smore.Thetasktounlocksuchnewdatasourcesisnotlimitedtotherealmofthetechnical.Ifindicatorsarebuiltontopofthislinkeddata,thereremainsthechallengetoconstruct/uncovermeaningandrelevanceofsuchnumbers.Ataskaseasilyoverlookedandneglected,asitisfundamental.Inthissession,youwillgetawalkthroughofsuchachallengeusingtheexampleoftechnicalstandardsasnewdatasource.Thereareanumberofquestionstothelinkbetweenstandardsandpublications:Howmuchscienceisthereintechnicalstandards?Aretherefeedbackeffectstobeingcitedinstandards?Maybeyougetmorecitationsfromthis!Whatisthemeaningofthistypeofcitationcounts?Justtonameafew.Youwillbepresentedwithanarrayoftoolstomakeyourlifeeasier,howtoplanresearchdesignsbeyondbibliometricstouncoverthemeaningofsuchcounts,whyitisimportanttounderstandthedomain-specificcitationculturesandpractices,typicalpitfallsinopeningupnewdatasources,and,enpasssant,learnsomethingabouttheinnerworkingsoftechnicalstandardsandthestandardisationsystem.BibliometricsinPractice:HowtoGenerateReportsforInstitutionsDanielTorres-Salinas,UniversidaddeGranada(EC3metrics,ResearchEvaluationUnit),SpainInaninstitutionalcontextandataprofessionallevel,oneofourmaintasksistocarryoutbibliometricreports.Thesestudiesareessentialbecausetheyareusedbymanagerstomakedecisions(distributionoffunds,recruitmentofpersonnel,planningofresearchlines,etc.).Inthistalkwewillexplainhowtomakeaglobalbibliometricreportofaninstitution,weuseasacasestudytheUniversityofGranada.Wefocusonthesetopics:

1)Generalconsiderations:target,selectionofindicators,objectives,etc.);2)whatsourcesofinformationcanbeused;3)Howtocontextualizeandinterprettheindicators;4)Howtocomparetheresultswithotherinstitutions(Benchmarking);5)Howtomakegraphsandtables;and6)Disseminationofresultsanddata.TheApplicationContextofResearchAssessmentMethodologiesHenkF.Moed,IndependentresearcherandscientificadvisorThelecturepresentsaseriesofkeynotionsfromthespeaker’snewmonograph“AppliedEvaluative Informetrics (Springer, 2017)”. First, an analytical distinction is madebetween four domains of intellectual activity in a research assessment process: thedomains of policy, evaluation, analytics, and data collection. Next, the lecture defendsthe idea of a multi-paradigmatic, value-free informetrics, and argues that, althoughevaluative assumptions (“values”) on what constitutes research performance play acrucialroleinresearchassessment,thisroleoftenremainsimplicit,andsuchvaluesareextra-informetric, in the sense that their validity cannot be grounded in informetricresearch.Aseriesofexamplesillustrateshowthechoiceofindicatorsinanassessmentprocessisinfluencedbypolicyobjectives,andhowtechnicalindicatorconceptsfitintothedevelopers’wider–social,culturalandhistorical–context.Itisfurtherarguedthatevaluative frameworks are indispensable but often missing in research assessment.Finally,thelecturecriticallyreflectsontheassumptionsunderlyingcurrentpracticesinthe use of informetric indicators in research assessment, and proposes a series ofalternativeapproaches,indicatingtheirprosandcons.TopicProminenceinScience–aNewBibliometricApproachtoIdentifyHigh-DynamicResearchTopicsTomaszAsmussen,CustomerConsultant,ElsevierAsresearchisbecomingincreasinglyinterdisciplinaryandinternationalitbecomesmoredifficulttoidentifyexistingresearchstrengthanduncovernewemergingresearchfieldswithahighrelevancyglobally.ElsevierandSciTechStrategieshavepartneredtodevelopascientificallyfoundedandyetpracticalbibliometricapproachtoidentifyresearchTopicsusingdirectcitationanalysisandfurtherassigningaProminenceindicatortodetermineitsmomentum.ByapplyingthisbibliometricapproachtothefullScopusdatasetsince1996roughly97,000stableresearchtopicshavebeenidentifiedandassignedaProminenceindicatorbyweighing3metrics(citationcount,viewscount,journalimpact)forpapersclusteredinaTopictodetermineitsmomentum.ThefactthataTopic’sProminencehighlycorrelateswithfundingmakesithighlyrelevantforresearchmanagersandresearchersalikeandthusProminenceprovidesadata-drivenindicationintowhichresearchtopicsarethebesttoinvesttimeandeffortsin.TopicProminenceinScienceisavailableinSciValandcanbeappliedtocountries,universities,researchersorgroupsofresearchersformorethan8,500researchinstitutionsgloballytorunafullresearchportfolioanalysis,inseconds.Dimensions-LinkingPublicationsandCitationswithGrants,PatentsandClinicalTrialstoWidentheViewTomLickiss–SeniorResearchConsultant,ÜberResearchPublicationsandtheirassociatedcitationsareagoodproxytomeasuretheimpactfromandwithinthescientificcommunity,butthisisonlyonefacetofamuchlargerpicture.

Dimensionshasbeenrealisedtoaddressthisissue,andtoprovidegreaterandmoreopenlyavailableinsightsacrosstheresearchlifecycle.Byintegratingmorecontenttypes(likegrantstocaptureprojectbasedfunding,clinicaltrialsfortranslationintoclinicalcures,patentstoprovidethecommercialtranslationofresearchactivitiesandevenpolicydocumentstoreflectwhereresearchresultsmadeitintopolicies)wecanchangethewaysinwhichweaccessandunderstandthescholarlylandscape.Dimensionsdoesnotjustputmoredocumentsinadatabase,italsolinksthemconsistentlytogethertoallowa‘trajectoryview’attheinstitutional,researcherortopiclevel,enablinguserstogatherabroaderandmorequalitativeunderstandingoftheassociatedresearchactivity.Takingthisbroaderapproachtoresearchinformationalsoprovidestheopportunitytodevelopnewscientometricapproaches,usingamoremultifacetedviewtoanalyseinput,resultsandimpactfromvariousangles.InthepresentationwewillexplainthebasicconceptsandusecasesofDimensions,anddiscusshowresearcherswhoareinterestedtoworkwithorbuildonourdatacandoso.

Thursday,July26thTheApplicationofNetworkAnalysisinScienceStudies:CommonTheoreticalBackgroundforBroadApplicationsBartThijs,CentreforR&DMonitoring(ECOOM),KULeuven,BelgiumNetworkanalysisinscientometricsprovidesapowerfulsetoftoolsandtechniquestouncovertherelations,structureanddevelopmentamongdifferentactorsinscience.ItisoftenreferredtoasMappingofScienceandcanbeappliedtoallentitiesassociatedwithsciencelikedisciplines,journals,institutionsandresearchers.Thislecturewillfocusmainlyondifferentmeasuresofrelationsbetweenentitiestacklingbothontheclassicalapproachesasonthenewtechniquesofnetworkanalysisinanapplication-orientedapproachwithinasolidtheoreticalframework.Relationsbasedoncitationsandreferencesincludebibliographiccoupling,co-andcross-citation.Otherdirectlinksbetweenentitiesincludeco-authorship,institutionalcollaborationorinternationalcollaboration.Alsolexicalapproacheslikeco-wordanalysisandtextminingwillbetackled.Eachofthesemeasureshastheirownpropertieswhichcanhavestrongimplicationsontheapplicabilityoftheanalyticaltechniques.Inordertoimprovethedistinctivecapabilitiesofthesemeasuresnewhybridapproacheshavebeenproposed.Thelecturewillalsodealwithseveralanalyticaltoolsandvisualizationtechniquesthataresuitableforcapturingtheunderlyingstructure.Clusteringtechniqueslikek-meansorWard’shierarchicalclusteringareproventechniquestoclassifytheentitiesmodularityclusteringhasbecomeapopularalternative.ResearchCollaborationMeasuredbyCo-AuthorshipWolfgangGlänzel,CentreforR&DMonitoring(ECOOM)&Dept.MSI,KULeuven,BelgiumCo-authorshipcanbeusedasaproxyforresearchcollaborationathigherlevelsofaggregation,e.g.,inthecaseofinstitutionalorinternationalcollaboration.Butevenatthelevelofresearchteamsandindividualscientists,co-authorshippatternsrevealimportantinformationaboutmainactorsandtheirroleinthenetworkofscholarlycommunication.Inthefirstpartofthelecturetheanalysisofco-authorshipnetworksatthemicro,mesoandmacrolevelisdescribed.Thestrengthofco-authorshiplinksamongindividualscientists,institutionsorcountriescanpreferablybedeterminedusingappropriatesimilaritymeasures.Co-authorshipnetworkscanreadilybevisualisedapplyingsuitablesoftwarethatisavailableandfreefornon-commercialuse.Inthesecondpart,bibliometricindicatorsfortheanalysisofresearchcollaborationatthemesoandmacrolevelwillbeintroduced.Itwillbeshownhowindicatorsandsimilaritymeasurescanbecalculatedusingthe“analyseresults”and“citationreport”toolintheonlineversionoftheWebofScience.TechnologyMaturity–UsingBibliometricMethodstoAssessTechnologyReadinessMariadeKleijn-Lloyd*,SVPAnalyticalServices,ElsevierGovernmentsandresearchfundersareincreasinglytryingtoensureresearchtheysponsorleadstoeconomicimpactandtechnologybreak-throughs.Insteadofthinkingin

termsofresearchdisciplines,theyreframethequestionto‘grandchallenges’ortotechnologieslikenanotechnologies,artificialintelligenceorrobotics.Andontopoftheusual‘whereistheexcellenceandwhocollaborateswithwho’,questionsareaskedonthematurityortechnologyreadiness.Wewillpresentamethodandcasestudyusingbibliometricstoinvestigateresearchintechnologiesandassesstechnologyreadiness.

Friday,July27thFocusTopicDay:Bibliometrics&OpenAccessTheDifferentFlavoursofOpenAccessBernhardSchubert,OpenAccessOffice,UniversityofVienna,AustriaThispresentationintroducestheconceptofOpenAccesstoscholarlypublicationsandthevarious"roads"leadingtowardsit.WewillalsobelookingattransformationalbusinessmodelsfromClosedtoOpenAccessandatservicesinstitutionscanoffertosupportthisdevelopment.OpenAccessandPublicationPracticesinAstronomyandMathematicsNielsTaubert,BielefeldUniversity,GermanyInastronomyandmathematicsalargeshareofpublicationsisfreelyaccessibleonlineviadisciplinaryorsubject-specificrepositories.Referringtoanempiricalstudyofincludingbibliometricanalysisandin-depthinterviews,thecontributionexaminestheroleofself-archivedmanuscriptsinthecommunicationsystemofthetwodisciplines.Theanalysisshowsthatrepositoriesactasasecondchannelofdisseminatingresearchinadditiontojournals.Moreover,itreconstructshowrepositoriesarebeingusedbyauthorsandreaders.Inbothfieldsauthorseven-handedlyself-archivetheirmanuscriptsinpartnotonlybeforethepublicationappearsinajournalbutevenbeforepeerreviewiscompleted.Thishappensfordifferentreasons,includingtheimprovementofaccessibility,theprotectionofpriority,andtoincreasethechancesofgettingtheresearchpublishedinajournal.Earlyself-archivingbeforecompletionofpeerreviewdefactobypassestheevaluationprocedurewhichisapreconditionfortrustinpublishedresearch.Therefore,itisaskedwhetherreadersdealwithsuchpre-printsinaspecificway,takingtheirpotentialnon-peer-reviewednatureintoaccount.Thereconstructionshowsthattheusabilityofself-archivedmanuscriptsresultsfromspecificroutinesamongthereaders:Theyinterpretcontextualinformationofpre-prints,undertaketestsofplausibility,usetheauthornameasaproxyfortrust,limitthecitationofpre-prints,anddistinguishbetweentrustworthyandnon-trustworthycomponentsofapre-print.Thus,theroutinesofthereadersarecomplementarytotheroutinesofauthorsandare–tosomeextent–shapedbyepistemiccharacteristicsoftheparticularfield.BibliometricsandOpenAccessEricArchambault,1science&Science-Metrix,CanadaAcademicshavebeenexaminingtheOpenAccess(OA)modelforscientificpublicationsforyears.ThoughithasbeennotedrepeatedlythatOAavailabilityisrisingsteadily,currentmeasurementisoftenlimitedbyvaguedefinitionsandexistingbibliographicdatabases.Oneofthechallengesistodistinguishmoreclearlybetweendifferenttypesofavailability(e.g.goldorgreen),whileaccountingfor,butnotconflating,otherimportantdimensionssuchastimetoavailability,transiencyandlicensetype.Anothermajorchallengeliesinmeasurementperse.Measuringopenaccessavailabilitycaninvolve

computingthetotalnumberofavailablearticlesandthepercentageofavailablepapers.Thispresentationwillexaminecurrentmeansofretrievingopenaccessarticles(thenumeratorinthepercentage)andthedatabasescurrentlybeingusedtocountthetotalnumberofavailablepapers(thepercentage’sdenominator).AdvocatesofOAhavebeenarguingthatbyincreasingaccessibility,OAwouldenhancetheimpactofresearch.ThispresentationwillreviewcurrentevidenceontheOAcitationadvantageincludingtheargumentsraisedbyitsdetractors.DisentanglingGoldOpenAccess:DisciplinaryandCountryEffectNicolasRobinson-Garcia,INGENIO(CSIC-UPV),UniversitatPolitècnicadeValència,Spain;UniversidaddeGranada(EC3metrics),Spain/DanielTorres-Salinas,UniversidaddeGranada(EC3metrics,ResearchEvaluationUnit),SpainInthisseminarwewilldiscusscurrentpublicationtrendsingoldOpenAccess(OA).Thepurposeistodevelopafullunderstandingoncountrypatterns,OAjournalscharacteristicsandcitationdifferencesbetweengoldOAandnon-goldOApublications.Forthis,wewillfirstreviewcurrentliteratureregardingOpenAccessanditsrelationwithitsso-calledcitationadvantage.Startingwithachronologicalperspectivewewilldescribeitsdevelopment,howdifferentcountriesarepromotingOApublishing,anditseffectsonthejournalpublishingindustry.Wewilldeepentheanalysisbyinvestigatingtheresearchoutputproducedbydifferentunits.First,wewillfocusontheproductionofcountrieswithaspecialemphasisoncitationanddisciplinarydifferences.GoldOApublishingisbeingencouragedinmanycountriesasopposedtoGreenOA.Wewilldiscusshowthisaffectsresearchers’publicationpatternsandwhetheritensuresanallegedcitationadvantageasopposedtonon-goldOApublications.

Saturday,July28thAltmetrics:StateoftheArtandFutureWorkIsabellaPeters,Leibniz-InformationszentrumWirtschaft(ZBW),GermanyThelecturewillpresentthecurrentstateoftheartofaltmetricsresearchanditsmajorfindings.Itwillparticularlyfocusonstudiesonthecoverageandintensityofaltmetricsaswellasonthetheoriesandmodelstryingtoestablishatheoreticalbackgroundofaltmetrics.Researchgapswillbeidentifiedandcurrentdevelopmentsandinitiativesthataimatbringingaltmetricsintopractice(e.g.,NISO,EU,LIBER)willbepresented.PracticalApplicationsofAltmetricsNicolasRobinson-Garcia,INGENIO(CSIC-UPV),UniversitatPolitècnicadeValència,Spain;UniversidaddeGranada(EC3metrics),SpainThistalkaddressespracticalissues,limitationsandproblemswemightencounterwhenretrievingandprocessingaltmetricdata.Wewillexplorewhatitiswhattheindicatorsprovidedbythemainaltmetricprovidersofferandhowthesecanbeusedinameaningfulwaytomakeinformativeandsensibleanalyseswhichoffercouldofferanaddedvaluetoourinstitutions.Thefirstpartofthetalkwillfocusonthediscussionofthepeculiaritiesandtechnicalitiesrelatedtohowaltmetricdataisprovidedtotheuser.Thesecondpartwillprovideexamplesandshowempiricalapproachesthatcanbeappliedtoinformonthesocialmediaattentionofresearchers’activity.