Analysis of regional species distribution models based on ... · Population Ecology Analysis of...

11
Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple Small-Scale Studies MINDY B. RICE, 1 Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA ANTHONY D. APA, Colorado Parks and Wildlife, 711 Independent Avenue, Grand Junction, CO 81505, USA MICHAEL L. PHILLIPS, Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA JAMES H. GAMMONLEY, Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA BRADFORD B. PETCH, Colorado Parks and Wildlife, 711 Independent Avenue, Grand Junction, CO 81505, USA KARIN EICHHOFF, Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA ABSTRACT The identification of core habitat areas and resulting prediction maps are vital tools for land managers. Often, agencies have large datasets from multiple studies over time that could be combined for a more informed and complete picture of a species. Colorado Parks and Wildlife has a large database for greater sage-grouse (Centrocercus urophasianus) including 11 radio-telemetry studies completed over 12 years (1997–2008) across northwestern Colorado. We divided the 49,470-km 2 study area into 1-km 2 grids with the number of sage-grouse locations in each grid cell that contained at least 1 location counted as the response variable. We used a generalized linear mixed model (GLMM) using land cover variables as fixed effects and individual birds and populations as random effects to predict greater sage-grouse location counts during breeding, summer, and winter seasons. The mixed effects model enabled us to model correlations that may exist in grouped data (e.g., correlations among individuals and populations). We found only individual groupings accounted for variation in the summer and breeding seasons, but not the winter season. The breeding and summer seasonal models predicted sage-grouse presence in the currently delineated populations for Colorado, but we found little evidence supporting a winter season model. According to our models, about 50% of the study area in Colorado is considered highly or moderately suitable habitat in both the breeding and summer seasons. As oil and gas development and other landscape changes occur in this portion of Colorado, knowledge of where management actions can be accomplished or possible restoration can occur becomes more critical. These seasonal models provide data-driven, distribution maps that managers and biologists can use for identification and exploration when investigating greater sage-grouse issues across the Colorado range. Using historic data for future decisions on species management while accounting for issues found from combining datasets allows land managers the flexibility to use all information available. ß 2013 The Wildlife Society. KEY WORDS generalized linear mixed model, greater sage-grouse, radio-telemetry, species distribution models. Predicting species distribution across a broad geographic range can be challenging because of variability within and among regions and populations. Some studies indicate high levels of predictability among regions (Vanreusel et al. 2006), whereas others argue against a uniform management pro- gram for species with a large geographic range (McAlpine et al. 2008). When conserving for multiple populations across a large range, we need to develop predictive species distribution maps with details specific to each population, but applicability across the entire range (McAlpine et al. 2008). The identification of core or priority habitat areas for a species provides a vital tool for communication to private landowners and partner wildlife professionals. Species distribution models have become an important tool for wildlife management and many methods have been created to accomplish this goal. Often times, the data available across a landscape scale are presence locations of a species. Commonly used methods for this type of data are resource selection functions (RSF) using a logistic re- gression framework with presence and absence locations where absences are often represented by random locations or pseudo-absences (Greaves et al. 2006, Ciarniello et al. 2007, Johnson and Gillingham 2008). Problems associated with these resource selection methods include pseudo-absences whose absolute presence or absence is not known with certainty (Johnson et al. 2006), contamination and overlap Received: 9 April 2012; Accepted: 29 October 2012 Published: 4 January 2013 Additional supporting information may be found in the online version of this article. 1 E-mail: [email protected] The Journal of Wildlife Management 77(4):821–831; 2013; DOI: 10.1002/jwmg.496 Rice et al. Analysis of Regional Distribution Models 821

Transcript of Analysis of regional species distribution models based on ... · Population Ecology Analysis of...

Page 1: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

Population Ecology

Analysis of Regional Species DistributionModels Based on Radio-Telemetry DatasetsFrom Multiple Small-Scale Studies

MINDY B. RICE,1 Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA

ANTHONY D. APA, Colorado Parks and Wildlife, 711 Independent Avenue, Grand Junction, CO 81505, USA

MICHAEL L. PHILLIPS, Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA

JAMES H. GAMMONLEY, Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA

BRADFORD B. PETCH, Colorado Parks and Wildlife, 711 Independent Avenue, Grand Junction, CO 81505, USA

KARIN EICHHOFF, Colorado Parks and Wildlife, 317 W Prospect Avenue, Fort Collins, CO 80526, USA

ABSTRACT The identification of core habitat areas and resulting prediction maps are vital tools for landmanagers. Often, agencies have large datasets from multiple studies over time that could be combined for amore informed and complete picture of a species. Colorado Parks andWildlife has a large database for greatersage-grouse (Centrocercus urophasianus) including 11 radio-telemetry studies completed over 12 years(1997–2008) across northwestern Colorado. We divided the 49,470-km2 study area into 1-km2 gridswith the number of sage-grouse locations in each grid cell that contained at least 1 location counted asthe response variable. We used a generalized linear mixed model (GLMM) using land cover variables as fixedeffects and individual birds and populations as random effects to predict greater sage-grouse location countsduring breeding, summer, and winter seasons. The mixed effects model enabled us to model correlations thatmay exist in grouped data (e.g., correlations among individuals and populations). We found only individualgroupings accounted for variation in the summer and breeding seasons, but not the winter season. Thebreeding and summer seasonal models predicted sage-grouse presence in the currently delineated populationsfor Colorado, but we found little evidence supporting a winter season model. According to our models, about50% of the study area in Colorado is considered highly or moderately suitable habitat in both the breedingand summer seasons. As oil and gas development and other landscape changes occur in this portion ofColorado, knowledge of where management actions can be accomplished or possible restoration can occurbecomes more critical. These seasonal models provide data-driven, distribution maps that managers andbiologists can use for identification and exploration when investigating greater sage-grouse issues across theColorado range. Using historic data for future decisions on species management while accounting for issuesfound from combining datasets allows land managers the flexibility to use all information available. � 2013The Wildlife Society.

KEY WORDS generalized linear mixed model, greater sage-grouse, radio-telemetry, species distribution models.

Predicting species distribution across a broad geographicrange can be challenging because of variability within andamong regions and populations. Some studies indicate highlevels of predictability among regions (Vanreusel et al. 2006),whereas others argue against a uniform management pro-gram for species with a large geographic range (McAlpineet al. 2008). When conserving for multiple populationsacross a large range, we need to develop predictive speciesdistribution maps with details specific to each population,but applicability across the entire range (McAlpine et al.

2008). The identification of core or priority habitat areas fora species provides a vital tool for communication to privatelandowners and partner wildlife professionals.Species distribution models have become an important

tool for wildlife management and many methods havebeen created to accomplish this goal. Often times, thedata available across a landscape scale are presence locationsof a species. Commonly used methods for this type of dataare resource selection functions (RSF) using a logistic re-gression framework with presence and absence locationswhere absences are often represented by random locationsor pseudo-absences (Greaves et al. 2006, Ciarniello et al.2007, Johnson and Gillingham 2008). Problems associatedwith these resource selectionmethods include pseudo-absenceswhose absolute presence or absence is not known withcertainty (Johnson et al. 2006), contamination and overlap

Received: 9 April 2012; Accepted: 29 October 2012Published: 4 January 2013

Additional supporting information may be found in the online version ofthis article.1E-mail: [email protected]

The Journal of Wildlife Management 77(4):821–831; 2013; DOI: 10.1002/jwmg.496

Rice et al. � Analysis of Regional Distribution Models 821

Page 2: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

in used and available locations (Johnson et al. 2006), andunequal sampling of the species range (Latimer et al. 2006).In addition, many methods for evaluating logistic regressionmodel predictions are inappropriate for presence-availabledata because used sites are drawn directly from the distribu-tion of available sites (Boyce et al. 2002). This overlap causesthe variance estimates from the logistic regression to bebiased (Johnson et al. 2004). Another option is using thefrequency of animal locations as a count variable for model-ing habitat associations when absence is unknown across aspecies range, such as resource utilization functions (RUF)and resource selection probability functions (RSPF;Marzluffet al. 2004, Sawyer et al. 2009). These analyses focus on anindividual animal’s habitat selection, which is then combinedto yield population level inference, and may require a largenumber of locations per individual, which may not be avail-able for all datasets. Another method for presence onlymodeling is based on maximum entropy using the softwareMaxent (Phillips et al. 2006).Maxent produces estimates of asuitability index rather than occurrence probability and is notsuitable for making explicit predictions (Royle et al. 2012).Maxent can also be sensitive to modeling choices and inputlocalities (Rodda et al. 2011).Most of these methods have been shown to provide ade-

quate predictive species distribution maps, but may becomemore problematic for data not originally collected for habitatanalyses, data collected from multiple populations, or datafrom multiple studies. These data are common for stateagencies and if analyzed correctly, may provide a betterpicture of the overall species’ range.To demonstrate an alternative method for producing pre-

dictive species maps with more complicated datasets, we usedthe greater sage-grouse (hereafter sage-grouse) in Coloradofor which multiple telemetry studies have been completedover the last 13 years in multiple populations across theirrange in the state. The sage-grouse is a species of conserva-tion concern because of historical population declines andrange contraction (Schroeder et al. 2004) and thus requireshigh-quality seasonal distribution maps in the state ofColorado. Many anthropogenic developments (Knick andConnelly 2011) are stressors on sage-grouse habitat andpopulations, but more recently, energy development insome of the largest energy reserves in western NorthAmerica are located in regions characterized by sagebrushhabitat (Copeland et al. 2009, Harju et al. 2010, Naugle et al.2011). Identifying priority sage-grouse habitat that overlapswith potential development may be essential to the futuremanagement of the species (Doherty et al. 2010b). Currently,sage-grouse monitoring and modeling across its range hasfocused on breeding season-specific locations including nestsand leks (spring breeding grounds) which are often a keysource of information for these models (Walker et al. 2007;Copeland et al. 2009; Doherty et al. 2010a, 2011; Aldridgeet al. 2012). In addition, most of the current modelingmethods for sage-grouse use some form of RSF, RSPF, orprogram Maxent (Homer et al. 1993; Aldridge and Boyce2007; Doherty et al. 2008, 2011; Yost et al. 2008). Multiplepopulations of sage-grouse in Colorado are separated geo-

graphically and may exhibit seasonal and regional differencesin habitat preferences. Regional variations, such as in theseseparate populations, and their habitat relationships across abroad geographic range is an emerging issue in ecology(McAlpine et al. 2008). Currently, Colorado uses an occu-pied range map based on field personnel expert opinion andobservations. This map provides a generalized spatial extentof sage-grouse activity in Colorado, but no specific associa-tion exists between the habitat encompassed by the occupiedrange and sage-grouse habitat use. However, more detaileddata exist in the form of radio-telemetry locations thatprovide information for 6 populations across the Coloradorange. These data were collected during multiple smaller-scale studies on multiple individuals and contain informationthroughout the sage-grouse lifecycle including the breeding,winter, and summer seasons.Incorporating multiple datasets into habitat mapping along

with information collected on individuals to predict distri-butions at a broader scale can be critical for large-scalepopulation management (Klar et al. 2008). Generalizedlinear mixed models (GLMM) provide a method of analysisthat accounts for variation and covariation in and amonggroups. By incorporating random effects in the model, vari-ation that may exist between genotypes, species, regions, ortime periods can be investigated (Bolker et al. 2008). Byaccounting for differences among the 6 Colorado sage-grouse populations as well as differences in individual birds,we can provide a more accurate and valid assessment for theprobability of presence of sage-grouse across multiple pop-ulations at a regional scale. Modeling the frequency of sage-grouse locations as a continuous variable while accountingfor data from multiple datasets and different populationsprovides a unique method for managing sage-grouse on alarge scale where the knowledge of species absence may beunconfirmed or in areas where data have not been collected.Our goal was to test this method of modeling sage-grousedistribution using seasonal land cover associations in north-west Colorado at a 1-km2 scale. By accounting for assump-tions and variability in these combined datasets, we canproduce seasonal distribution maps that managers can useto help identify important areas for sage-grouse conservationand habitat restoration across the species’ range in Colorado.

STUDY AREA

The study area included Eagle, Garfield, Jackson, Moffat,Rio Blanco, and Routt counties in northwestern Colorado.This area is occupied by 6 populations of sage-grouse(Fig. 1): North Park, Middle Park, North Eagle/SouthRoutt, Meeker-White River, Parachute/Piceance/Roan,and Northwest. This 49,470-km2 study area encompassesthe current range of sage-grouse in Colorado.

METHODS

Greater Sage-Grouse Location Database CompilationWe compiled telemetry locations of sage-grouse from 1997to 2010 in all populations except North Park (North Parkdata were collected after the initial project started and will be

822 The Journal of Wildlife Management � 77(4)

Page 3: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

used as validation data). These data were not originallyobtained with the goal of a distribution analysis, but insteadmostly for demographic studies. This analysis used all sage-grouse telemetry studies in the state opportunistically withthe idea of combining and summarizing overall sage-grousehabitat use patterns. We only included individual sage-grouse that had �3 telemetry locations using very highfrequency (VHF) radio transmitters in the dataset used todevelop the seasonal distribution models. We projected alllocations to NAD83 UTM 13 and cross checked them withthe original data as well as with the other datasets to excludepossible duplicates. For each location, we included the pop-ulation, individual, sex, age, date of location, year, season,and Universal Traverse Mercator (UTM) coordinates. Somestudies did not include sex or age in their datasets, whichresulted in a restricted set of information. Therefore, we didnot use age and sex in this modeling effort at the overall rangescale. For those datasets that did contain age and sex infor-mation, 90.8% (12,909/14,213) of telemetry locations werefrom females, 9.2% (1,304/14,213) were from males, 65.3%(9,151/14,005) were from adults, and 34.7% (4,854/14,005)were from juveniles (yearlings were grouped with juveniles).We classified seasons as follows: the breeding period wasMarch through July, the summer period was July throughSeptember, and the winter period was December throughFebruary (modified from Connelly et al. 2000). Locationdata from October and November were not included becausethese months were considered transition periods (8.8% dataremoved). Our interest was to analyze important seasonsrelevant to the sage-grouse population rather than transition

periods where habitat choices may be indistinct. We sepa-rated populations based on management boundaries used inColorado (Fig. 1).

GIS Layers and Variables

We used geographic information system (GIS) data layers toassess land cover associated with sage-grouse use locations.We obtained the land cover data from the former ColoradoDivision ofWildlife, now the Colorado Parks andWildlife’s,‘‘basinwide’’ land cover layer. This land cover layer wasconstructed with 25-m resolution lands at imagery as partof the Colorado Vegetation Classification Project adminis-tered by the Colorado Division of Wildlife in collaborationwith the Bureau of LandManagement and the United StatesForest Service and was completed in 2005. Initially, we usedexpert opinion about sage-grouse habitat use to combine 122vegetation types in the original basinwide data into 13 landcover categories. As a result, across all counties, we includedproportions of sagebrush (Artemisia spp), pinyon (Pinus spp)-juniper (Juniperus spp), agriculture, shrubland, urban, alpine,riparian, grassland, forest, bare, forest shrubland, mountainshrubland, and salt desert shrubland as variables in themodel. We removed urban as a variable because no sage-grouse locations occurred in this category. Subsequently, weoverlaid the 6-county study area with 1-km2 grid cells, whichprovided the sampling scale for summarizing the data. Weused this resolution to account for location error associatedwith multiple radio-telemetry methodologies used overnumerous years. This grid size was also most appropriatefor the large area in the analysis. We only included cells that

Figure 1. Populations (n ¼ 6) of greater sage-grouse in northwestern Colorado, 1997–2010.North Park is not included in our initial presencemodel as no datawere collected from this population at the time this model was generated.

Rice et al. � Analysis of Regional Distribution Models 823

Page 4: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

contained sage-grouse locations in model building as we hadno information about sage-grouse presence or absence inother cells. Within each grid cell, we added the number ofsage-grouse locations and used the sum as the responsevariable for the models.We used land cover to model sage-grouse habitat because

sage-grouse are sagebrush obligates (Connelly et al. 2004,2011) and require sagebrush for food and cover, which mayindicate dependence on vegetation types (Homer et al.1993). Sage-grouse require sagebrush through all phasesof their life history to varying degrees; however, the amountand composition of sagebrush in the landscape may differamong breeding, summer, and winter seasons (Connellyet al. 2011). In addition, numerous other studies have dem-onstrated that vegetation type influences sage-grouse distri-bution (Aldridge and Boyce 2007, Doherty et al. 2008, Yostet al. 2008, Carpenter et al. 2010). Land cover also provided aconsistent layer to evaluate sage-grouse habitat at the region-al scale and generalizations based on basic resources such asland cover can provide a conservative accuracy for predictingspecies occurrence (Shanahan and Possingham 2009). Morelocalized studies have indicated that topographic variablesmay be important predictors of sage-grouse distribution,such as elevation, slope, aspect, and terrain ruggedness(Doherty et al. 2008, 2010b), but these variables likely oper-ate at finer scales (<1 km2). For example, in a 1-km2 grid,roughly 1,100 grid cells occur in our study area and forcontinuous variables such as elevation, information relatedto actual sage-grouse locations can be lost.We extracted land cover variables using the Geospatial

Modeling Environment (version 0.5.3 beta, www.spatiale-cology.com, accessed 08 Jan 2010) tools and converted themto proportion of land cover type within each grid cell wheresage-grouse locations were recorded. We categorized thedatabase into seasonal datasets based on breeding, summer,and winter locations. The proportions of each of the landcover types were the explanatory variables and were stan-dardized (mean ¼ 0, SD ¼ 1) to address possible conver-gence issues (Bolker et al. 2008, Zuur et al. 2009). Wecalculated Pearson correlation coefficients for the land covervariables for each seasonal dataset separately, and removedthose variables with an r > 0.60. We did not remove var-iables from the breeding season model; we removed alpineand forest from the winter model and alpine, agriculture, andriparian from the summer model. We fit each seasonal modelseparately with the count of sage-grouse locations in eachseason as the response variable.

Data Analysis

We used a GLMM to investigate if the variance could beexplained by similarity in grouping variables. GLMM is apossibly non-Gaussian regression that incorporates randomeffects to separate potential effects on the models by co-varying factors (Martinez-Abrain et al. 2003, Bolker et al.2008). By associating common random effects to observa-tions sharing the same level of a classification factor, mixedeffects models more appropriately represent the covariancestructure induced by grouping data (McAlpine et al. 2008).

We were also more interested in the predictive versus ex-planatory power for predicting sage-grouse possible habitat,which lends itself to the GLMM approach (Goetz et al.2012).The response variable used in the models was a count based

on the number of sage-grouse locations in a grid cell, with theproportion of land cover classes as fixed effects and individualand population as random effects. We recognize that esti-mating habitat preferences by pooling telemetry data from allindividuals is likely to bias toward data-rich individuals(Aarts et al. 2008), but random effects allow us to recognizethis unbalanced sampling effort (Gillies et al. 2006). In oursample, we only used those grid cells that had known pres-ence locations to avoid zero counts in the dataset, which maybias estimates (Creel and Loomis 1990). Therefore, we useda zero truncated Poisson distribution with a log link to modelsage-grouse counts within each grid cell (Plackett 1953,Zuur et al. 2009). Censoring the data in this manner sothat inference is conditional on observed presence is anadapted hurdle model. Hurdle models consist of 2 compo-nents. The first component models zero versus counts equalto or larger than 1 (Seifert et al. 2010). The second compo-nent is left truncated to exclude zero counts and determinesthe number of prediction events. In our model, we alreadyhad knowledge of presence with the sage-grouse locations, sowe used the second part of a hurdle model, which excludeszero counts.Let yijk be the value of the grid cell count of telemetry

locations for individual i, population j, and grid cell k. Theexpected number of counts is log uijk ¼ hijk, with linearpredictor hijk ¼ (xijk � bj) þ (zijk � ni) where x is fixedvariables, b is the fixed variable coefficients, n is the param-eters of the random effect, and z is the levels of the randomeffect. Assuming a truncated poisson process for count yij, theprobability that yij � y conditional on random effects n, is

Pðyij ¼ yjvi; xij ; zijÞ ¼uy

ijexpð�uij Þ

ð1� exp�uijÞy!y ¼ 0; 1; 2

We investigated 2 grouping variables that may influencethe sage-grouse dataset. The first random variable was ra-dio-marked individuals, which accounts for multiple loca-tions from individual sage-grouse. By including markedindividuals as a grouping variable, we account for the lackof independence associated with multiple observations madeon the same individual over time (Wagner et al. 2011).Including an individual random effect is also useful foraccommodating overdispersion, which is often observedwith Poisson or count distributions (Breslow and Clayton1993). A random intercept influences overall prevalence,which often arises because of unbalanced samples, in ourcase, multiple studies from multiple populations or multiplelocations per individual (Gillies et al. 2006). The secondgrouping variable of interest was the influence of population.We assumed relationships between sage-grouse and landcover variables in 1 population would be more similarthan those in another population because of the large scale

824 The Journal of Wildlife Management � 77(4)

Page 5: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

of this analysis. In addition to the random effects, we evalu-ated the variance attributed to the possible autocorrelationin all 3 seasonal models because ignoring dependencecan lead to inaccurate and invalid conclusions (Olea2009). We did this by using a semivariogram, which definesthe spatial scales over which patterns are dependent (Rossiet al. 1992). We used the residuals for each of the fullseasonal models without random effects to construct eachsemivariogram.We first ran each seasonal model with only an individual

random effect, a population random effect, and a combina-tion of both random effects without explanatory variablesto determine if the random effects provided a better fit forthe data based on a smaller Akaike’s Information Criterion(AIC) value. In both cases, only the individual effect made animpact on the null model, so we only used the individualrandom effect in the following models. We then fitted a setof all possible linear models from our set of 12 explanatoryvariables and the appropriate random effect(s) for each seasonand evaluated them based on AIC corrected for sample size(AICc; Burnham and Anderson 2002, Boccadori et al. 2008,McAlpine et al. 2008). We included sagebrush in all modelsas sage-grouse are sagebrush obligates and we were interestedin its explanatory power (Aldridge and Boyce 2007). We fitall combinations of variables along with sagebrush in everymodel because we did not have a clear reason to include orexclude the other land cover variables as subsets of all possiblemodels. This resulted in 2,049 models in the breeding seasonmodel, 513 in the winter season model, and 257 in thesummer season models. Model averaging allows inferenceto be based on information from a number of models(Greaves et al. 2006). Doherty et al. (2010c) recommendedusing all model combinations with model averaging andLukacs et al. (2010) determined that model averaging canprotect against spurious results and is appropriate for devel-oping a prediction tool (Burnham and Anderson 2002).Therefore, rather than selecting the 1 best model, we aver-aged across all models with weights >0.00 (Burnham andAnderson 2002, Bolker et al. 2008). We calculated therelative importance of variables by summing the Akaikeweights across all competing models in which each variableappeared (Murray and Connor 2009). We fit all GLMMmodels with the glmmADMB library (Fournier et al. 2012)in the R statistical computing environment (R DevelopmentCore Team 2012).We then applied the averaged model for each season to the

proportion of land cover raster layers in ArcMap (ArcGIS10; Environmental Research Systems Institute, Redlands,CA). This resulted in a relative probability of sage-grouseoccurrence layer for each seasonal model that rangedfrom 0 to 1. To standardize the probabilities for comparisonbetween seasons, we combined probability values based onquartile breaks in the data for each seasonal model resultingin 4 categories of high, moderate, low, and rare (Johnsonet al. 2004, Sawyer et al. 2009). This means that a quarter ofall values across the predictive surface in each seasonfall within each of the 4 bins. In addition, we calculatedproportions of each prediction category for each of the

current sage-grouse population boundaries in Colorado(Fig. 1).The gold standard for any modeling exercise is the testing

of predictions against an independently collected dataset(Wiens et al. 2008). In addition, tested predictions in areaswhere data had not been collected to verify that the modelresults could be extrapolated across the sage-grouse range.We used 2 different independent datasets for comparison.The first validation dataset consisted of active leks collectedacross the sage-grouse range in our study area (n ¼ 263)similar to methods used by Aldridge et al. (2012). These datawere collected on a yearly basis and provided an especiallygood validation for the breeding model, but less so for thesummer and winter models. Therefore, we used a seconddataset that was collected specifically in the North Parkpopulation across all 3 seasons. This population was notincluded in the original analysis as data did not exist atthat time, but has since been collected in a separate telemetrystudy. Initially, 95 females were radio-marked in April 2010in the North Park population, with 51 still being monitoredinMarch 2011. An additional 22 females were radio-markedin March 2011 providing 3,132 locations from 117 sage-grouse to use in validating the rangewide seasonal distribu-tion models. We separated the North Park validation datasetinto seasons based on the original model for the best valida-tion in each season. For both validation datasets, in eachseason we calculated the proportion of locations or leks thatoccurred in each quartile (Sawyer et al. 2007). We then useda Spearman rank correlation to assess the relationship be-tween the predicted probability of occurrence for the originallocations for each season and the test dataset locations in eachquartile (Johnson et al. 2004). We would expect the presencelocations from the validation datasets to be more prevalent inthe high and moderate categories than the low and rarecategories.

RESULTS

We used 16,796 sage-grouse radio-telemetry locations from959 individual sage-grouse in Northwest Colorado from1997 to 2010. Of the locations, 74.1% were during thebreeding season, 8% during the winter, and 17.9% in thesummer. Sage-grouse location counts for each individual perpopulation per grid cell ranged from 1 to 57 during thebreeding, 1 to 12 during the winter, and 1 to 37 duringthe summer seasons. We found no patterns of latent spatialautocorrelation in any of the seasonal datasets (Appendix 1,available online at www.onlinelibrary.wiley.com). Only theindividual random effect contributed to the variance in thebreeding and summer models. The variances associated withthese variables will be discussed in detail with each seasonalmodel.In each season, sagebrush comprised the largest proportion

of land cover in the 1-km2 cells used by sage grouse (Table 1).The greatest proportion of sagebrush was found during thewinter and breeding seasons followed by the summer season.The second greatest proportion of land cover type found innotable quantities during the winter period was salt desertshrubland. The second most often used land cover type

Rice et al. � Analysis of Regional Distribution Models 825

Page 6: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

during the summer and breeding period was mountainshrubland.For the breeding season model, the averaged model includ-

ed all land cover variables (Fig. 2a, Table 2). Sage-grousewere negatively associated with alpine, bare, forest, andforested shrub, but had a positive association with all othervariables (Table 3). The relative variable importance indi-cated that bare, forest, mountain shrub, and sagebrush werethe most influential variables found in the averaged models(Table 3). The quartile cutoff values for the breeding seasonpredictive surface were 0.04, 0.53, 0.76, and 1.00. North ParkandMeeker-White River had>90% of their population areacategorized as high or moderate habitat (Fig. 2a, Table 4).The Northwest and Parachute/Piceance/Roan populationshad>80% of their population area as high or moderate. TheMiddle Park population had the least amount of highlyor moderately suitable habitat with 65.6%. The individual

Figure 2. Probability of greater sage-grouse (GRSG) presence in northwestern Colorado during the (a) breeding season and (b) summer season based on radio-telemetry locations from 1997 to 2010 with the current estimated range of sage-grouse.

Table 1. Average values within each seasonal dataset for each land coverclass for sage-grouse across Colorado from 1997 to 2010 (all values inproportion of land cover type).

Variable Breeding Summer Winter

Agriculture 0.0196 0.0258 0.0131Grassland 0.0428 0.0595 0.0231Shrubland 0.0371 0.0334 0.0361Sagebrush 0.7016 0.6402 0.7025Salt desert shrub 0.0260 0.0121 0.1247Pinyon juniper 0.0400 0.0385 0.0191Mountain shrub 0.0863 0.1271 0.0355Bare 0.0148 0.0093 0.0226Forest shrub 0.0144 0.0283 0.0143Forest 0.0036 0.0063 0.0008Alpine 0.0006 0.0015 0.0003Riparian 0.0124 0.0171 0.0071

826 The Journal of Wildlife Management � 77(4)

Page 7: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

random variable accounted for 13.2% of the variance in themodel.The averaged winter model included all variables except

alpine and forest and indicated positive relationships withforested shrubland, grassland, mountain shrubland, pinyon-juniper, sagebrush, and salt desert shrubland (Fig. 2b;Tables 5 and 6). We found negative relationships with theother variables. Most of the variables in the winter model hada low contribution to the overall averaged model as variableimportance was negligible (Table 6). The top models for thewinter season had very little support. For this reason, we didnot calculate a prediction surface as no variables significantlycontributed to the averaged model.The averaged summer model included all variables

except riparian, alpine, and agriculture (Fig. 2b, Table 7).Sage-grouse were positively associated with grassland,mountain shrubland, and shrubland and negatively associat-ed with the other variables (Table 8). Bare, grassland,sagebrush, and shrubland were the most influentialvariables in the averaged model (Table 8). The quartile cutoffvalues for the summer model predictive surface were0.23, 0.46, 0.55, and 1.00. The resulting probability map

indicated 90.6% high and moderate habitat in Meeker-White River and >80% in Parachute/Piceance/Roan andNorth Eagle/South Routt (Table 4). Middle Park had thesmallest probability of high and moderate habitat with55.1%. The variance associated with the individual randomeffect was 37%.Validation showed that both the breeding and summer

seasonal models were good predictors for North Park andthe breeding model was also a good predictor for active lekdatasets (Table 9). The original locations for the breedingmodel had a Spearman correlation of 0.9940 with NorthPark locations and 0.9982 with the active lek locations. Theoriginal locations for the summer model had a Spearmanrank correlation of 0.7971 with the North Park locations.The lesser r2 value for the summer model and North Parklocations was mostly driven by the large percentage of NorthPark locations found in the high category and few locationsin the rare and low categories.

DISCUSSION

Our analysis combined Colorado sage-grouse radio-telemetry data and modeled the distribution of sage-grousepresence in 6 counties. The seasonal habitat maps representthe basic land cover associations for sage-grouse in thisregion while accounting for possible covariation within in-dividuals and populations. The resulting seasonal maps pro-vide managers and biologists with a useful method foridentifying large-scale high use areas throughout the annuallifecycle of the sage-grouse in Colorado.The breeding and summer seasons predict suitable habitat

within the current estimated sage-grouse range in Colorado.The summer habitat model is mostly driven by negativeassociations with forest, forested shrubland, and bare ground,which follows patterns described in other habitat studies(Connelly et al. 1988, 2011). We found a very slight negativerelationship with sagebrush in the summer model, whichsuggests that sage-grouse use a more diverse suite of landcover types in the summer period that include mesic non-sagebrush dominated cover types (Connelly et al. 2011). Thebreeding and summer models also predicted habitat outsidethe estimated sage-grouse range, which may be a result ofover-prediction in the models or due to lack of informationoutside the range. The purpose of these models is to identify

Table 2. Themodel structure, Akaike’s InformationCriterion adjusted for sample size (AICc), differences inAICc (DAICc), andAkaikeweights (wi) for the topbreeding season models predicting greater sage-grouse presence in Colorado, 1997–2010. Variables are abbreviated as follows: ag ¼ agriculture, a ¼ alpine,b ¼ bare, f ¼ forest, fs ¼ forested shrub, gl ¼ grassland, ms ¼ mountain shrub, pj ¼ pinyon juniper, r ¼ riparian, sb ¼ sagebrush, sd ¼ salt desert shrub,sh ¼ shrubland.

Model AICc DAICc wi

a þ ag þ b þ f þ gl þ ms þ pj þ r þ sb þ sd þ sh 23,796.27 0.00 0.13a þ ag þ b þ f þ gl þ ms þ pj þ r þ sb þ sh þ fs 23,796.87 0.60 0.09a þ b þ f þ fs þ gl þ ms þ r þ sb þ sd þ sh 23,797.46 1.19 0.07a þ ag þ b þ f þ fs þ ms þ pj þ sb þ sd 23,797.65 1.38 0.06ag þ b þ f þ gl þ ms þ pj þ r þ sb þ sd þ sh 23,797.86 1.59 0.06a þ b þ f þ fs þ gl þ ms þ sb þ sd þ sh 23,798.05 1.78 0.05a þ b þ f þ fs þ gl þ ms þ pj þ r þ sb þ sd þ sh 23,798.07 1.80 0.05a þ ag þ b þ f þ fs þ gl þ ms þ pj þ r þ sb þ sd þ sh 23,798.07 1.80 0.05a þ ag þ b þ f þ fs þ gl þ ms þ r þ sb þ sd þ sh 23,798.67 2.40 0.04

Table 3. Coefficients for the model-averaged estimates for the top breedingseason models predicting greater sage-grouse presence in Colorado, 1997–2010. Variables are abbreviated as follows: ag ¼ agriculture, a ¼ alpine,b ¼ bare, f ¼ forest, fs ¼ forested shrub, gl ¼ grassland, ms ¼ mountainshrub, pj ¼ pinyon juniper, r ¼ riparian, sb ¼ sagebrush, sd ¼ salt desertshrub, sh ¼ shrubland.

Variable Coefficient SE

CI Relativevariable

importanceLower Upper

Intercept 0.8626 0.0105 0.8421 0.8832a �5.4455 2.6390 �10.6189 �0.2721 0.82ag 0.9949 1.5841 �2.1100 4.0997 0.77b �3.7752 1.2803 �6.2847 �1.2657 0.93f �3.6238 1.3896 �6.3477 �0.9000 0.90fs �1.2002 1.5373 �4.2133 1.8130 0.80gl 1.9087 1.4281 � 0.8904 4.7078 0.86ms 2.1420 1.4596 � 0.7187 5.0027 1.00pj 1.2312 1.5382 �1.7837 4.2461 0.77r 1.8682 1.4582 �0.9900 4.7263 0.74sb 1.1703 1.4617 � 1.6946 4.0352 1.00sd 0.3097 1.5820 �2.7909 3.4103 0.87sh 1.8470 1.4206 � 0.9374 4.6315 0.86

Rice et al. � Analysis of Regional Distribution Models 827

Page 8: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

potential species distribution, so surveys for habitat and birdsoutside the range would be appropriate.The breeding season model was driven by negative rela-

tionships with alpine, bare, forest, and forested shrub. Theabsence of tall shrubs and trees appears to be critical forlekking (Colorado Greater Sage-grouse Steering Committee2008). We found was a positive association with grasslandand grass understory has been shown to influence sage-grouse nesting and early brood-rearing sites (Connellyet al. 2000).The winter model lacked significant variables. Overall, we

obtained only 1,348 locations from 446 individuals in thewinter model compared to 3,000 in the summer and 12,444in the breeding model. For a winter model to be feasiblewhile accounting for variation in the dataset, more winterlocations would likely need to be collected.The effect of individual random effect was relatively large

for the breeding and summer seasons where 13% or more ofthe variation was explained. Including this as a random effectin the models allowed a more robust way to identify theexplanatory variables that actually affect seasonal distribution(Vall-llosera and Sol 2009). Failure to account for the re-peated measurement of individual locations can lead toincorrect conclusions regarding effects of ecological variablesand how those variables affect model selection and scientificconclusions (McAlpine et al. 2008).

The North Park independent dataset and the active leklocations validated well for the breeding and summer seasonmodels. This indicates that overall, these models are robustin predicting areas of use that were not part of the originalanalysis or that were outside the scope of the objectives ofthe original telemetry locations. Building accurate androbust predictive distribution models based on functionalresources such as land cover and extrapolating across a largergeographic range is possible (Vanreusel et al. 2006). This canbe important for management agencies making decisions forareas where sampling has been limited or non-existent. InColorado, these models provide seasonal distribution mapsthat can be used by managers, along with finer-scale and site-specific information, to identify priority areas for sage-grouseconservation statewide.At the broad scale of this study, small differences between

individual uses and population uses will not likely bedetected. For example, the breeding season habitat modelincludes lekking habitat for males and both nestingand early-brood rearing habitats for females that can befound in a broad spectrum of sagebrush cover values (heavycover to open areas). Our seasonal habitat map does notdiscern between the habitat occupied during these differingbehaviors. Another issue with these probability maps isthe hierarchical nature of habitat selection from the localscale immediately adjacent to the sage-grouse to the larger

Table 4. Proportion of high, moderate, low, and rare habitat in each of the 6 populations in the northwestern region of Colorado. 1997–2010, based onbreeding, winter, and summer seasonal models. Populations are abbreviated as follows: PPR ¼ Parachute-Piceance-Roan, NW ¼ Northwest, NP ¼ NorthPark, NESR ¼ North Eagle/South Routt, MP ¼ Middle Park, and M ¼ Meeker-White River.

Population

Breeding Summer

Hectares High Moderate Low Rare High Moderate Low Rare

PPR 22,0551 0.4431 0.3993 0.1573 0.0001 0.4162 0.4302 0.1483 0.0053NW 1,072,462 0.4784 0.3389 0.1810 0.0019 0.2909 0.4490 0.2454 0.0148NP 167,578 0.5928 0.3135 0.0936 0.0002 0.3980 0.9487 0.2519 0.0014NESR 94,460 0.3761 0.3905 0.2241 0.0092 0.2395 0.5752 0.1706 0.0147MP 109,567 0.2269 0.4286 0.3388 0.0057 0.2038 0.3472 0.3973 0.0517M 66,594 0.6316 0.2710 0.0931 0.0043 0.4792 0.4270 0.0879 0.0058

Table 5. The model structure, Akaike’s Information Criterion adjusted forsample size (AICc), differences in AICc (DAICc), and Akaike weights (wi)for the top winter season models predicting greater sage-grouse presence inColorado, 1997–2010. Variables are abbreviated as follows: ag ¼ agriculture,b ¼ bare, fs ¼ forested shrub, gl ¼ grassland, ms ¼ mountain shrub,pj ¼ pinyon juniper, r ¼ riparian, sb ¼ sagebrush, sd ¼ salt desert shrub,sh ¼ shrubland.

Model AICc DAICc wi

ag þ b þ gl þ sb 1,080.20 0.00 0.03ag þ b þ gl þ ms þ sb 1,080.33 0.13 0.03ag þ b þ gl þ pj þ sb 1,081.24 1.04 0.02ag þ b þ gl þ ms þ pj þ sb 1,081.25 1.05 0.02ag þ b þ gl þ r þ sb 1,081.52 1.32 0.02fs þ gl þ ms þ pj þ sb þ sd þ sh 1,081.60 1.40 0.01ag þ b þ gl þ sb þ sd 1,081.61 1.40 0.01ag þ b þ gl þ sb þ sh 1,081.61 1.41 0.01ag þ b þ gl þ ms þ sb þ sh 1,081.64 1.44 0.01ag þ b þ sb þ sd þ sh 1,081.65 1.44 0.01

Table 6. Coefficients for the model-averaged estimates for the top winterseason models predicting greater sage-grouse presence in Colorado,1997–2010. Variables are abbreviated as follows: ag ¼ agriculture, b ¼ bare,fs ¼ forested shrub, gl ¼ grassland, ms ¼ mountain shrub, pj ¼ pinyonjuniper, r ¼ riparian, sb ¼ sagebrush, sd ¼ salt desert shrub, sh ¼ shrubland.

Variable Coefficient SE

CI Relativevariable

importanceLower Upper

Intercept �1.2697 0.0797 �1.4260 �1.1134ag �3.8513 3.6224 �10.9553 3.2528 0.69b �7.4574 3.7410 �14.7955 �0.1193 0.89gl 4.3436 3.2761 �2.0805 10.7978 0.71sb 0.7003 2.4583 �4.1192 5.5198 1.00ms 2.4508 3.1183 �3.6631 8.5647 0.57pj 3.0205 3.7676 �4.3671 10.4081 0.44r �4.7878 6.1931 �16.9354 7.3599 0.41fs 1.8953 4.0669 �6.0789 9.8696 0.34sd 0.8478 3.5097 �6.0330 7.7286 0.47sh �0.1139 3.8633 �7.6886 7.4609 0.39

828 The Journal of Wildlife Management � 77(4)

Page 9: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

landscape (Johnson 1980). For example, taking measure-ments in a 1-m vegetation plot may indicate that a birdchooses pinyon-juniper for cover. Expand the scale to a 1-kmgrid cell and the vegetation in that grid cell might be 90%sagebrush and 10% pinyon-juniper, indicating that the in-dividual strongly prefers sagebrush over pinyon-juniper. Atthe broad scale of these models, detecting specifics for indi-vidual birds or individual locations is not possible. In addi-tion, terrain variables such as slope or elevation are maskedwhen using a larger scale analysis such as 1-km2 grids.

MANAGEMENT IMPLICATIONS

Traditional methods of analyzing habitat selection for sage-grouse have been focused on the presence-available studydesign, often using pseudo-absences or random locations tomodel the species distribution (Aldridge and Boyce 2007,Doherty et al. 2008). This type of modeling method iscommon among other species as well (Copeland et al.2006, Kaczensky et al. 2008). When using a presence-avail-able approach, often the random or available locations fallinto land cover categories where a species would never belocated, but may exist across the available landscape (e.g.,urban). Observed locations can thus be a subset of a sample of

available locations which can cause overlap in environmentalvariables in a logistic regression framework (Boyce et al.2002). We adapted a hurdle model to compare each gridcontaining at least 1 location to all other grids with at least 1location, investigating attributes of those grids that have fewlocations against those that have many locations. This type ofmodeling allows comparisons between landscapes that areknown to contain birds to discern patterns that explain whycertain land cover categories are used more than others. It is aunique way to use large datasets collected across a species’range over time and can provide biologists a large scaleutilization map. These types of data are common to man-agement agencies and are often overlooked as useful becausethe original studies were not designed for habitat analysis,the data were collected over a long period, or the data werecollected differently in each study. The breeding and summerseasonal distribution models provide managers and biologistsa useful tool for interpreting general sage-grouse habitatcharacteristics for management actions at a large scale. Italso provides maps that have been tested and validated sothey can have more certainty with broad scale managementand policy decisions that may be made based on themapped distribution. By using a count based GLMMmodeling approach, accounting for possible variation in

Table 7. The model structure, Akaike’s Information Criterion adjusted forsample size (AICc), differences in AICc (DAICc), and Akaike weights (wi)for the top summer season models predicting greater sage-grouse presencein Colorado, 1997–2010. Variables are abbreviated as follows: b ¼ bare,f ¼ forest, fs ¼ forested shrub, gl ¼ grassland, ms ¼ mountain shrub,pj ¼ pinyon juniper, sb ¼ sagebrush, sd ¼ salt desert shrub,sh ¼ shrubland.

Variable AICc DAICc wi

b þ f þ fs þ gl þ sb þ sh 4,941.75 0.00 0.14b þ f þ gl þ sb þ sh 4,942.55 0.80 0.09b þ f þ fs þ gl þ pj þ sb þ sh 4,943.13 1.38 0.07b þ f þ fs þ gl þ sb þ sd þ sh 4,943.15 1.40 0.07b þ f þ fs þ gl þ ms þ sb þ sh 4,943.69 1.94 0.05b þ f þ gl þ ms þ sb þ sh 4,944.27 2.52 0.04b þ f þ gl þ sb þ sd þ sh 4,944.33 2.58 0.04b þ f þ gl þ pj þ sb þ sh 4,944.55 2.80 0.03b þ f þ fs þ gl þ pj þ sb þ sd þ sh 4,944.59 2.84 0.03b þ fs þ gl þ sb þ sh 4,944.97 3.22 0.03

Table 8. Coefficients for the model-averaged estimates for the top summerseason models predicting greater sage-grouse presence in Colorado,1997–2010. Variables are abbreviated as follows: b ¼ bare, f ¼ forest,fs ¼ forested shrub, gl ¼ grassland, ms ¼ mountain shrub, pj ¼ pinyonjuniper, sb ¼ sagebrush, sd ¼ salt desert shrub, sh ¼ shrubland.

Variable Coefficient SE

CI Relativevariable

importanceLower Upper

Intercept 0.3398 0.0294 0.2909 0.3887b �3.4166 1.3059 �5.9780 �0.8551 0.95f �2.5111 1.1862 �4.8377 �0.1845 0.87fs �0.8445 0.4832 �1.7921 0.1031 0.66gl 1.0848 0.4211 0.2589 1.9108 0.91sh 0.9577 0.3762 0.2198 1.6955 0.89sb �0.5511 0.2164 �0.9754 �0.1268 1.00pj �0.2662 0.4382 �1.1257 0.5933 0.32sd �0.5163 0.7499 �1.9870 0.9545 0.33ms 0.0172 0.2909 �0.5533 0.5877 0.31

Table 9. Percentage of greater sage-grouse original locations, lek locations, andNorth Park locations predicted by each season’s model in each of 4 bins based onthe quartile cutoff values along with the Spearman rank correlation coefficient between the lek locations and the original locations as well as the North Parklocations and the original locations.

Original locations Lek locations North Park locations

BreedingRare 0.000 0.000 0.000Low 0.041 0.053 0.012Moderate 0.278 0.251 0.227High 0.681 0.696 0.761Spearman rank correlation coefficient r2 ¼ 0.9982 r2 ¼ 0.9940

SummerRare 0.000 0.000Low 0.066 0.092Moderate 0.539 0.325High 0.395 0.584Spearman rank correlation coefficient r2 ¼ 0.7971

Rice et al. � Analysis of Regional Distribution Models 829

Page 10: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

multiple datasets, and validating with independent datasets,researchers can provide reliable and functional landscapescale distribution maps to biologists on the ground evengiven the aforementioned constraints.

ACKNOWLEDGMENTS

I would like to thank B. Walker for contributing data as wellas reviewing previous versions of this manuscript. We wouldalso like to thank those that collected the data for portions ofthe dataset including J. Beck, M. Cowardin, B. Holmes, S.Huwer, B. Miller, L. Rossi, and T. Thompson. We alsothank P. Lukacs, J. Runge, M. Aldridge, and the anonymousjournal reviewers for comments on earlier drafts.

LITERATURE CITEDAarts, G., M. MacKenzie, B. McConnell, M. Fedak, and J. Matthiopoulos.2008. Estimating space-use and habitat preference from wildlife telemetrydata. Ecography 31:140–160.

Aldridge, C. L., and M. S. Boyce. 2007. Linking occurrence and fitness topersistence: habitat based approach for endangered greater sage-grouse.Ecological Applications 17:508–526.

Aldridge, C. L., D. J. Saher, T. M. Childers, K. E. Stahlnecker, and Z. H.Bowen. 2012. Crucial nesting habitat for Gunnison sage-grouse: a spa-tially explicitly hierarchical approach. Journal of Wildlife Management76:391–406.

Boccadori, S. J., P. J. White, R. A. Garrott, J. J. Borkowski, and T. L. Davis.2008. Yellowstone pronghorn alter resource selection after sagebrushdecline. Journal of Mammalogy 89:1031–1040.

Bolker, B. M., M. E. Brooks, C. J. Clark, S. W. Geange, J. R. Poulsen, M.H. H. Stevens, and J. S. White. 2008. Generalized linear mixed models: apractical guide for ecology and evolution. Trends in Ecology andEvolution 24:127–135.

Boyce, M. S., P. R. Vernier, S. E. Nielsen, and F. K. A. Schmiegelow. 2002.Evaluating resource selection functions. Ecological Modelling 157:281–300.

Breslow, N. E., and D. G. Clayton. 1993. Approximate inference in gener-alized linear mixedmodels. Journal of the American Statistical Association88:9–25.

Burnham, K. P., and D. R. Anderson. 2002. Model selection andmultimodel inference: a practical information-theoretic approach.Springer-Verlag, New York, New York, USA.

Carpenter, J. E., C. L. Aldridge, andM. S. Boyce. 2010. Sage-grouse habitatselection during winter in Alberta. Journal of Wildlife Management78:1806–1814.

Ciarniello, L. M., M. S. Boyce, D. C. Heard, and D. R. Seip. 2007.Components of grizzly bear habitat selection: density, habitats, roads,and mortality risk. Journal of Wildlife Management 71:1446–1457.

ColoradoGreater Sage-grouse Steering Committee. 2008. Colorado greatersage-grouse conservation plan. Colorado Division of Wildlife, Denver,USA.

Connelly, J.W., H.W. Browers, and R. J. Gates. 1988. Seasonal movementsof sage-grouse in southeastern Idaho. Journal of Wildlife Management52:116–122.

Connelly, J. W., S. T. Knick, M. A. Schroeder, and S. J. Stiver. 2004.Conservation assessment of greater sage-grouse and sagebrush habitats.Western Association of Fish and Wildlife Agencies, Cheyenne,Wyoming, USA.

Connelly, J. W., E. T. Rinkes, and C. E. Braun. 2011. Characteristics ofgreater sage-grouse habitats: a landscape species at micro and macroscales. Pages 69–84 in S. T. Knick and J. W. Connelly, editors.Greater sage-grouse: ecology and conservation of a landscape speciesand its habitats. Studies in avian biology, Vol. 38. University ofCalifornia Press, Berkeley, USA.

Connelly, J. W., M. A. Schroeder, A. R. Sands, and C. E. Braun. 2000.Guidelines to manage sage-grouse populations and their habitats.WildlifeSociety Bulletin 28:967–985.

Copeland, H. E., K. E. Doherty, D. E. Naugle, A. Pocewicz, and J. M.Kiesecker. 2009. Mapping oil and gas development potential in the USIntermountain West and estimating impacts to species. PLoS ONE4:e7400.

Copeland, J. P., J. M. Peek, C. R. Groves, W. E. Melquist, K. S. McKelvey,G. W. McDaniel, C. D. Long, and C. E. Harris. 2006. Seasonal habitatassociations of the wolverine in central Idaho. Journal of WildlifeManagement 71:2201–2212.

Creel, M., and J. Loomis. 1990. Theoretical and empirical advantages oftruncated count data estimators for analysis of deer hunting in California.American Journal of Agricultural Economics 72:434–441.

Doherty, K. E., D. E. Naugle, H. Copeland, A. Pocewicz, and J. Kiesecker.2011. Energy development and conservation tradeoffs: systematicplanning for greater sage-grouse in their eastern range. Pages 506–516in S. T. Knick and J. W. Connelly, editors. Greater sage-grouse:ecology and conservation of a landscape species and its habitats.Studies in avian biology, Vol. 38. University of California Press,Berkeley, USA.

Doherty, K. E., D. E. Naugle, and B. L.Walker. 2010a. Greater sage-grousenesting habitat: the importance of managing at multiple scales. Journal ofWildlife Management 74:1544–1553.

Doherty, K. E., D. E. Naugle, B. L. Walker, and J. M. Graham. 2008.Greater sage-grouse winter habitat selection and energy development.Journal of Wildlife Management 72:187–195.

Doherty, K. E., J. D. Tack, J. S. Evans, and D. E. Naugle. 2010b. Mappingbreeding densities of greater sage-grouse: a tool for range-wide conserva-tion. BLM completion report. Interagency agreement # L10PG00911.Bureau of Land Management, Washington, D.C., USA.

Doherty, P. F., G. C. White, and K. P. Burnham. 2010c. Comparison ofmodel building and selection strategies. Journal of Ornithology 152:S317–S323.

Fournier, D. A., H. J. Skaug, J. Ancheta, J. Ianelli, A. Magnusson, M. N.Maunder, A. Nielsen, J. Sibert, 2012. AD Model Builder: usingautomatic differentiation for statistical inference of highly parameterizedcomplex nonlinear models. Optimization Methods and Software 27:233–249.

Gillies, C. S., M. Hebblewhite, S. E. Nielsen, M. A. Krawchuk, C. L.Aldridge, J. L. Frair, D. J. Saher, C. E. Stevens, and C. L. Jerde. 2006.Application of random effects to the study of resource selection by animals.Journal of Animal Ecology 75:887–898.

Goetz, K. T., R. A. Montgomery, J. M. Ver Hoef, R. C. Hobbs, and D. S.Johnson. 2012. Identifying essential summer habitat of the endangeredbeluga whale Delphinapterus leucas in Cook Inlet, Alaska. EndangeredSpecies Research 16:135–147.

Greaves, R. K., R. A. Sanderson, and S. P. Rushton. 2006. Predicting speciesoccurrence using information-theoretic approaches and significance test-ing: an example of dormouse distribution in Cumbria, UK. BiologicalConservation 130:239–250.

Harju, S. M., M. R. Dzialak, R. C. Taylor, L. D. Hayden-Wing, and J. B.Winstead. 2010. Thresholds and time lags in effects of energy develop-ment on greater sage-grouse populations. Journal ofWildlifeManagement74:437–448.

Homer, C. G., T. C. Edwards, R. D. Ramsey, and K. P. Price. 1993. Use ofremote sensing methods in modeling sage-grouse winter habitat. Journalof Wildlife Management 57:78–84.

Johnson, D. H. 1980. The comparison of usage and availability measure-ments for evaluating resource preference. Ecology 61:65–71.

Johnson, C. J., and M. P. Gillingham. 2008. Sensitivity of species-distribution models to error, bias, and model design: an application toresource selection functions for woodland caribou. Ecological Modelling213:143–155.

Johnson, C. J., S. E. Niesen, E. H. Merrill, T. L. McDonald, and M. S.Boyce. 2006. Resource selection functions based on use-availability data:theoretical motivation and evaluation methods. Journal of WildlifeManagement 70:347–357.

Johnson, C. J., D. R. Seip, and M. S. Boyce. 2004. A quantitative approachto conservation planning: using resource selection functions to map thedistribution of mountain caribou at multiple spatial scales. Journal ofApplied Ecology 41:238–251.

Kaczensky, P., O. Ganbaatar, H. Von Wehrden, and C. Walzer. 2008.Resource selection by sympatric wild equids in the Mongolian Gobi.Journal of Applied Ecology 45:1762–1769.

830 The Journal of Wildlife Management � 77(4)

Page 11: Analysis of regional species distribution models based on ... · Population Ecology Analysis of Regional Species Distribution Models Based on Radio-Telemetry Datasets From Multiple

Klar, N., N. Fernandez, S. Kramer-Schadt, M. Herrmann, M. Trinzen, I.Buttner, and C. Niemitz. 2008. Habitat selectionmodels for the Europeanwildcat conservation. Biological Conservation 141:308–319.

Knick, S. T., and J. W. Connelly. 2011. Greater sage-grouse and sagebrush:an introduction to the landscape. Pages 1–12 in S. T. Knick and J. W.Connelly, editors. Greater sage-grouse: ecology and conservation of alandscape species and its habitats. Studies in avian biology, Vol. 38.University of California Press, Berkeley, USA.

Latimer, A. M., S. Wu, A. E. Gelfand, and J. A. Silander. 2006. Buildingstatistical models to analyze species distributions. Ecological Applications16:33–50.

Lukacs, P. M., K. P. Burnham, and D. R. Anderson. 2010. Model selectionbias and Freedman’s paradox. Annals of the Institute of StatisticalMathematics 62:117–125.

Martinez-Abrain, A., D. Oro, M. G. Forero, and D. Conesa. 2003.Modeling temporal and spatial colony-site dynamics in a long-livedseabird. Population Ecology 45:133–139.

Marzluff, J. M., J. J. Millspaugh, P. Hurvitz, and M. S. Handcock. 2004.Relating resources to a probabilistic measure of space use: forest fragmentsand Steller’s jays. Ecology 85:1411–1427.

McAlpine, C. A., J. R. Rhodes, M. E. Bowen, D. Lunney, J. G. Callaghan,D. L. Mitchell, and H. P. Possingham. 2008. Can multiscale models ofspecies’ distribution be generalized from region to region? A case study ofkoala. Journal of Applied Ecology 45:558–567.

Murray, K., and M. M. Connor. 2009. Methods to quantify variableimportance: implications for the analysis of noisy ecological data.Ecology 90:348–355.

Naugle, D. E., K. E. Doherty, B. L. Walker, M. J. Holloran, and H. E.Copeland. 2011. Energy development and greater sage-grouse. Pages489–504 in S. T. Knick and J. W. Connelly, editors. Greater sage-grouse:ecology and conservation of a landscape species and its habitats. Studiesin avian biology, Vol. 38. University of California Press, Berkeley,USA.

Olea, P. P. 2009. Analyzing spatial and temporal variation in colony size: anapproach using autoregressive mixed models and information theory.Population Ecology 51:161–174.

Phillips, S. J., R. P. Anderson, and R. E. Schapire. 2006. Maximum entropymodeling of species geographic distributions. Ecological Modelling190:231–259.

Plackett, R. L. 1953. The truncated Poisson distribution. Biometrics 9:485–488.

R Development Core Team. 2012. R: a language and environment forstatistical computing. R Foundation for Statistical Computing, Vienna,Austria.

Rodda, G. H., C. S. Jarnevich, and R. N. Reed. 2011. Challenges inidentifying sites climatically matched to the native ranges of animalinvaders. PLoS ONE 6(2):e14670.

Rossi, R. E., D. J. Mulla, A. G. Journel, and E. H. Franz. 1992. Geostasticaltools for modeling and interpreting ecological spatial dependence.Ecological Monographs 62:277–314.

Royle, J. A., R. B. Chandler, C. Yackulic, and J. D. Nichols. 2012.Likelihood analysis of species occurrence probability from presence-only data for modeling species distributions. Methods in Ecology andEvolution 3:545–554.

Sawyer, H., M. J. Kauffman, and R. M. Nielson. 2009. Influence of well padactivity on winter habitat selection patterns of mule deer. Journal ofWildlife Management 73:1052–1061.

Sawyer, H., R. M. Nielson, F. G. Lindzey, L. Keith, J. H. Powell, and A. A.Abraham. 2007. Habitat selection of RockyMountain elk in a nonforestedenvironment. Journal of Wildlife Management 71:868–874.

Schroeder, M. A., C. L. Aldridge, A. D. Apa, J. R. Bohne, C. E. Braun, S.D. Bunnell, J. W. Connelly, P. A. Deibert, S. C. Gardner, M. A. Hilliard,G. D. Kobriger, and C. W. McCarthy. 2004. Distribution of sage-grousein North America. Condor 106:363–376.

Seifert, T., J. Breibeck, S. Seifert, and P. Biber. 2010. Resin pocket occur-rence in Norway spruce depending on tree and climate variables. ForestEcology and Management 260:302–312.

Shanahan, D. F., and H. P. Possingham. 2009. Predicting avian patchoccupancy in a fragmented landscape: do we know more than we think?Journal of Applied Ecology 46:1026–1035.

Vall-llosera,M., andD. Sol. 2009. A global risk assessment for the success ofbird introductions. Journal of Applied Ecology 46:787–795.

Vanreusel, W., D. Maes, and H. Van Dyck. 2006. Transferability of speciesdistribution models: a functional habitat approach for two regionallythreatened butterflies. Conservation Biology 21:201–212.

Wagner, T., D. R. Diefenbach, S. A. Christensen, and A. S. Norton. 2011.Using multilevel models to quantify heterogeneity in resource selection.Journal of Wildlife Management 75:1788–1796.

Walker, B. L., D. E. Naugle, and K. E. Doherty. 2007. Greater sage-grousepopulation response to energy development and habitat loss. Journal ofWildlife Management 71:2644–2654.

Wiens, T. S., B. C. Dale, M. S. Boyce, and G. P. Kershaw. 2008. Three wayk-fold cross-validation of resource selection functions. EcologicalModelling 212:244–255.

Yost, A. C., S. L. Petersen, M. Gregg, and R. Miller. 2008. Predictivemodeling and mapping sage grouse (Centrocercus urophasianus) nestinghabitat using Maximum Entropy and a long-term dataset from SouthernOregon. Ecological Informatics 3:375–386.

Zuur, A. F., E. N. Leno, N. J. Walker, A. A. Saveliev, and G. M. Smith.2009. Mixed effects models and extensions in ecology with R. Springer,New York, New York, USA.

Associate Editor: Wayne Thogmartin.

Rice et al. � Analysis of Regional Distribution Models 831