Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the...

26
Copyright © 2013 The Brattle Group, Inc. Quantile Regression for Peak Demand Forecasting Charlie Gibbons Ahmad Faruqui July 1, 2014

Transcript of Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the...

Page 1: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

Copyright © 2013 The Brattle Group, Inc.

Quantile Regression for Peak Demand Forecasting

Charlie Gibbons Ahmad Faruqui

Ju l y 1 , 2 0 1 4

Page 2: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 1

  Approaches to forecasting peak demand   Our empirical approach   OLS versus QR   Results

Outline

Page 3: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 2

  In this presentation, we discuss methodologies for forecasting peak demand.   Any proposed methodology should be evaluated by its accuracy.

  An accurate model is just as likely to over-forecast as it is to under-forecast peak demand in a given year.

Forecasting peak demand

Page 4: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 3

  Annual peak demand is anomalous and the forecasting methodology must take this into account.   Current approaches largely rely on OLS, which is best suited to forecasting average consumption and not peak demand: ▀ OLS with one data point for each annual peak ▀ OLS on a subset of relatively extreme days

  We propose Quantile Regression (QR) as a superior solution.   We compare QR and OLS methods of the same functional form using 32 “utilities” in a meta-study.

Motivation for the study

Page 5: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 4

  We model ▀ Daily maximum hourly demand using all summer (May-September)

days   Using

▀ Monthly energy ▀ Maximum daily temperature (contemporaneous and lag) ▀ Minimum daily temperature (contemporaneous and lag) ▀ Month fixed effects ▀ Day of week fixed effects ▀ Dummy variable for weekday holiday ▀ Quarterly index of economic activity* ▀ Daily humidity* ▀ Monthly CDD and HDD*

  * when available

Data (1999—2013)

Page 6: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 5

  Daily maximum demand is predicted separately by utility and the same functional form is used for all utilities.   We estimate QR and OLS using data from 1999-2008 (the “in sample” or “estimation” period).   We evaluate the methods using the 2009-2013 data (the “out of sample” period).

Approach

Page 7: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 6

  We can decompose maximum demand into two parts: ▀ Predictable demand

We can use weather, sales, and other variables to predict maximum demand.

▀ Unpredictable shock There are idiosyncratic components of demand that are not predictable.

Decomposing maximum demand

Page 8: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 7

  The day establishing peak demand likely has large values for both of these components. ▀ Many days in the summer exhibit severe weather; the one with the

highest demand will be the one with the highest demand shock. ▀ OLS can be used to create forecasts for days with large predictable

demand. ▀ OLS cannot be used to create forecasts for days with large shocks. ▀ QR can be used to create forecasts for days with both large

predictable demand and large shocks.   An accurate peak demand model must incorporate both components.

OLS versus QR

Page 9: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 8

Page 10: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 9

  OLS ▀ For a given level of the predictors, what is the average level of

demand that is to be expected? ▀ This model incorporates a shock of size 0 (the average).

  QR ▀ QR requires specifying a percentile of interest; 90%, say. ▀ For a given level of the predictors, what is the 90th percentile of

demand that is to be expected? ▀ This model incorporates a 90th percentile shock.

The questions that OLS and QR answer

Page 11: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 10

  The quantile is estimated to provide accurate in-sample predictions of peak demand.

  The further the estimated quantile is from 50, the greater the difference between the QR and OLS models.

Quantiles

Page 12: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 11

Page 13: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 12

  For each year and each utility, we compare: ▀ Highest level of hourly demand predicted by the model ▀ Highest level of hourly demand actually witnessed (non-coincident)

  We provide errors for two sets of predictions:

▀ In sample prediction ▀ Oracle forecasts

These out-of-sample forecasts use the true values of the predictors.

Evaluation

Page 14: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 13

Page 15: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 14

Page 16: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 15

Page 17: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 16

Page 18: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 17

  Across utilities, QR: ▀ Has a mean out-of-sample prediction error of 0.05% compared to

-4.82% for OLS ▀ Has a mean out-of-sample absolute prediction error of 3.05%

compared to 5.28% for OLS, a reduction of 42%

  By utility, QR: ▀ Has a negative MPE for 15 of 32 utilities, while OLS has a negative

MPE for 30 of 32 utilities ▀ Has a smaller MAPE than OLS for 24 out of 32 utilities ▀ Has a median MAPE that is 25% smaller than that for OLS

Performance summary

Page 19: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 18

  Peak demand is a function of predictable demand and unpredictable shocks. ▀ OLS only considers the predictable component of demand. ▀ Shocks are larger on annual peak days compared to non-peak days. ▀ QR incorporates the size of the shock term in addition to the

predictable component.   We see that

▀ The OLS model generally under-predicts peak demand. ▀ The QR model generally provides an accurate estimate of peak

demand.   These results generally hold across utilities.

Results

Page 20: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 19

Forecast intervals

  We also develop a bootstrapping method to produce forecast intervals for peak demand.

95% interval coverage

In sample 95.1

Oracle 88.1

Page 21: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 20

  Peak demand days are differentiated from other high demand days by the presence of extreme shocks to demand.   OLS does not account for this distinguishing feature of these days and the approach’s predictions are biased downward.   Focusing on days with high levels of predictors (rather than high levels of shocks) does not counteract this bias.   Quantile regression can incorporate extreme shocks to better predict peak demand.

Conclusions

Page 22: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 21

Presenter information CHARLIE GIBBONS Associate│ San Francisco, CA [email protected] +1.415.217.1055

Dr. Charles Gibbons is an associate with The Brattle Group who specializes in applying sophisticated econometric and statistical models to legal, regulatory, and policy issues. He has produced analysis for a variety of litigation matters, including models of mortgage delinquencies, forensic analysis of product defects, and local impacts of environmental damages. His work has been used for class certification, liability determination, and damage calculations. He has also developed models for forecasting electricity sales and peak demand for an international utility. Additionally, Dr. Gibbons is a lecturer at the University of California, Berkeley and last taught a graduate-level course in probability and statistics. He received a Ph.D. in economics and an M.A. in statistics from the University of California, Berkeley. His dissertation proposed new methods in applied econometrics and a theory of competition for online advertising platforms.

The views expressed in this presentation are strictly those of the presenter(s) and do not necessarily state or reflect the views of The Brattle Group, Inc.

Page 23: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 22

Presenter information AHMAD FARUQUI Principal│ San Francisco, CA [email protected] +1.415.217.1026

Dr. Ahmad Faruqui has advised utilities, ISOs/RTOs and government agencies on the design and evaluation of demand forecasting models since the inception of his career at the California Energy Commission. At the Electric Power Research Institute, he directed the research program on end-use analysis and forecasting which pioneered the use of a variety of new forecasting models that are still in widespread use in the electricity utility industry. He has consulted with more than 50 utilities and transmission system operators around the globe and testified or appeared before a dozen state and provincial commissions and legislative bodies in the United States and Canada. He has developed models for forecasting monthly and hourly loads for clients using a variety of econometric and time series methods. He helped develop an hourly load forecasting model to assist a competitive wholesaler in bidding for default service. For a utility, he diagnosed why energy sales were below forecasts even after adjusting for the effects of the economy. He assisted a transmission system operator understand why peak demand was being under-forecast by a large amount. And he assisted a regulated provider of steam analyze the customer’s decision to switch from purchasing steam to self-generating of steam and also to analyze the response of steam usage to rising steam prices. The analysis was carried out on a customer-by-customer basis and involved the use of discrete choice methods and conventional regression analysis. He holds a doctorate in economics from the University of California at Davis and undergraduate and graduate degrees from the University of Karachi, Pakistan.

The views expressed in this presentation are strictly those of the presenter(s) and do not necessarily state or reflect the views of The Brattle Group, Inc.

Page 24: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 23

  The Brattle Group provides consulting and expert testimony in economics, finance, and regulation to corporations, law firms, and governments around the world. We aim for the highest level of client service and quality in our industry.     We are distinguished by our credibility and the clarity of our insights, which arise from the stature of our experts, affiliations with leading international academics and industry specialists, and thoughtful, timely, and transparent work. Our clients value our commitment to providing clear, independent results that withstand critical review.

About Brattle

Page 25: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 24

■ Antitrust/Competition ■ Commercial Damages ■ Environmental Litigation and Regulation ■ Forensic Economics ■ Intellectual Property ■ International Arbitration ■ International Trade ■ Product Liability ■ Regulatory Finance and Accounting ■ Risk Management ■ Securities ■ Tax ■ Utility Regulatory Policy and Ratemaking ■ Valuation

■ Electric Power ■ Financial Institutions ■ Natural Gas ■ Petroleum ■ Pharmaceuticals, Medical Devices, and

Biotechnology ■ Telecommunications and Media ■ Transportation

Our practices PRACTICES INDUSTRIES

Page 26: Quantile Regression for Peak Demand Forecasting · Annual peak demand is anomalous and the forecasting methodology must take this into account. Current approaches largely rely on

| brattle.com 25

Offices

Cambridge New York San Francisco Washington, DC

London Rome Madrid

NORTH AMERICA

EUROPE


2020 MISO Energy and Peak Demand Forecasting for System ...

2020 MISO Energy and Peak Demand Forecasting for System ...

Forecasting long-term peak half-hourly electricity demand ... · The operational demand excludes the demand met by non-scheduled non-intermittent generating ... Forecasting long-term

Forecasting long-term peak half-hourly electricity demand ... · The operational demand excludes the demand met by non-scheduled non-intermittent generating ... Forecasting long-term

Forecasting long-term peak half-hourly electricity demand ... · Forecasting long-term peak half-hourly electricity demand for Tasmania 1Modelling and forecasting electricity demand

Forecasting long-term peak half-hourly electricity demand ... · Forecasting long-term peak half-hourly electricity demand for Tasmania 1Modelling and forecasting electricity demand

Peak Load Forecasting - AERTC

Peak Load Forecasting - AERTC

Reliability Forecasting Methodology Workshop · 1-in-2 year peak demand 9 •AEMO must publish a 1-in-2 year peak demand forecast as part of the reliability forecast. •This represent

Reliability Forecasting Methodology Workshop · 1-in-2 year peak demand 9 •AEMO must publish a 1-in-2 year peak demand forecast as part of the reliability forecast. •This represent

Demand Forecasting

Demand Forecasting

Probabilistic forecasting of long-term peak electricity demand

Probabilistic forecasting of long-term peak electricity demand

Challenges in forecasting peak electricity demand

Challenges in forecasting peak electricity demand

DEMAND FORECASTING The Context of Demand Forecasting The

DEMAND FORECASTING The Context of Demand Forecasting The

Demand forecasting

Demand forecasting

NATIONAL ELECTRICITY FORECASTING REPORT · peak use. This will have a greater effect on system peak demand than annual electricity consumption, by flattening the peak and changing

NATIONAL ELECTRICITY FORECASTING REPORT · peak use. This will have a greater effect on system peak demand than annual electricity consumption, by flattening the peak and changing

Challenges in forecasting peak electricity demandChallenges in forecasting peak electricity demand How to select the best forecasting method 16 Locally generated power may not be recorded.

Challenges in forecasting peak electricity demandChallenges in forecasting peak electricity demand How to select the best forecasting method 16 Locally generated power may not be recorded.

Probabilistic forecasting of peak electricity demand

Probabilistic forecasting of peak electricity demand

MISO Energy and Peak Demand Forecasting for System …...APPENDIX C Peak Demand Models 63 APPENDIX D Weather Normalization Methodology 73 APPENDIX E High and Low Forecasts 75. TABLES

MISO Energy and Peak Demand Forecasting for System …...APPENDIX C Peak Demand Models 63 APPENDIX D Weather Normalization Methodology 73 APPENDIX E High and Low Forecasts 75. TABLES