Benchmarking for Large C&I
Facility Energy Use
What Is Benchmarking and What Is It Good For?
Gwen Farnsworth
E SOURCE Research Manager
September 27, 2005
18th Annual E SOURCE Forum
2005 Platts, a Division of The McGraw-Hill Companies
Can You Tell Me?
Questions we hear from energy managers and
key account managers:
How much energy does an office building use?
Am I using too much energy?
How can I compare energy use across my
facilities?
What is my cost per HDD?
Is my facility using less energy since we put in
that new HVAC system?
9/27/05
Confidential: Not for distribution outside subscribing organization
Workshop Objectives
Main points of this workshop
Benchmarking is harder than most assume
Some data is available (how to find it and
how to use it)
The good and bad news about external
benchmarking tools
Reality check on internal benchmarking
(energy accounting) tools
How to help your customers
9/27/05
Confidential: Not for distribution outside subscribing organization
Presentation Outline
What Is Benchmarking and What Is It Good For?
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting) Tools
Tips for Your Customers: How to Benchmark
9/27/05
Confidential: Not for distribution outside subscribing organization
What Is Benchmarking and
What Is It Good For?
You cant manage what
you dont measure.
9/27/05
Confidential: Not for distribution outside subscribing organization
What Is Benchmarking and
What Is It Good For? (cont.)
Benchmarking
Is a process of comparing the energy usage
(and/or costs) of one facility against other
similar facilities
May involve comparing against facilities
owned or operated by the same company
(internal benchmarking) or against an industry
standard (external benchmarking)
9/27/05
Confidential: Not for distribution outside subscribing organization
What Is Benchmarking and
What Is It Good For? (cont.)
Why benchmark?
Get perspective on how facilities are performing
Motivate action (energy-awareness programs)
Screen buildings for audits, tune-ups, and retrofits
Communicate good results (public PR and
internal reporting)
Develop performance targets
Forecast and budget
Assess impact of energy conservation measures
9/27/05
Confidential: Not for distribution outside subscribing organization
What Is Benchmarking and
What Is It Good For? (cont.)
Why dont more energy managers benchmark?
Dont know where to find external benchmark data
Dont know how to use external benchmark data
Dont have time to track internal data
Dont know what metrics to track
Dont have the proper tools (energy accounting software)
Dont know how to use energy accounting software
(or its just not user-friendly)
Hoping to get energy accounting software to do things
it wasnt designed to do
8
9/27/05
Confidential: Not for distribution outside subscribing organization
What Is Benchmarking and
What Is It Good For? (cont.)
Benchmarking task or goal
Energy
accounting
Statistical
analysis
Target audits and planned retrofits
Create energy awareness campaigns
Compare against external data
Develop performance targets
Monitor performance
Communicate good results
Assess impact of energy conservation measures
Forecast and budget
Source: Platts
9
9/27/05
Confidential: Not for distribution outside subscribing organization
What Is Benchmarking and
What Is It Good For? (cont.)
If the only tool you have is a
hammer, it is tempting to treat
everything as if it were a nail.
Abraham Maslow,
The Psychology of Science
10
9/27/05
Confidential: Not for distribution outside subscribing organization
Presentation Outline
What Is Benchmarking and What Is It Good For?
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting) Tools
Tips for Your Customers: How to Benchmark
11
9/27/05
Confidential: Not for distribution outside subscribing organization
Can You Tell Me?
Questions we hear from energy managers and
key account managers:
How much energy does an office building use?
Am I using too much energy?
How can I compare energy use across my
facilities?
What is my cost per HDD?
Is my facility using less energy since we put in
that new HVAC system?
12
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: Commercial
Some commercial data sources
U.S. DOE EIA CBECS (Commercial Building
Energy Consumption Survey)
NRCAN OEE CIBEUS (Commercial and
Institutional Buildings Energy Use Survey)
Californias CEC CEUS (Commercial
End-Use Survey)
13
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS
Commercial Building
Energy Consumption Survey
Survey conducted every 4 years
1999 data released 20012002
2003 preliminary Building Characteristics
data released mid-2005
Expect 2003 energy Consumption and
Expenditures data early 2006
14
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS (cont.)
What data is collected?
5,430 buildings (1999)
1,000 square feet or greater
Structurally enclosed buildings
At least 50% of floor space for a primary
commercial or institutional use
How is the data collected?
Computer assisted telephone interview
Mail survey of energy providers (if needed)
15
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS (cont.)
Best available national data
Results extrapolated to national level
Useful for
Building characteristics
Energy intensity estimates
Estimated end-use breakdowns (preliminary)
16
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS (cont.)
Formats in which to access CBECS data
Special topics reports, 1999 Building Activities
Detailed tables
Public use micro-data files
www.eia.doe.gov/emeu/cbecs/contents.html
17
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS,
Building Activities Reports
18
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS,
Detailed Tables
19
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS,
Public Use Micro-Data Files
20
9/27/05
Confidential: Not for distribution outside subscribing organization
10
External Benchmarking Data: CBECS,
Public Use Micro-Data Files (cont.)
21
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS,
Public Use Micro-Data Files (cont.)
22
9/27/05
Confidential: Not for distribution outside subscribing organization
11
External Benchmarking Data: CBECS,
Public Use Micro-Data Files (cont.)
23
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: CBECS,
End-Use Consumption Estimates
24
9/27/05
Confidential: Not for distribution outside subscribing organization
12
External Benchmarking Data: CBECS (cont.)
Special topics reports, 1999 Building Activities
and End-Use Estimates tables
Quick online answers
Just a small portion of the available data
Detailed tables
More detailed data
Requires more time and familiarity
Public use micro-data files
Unlimited flexibility for manipulating the data
Requires in-depth study of background materials
25
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data:
CIBEUS, Canada
First Canadian commercial and institutional
building survey: 2000 data (published 2002)
Future building surveys will be smaller
26
9/27/05
Confidential: Not for distribution outside subscribing organization
13
External Benchmarking Data:
CIBEUS, Canada (cont.)
What data is collected?
4,101 responses
Buildings of at least 1,000 square feet
At least 50% of space for a single commercial
or institutional activity
Areas with population of 175,000 or more
(50,000-plus in Atlantic provinces)
How is that data collected?
In-person interviews
Some data collected from energy supplier
27
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data:
CIBEUS, Canada (cont.)
Useful for
Building characteristics
Energy intensity data
Not to be confused with NRCANs
Comprehensive Energy Use Database (CEUD)
28
9/27/05
Confidential: Not for distribution outside subscribing organization
14
External Benchmarking Data:
CIBEUS, Canada (cont.)
Formats in which to access CIBEUS data
Detailed tables
PDF or Excel
www.oee.nrcan.gc.ca/corporate/statistics/neud/dpa/
data_e/cibeus_description.cfm?attr=0
29
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data:
CIBEUS, Canada (cont.)
30
9/27/05
Confidential: Not for distribution outside subscribing organization
15
External Benchmarking Data: CEUS
(California Energy Commission)
California Energy Commission sponsored
the surveys
Data were collected in utility service territories
PG&E 1996
SCE 1992, 1995 (electric only)
No public access to full data set (except
via CalArch)
Next round of data should be more accessible
31
9/27/05
Confidential: Not for distribution outside subscribing organization
Presentation Outline
What Is Benchmarking and What Is It Good For?
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting) Tools
Tips for Your Customers: How to Benchmark
32
9/27/05
Confidential: Not for distribution outside subscribing organization
16
External Benchmarking Tools:
Commercial
Some available tools
Energy Stars Portfolio Manager (EPA)
LBNLs Arch and CalArch
Kilojolts EnerCop
33
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools:
Energy Star
What the user does
Enter 12 months of billed energy data
Enter building characteristics data
What the software does
Compares entered data to CBECS (and
additional external data for some sectors)
Normalizes for various factors that affect usage
(e.g., occupancy, computers, swimming pool)
Complex algorithms for weather normalization
using 30-year norms
34
9/27/05
Confidential: Not for distribution outside subscribing organization
17
External Benchmarking Tools:
Energy Star (cont.)
What the user gets
Energy Star score (1 to 100, 75 = the building
ranks among the 25% most-efficient buildings)
Site and source annual energy intensity
CO2 emissions estimate
35
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools:
Energy Star (cont.)
Source: Energy Star, www.energystar.gov
36
9/27/05
Confidential: Not for distribution outside subscribing organization
18
External Benchmarking Tools:
Energy Star (cont.)
Source: Energy Star
37
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools:
Energy Star (cont.)
Source: Energy Star
38
9/27/05
Confidential: Not for distribution outside subscribing organization
19
External Benchmarking Tools:
Energy Star (cont.)
Its not perfect
Some sectors currently not represented
(restaurants, retail)
Must assess one building at a time; cant get
the big picture for a single sector
Results dont provide context
Score is based on source (primary) energy;
can be confusing for user
39
9/27/05
Confidential: Not for distribution outside subscribing organization
Can You Tell Me?
Questions we hear from energy managers and
key account managers:
How much energy does an office building use?
Am I using too much energy?
How can I compare energy use across my
facilities?
What is my cost per HDD?
Is my facility using less energy since we put in
that new HVAC system?
40
9/27/05
Confidential: Not for distribution outside subscribing organization
20
External Benchmarking Tools: Arch
What the user does
Enters building descriptive data (size, ZIP code,
type of building)
Enters total annual energy use
What the software does
Queries CBECS database for energy usage
data of similar buildings (grouped by type, size,
and location)
41
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools: Arch (cont.)
What the user gets
A histogram report showing distribution of similar
buildings and usage from CBECS
Graph identifies where the users building would
appear in the distribution
Summary of information the user entered,
calculation of Btu/ft2/yr, number of similar
buildings from CBECS
42
9/27/05
Confidential: Not for distribution outside subscribing organization
21
External Benchmarking Tools: Arch (cont.)
Source: LBNL, http://poet.lbl.gov/arch
43
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools: Arch (cont.)
Source: LBNL
44
9/27/05
Confidential: Not for distribution outside subscribing organization
22
External Benchmarking Tools: Arch (cont.)
Its not perfect
Results may be based on few buildings
Results show actual survey data, not
extrapolated to the broader population
(i.e., no regional weighting)
Current version (released 2001) uses 1995
CBECS data
45
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools:
CalArch
Very similar to Arch
Similar interface, data entry and output
Data is California-specific (CEUS)
And its also not perfect
Some CEUS data is electric only
View actual survey data, not representative of
broader population (unweighted)
46
9/27/05
Confidential: Not for distribution outside subscribing organization
23
External Benchmarking Tools:
CalArch (cont.)
Source: LBNL, http://poet.lbl.gov/cal-arch/benchmark.html
47
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools:
CalArch (cont.)
Source: LBNL
48
9/27/05
Confidential: Not for distribution outside subscribing organization
24
External Benchmarking Tools:
CalArch (cont.)
Source: LBNL
49
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools:
Kilojolts EnerCop
Kilojolts Consulting Group
(Lexington, Massachusetts)
EnerCop software, commercially released in
August 2005
Includes sector-specific energy intensity
benchmarks from CBECS data
Developing a Kilojolts benchmark with
additional industry data
50
9/27/05
Confidential: Not for distribution outside subscribing organization
25
External Benchmarking Tools: EnerCop
(cont.)
Source: Kilojolts, www.kilojolts.com
51
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Tools: EnerCop
(cont.)
Source: Kilojolts
52
9/27/05
Confidential: Not for distribution outside subscribing organization
26
Presentation Outline
What Is Benchmarking and What Is It Good For?
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting) Tools
Tips for Your Customers: How to Benchmark
53
9/27/05
Confidential: Not for distribution outside subscribing organization
For More Information
Gwen Farnsworth
E SOURCE Research Manager
Tel 720-548-5428
E-mail
[email protected]54
9/27/05
Confidential: Not for distribution outside subscribing organization
27
Benchmarking for
Large C&I Facility Energy Use
External Benchmarking Data and Tools:
Industrial
Neil Kolwey
E SOURCE Research Manager
September 27, 2005
18th Annual E SOURCE Forum
2005 Platts, a Division of The McGraw-Hill Companies
Industrial Benchmarking Challenges
Most of energy use is for processes
(average of 80% for process use,
20% for HVAC and lighting)
Process use is industry-specific
Within specific industry sectors, many different
product mixes and different processes
Within same company, different products
and processes
9/27/05
Confidential: Not for distribution outside subscribing organization
Measurement of Energy Performance
Tracking energy use for facility or operation
Breakdown of energy use within facility
Identify largest energy uses
Understand weather-related component
Possible tracking at process level
Comparing energy use for facility (benchmarking)
Other facilities within same company
Other facilities within industry sector
9/27/05
Confidential: Not for distribution outside subscribing organization
External Data and Tools
Manufacturing Energy Consumption
(MECs) data
Energy-use breakdown for specific sectors
Annual Survey of Manufacturing
(ASM) data
Total energy costs and total value of shipments
Energy Star Plant Energy Performance Indicators
(EPI) data
Benchmarking tool available for a few sectors
9/27/05
Confidential: Not for distribution outside subscribing organization
What Are the Largest Uses
of Energy at My Facility?
Facility energy analysis/audit
Temporary submeters
Analysis of equipment rating, capacity factor,
hours of operation
Use MECs dataprovides typical energy use
patterns for your industry subsector
9/27/05
Confidential: Not for distribution outside subscribing organization
MECs Data Strengths and Weaknesses
Strengths
Provides breakdown of total energy use (for the
sector as a whole), by process and facility uses,
and for electricity versus specific fuels
Weaknesses
MECs provides no measure of total energy
use per unit of output
1998 data is most recent
Data quality problems, gaps
Data for specific sectors is limited
9/27/05
Confidential: Not for distribution outside subscribing organization
MECs Data: Energy Use for Rubber
and Plastic Products (NAIC 326)
Electricity use
(59% of total
energy)
Lighting
8%
Other
7%
HVAC
9%
Process
cooling
8%
Machine
drive
52%
Process
heating
16%
9/27/05
Confidential: Not for distribution outside subscribing organization
MECs Data: Energy Use for Rubber
and Plastic Products (NAIC 326)
Fuel use
(41% of total
energy)
Other
12%
HVAC
15%
Boiler fuel
50%
Process
heating
23%
Source: EIA, from http://www.eia.doe.gov/emeu/mecs/contents.html
8
9/27/05
Confidential: Not for distribution outside subscribing organization
MECs Data for One Sector:
Paper Products
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: ASM
Strengths
ASM provides annual energy costs (fuels and electricity),
other operating costs, and total value of shipments for
specific industrial sectors
2003 data is most recent
Weaknesses
Energy use for a specific facility depends on specific
processes, products made, and on outdoor temperature
(to a smaller extent)
ASM offers no way to adjust for these variables in order to
produce meaningful comparisons to the sectorwide average
10
9/27/05
Confidential: Not for distribution outside subscribing organization
ASM Data: What Is It Good For?
Electricity
costs
(million $)
Total energy
costsfuels
and electricity
(million $)
Total value
of shipments
(million $)
Polystyrene foam
products (32614)
114
200
6,647
Glass container mfg.
(NAICS 327213)
185
511
4,361
Cement mfg. (NAICS
32731)
589
1,158
7,550
Ferrous metal foundries
(NAICS 33151)
543
845
14, 653
Industrial sector
Source: Platts; data from ASM
11
9/27/05
Confidential: Not for distribution outside subscribing organization
ASM Data: Table 4
12
9/27/05
Confidential: Not for distribution outside subscribing organization
ASM Data: Table 2
13
9/27/05
Confidential: Not for distribution outside subscribing organization
ASM Data: Sources
Where does it come from?
U.S. Census data gathered every four years
From approximately 55,000 manufacturing
facilities
Where to find it:
http://www.census.gov/mcd/asmhome.html
14
9/27/05
Confidential: Not for distribution outside subscribing organization
External Benchmarking Data: Energy Star
Plant Energy Performance Indicators (EPIs)
Strengths
Useful tool for comparing energy performance
with other facilities in the same sector
Energy data is adjusted for product mix,
production rate, outdoor temperature, and
other variables, making it more meaningful
Weaknesses
Only available for a few sectors
Somewhat complicated to use
15
9/27/05
Confidential: Not for distribution outside subscribing organization
Sectors with Upcoming Energy Star EPIs
Breweries
Motor vehicle mfg.
Cement mfg.
Petroleum refining
Corn refining
Pharmaceutical mfg.
See http://www.energystar.gov/index.cfm?c=in_focus.bus_industries_focus
16
9/27/05
Confidential: Not for distribution outside subscribing organization
Data for Energy Star EPIs
Source
ASM and additional data from U.S. Census
Bureau
Data from companies participating in focus groups
How to use
Facilities enter data on annual energy use, total
production, product mix, and other metrics
Output is percentile ranking of facility compared
with other companies in sector (75th percentile
or above is considered efficient)
17
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking
Comparing energy use per unit output for
similar facilities within the same company
Works if company has several facilities making
the same product (beer, cement)
Consider energy accounting tools
More-sophisticated analysis is possible on
site-specific basis
Some tools work well with submetering and
interval data
18
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Example: Unilever
2001 energy
budget
(million $)
1Q01 energy
costs
2Q01 energy
costs
3Q01 energy
costs
4Q01 energy
costs
YTD energy
costs
(million $)
Baltimore
1.37
0.38
0.39
0.35
0.25
1.37
Cartersville
0.62
0.18
0.15
0.19
0.14
0.66
Edgewater
0.38
0.05
0.09
0.07
0.09
0.30
Chicago
2.58
0.78
0.59
0.76
0.66
2.79
Total
4.94
1.39
1.22
1.37
1.14
5.11
Facility
Green : Under budget or 2000 consumption
Yellow: Exceeds budget or 2000 consumption
by <20%
Red : Exceeds budget or 2000 consumption
by >20%
19
9/27/05
Confidential: Not for distribution outside subscribing organization
Industrial Summary
Industrial facilities are hard to compare
External benchmarking data is limited
Basic internal benchmarking can be useful
Dont forget analysis and tracking of energy use
at the facility level
20
9/27/05
Confidential: Not for distribution outside subscribing organization
10
For More Information
Neil Kolwey
Research Manager
Tel 720-548-5741
E-mail
[email protected]21
9/27/05
Confidential: Not for distribution outside subscribing organization
11
Benchmarking for
Large C&I Facility Energy Use
Commercial & Industrial Benchmarking
Tools and Tips
Gwen Farnsworth
E SOURCE Research Manager
September 27, 2005
18th Annual E SOURCE Forum
2005 Platts, a Division of The McGraw-Hill Companies
Presentation Outline
What Is Benchmarking and What Is It Good For?
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting)
Tools
Tips for Your Customers: How to Benchmark
2
9/27/05
Confidential: Not for distribution outside subscribing organization
Can You Tell Me?
Questions we hear from energy managers and
key account managers:
How much energy does an office building use?
Am I using too much energy?
How can I compare energy use across my
facilities?
What is my cost per HDD?
Is my facility using less energy since we put in
that new HVAC system?
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools
E SOURCE researchers reviewed several energy
accounting software systems
Itron EEM
Cadence Enterprise
Avista Advantage Facility IQ and BI Tool
EnVinta Enterprize.EM
SMR Utility Manager
Metrix (Abraxas)
Kilojolts EnerCop
4
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Energy Star
Some EASs now offer Energy Star benchmarking
Cadence Enterprise
Save More Resources
Avista Advantage
Ei3 Energy Watch
Servidyne EnergyCheck
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Energy Star (cont.)
Source: Cadence Network, www.cadencenetwork.com
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Energy Star (cont.)
Source: Cadence Network
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Energy Star (cont.)
Source: Cadence Network
8
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking
Ranking is a basic way to compare usage
across sites. Some options are to rank by:
Index or simple normalization function (such as
usage/output, usage/ft2 , usage/HDD)
Total annual usage, or daily usage or costs
Budget variance
Percentage improved over baseline
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking (cont.)
Source: Itron, www.itron.com
10
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking (cont.)
Source: EnVinta, www.enterprizeem.com
11
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking (cont.)
Source: Avista Advantage, www.avistaadvantage.com
12
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking (cont.)
Source: Cadence Network
13
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking (cont.)
Source: Kilojolts
14
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Ranking (cont.)
Source: Kilojolts
15
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Weather Normalization (cont.)
Source: Cadence Network
16
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Weather Normalization
Weather normalization options are limited with
commercial software
Focus on cost-avoidance (M&V, performance
versus baseline)
Normalize for weather by individual site, not
across sites
Require experienced users to control regression
options
17
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Cost Avoidance
Source: SMR, www.savemoreresources.com
18
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Cost Avoidance (cont.)
Source: SMR
19
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Cost Avoidance (cont.)
Source: Abraxas Consulting (Metrix)
20
9/27/05
Confidential: Not for distribution outside subscribing organization
10
Internal Benchmarking Tools:
Cost Avoidance (cont.)
Source: Abraxas Consulting (Metrix)
21
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Selecting Software
Each tool and vendor offers unique features
Big Bundle: Bill pay, error resolution, refunds,
procurement
Energy Star
Cost-avoidance analysis
Weather data (temp, HDD/CDD, 30-year norm)
Budgeting, scenario forecasting, variance analysis
Meter data analysis
ASP versus intranet versus desktop versions
22
9/27/05
Confidential: Not for distribution outside subscribing organization
11
Internal Benchmarking Tools:
Selecting Software (cont.)
Key usability features
Report set-up, modification options, and interface
Grouping
Filtering
Calculations (normalization indexes)
Graphic options
Navigation interface
Online help, report explanations, and instructions
23
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Why Usability Features Are Important
Source: Abraxas Consulting (Metrix)
24
9/27/05
Confidential: Not for distribution outside subscribing organization
12
Internal Benchmarking Tools:
Report Options
Source: Abraxas Consulting (Metrix)
25
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Report Options (cont.)
Source: Itron
26
9/27/05
Confidential: Not for distribution outside subscribing organization
13
Internal Benchmarking Tools:
Report Options (cont.)
Source: EnVinta
27
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Report Options (cont.)
Source: SMR
28
9/27/05
Confidential: Not for distribution outside subscribing organization
14
Internal Benchmarking Tools:
Grouping Function
Source: Cadence Network
29
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Grouping Function (cont.)
Source: EnVinta
30
9/27/05
Confidential: Not for distribution outside subscribing organization
15
Internal Benchmarking Tools:
Grouping Function (cont.)
Source: SMR
31
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Filtering Function
Source: SMR
32
9/27/05
Confidential: Not for distribution outside subscribing organization
16
Internal Benchmarking Tools:
Filtering Function (cont.)
Source: Kilojolts
33
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Filtering Functions (cont.)
Source: Avista Advantage
34
9/27/05
Confidential: Not for distribution outside subscribing organization
17
Internal Benchmarking Tools:
Graphic Options
Source: SMR
35
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Graphic Options (cont.)
Source: SMR
36
9/27/05
Confidential: Not for distribution outside subscribing organization
18
Internal Benchmarking Tools:
Graphic Options (cont.)
Source: SMR
37
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Graphic Options (cont.)
Source: EnVinta
38
9/27/05
Confidential: Not for distribution outside subscribing organization
19
Internal Benchmarking Tools:
Graphic Options (cont.)
Source: Cadence Network
39
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Online Help
Source: Cadence Network
40
9/27/05
Confidential: Not for distribution outside subscribing organization
20
Internal Benchmarking Tools:
Interface
Source: Avista Advantage
41
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Keeping Data Clean
Source: EnVinta
42
9/27/05
Confidential: Not for distribution outside subscribing organization
21
Internal Benchmarking Tools:
Keeping Data Clean (cont.)
Source: Itron
43
9/27/05
Confidential: Not for distribution outside subscribing organization
Internal Benchmarking Tools:
Keeping Data Clean (cont.)
Source: SMR
44
9/27/05
Confidential: Not for distribution outside subscribing organization
22
Presentation Outline
What Is Benchmarking and What Is It Good For?
(Or Why Are We All Sitting Here?)
External Benchmarking Data
External Benchmarking Tools
Industrial Benchmarking
Internal Benchmarking (Energy Accounting) Tools
Tips for Your Customers: How to Benchmark
45
9/27/05
Confidential: Not for distribution outside subscribing organization
How to Benchmark
1. Gather the data for each site
Total usage and demand
Expenditures
Normalization factors (square footage,
occupancy, revenue, production)
2. Check the data
Anomaly, missing data or variance reports
Review graphs of site-level monthly trends
46
9/27/05
Confidential: Not for distribution outside subscribing organization
23
How to Benchmark (cont.)
3. Clean the data
Verify and correct suspicious data
Estimate usage if missing
Exclude suspicious, incorrect, or incomplete
records from analysis
4. Convert to comparable values
Daily or annual usage
Indexes
47
9/27/05
Confidential: Not for distribution outside subscribing organization
How to Benchmark (cont.)
5. Compare usage and expenditures
Totals (daily, monthly, quarterly, annual)
Index values (per ft2, per HDD or CDD,
per activity variable)
Average, range, distribution
Difference from average
Difference from previous period
Difference from budget
Difference from target
Rankings and multiple index ranking
48
9/27/05
Confidential: Not for distribution outside subscribing organization
24
How to Benchmark (cont.)
5. Compare usage and expenditures (cont.)
Apply normalization factors to external benchmark
usage data (if available)
Adjust square footage for varying space types for
internal benchmarking
49
9/27/05
Confidential: Not for distribution outside subscribing organization
How to Benchmark (cont.)
6. Interpret results
Top and bottom performers
Prioritize highest users and highest spenders
7. Take action
50
9/27/05
Desktop audits
Walk-through and full-building audits
Commissioning
Retrofit and operational plans
Recognize and reward good performers
Confidential: Not for distribution outside subscribing organization
25
How to Benchmark (cont.)
Avoid the easy mistakes
Record usage for when energy was used, not
necessarily when the bill was paid
If comparing monthly data, make sure its
normalized to calendar month
CDD, HDD, and production monthly totals
should correspond to meter-read dates
Compare full-cycle data (annual average)
51
9/27/05
Confidential: Not for distribution outside subscribing organization
How to Benchmark (cont.)
Use graphics
Line graphs to check monthly trends
Bar charts to compare current versus previous
period, budget, or target
Scatterplot to understand relationships between
usage and drivers (e.g., weather, production)
Histogram to see range and distribution of
performance across sites
52
9/27/05
Confidential: Not for distribution outside subscribing organization
26
How to Benchmark (cont.)
Weekly
Energy metric
Compare daily energy use to
benchmarks
Monthly
Quarterly Annually
Verify utility bills
Compare monthly energy use to
historical trends
Summarize monthly results and
report to facility managers
Compare usage to historical trends
Compare usage to industry
benchmarks
Re-assess historical trends and
baseline
a
Source: Platts; adapted from LBNL- 54862
53
9/27/05
Confidential: Not for distribution outside subscribing organization
What You Can Do
Provide customer usage data in electronic
format
Calculate benchmark data from your
customer data
Provide national benchmark data
Encourage and help customers to use
Energy Star
54
9/27/05
Confidential: Not for distribution outside subscribing organization
27
For More Information
Gwen Farnsworth
E SOURCE Research Manager
Tel 720-548-5728
E-mail
[email protected]Neil Kolwey
E SOURCE Research Manager
Tel 720-548-5741
E-mail [email protected]
55
9/27/05
Confidential: Not for distribution outside subscribing organization
28
