Understanding the Elements of Success: Findings from the National Energy Efficiency Programmatic Bes - PowerPoint PPT Presentation

About This Presentation
Title:

Understanding the Elements of Success: Findings from the National Energy Efficiency Programmatic Bes

Description:

Kenneth James, PG&E, Study Manager. Mike Rufo, Quantum Consulting, Prime Contractor ... Tailor program to the unique needs of market sector targeted ... – PowerPoint PPT presentation

Number of Views:75
Avg rating:3.0/5.0
Slides: 28
Provided by: kennet72
Learn more at: https://www.calmac.org
Category:

less

Transcript and Presenter's Notes

Title: Understanding the Elements of Success: Findings from the National Energy Efficiency Programmatic Bes


1
Understanding the Elements of Success Findings
from the National Energy Efficiency Programmatic
Best Practices Study
  • CALMAC MeetingDecember 15, 2004
  • Kenneth James, PGE, Study Manager
  • Mike Rufo, Quantum Consulting, Prime Contractor

2
Project Advisory Committee Kenneth James
PGE Pierre Landry SCE Rob Rubin SDGE Jay
Luboff CPUC Eli Kollman CPUC Sylvia Bender -
CEC
Project Team Mike Rufo Quantum Marissa Meyers
- Quantum Phil Willems Quantum Jane Peters
Research Into Action Bruce Mast Frontier
Associates Megdal Associated Shel Feldman Mgt
Cons.
3
  • Presentation Overview
  • Project Background
  • Example Best Practices Study Findings
  • Best Practices Website and Products
  • Next Steps

4
Benchmarking
5
Best Practices
6
Background
7
  • A Few Key Questions Addressed by this Best
    Practices Project
  • What EE program design, implementation and
    management practices are entities currently
    using?
  • How effective are they?
  • Where is there room for performance improvement?
  • How will this knowledge assist in meeting the
    challenges and opportunities in CA new EE
    environment?

8
Program Components
9
Program Areas
Program Area Reports (13)
  • On Beta Website
  • Residential
  • Lighting
  • HVAC
  • Single-Family Comp
  • Multi-Family Comp
  • Audits
  • New Construction
  • Nonresidential
  • Lighting/Turnkey
  • Large Comprehensive
  • In Review
  • Nonresidential
  • HVAC
  • Trade Ally Training
  • New Construction
  • Other
  • Mass Market Advertising
  • Still in Preparation
  • Res Appliances

10
Study Products Program Area White Paper Reports
Report Content
  • Summary of Findings
  • Overview of Programs (5-10 each, 80 total)
  • Policy/Historic Context Issues
  • Feature Benchmarking and Best Practices
  • Comparison of Outcomes

11
  • Example of Range of Programs Covered -
  • Large Nonresidential Comprehensive Incentives
    Program Area
  • CAs Nonresidential Standard Performance Contract
  • NYSERDAs Energy martTM C/I Performance
  • United Illuminatings Energy Opportunities
  • BC Hydros Power Smart
  • Xcel Energys Custom Efficiency (Colorado)
  • Northeast Utilities Custom Efficiency
  • Massachusetts Electrics Energy Initiative
  • Alliant Energys Energy Shared Savings
  • Efficiency Vermonts Business Energy Services
  • SMUDs Commercial Industrial Custom Retrofit

12
Study Products Program Area White Paper Reports
Program Profiles
  • Program Synopsis
  • Program Focus
  • Program Context
  • Program Components
  • Key Sources
  • Contact Information

13
Sample Program Design BPs
  • Generally Cross-Cutting
  • Articulate plan/theory that states expectations,
    timing, approach
  • Link strategic approach to policy objectives and
    constraints
  • Build feedback loops into program design and
    logic
  • Do not over-promise results
  • Understand local market conditions
  • Conduct sufficient market research
  • Maintain program design flexibility to respond to
    changes in market other factors
  • Put process plan (including program management)
    in writing
  • Tailor program to the unique needs of market
    sector targeted
  • Define locate hard-to-reach customers target
    programs accordingly, as appropriate

14
Sample Program Management BPs
  • Generally Cross-Cutting
  • Clearly define program management
    responsibilities to avoid confusion as to roles
    and responsibilities
  • Develop and maintain clear lines of communication
  • Use well-qualified engineering staff (for
    technical programs)
  • Motivate field staff and service providers
  • Maintain consistency in personnel over time
  • Delegate responsibility based on risk versus
    reward
  • Make sure at least some of the institutional
    memory resides in-house, not with subcontractors
  • Reward high performing staff and link performance
    evaluations to tangible measures which are known
    in advance and developed together jointly by the
    manager and employee

15
Sample Reporting Tracking BPs
  • Generally Both Program-Specific and Cross-Cutting
  • Define identify key information early in
    program process
  • Clearly articulate data requirements for
    measuring program success
  • Balance level of tracking planned against
    resource availability
  • Design system to support requirements of
    evaluators
  • Use Internet to facilitate data entry
    reporting build in real time data validation
    systems that perform routine data quality
    functions
  • Automate, as much as is practical, routine
    functions
  • Develop electronic application processes
  • Develop accurate algorithms assumptions for
    savings estimates
  • Conduct regular checks of reports to assess
    program performance
  • Document tracking system provide manuals for
    all users

16
Sample QC Verification BPs
  • Mostly Program-Specific
  • Develop inspection verification procedures
    during program design
  • Base quality control on programs relationship
    with vendors, involved, types of measures,
    volume, variability of project size
  • Use measure product specification in requirements
    guidelines
  • Require pre-inspections for large or uncertain
    impact projects
  • Require builder/representative to be on site
    during inspection
  • Verify accuracy of rebates, coupons, invoices to
    ensure the reporting system is recording actual
    product installations
  • Assure quality of product through independent
    testing procedures
  • Build in statistical features to the sampling
    protocol
  • Treat inspection visits as partnership-building
    learning events
  • Ensure inspectors have plenty of
    hands-on-construction practice
  • Assess customer satisfaction with the product
    through evaluation

17
Program Implementation
  • Mostly Program Specific
  • Keep participation simple, Offer a single point
    of contact for customers
  • Develop participation strategies that are
    multi-pronged inclusive
  • Review understand product availability before
    establishing eligibility
  • Make program participation part of an existing,
    routine transaction
  • Use Internet/electronic means to facilitate
    participation
  • Avoid over committing to projects before design
    parameters are known
  • Set incentive levels to maximize net not gross
    program impacts
  • Use incremental costs to benchmark and limit
    payments
  • Tie rebates for popular measures to those less
    likely to be considered
  • Limit or exclude incentive payments to known free
    riders
  • Tie incentives to building performance
  • Offer low interest loans or financing as leverage
    on incentives
  • Use disincentives for savings inflation for
    performance-based options

18
Program Marketing
  • Mostly Program Specific
  • Use Energy Star? logo to instill consumer
    confidence/utility credibility
  • Leverage with cities/community-based
    organizations other programs
  • Include adequate retail outreach support to
    ensure product is stocked advertised that
    point-of-purchase materials are accurate clear
  • Develop disseminate case studies to showcase
    program projects
  • Use target marketing strategies to ensure that
    hard-to-reach populations are informed about
    available programs and options
  • Use face-to-face marketing, where possible,
    especially for small biz
  • Give builders the opportunity to participate in
    development of message
  • Market to multiple departments with volume
    building organizations
  • Provide trade allies with training resources to
    enhance marketing
  • Sell the customer benefits first, then energy
    efficiency
  • Keep benefits quantifiable in economic terms,
    Promote life-cycle cost
  • Take advantage of external factors (i.e., heat
    waves, etc.)

19
Program Evaluation
  • Generally Both Program-Specific and Cross-Cutting
  • Engage the implementation team in the evaluation
    process
  • Create a culture whereby evaluation findings are
    valued and integrated into program management
  • Present actionable findings in real time and at
    the end of study
  • Stagger the timing of process and ex post impact
    tasks so that process results are communicated on
    a relatively real-time basis
  • Conduct impact evaluations routinely, but not
    necessarily annually
  • Include periodic estimation or free-ridership and
    spillover
  • Use regular process evaluation to provide timely
    and fresh results
  • Periodically review update market information
    on construction practices, EE market share,
    measure adoption, trends
  • Perform detailed market assessments particularly
    for MT programs
  • Support program review assessment at the most
    comprehensive level possible

20
  • The Best Practices
  • Benchmarking
  • Website

21
Communication of Results Model
22
Home Page Best Practice Website
23
Find A Study
24
Links to Program Areas
25
Search Results
26
  • Website Products
  • Program Area Chapter Reports
  • Description of Report
  • Full Chapter Report (PDF)
  • Executive Summary (PDF)
  • Best Practices Table (PDF)
  • Program Profiles
  • Description of Program Profile
  • Program Profile Report (PDF)

27
  • Next Steps
  • Need feedback from Beta Review Group and Project
    Advisory Committee (PAC)
  • Post review consideration, revisions made on
    January
  • Load final chapters onto website in January to
    be used for 2005-08 Portfolio planning
  • Further analysis of outcomes (/kWh saved)
Write a Comment
User Comments (0)
About PowerShow.com