Learning from Machine Learning
Moderator: Anna Kelly, Power TakeOff

• The Advanced M&V Proving Ground: It’s Working and It’s Yielding Great Results
  Speaker: Abigail Hotaling, VEIC
• Opening the Black Box: Explainable AI for Greater Energy Savings
  Speaker: Abiodun Iwayemi, VEIC
• Harnessing Machine Learning for Predicting Consumption
  Speaker: Jessica Thompson, Tetra Tech

Managing Demand
Moderator: Jes Rivas, ILLUME Advising

• Evaluating Utility EV Managed Charging Programs
  Speaker: Kristina Kelly, DNV
• Demanding the Most from DR: How Evaluation Can Inform Residential Demand Response Optimization
  Speaker: Alexandra Horne, ADM Associates
• Seeing the (short-term) Future: Assessment of Demand Response M&V Baseline Methods
  Speaker: Eliot Crowe, Lawrence Berkeley National Laboratory

Toward More Equitable Programs: Insights at the Vanguard of Program Participation
Moderator: Michael Noreika, NMR Group

• Quantitative Measurement of Advances in Energy Equity: Application of Distributional Weighting
  Speaker: Cindy Manson, IEc
• Beyond Awareness: An In-Depth Look at Participation Barriers for the Hardest-to-Reach
  Speaker: Laura Schauer, ILLUME Advising
• Improving Equity in Energy Efficiency: Identifying Priority Areas for Investment
  Speaker: Riley Hastings, Eversource Energy

GHG Goals and Decarbonization – How do we get there? How do we measure it?
Moderator: Lauren Gage, Apex Analytics

• Leveraging Evaluated Energy Efficiency Savings for GHG Reduction
  Speaker: Robert Neumann, Guidehouse
• Climate Crisis Checkmate: A Strategy for Rapidly Aligning Utility Programs Around 2050 Performance Outcomes
  Speaker: Faith DeBolt, SBW Consulting
• To BE or not to BE? Market Potential and Feasibility of Commercial Building Electrification (BE)
  Speaker: Sarah Monohon, Evergreen Economics
• Did You Hear Energy Intensity was Flirting with Carbon Intensity?
  Speaker: Samuel Manning, NMR Group

High-Resolution Data for Residential Program Success
Moderator: Carmen Best, Recurve

• The Smart Home Data Stream: Opportunities and Challenges in Device-Level Energy Monitoring
  Speaker: Amalia Hicks, Cadmus Group
• NMEC Program Design with Missing Data,  Zero Values, and Differing Meter Resolutions
  Speaker: Cory Read, EcoMetric
• The Wild West of Evaluation? Comparing Methods of Outlier Detection in Consumption Analyses
  Speaker: Jonathan Hoechst, Tetra Tech

Evolving Evaluations to Optimize Program Insights
Moderator: Victoria Engel-Fowles, NYSERDA

• Evaluation of Energy Efficiency Programs by the States: Common Purposes, Differing Approaches
  Speaker: Dan York, ACEEE
• Prioritizing Evaluation Resources to Support a Clean and Equitable Future
  Speaker: Hannah Justus, TRC 
• Evaluation Engagement Leads to Greater Certainty and Savings
  Speaker: Jane Colby, Apex Analytics and Rohith Mannam, Nicor Gas

Future Implications for EE Markets & Evaluations
Moderator: Sepi Shahinfard, Quantum Energy Analytics

• Virtual Visions: The Future of Field Work
  Speaker: Joel Zahlan, Cadmus Group
• BAS Fiddling: Learning How Customers Use and Replace EMS/BAS Systems
  Speaker: Christopher Dyson, DNV
• Commercial Lighting: Market Actor Insights on a Dynamic Market
  Speaker: Lisa Obear, ILLUME Advising

Research and Evaluation Insights for Light-, Medium-, and Heavy-Duty Electric Vehicle Programs
Moderator: Jenna McDavid (Canseco), Kimley-Horn

• Evaluating the Cost-Effectiveness of Greenhouse Gas Emission Reductions Associated with California’s Statewide Electric Vehicle Rebate Program in 2020
  Speaker: Nicholas Pallonetti, Center for Sustainable Energy (CSE)
• Learnings from an In-depth Portfolio-Level Evaluation of EV Programs
  Speaker: Gomathi Sadhasivan, DNV
• It’s Electrifying: Insights about Steering Medium- and Heavy-Duty Fleets toward Electric Vehicles
  Speaker: Ingo Bensch, Evergreen Economics

PVs & Batteries – Resilience, Costs, Benefits, Tariffs and Carbon Impacts
Moderator: Jake Millette, Michaels Energy

• Looking Behind-the-Meter – How do Households with Solar + Storage Bridge the Gap Throughout Public Safety Power Shutoff (PSPS) Events
  Speaker: Brian McAuley, Verdant Associates
• M&V Applied to a Distributed and Integrated Grid: Can Batteries be a Customer and Utility Financial and GHG Win-Win?
  Speaker: Chelsea Liddell, DNV
• Are California’s Net Metering Tariffs Fair, and How Can We Avoid a Cost-shift?
  Speaker: William Marin, Verdant Associates

Non-Energy Impacts Come of Age, Finally!
Moderator: Jane Peters, Jane S. Peters Advising

• I Need to Know: Understanding Non-Energy Impacts for C&I Programs
  Speaker: David Barclay, DNV
• Seeing the Big Picture – Understanding Co-Benefits Implementers Gain from Local Government Partnerships
  Speaker: Jenny Hughes, Evergreen Economics
• Save Energy, Breathe Better: Quantifying the Societal Health Benefits of Improving Air Quality Through Energy Efficiency
  Speaker: Aaiysha Khursheed, Opinion Dynamics
• New Results and Uses for Measure-Based NEBs/NEIs:  Smart Thermostats, and Next-Gen LED Bulbs
  Speaker: Lisa Skumatz, Skumatz Economic Research Associates

Equity: Measuring and Identifying Gaps in Service
Moderator: Bob Wirtshafter, Wirtshafter Associates

• Information or Obfuscation: What do Census Tract Demographics Tell Us about Program Participants?
  Speaker: Ryan Bliss, ADM Associates
• Using Exploratory Factor Analysis to Geotarget Personas of Interest
  Speaker: Rich Crowley, DNV
• Integrating Community Characteristics into Distribution Resource Planning
  Speaker: Fred Schaefer, Cadeo

PANEL: EM&V for Electric Vehicles: Deciding When to Travel the Beaten Path and When to Pave New Roads
Moderator: Hilary Polis, Opinion Dynamics

Panelists:
Kara Crohn, CSE
Paula Gruendling, CPUC
Aakanksha Dubey, National Grid

Lightning Round: Developing Timely Residential Program Methods and Insights
Moderator: Hanna Lee, Bonneville Power Administration

• An M&V Strategy for Evaluating Level 2 Electric Vehicle Chargers
  Speaker: Michael Nicholson, ADM Associates
• Residential Solar and Changes in Consumption of Electricity
  Speaker: Collin Elliot, Verdant Associates
• Energy Efficiency is a Non-Wires Solution and Evaluators can Help
  Speaker: Curtis Robbins, ADM Associates
• Why Buy? How Longitudinal Survey Data Tracks Appliance Purchase Motivations, Trends, and More
  Speaker: Kayla Kirksey, Evergreen Economics
• Evaluating Workforce Education and Training Programs in California in 2020
  Speaker: Jordan Christenson, California Public Utilities Commission

Codes, Standards, and TRMs
Moderator: Nick Minderman, Xcel Energy

• Electrifying TRMs at the Convergence of Decarbonization Policy, Program Delivery, and Evaluation
  Speaker: Kevin Ketchman, Opinion Dynamics
• A New Frontier: Capturing Savings from Code Advancement
  Speaker: Michael Noreika, NMR
• How Should Energy Efficiency Program Savings be Credited in Jurisdictions with Building Performance Standards?
  Speaker: Steven Nadel, ACEEE

Resiliency and Investments in the Modern Grid
Moderator: Paula Gruendling, CPUC

• Survival of Behind the Meter Generation Projects
  Speaker: Ethan Barquest, Verdant Associates
• What is the Residential Value of Resiliency? The Answer May Lie in the Shadows
  Speaker: Jean Shelton, Verdant Associates
• An Evaluation of a Smart Grid Program
  Speaker: Daniel Kaufman, IEc
• Estimating the Economic Resiliency Benefits of Community Microgrids
  Speaker: Maura Flight, IEc

Residential Heat Pumps: Costs, Emissions, Savings… and Barriers
Moderator: Rob Kasman, PG&E

• Heat Pump Water Heaters in Every Home? Forecasting the Costs and Emissions Impacts for Residential Customers and Long-Term Resource Planning Impacts
  Speaker: Byron Boyle, Xcel Energy
• Heat Pump Evaluation: Weighing Evolving Methods for an Evolving Technology
  Speakers: Patrick Hewlett, DNV and Elizabeth Boulton, NYSERDA 
• What is the Final Bill for a Heat Pump Residential Retrofit Installation? A Delphi Approach to Uncovering the Costs of Electrification’s Favorite Technology
  Speaker: Jen Loomis, Opinion Dynamics

The Next Evolution of Gas Programs: Developments in Program Design and Measurement
Moderator: Jon Maxwell, DNV

• Renewable Natural Gas – hope or hype? Initial research into cost-effectiveness and market barriers
  Speaker: Ben Cheah, Verdant Associates
• The Midstream Gas Sasquatch – Elusive or Illusive?
  Speaker: Jenna Bagnall-Reilly, TRC
• Invisible No Longer: Cost-Effective Methods for Determining Gas End-Use Load Shapes
  Speaker: Ryan Powanda, Guidehouse

Soft Costs and Hard Target Markets: Understanding the Contractor Supply Chain
Moderator: Ralph Prahl, Prahl & Associates

• Contractor Needs for Supporting Building Electrification in the State of California
  Speaker: Donna Whitsett, TRC
• Renovation Nation: Granite Counters, Stainless Appliances, and … Thick Insulation
  Speaker: Tim Steis, NMR Group
• Hard Work via Soft Costs: Achieving Ambitious Energy Efficiency Goals
  Speaker: Patricia Gonzales, NYSERDA

Equity: Insights From Hard-to-Reach Customers
Moderator: Danielle Walker, U.S. Department of Energy

• Listen Up: Renewable Energy Program Design for ALL
  Speaker: Jeana Swedenburg, Cadmus Group
• We can have the cake and eat it too: A case study of how financing can bring clean energy projects to disadvantaged communities
  Speaker: Megan Campbell, Opinion Dynamics
• What Happens to a Light Bulb After Being Distributed Through a Food Bank?
  Speaker: Ariel Crowley, Guidehouse

It’s Electric! Insights into our Customers’ Electrification Journeys
Moderator: Sharyn Barata, Opinion Dynamics

• Apples to Apples Comparison of Identical All-Electric and Dual-Fuel Homes: The Promise of All-Electric Homes as an Affordable Decarbonization Strategy
  Speaker: TBD, Cadmus Group
• Magnitude Matters: Re-evaluating Traditional Cost-effectiveness Practices for Electrification
  Speaker: Jayden Wilson, Opinion Dynamics
• Are You Ready for Plug and Play? Insights from Holistic Electrification Program Evaluation
  Speaker: Jennifer McWilliams, DNV
• In with Induction? Understanding Customer Experiences and Opinions on Induction Cooktops
  Speaker: Martha Wudka, Evergreen Economics

Adapting Evaluation Methods in a Changing Energy Efficiency Landscape
Moderator: Jaclyn Rambarran, Eversource Energy

• How Do We Light a Way Forward? Refined / Streamlined Shelf-Stocking Study Approach for Actionable Recommendations
  Speaker: Seth Craigo-Snell, SCS ANALYTICS
• Towards More Robust EUI Baselines for Non-residential New Construction
  Speaker: Yogesh Patil, NMR Group
• Seeking Answers: Strategies for Interpreting Consumption Analyses
  Speaker: Kathryn Parlin, West Hill Energy and Computing

Residential Appliances: Methods and Results for Medical Devices, Equipment Label Development, and Laundry Appliances
Moderator: Ingo Bensch, Evergreen Economics

• Hidden Health Care Costs: Energy Demand for Home Medical Equipment
  Speaker: Safdar Chaudhry, ADM Associates
• Accelerating Uptake of Energy Efficient Appliances in Kenya through Consumer Awareness Campaigns
  Speaker: Alexia Ross, CLASP
• The Spin Zone: Unraveling Clothes Washer and Dryer Usage Behavior from Energy Monitoring Data
  Speaker: Kevin Price and Sarah Monohon, Evergreen Economics

Reaching Out: Methods for Equity Research
Moderator: Beth Delahaij, National Grid

• Virtual Audits and Other Novel Alternatives to On-site Data Collection in Hard-to-Reach Communities
  Speaker: Rupam Singla, TRC
• Persistence of Low-Income Weatherization Savings
  Speaker: Andy Lick, Slipstream
• Providing Avenues to Electric Vehicle Ownership for Ride-Hail Drivers
  Speaker: Zac Hathaway, Opinion Dynamics

PANEL: Energy Efficiency as the Least Cost Decarbonization Resource
Moderator: Russell Meyer, Opower

Panelists:
Steve Nadel, ACEEE
Kristin Munsch, Com Ed
Paul Hibbard, Analysis Group
Steve Menges, National Grid

DR Advances with Technology
Moderator: Greg Wikler, CEDMC

• Water Heater Demand Response: Comparing Full Replacement and After-Market Controllers
  Speaker: Eileen Hannigan, ILLUME Advising
• Can Residential Water Heater Provide Reliable and Predictable Demand Response Grid Services?
  Speaker: James Stewart, Cadmus Group
• Bundle of M&V Joy? M&V of Bundled DR Smart Thermostats, Direct Install, and Assessments Programs
  Speaker: Noah Fraser, ADM Associates

PANEL: At the Intersection of Equity and Energy and Infrastructure
Moderator: Anne Dougherty, ILLUME Advising

Panelists:
Brandy Brown, Walker-Miller
Knox Cameron, DTE Energy
Dan Rubado, Energy Trust Oregon

Energy Related Consumer Behavior: Insights for Promoting Behavioral Change
Moderator: Bill Saxonis, Rockefeller College of Public Affairs and Policy

• The R.E.D. Carpet of Thermostat Optimization
  Speaker: Jesse Smith, Demand Side Analytics
• Something for Nothing: The Who and the How Much of Bill Salience Effects on Energy Consumption
  Speaker: Brett Close and Dereck Dinsmoor, TRC, and Galib Rustamov, SCE
• How to Harness People as an Intervention and Evaluate Such a Program
  Speaker: Jake Fuller, EcoMetric and Mersiha McClaren, DNV

Demand Response Evaluation in Theory …and Emerging Practice
Moderator: Jeremy Newberger, Guidehouse

• The Myth of the “Ideal” DR Evaluation Methodology
  Speaker: Vijay Gopalakrishnan, DNV
  
• A Tale of the Tape: A Comparison of Curtailment Impacts and Value Streams of Various Technologies in the C&I Sector
  Speaker: Jon Maxwell, DNV
• Measuring Gas Demand Response Program Impacts: A Pilot Evaluation Using Thermostat Telemetry Data
  Speaker: Emily Kremser, Cadmus Group

Advances in Methods Using AMI and Virtual Site Visits
Moderator: Brian Arthur Smith, PG&E

• The Best of Both Worlds: Statistics and Engineering Working Toward a Good End (Use)
  Speaker: Lullit Getachew, DNV
• Performing High Rigor Impact Evaluations Cost-Effectively in the COVID-19 Era
  Speaker: Sharan Suresh, DNV
• Self-Reported Virtual or Third-Party Onsite Impact Verification: A Case Study Test of Feasibility, Logistics, and Accuracy of Findings
  Speaker: Shannon Dorato, Guidehouse and Denise Allard, DTE Energy 

PANEL: Going Out in Flames: Rapid Fire Hot Topics
Moderator: Lauren Gage, Apex Analytics

Panelists:
Matt Nelson, Massachusetts Department of Public Utilities
Nick Minderman, Xcel Energy

Heat Pumps and Heat Pump Water Heaters
Moderator: Sarah Castor, Energy Trust of Oregon

• Learning from Those Who Came Before: How Utility Incentive Programs Can Alleviate Supply Chain Friction for Heat Pump Water Heaters
  Speaker: Jen Loomis, Opinion Dynamics
• Don’t Freeze! The Heating Electrification Train is Barreling Towards Us
  Speaker: Justin Spencer, Apex Analytics
• Take a Load Off Showering: Heat Pump Water Heaters Can Help
  Speaker: Rachel Murray, DNV

PANEL: The Inflation Reduction Act: Implementing the HOMES Rebate Program
Moderator: Michael Li and Danielle Walker, U.S. Department of Energy

The Inflation Reduction Act includes a provision known as HOMES (Section 50121) providing $4.3 billion for comprehensive home energy retrofits to single-family homeowners, multi-family building owners, and LMI-occupied properties. The program is structured to provide funding to states for modeled energy savings across three tiers: 15-20 percent, 20-35 percent, and greater than 35 percent savings on kWh or kWh-equivalent basis. States are required to submit a plan to DOE on procedures “for determining the reductions in home energy use resulting from the implementation of a home energy efficiency retrofit” and ” to use open-source advanced measurement and verification software, as approved by the Secretary, for determining and documenting the monthly and hourly (if available) weather-normalized energy use of a home before and after the implementation of a home energy efficiency retrofit, for purposes of measured performance home rebates”

This session will provide a brief overview of the provision and initial thoughts from the panelists, followed by a deeper dive into audience discussion, ideas, and feedback. Discussion topics may include lessons learned from similar programs, opportunities for coordination between states and utilities, and key considerations for program development and evaluation.

Presentation

Panelists:
Mimi Goldberg, DNV
Nate Kinsey, Sealed
Bing Tso, SBW
Brian Smith, PG&E