Senior Data Engineer, C&I
EnergyHubAbout the Opportunity
The Commercial & Industrial Team facilitates the management of our non-residential demand response programs, where businesses such as factories, offices and retail sites reduce their energy use when the grid needs it. These programs cover some of our largest customers and programs by flexible grid capacity. Our team plays a critical role in ensuring the scalability and flexibility of our future by creating a first class platform for our clients. This is an opportunity to join a highly energized team of engineers eager to define and develop key concepts, solve complex challenges with real-world constraints and have a positive impact on our climate future.
Main Responsibilities: What you’ll do
- Lead the design and delivery of large, loosely scoped data engineering projects on the C&I measurement and verification (M&V) platform. That pipeline takes raw meter data through baselines, event performance and payments to the reports our operations teams and partners rely on
- Break complex, ambiguous problems into well-scoped tracks of work that your teammates can pick up. Roadmap them with reliable estimates of time, effort and risk
- Help tackle tech debt and collaborate to drive the technical direction for the team’s Snowflake and dbt codebase: layering and model design, incremental processing, Python in the warehouse, and the orchestration and CI that support them
- Own the health of our production pipelines. Strengthen data tests, monitoring and alerting, troubleshoot and resolve incidents (including on-call support), and cut tech debt and build times along the way
- Make sure payment and performance outputs are accurate and explainable, working closely with product, operations and customer-facing teams to turn program rules into correct, maintainable logic
- Make the team better through thoughtful code review, documentation and pairing. Teach what you know, learn from teammates at every level, and help the team’s practices improve
- Tech stack: Snowflake, dbt, Python, SQL, AWS (S3), MongoDB, GitHub Actions
- Other duties as assigned
Required Skills and Experience: What you need
- First and foremost, you sincerely love data and all the things it can enable and empower
- Professional experience designing, building and operating production data pipelines, with a track record of leading projects from ambiguous idea to successful release
- Advanced SQL, with strong dbt experience in a layered (staging, intermediate, marts) project. That includes incremental models that stay correct when data arrives late, changes or is deleted, and backfills you can run with confidence
- A track record of making slow or expensive pipelines faster and cheaper on Snowflake or a comparable cloud warehouse, by reading query profiles, choosing the right materializations
- Strong data modeling: choosing the right grain, keeping the history of data and configuration that change over time, and producing results that can be reproduced and explained months later
- Strong Python for data work, including pandas and numpy
- Experience with time-series or event-based data, such as meter or sensor readings, and with the data quality issues that come with it (gaps, duplicates, late arrivals, time zones)
- Hands-on experience with automated testing (for example dbt unit and data tests, pytest), CI/CD, and monitoring and alerting for pipeline health. You use them to change existing pipelines in small, safe steps and show that outputs only changed where you meant them to
- Experience choosing among architectural approaches and tradeoffs, with strong, well-founded opinions you hold with an open mind
- Clear written and verbal communication: you document larger initiatives, explain technical concepts to technical and non-technical audiences, and give and receive feedback with empathy
- A history of taking ownership of problems that have no clear owner. You enjoy pairing, and you teach and learn from teammates at every level
- Warmth and welcome for your collaborators and colleagues, with an urge to help them succeed
Preferred Skills and Experience: Nice-to-haves
- Snowflake depth beyond SQL: Python UDTFs and stored procedures, streams and tasks, clustering, warehouse sizing and cost management
- dbt beyond the basics: custom macros and materializations, cross-project refs and jobs-as-code
- Experience with semi-structured sources such as MongoDB and file formats like CSV, JSON and Parquet
- Background in energy, demand response, utilities or other settings where data drives billing or payments
- Experience leading a migration, or a long-running initiative that spans teams
Why work for EnergyHub?
- Collaborate with outstanding people: Our employees work hard, do great work, and enjoy collaborating and learning from each other.
- Make an immediate impact: New employees can expect to be given real responsibility for bringing new technologies to the marketplace. You are empowered to perform as soon as you join the team!
- Gain well rounded experience: EnergyHub offers a diverse and dynamic environment where you will get the chance to work directly with executives and develop expertise across multiple areas of the business.
- Work with the latest technologies: You'll gain exposure to a broad spectrum of IoT, SaaS and machine learning obstacles, including distributed fault-tolerance, device control optimization, and process modeling to support scalable interaction with disparate downstream APIs.
- Be part of something important: Help create the future of how energy is produced and consumed. Make a positive impact on our climate.
About EnergyHub
EnergyHub empowers utilities and their customers to create a clean, distributed energy future. We help consumers turn their smart thermostats, EVs, batteries, and other products into virtual power plants that keep the grid stable and enable higher penetration of solar and wind power.
To learn more, visit energyhub.com.
Company Benefits
EnergyHub offers a generous benefits package including 100% paid medical for employees and a 401(k) with employer match. We offer a casual environment, the flexibility to set your own schedule, a fully stocked fridge and pantry, free Citi Bike membership, secure bike rack, gym subsidy, paid parental leave, and an education assistance program.
EnergyHub is an Equal Opportunity Employer
EOE, Including Disability/Vets. Reasonable accommodations are available for individuals with disabilities throughout the application process. If you are a person with a disability needing assistance with the application process, please contact [email protected].
In connection with your application, we collect information that identifies, reasonably relates to or describes you ("Personal Information"). The categories of Personal Information that we may collect include your name, government-issued identification number(s), email address, mailing address, other contact information, emergency contact information, employment history, educational history, and demographic information. We collect and use those categories of Personal Information about you for human resources and other business management purposes, including identifying and evaluating you as a candidate for potential or future employment or future positions, recordkeeping in relation to recruiting and hiring, conducting analytics, and ensuring compliance with applicable legal requirements and Company policies. By submitting your application, you acknowledge that we may retain some of the personal data that you provide in your application for our internal operations such as managing our recruitment system and ensuring that we comply with labor laws and regulations even after we have made our employment decision.
Notice To Third Party Agencies:
EnergyHub understands the value of professional recruiting services. However, we are not accepting resumes from recruiters or employment agencies for this position. In the event we receive a resume or candidate referral for this position from a third-party recruiter or agency without a previously signed agreement, we reserve the right to pursue and hire those candidate(s) without any financial obligation to you.
The base salary range of this opportunity is listed below and is determined within a range based on factors including qualifications, location and experience. This allows opportunity for growth and development within the role. The base salary offered is part of a total compensation package.