National Grid Principal Data Engineer in Waltham, Massachusetts
National Grid is hiring a Principal Data Engineer for our IT group in Waltham, MA. This role can also be based out of New York, NY.
Every day we deliver safe and secure energy to homes, communities, and businesses. We are there when people need us the most. We connect people to the energy they need for the lives they live. The pace of change in society and our industry is accelerating and our expertise and track record puts us in an unparalleled position to shape the sustainable future of our industry.
To be successful we must anticipate the needs of our customers, reducing the cost of energy delivery today and pioneering the flexible energy systems of tomorrow. This requires us to deliver on our promises and always look for new opportunities to grow, both ourselves and our business.
We are looking for a hands-on, detail oriented and highly motivated Principal Data Engineer to help create data backed insights that will drive selection improvement. The candidate should be comfortable interfacing with technology systems and be able to analyze data and gather actionable conclusions. Operating in a rapidly changing environment will require the candidate to be adept at dealing with ambiguous, new and challenging situations. The candidate will be comfortable in executing repeatable processes.
Develop streaming data pipelines from IoT/Timeseries data.
Develop data integration and ETL components by coding utilities, responding to user questions, and resolving problems
Maintain overall performance of components involved in Data Integration through ETL tools like Informatica by identifying and resolving production and application development problems
Work with Data Architects to turn conceptual data models into logical and physical models using best practices
Implement and document data architectures and data models consistent with business and technical requirements
Create, support and optimize data models (CDM, LDM and PDM) and find creative solutions for a variety of challenges
Develop test scenarios and test cases in collaboration with our central test team along with acceptance criteria
Identify and drive opportunities to reuse data models in new environments
Communicate with both technical and non-technical staff, stakeholders, end-users, and vendors
Work with enterprise architects, solution architects, data architects, data scientists, and business SMEs and assist them on any data questions
Provide support in assessing data quality through data validation exercise
Supervisory/Interpersonal- Experience Required
Able to clearly communicate technical concepts to both technical and non-technical audiences.
Demonstrated ability to interface effectively and collaborate with third party suppliers/vendors.
Bachelor's degree in Computer Science or related field strongly preferred
5+ years of consulting or client service delivery experience on Azure
7+ years of experience developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions
Azure Native services and Hadoop
Data migration/data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db
DevSecOps and CI/CD deployments
Cloud migration methodologies and processes including tools like Azure Data Factory, Data Migration Service, SSIS Event Hub, Kafka
Data models – 3NF, Kimball, Data Vault 2.0
Snowflake Cloud DWH – Design Patterns, Data Loading Patterns, CDC
Big Data File Formats and compression techniques
Developer tools - Azure DevOps, Visual Studio Team Server, GitLabs, Jenkins, Ansible
IoT, event-driven, microservices, Containers/Kubernetes in the cloud
This position has a career path which provides for advancement opportunities within and across bands as you develop and evolve in the position; gaining experience, expertise and acquiring and applying technical skills. Internal candidates will be assessed and provided offers against the minimum qualifications of this role and their individual experience.
National Grid is an equal opportunity employer that values a broad diversity of talent, knowledge, experience and expertise. We foster a culture of inclusion that drives employee engagement to deliver superior performance to the communities we serve. National Grid is proud to be an affirmative action employer. We encourage minorities, women, individuals with disabilities and protected veterans to join the National Grid team.