Data Engineer - Quality

Position Overview

Penn Medicine is dedicated to providing exceptional patient care, conducting innovative research, and educating future leaders. As part of the Corporate entity and the PennDnA Data Management & Operations department, located at 3600 Civic Center Blvd. in Philadelphia, PA, the Senior Data Engineer: PennDnA plays a vital role in designing, developing, and maintaining robust data pipelines, ETL/ELT processes, and transformation solutions in a healthcare environment. This position typically involves 8‑hour days, mostly remote with occasional in‐person meetings.

Key Responsibilities

• Design and architect scalable data pipelines to ingest, process, and transform large volumes of healthcare data from electronic health records (EHR), clinical systems, research databases, and external feeds.

• Build and optimize ETL/ELT processes using cloud technologies such as Azure and Databricks, ensuring data quality, consistency, and integrity.

• Implement and maintain cloud-based data platforms and services, deploying solutions with tools like Azure SQL Database to support advanced analytics and machine learning.

• Enforce data governance policies and security measures (including HIPAA and GDPR compliance) through access controls, encryption, and auditing.

• Monitor performance of data pipelines and databases, troubleshooting issues and optimizing processes for improved efficiency and scalability.

• Collaborate with cross-functional teams to define project requirements and provide technical leadership and mentorship to junior engineers.

• Continuously improve workflows and stay updated with industry trends and best practices in data engineering and cloud technologies.

• Perform duties in accordance with Penn Medicine’s values, policies, and procedures, including other assigned tasks.

Required Qualifications

• Bachelor’s Degree in Computer Science, Information Systems, or a related field.

• 3+ years of experience in data engineering, database management, or related roles with a proven track record of executing complex projects independently.

• Proficiency with cloud technologies such as Azure and Databricks, with familiarity in AWS considered a plus.

• Credential: Epic Clarity Data Model must be completed within 6 months of the start date.

Benefits & Perks

• COMPENSATION: Comprehensive compensation package.

• BENEFITS: A comprehensive benefits program, including one of the finest prepaid tuition assistance programs in the region, to help you get healthy and stay healthy.

Position Overview

The Data Engineer: PennDnA is a key member of a dedicated team responsible for designing, developing, and maintaining data pipelines, ETL/ELT processes, and transformation solutions. This role emphasizes delivering high-quality work in a timely manner while ensuring data accuracy and robust performance.

Key Responsibilities

• Design, develop, and implement scalable data pipelines to ingest, process, and transform diverse datasets from EHRs, clinical systems, research databases, and external sources.

• Build and optimize ETL/ELT processes using cloud technologies such as AWS, Azure, and/or Databricks to ensure efficient and accurate data transformation.

• Perform data cleansing, transformation, and validation to maintain data quality and integrity while troubleshooting data-related issues.

• Document data pipelines, ETL/ELT workflows, and transformation processes to facilitate knowledge sharing and reproducibility.

• Collaborate with cross-functional teams to understand project requirements and provide regular updates to stakeholders.

• Continuously optimize ETL/ELT processes, data governance practices, and troubleshooting workflows.

• Perform duties in accordance with Penn Medicine’s values, policies, and procedures, including other assigned responsibilities.

Required Qualifications

• Bachelor’s Degree in Computer Science, Information Systems, or a related field, or 4+ years of related experience.

• 2+ years of experience in data engineering, demonstrating proficiency in programming to build robust data pipelines.

• Solid understanding of SDLC processes, including CI/CD approaches.

• Experience working with data from Electronic Health Records (EHRs) is preferred.

• Credential: Epic Clarity Data Model must be completed within 6 months of the start date.

Benefits & Perks

• COMPENSATION: Comprehensive compensation package.

• BENEFITS: A comprehensive benefits program featuring outstanding prepaid tuition assistance and health programs.