Health Sciences Research IT is seeking a Data Engineer to join our team serving the schools of the health sciences. The candidate will work with other team members and research groups to design pipelines for data ingestion/transformation and implement the designs and execute them. Sometimes this will be for ingesting thousands of files and others single large files in various formats. They will work with a large number of different research groups on many projects. The candidate will work with the teams to understand the data query requirements to optimize query performance with indices/views/functions etc. and be able to create analytic files based on specifications provided. Some research teams will require data warehouse development in creating models, data domains, and cubes and optimize for OLAP. The candidate must understand data warehousing concepts. The candidate will be responsible for DBA functions as well such as permissions, optimization, query optimization, performance monitoring, etc. Our team has a great mix of junior and experienced people and this position will mentor some of our more junior members.
The ideal candidate will have five or more years of experience working in a MS SQL Server environment in both writing data ingestion pipelines/jobs as well as database administration and be a strong mentor. The candidate must have strong communication and documentation skills. Data experience in Azure, AWS, Snowflake, and NoSQL as well as experience with EHR and claims data is preferred but not required.
Job Summary
Evaluates business requirements, creates advanced data ingestion processes and modeling, and provides extensive support for databases and relevant services. Designs new data architectures. Ensures data quality and delivery. Trains and assists lower-level data engineers; often serves as team lead. Supports data analysts and scientists with expert-level research and consulting.
Essential Functions
Design pipelines Data ingestion/transformation Work independently on multiple projects Work with groups to understand and document project requirements Data warehouse development: models, data domains, and cubes and optimize for OLAP All DBA functions Query and database optimization At least 5 years of experience with SQL server Mentor Junior members
Physical Effort
Little physical effort is required. Duties are primarily sedentary. May be required to move objects up to 25 pounds occasionally.
The University of Pittsburgh is committed to championing all aspects of diversity, equity, inclusion, and accessibility within our community. This commitment is a fundamental value of the University and is crucial in helping us advance our mission, which includes attracting and retaining diverse workforces. We will continue to create and maintain an environment that allows individuals to discover, belong, contribute, and grow, while honoring the experiences, perspectives, and unique identities of all.
The University of Pittsburgh is an Affirmative Action/Equal Opportunity Employer and values equality of opportunity, human dignity and diversity. EOE, including disability/vets.
Will this position accept substitution in lieu of education or experience: Combination of education and relevant experience will be considered in lieu of education and/ or experience requirement.
Work Schedule: Monday - Friday, 8:30 a.m. - 5:00 p.m.
Work Arrangement: Monday - Friday, 8:30 a.m. - 5:00 p.m.
Hiring Range: To be determined based on qualifications
Relocation_Offered: No
Visa Sponsorship Provided: No
Background Check: For position finalists, employment with the University will require successful completion of a background check
