Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design, develop, and maintain Python-based data ingestion and ETL pipelines to support large-scale data migration. Collaborate with stakeholders to ensure data quality while monitoring and optimizing pipeline performance.
What they look for
Requirements
Requires 7+ years of experience in data engineering and expert-level Python programming skills. Candidates must have strong proficiency in SQL, ETL processes, and experience working with various enterprise databases and APIs.
Full description
Position Overview
We are seeking a highly experienced Senior Data Engineer with strong Python development skills to support a large-scale data migration initiative. This individual will build and maintain data ingestion pipelines that extract data from legacy and enterprise systems, transform it, and load it into SQL databases for downstream reporting and analytics.
The ideal candidate is a self-sufficient engineer who is comfortable working across APIs, databases, and ETL pipelines, with the ability to independently deliver high-quality solutions in a fast-paced environment.
Responsibilities
- Design, develop, and maintain Python-based data ingestion and ETL pipelines.
- Extract data from legacy/homegrown securities platforms, REST APIs, MySQL, PostgreSQL, Microsoft System Center, MDM tools, and similar enterprise systems.
- Develop Python scripts to transform, validate, and load data into MySQL and PostgreSQL databases.
- Support migration of existing data feeds into a new environment while ensuring data quality and reliability.
- Monitor, troubleshoot, and optimize data pipelines.
- Collaborate with engineering and business stakeholders to implement scalable data solutions.
- Document data flows, processes, and technical solutions.
Required Qualifications
- 7+ years of Data Engineering and Python development experience.
- Expert-level Python programming.
Experience working with Fabric.
- Strong ETL/data ingestion pipeline experience.
- Experience with APIs, MySQL, and PostgreSQL.
- Strong SQL skills.
- Experience using Git/GitHub.
- Securities and vulnerability type of data analysis/management experience
- Ability to work independently with minimal oversight.
- Strong analytical and troubleshooting skills.
We are committed to providing and promoting Equal Employment Opportunity and Affirmative Action to all employees and applicants following all local, state, and federal laws and regulations governing personnel activities. It is our policy to provide and promote equal & affirmative employment opportunity to all employees and applicants following all local, state, and federal laws and regulations governing personnel activities.
Similar roles
-
Principal Data Engineer
Microsoft United States · $143K–$304K/yr
-
Data Engineer II
Amazon Hyderabad, Telangana, India
-
SAP Data Engineer
Jobgether India
-
Data Engineer / Data & AI Engineer
Trulogik Baltimore County, Maryland, United States
-
Data Engineer (SQL+Snowflake)
Capgemini Aguascalientes City, Aguascalientes, Mexico
-
Data Engineer
Jobgether United States · $100K–$120K/yr