JobCubby JobCubby
Sign up
INFO ORIGIN INC

Azure Databricks / Synapse Data Engineer-Hybrid- Indianapolis IN

INFO ORIGIN INC Indianapolis, Indiana, United States · $83K–$89K/yr

Software Development · 201-500 employees

3 h ago
data-engineer Mid (2-5 yrs) Full-time United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Develop and optimize data pipelines, lakehouse solutions, and data warehouse workloads using Azure Databricks and Synapse Analytics. Ensure secure data governance and compliance with HIPAA while managing batch and streaming data integration.

What they look for

Azure Databricks Azure Synapse Analytics PySpark Spark SQL Delta Lake Azure Data Factory Data Modeling Medallion Architecture Unity Catalog CI/CD SQL Data Governance Azure DevOps Performance Tuning Streaming Data Integration Entra ID

Requirements

Requires 4+ years of hands-on data engineering experience with proficiency in PySpark, Spark SQL, and Delta Lake. Candidates should have experience with Azure cloud services, data modeling, and CI/CD practices.

Full description

Azure Databricks / Synapse Data Engineer

Job Summary

Seeking an experienced Data Engineer to develop and optimize data pipelines, lakehouse solutions, and data warehouse workloads using Azure Databricks and Azure Synapse Analytics. The role focuses on batch and streaming data integration, data modeling, orchestration, performance tuning, and secure data governance for sensitive health data in compliance with HIPAA and agency policies.

Key Responsibilities

  • Build and maintain batch and streaming pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake.
  • Implement medallion architecture (Bronze/Silver/Gold) and incremental data ingestion.
  • Develop and optimize data models, SQL queries, and warehouse workloads in Azure Synapse Analytics.
  • Orchestrate workflows using Azure Data Factory and Databricks Workflows.
  • Implement data governance, security, and access controls using Unity Catalog, Entra ID, and Key Vault.
  • Manage CI/CD, source control, monitoring, troubleshooting, and pipeline performance optimization.
  • Collaborate with architects, analysts, data scientists, and project managers on requirements and technical solutions.
  • Maintain technical documentation and support data quality, governance, and operational improvements.

Required Skills & Qualifications

  • 4+ years of relevant hands-on data engineering experience or equivalent education and experience.
  • Strong experience with PySpark, Spark SQL, Delta Lake, Databricks notebooks, and medallion architecture.
  • Hands-on experience with Unity Catalog, Delta Lake transactions, schema evolution, and Spark performance tuning.
  • Experience with Azure Synapse Analytics, MPP architecture, dimensional modeling, star schemas, SCD Type 1/2, and SQL optimization.
  • Proficiency in Azure Data Factory, Databricks Workflows, ADLS Gen2, and pipeline orchestration.
  • Experience with Azure DevOps/GitHub, CI/CD, managed identities, security controls, and Azure monitoring tools.
  • Knowledge of Microsoft lakehouse patterns and Synapse–Databricks integration.
  • Strong written and verbal communication skills.

Preferred Qualifications

  • Databricks Certified Data Engineer Associate or Professional.
  • Microsoft Certified: Azure Data Engineer Associate (DP-203), if already held.
  • Experience with Power BI connectivity to Synapse, including Import vs. DirectQuery and dashboard performance optimization.

Similar roles