Data Engineer - IT
Guardian Life Insurance Gurgaon, Haryana, India
Financial Services · 5,001-10,000 employees
Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.
About the role
Design and build scalable data pipelines for structured and semi-structured data using Databricks and Spark. Implement data warehousing solutions and ensure high performance through optimized SQL and Spark configurations.
What they look for
Requirements
Requires strong hands-on experience with Databricks, PySpark, and advanced SQL techniques. Candidates should have a solid understanding of ETL concepts, data modeling, and version control practices.
Full description
Job Description:
Required Skills & Experience Strong hands-on experience in:
- Databricks (Lakehouse platform, notebooks, jobs, clusters)
- PySpark / Apache Spark
- Advanced SQL (joins, window functions, performance tuning)
- Solid understanding of ETL concepts, data warehousing, and data modeling
- Experience building scalable data pipelines for structured and semi-structured data
- Familiarity with data lake / delta lake architecture
- Good understanding of performance optimization techniques in Spark and SQL
- Experience with version control (Git) and deployment practices
- Strong problem-solving and analytical skills
Good to Have
- Experience with cloud platforms (AWS)
- Exposure to CI/CD pipelines (Jenkins)
- Knowledge of Delta Lake, Unity Catalog, or similar governance tools
- Understanding of data quality frameworks / monitoring tools
- Experience working in Agile / Scrum teams
Location:
This position can be based in any of the following locations:
Chennai, GurgaonCurrent Guardian Colleagues: Please apply through the internal Jobs Hub in Workday
Similar roles
-
Data Engineer-Business Intelligence
IBM Baton Rouge, Louisiana, United States
-
Senior Data Engineer
Anthro Alameda, California, United States · $116K–$145K/yr
-
Junior Data Engineer
Sentinel Group Wakefield, Massachusetts, United States · $85K–$93K/yr
-
Data Engineer
Sentinel Group Wakefield, Massachusetts, United States · $106K–$113K/yr
-
Senior Data Engineer
CONAGRA Chicago, Illinois, United States · $82K–$120K/yr
-
Data Engineer
Charles Schwab Inc. Austin, Texas, United States · $125K–$140K/yr