JobCubby JobCubby
Sign up
IBS Software

Data Engineer

IBS Software Kanayannur, Kerala, India

Software Development · 1,001-5,000 employees

Oct 09
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in distributed environments. Provide technical leadership and mentorship to data engineering teams while collaborating with stakeholders to deliver robust data solutions.

What they look for

Data Engineering Data Architecture Python Java Scala Snowflake AWS EMR AWS Glue ETL/ELT Data Modeling SQL NoSQL Docker Kubernetes Git Big Data

Requirements

Requires 5-10 years of experience with strong proficiency in Python, Java, or Scala and expertise in cloud-based data warehousing like Snowflake. Candidates must have a deep understanding of data engineering patterns, big data technologies, and modern development practices.

Full description

Job Title Lead Data Engineer

Location (s) Cochin

Years of Experience 5-10yrs

Job Description

Lead Data Engineer

What You’ll Do

  • Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in multi-cloud, multi-region, distributed environments.
  • Define and apply appropriate data engineering patterns and architectures based on business and technical requirements.
  • Drive technical investigations and resolve complex data, operational, and production issues.
  • Design scalable, flexible, efficient, and supportable solutions using appropriate technologies and disciplined development practices.
  • Provide technical leadership, guidance, and mentorship to data engineering teams.
  • Collaborate with architects, engineering teams, and business stakeholders to deliver robust data solutions.

Key Skills

  • Data Engineering & Architecture: Strong understanding of data engineering patterns and modern architectures such as Data Mesh, Data Fabric, Data Lake, and Data Warehouse.
  • Big Data & Cloud: Proficiency in Amazon EMR, AWS Glue, Data Lake, and technologies for processing large datasets.
  • Programming: Strong proficiency in Python, Java, or Scala, with solid OOP expertise.
  • Data Warehousing: Strong knowledge of data warehousing solutions, preferably Snowflake.
  • ETL/ELT & Orchestration: Hands-on experience with ETL/ELT pipelines and data orchestration tools.
  • Databases: Strong expertise in relational and NoSQL databases.
  • Data Modelling: Experience designing efficient OLAP and OLTP data models.
  • Streaming: Knowledge of streaming data technologies and architectures.
  • Version Control: Experience with Git and modern development practices.
  • Containers & Orchestration: Understanding of Docker and Kubernetes.
  • Data Security: Knowledge of encryption, access control, data privacy, and compliance.
  • Monitoring & Logging: Experience implementing monitoring, logging, alerting, and observability for data pipelines.

Role & Responsibilities

  • Lead Data Engineer
  • What You’ll Do
  • Lead the design, development, and maintenance of scalable ETL/ELT pipelines and data products in multi-cloud, multi-region, distributed environments.
  • Define and apply appropriate data engineering patterns and architectures based on business and technical requirements.
  • Drive technical investigations and resolve complex data, operational, and production issues.
  • Design scalable, flexible, efficient, and supportable solutions using appropriate technologies and disciplined development practices.
  • Provide technical leadership, guidance, and mentorship to data engineering teams.
  • Collaborate with architects, engineering teams, and business stakeholders to deliver robust data solutions.
  • Key Skills
  • Data Engineering & Architecture: Strong understanding of data engineering patterns and modern architectures such as Data Mesh, Data Fabric, Data Lake, and Data Warehouse.
  • Big Data & Cloud: Proficiency in Amazon EMR, AWS Glue, Data Lake, and technologies for processing large datasets.
  • Programming: Strong proficiency in Python, Java, or Scala, with solid OOP expertise.
  • Data Warehousing: Strong knowledge of data warehousing solutions, preferably Snowflake.
  • ETL/ELT & Orchestration: Hands-on experience with ETL/ELT pipelines and data orchestration tools.
  • Databases: Strong expertise in relational and NoSQL databases.
  • Data Modelling: Experience designing efficient OLAP and OLTP data models.
  • Streaming: Knowledge of streaming data technologies and architectures.
  • Version Control: Experience with Git and modern development practices.
  • Containers & Orchestration: Understanding of Docker and Kubernetes.
  • Data Security: Knowledge of encryption, access control, data privacy, and compliance.
  • Monitoring & Logging: Experience implementing monitoring, logging, alerting, and observability for data pipelines.

•

Technical Qualifications Python + AWS EMR + AWS Glue + Snowflake + ETL/ELT + Data Engineering + Data Architecture + Big Data + SQL

Similar roles