techcarrot FZ LLC

Data Engineer

techcarrot FZ LLC Hyderabad, Telangana, India

IT Services and IT Consulting · 201-500 employees

Oct 16
data-engineer Senior (5-10 yrs) Full-time India
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

The role involves developing and managing robust, scalable data pipelines using Azure Databricks and Spark. You will also consolidate project updates, define features, and collaborate with engineering teams to integrate prototypes into core products.

What they look for

Data Engineering Azure Databricks Spark Python Scala SQL ETL Pipelines Azure DevOps CI/CD Relational Databases Non-relational Databases Statistical Modeling JIRA Project Management Data Analysis

Requirements

Candidates must have 5-7 years of experience and a bachelor's degree in a relevant technical field. Proficiency in Azure cloud, ETL development, and strong analytical skills are required.

Full description

  • Collect progress updates from Squad on a regular basis.
  • Consolidate updates into weekly project status reports and share with the Squad Leads for their review.
  • You participate in early state design and feature definition activities.
  • Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
  • Responsible for creating reusable and scalable data pipelines.
  • You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  • You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
  • Develop and manage L3-level project plans with sufficient details for tasks, milestones, and dependencies

Requirements

Skills:

  • Knowledge and experience with relational and non-relational databases.
  • Strong analytic skills related to working with structured and unstructured datasets.
  • Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  • Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  • Strong proficiency in building JIRA dashboards based on tasks.
  • Strong experience in Project Management will be considered as an additional advantage.
  • Azure DevOps experience to deploy the data pipelines through CI/CD.

Qualifications and Experience:

  • Minimum 5-7 years of practical experience.
  • Bachelor’s degree in computer science, software engineering, information technology, or a related field.
  • Azure cloud stack in-production experience.

Similar roles