Data Engineer
techcarrot FZ LLC Hyderabad, Telangana, India
IT Services and IT Consulting · 201-500 employees
About the role
The role involves designing, architecting, and implementing robust data pipelines using the Microsoft and Databricks stack. You will collaborate with engineering teams to integrate prototypes into core intelligence products while ensuring data quality and business value.
What they look for
Requirements
Candidates must have at least 4-6 years of experience with Azure data platforms, including Databricks and Azure Data Factory. A bachelor's degree and strong proficiency in Python, PySpark, and SQL are required.
Full description
- Detailed reviewing and analyzing structured, semi-structured and
unstructured data sources for quality, completeness and business value.
- Design, architect, implement and test rapid prototypes that demonstrate value
of the data and present them to diverse audiences.
- Participate in early state design and feature definition activities.
- Responsible
for implementing robust data pipeline using Microsoft, Databricks Stack
- Responsible
for creating reusable and scalable data pipelines
- You
are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
Requirements
- Advanced
working knowledge and experience with relational and non-relational databases
- Experience
building and optimizing Azure Data data pipelines, architectures and data sets
- Strong
analytic skills related to working with unstructured datasets
- Strong
experience in Azure Data factory, Databricks, Eventhub, Python, PySpark , Azure Synapse and SQL, Azure DevOps
- Azure
DevOps experience to deploy the ADF pipelines.
- Create
end to end Azure databricks
- Minimum
4-6 years of experience
- Bachelor’s
degree
- Knowledge/Experience
with Azure cloud stack.
- Azure
Data Platform & Databricks exp should be more than 4 years
Similar roles
-
Senior Data Engineer, Vice President
State Street Boston, Massachusetts, United States · $110K–$208K/yr
-
AI Data Engineer II (Business Data Analyst II)
UKG Bengaluru, Karnataka, India
-
Databricks Data Engineer
Elevate Government Solutions Washington, District of Columbia, United States
-
Senior Data Engineer
Iris Software Noida, Uttar Pradesh, India
-
Data Engineer II, GenAI
Travelers Hartford, Connecticut, United States · $126K–$209K/yr
-
Data Engineer - BODS
Weekday AI Bengaluru, Karnataka, India