JobCubby JobCubby
Sign up
B

Senior Data Engineer

BBI Riyadh, Riyadh Region, Saudi Arabia

Manufacturing · 201-500 employees

Jun 03
data-engineer Senior (5-10 yrs) Full-time Saudi Arabia
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

Design, develop, and maintain scalable data pipelines and orchestration flows for batch and near-real-time data processing. Optimize data systems for performance while implementing robust data models and schemas to support business intelligence needs.

What they look for

Python SQL Airflow Airbyte DBT Hadoop Spark Hive Kafka PostgreSQL MinIO Data Modeling ETL Data Warehousing UNIX Big Data

Requirements

Requires a Bachelor's or Master's degree in Computer Science or a related field and at least 5 years of experience as a Data Engineer. Candidates must possess strong Python and SQL skills, along with proficiency in big data frameworks like Spark, Hadoop, and Airflow.

Full description

  • Design, develop, and maintain scalable data pipelines for the efficient collection, storage, and processing of large datasets.
  • Develops and design best practices around data collection and maintain orchestration of data flows, for batch, near-real time data.
  • Participates in evaluation and deployment of big data tools, relevant to the development.
  • Ability to identify different platforms, techniques, and methodology used in big data platforms, and demonstrate for various system in the organization.
  • Optimize and tune data systems for performance and reliability.
  • Develop and implement data models and schemas to support business intelligence and analytics needs.
  • Monitor and troubleshoot data pipelines to ensure smooth and efficient operation.
  • Stay up-to-date with the latest advancements in data engineering and incorporate them into our data infrastructure.
  • Document data engineering architectures and follow best practices.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
  • 5+ years of experience as a Data Engineer or similar role.
  • Strong programming skills in Python.
  • Experience with UNIX system administration using command line.
  • Experience with data processing frameworks such as Airflow, Airbyte, DBT, Hadoop, Spark, Hive, and Kafka, Proficiency in SQL and experience with relational databases.
  • Knowledge of data modeling, ETL processes, and data warehousing solutions.
  • Knowledge of Structuring data in various schemas suitable for a data lake, warehouse, or marts.
  • Experience in implementing scalable, reliable, and efficient data storage solutions with PostgreSQL, MinIO.
  • Experience in enhancing the performance of big data applications, including optimizing system operations.

Similar roles