Junior Data Engineer Job at Recruitment Room, Egypt

WldSbCtrQVJTQTlmSm4xaGFEV1htZUhKbmc9PQ==
  • Recruitment Room
  • Egypt

Job Description

What we are looking for

Were looking for a candidate with a foundational understanding of data engineering concepts and handson experience with relevant technologies. This role provides the opportunity to grow into a senior data engineering position contributing to innovative cloudbased projects.

What does the job involve

  • Data Pipeline Development: Assist in implementing and maintaining scalable data pipelines for ingesting processing and transforming large volumes of data from various sources using tools such as Databricks Python and PySpark.
  • Data Modeling: Assist in designing data models and schemas for efficient storage retrieval and analysis of structured and unstructured data.
  • ETL Processes : Develop and automate ETL workflows to extract data from diverse sources transform it into usable formats and load it into data warehouses data lakes or lakehouses.
  • Big Data Technologies: Utilize big data technologies such as Spark Kafka and Flink for distributed data processing and analytics.
  • Cloud Platforms: Collaborate with the team to deploy data solutions on cloud platforms such as AWS Azure or Google Cloud Platform (GCP) leveraging cloudnative services for data storage processing and analytics.
  • Data Quality and Governance: Implement data quality checks validation processes and data governance policies to ensure accuracy consistency and compliance with regulations.
  • Monitoring and Troubleshooting: Monitor data pipelines and assist in troubleshooting and resolving datarelated issues.
  • DevOps: Commit code to version control.
  • Collaboration: Collaborate with crossfunctional teams including data scientists analysts and software engineers to understand requirements and deliver datadriven solutions.
  • Documentation: Create and maintain technical documentation including data architecture diagrams ETL workflows and system documentation to facilitate understanding and maintainability of data solutions.
  • Best Practices : Continuously learn and apply best practices in data engineering and cloud computing.

Qualifications

  • Programming Languages: Experience with Python Java Scala or SQL for data manipulation and scripting.
  • Big Data Technologies: Experience with Databricks Spark Kafka and Flink.
  • Version Control : Experience with systems like Git.
  • Cloud Platforms: Familiarity with AWS Azure or GCP services.
  • SQL: Proficiency in SQL for database management and querying.
  • Apache Spark: Knowledge of Apache Spark for distributed data processing.
  • Modern Data Architectures : Exposure to modern data architectures such as lakehouse.
  • ETL Tools: Knowledge of ETL tools and technologies such as Apache Airflow Informatica or Talend.
  • Cl oud Data Tools : Familiarity with cloud data services like AWS S3 EMR Redshift Glue Azure Data Factory Databricks BigQuery Dataflow and Dataproc.

Benefits

Competitive Salary

Location

Remote Egypt Kenya South Africa Nigeria

Job Tags

Full time, Remote job,

Similar Jobs

Catalyst Physician Group

NCT/X-Ray Technician Job at Catalyst Physician Group

 ...we are Catalyst Physician Group - where your career can flourish as you help communities thrive. Job Summary As an NCT/X-Ray Technician, you will perform various patient care duties and prepare patients for X-rays and laboratory procedures. This role involves working... 

University Liggett School

Digital Marketing Specialist Job at University Liggett School

 ...Full-Time | Reports to: Director of Marketing and Communications Position Summary The Digital Marketing Specialist plays a key role in how University Liggett School tells its story across digital, print and experiential channels. This position blends creative design... 

Murata Electronics North America

Supply Chain Analyst Job at Murata Electronics North America

 ...a global leader in the design, manufacture and supply of advanced electronic materials, leading edge electronic...  ...applications to energy management systems and healthcare devices.Why Consider This Job OpportunityThe Supply Chain Analyst is responsible for the construction and... 

MyGreat Recruitment

Snr Superintendent, Data Centre Construction | General Contractor | Houston, TX - MyGreat Recruitment Job at MyGreat Recruitment

 ...Direct experience delivering hyperscale, colocation, or mission-critical data centre facilities Background working for a large general contractor on technically complex builds Experience mentoring and developing assistant superintendents and field engineers... 

Cornwall Executive Recruitment

Senior Executive Recruiters - African Nations Job at Cornwall Executive Recruitment

Job Information~Executive Recruiters African Nations~Recruitment Managers x 2~Executive Recruiters x 40South Africa, Central...  ..., Commercial Manufacturing, Scientific, Medical and Hospitality sectors. The African Nations consist of countries that are listed...