ROB04 | DATA ARCHITECT - INFRASTRUCTURE SPECIALIST

Bebeedataengineer


Unlock Data Potential "> We are looking for a seasoned Data Engineer to join our team. As part of our data engineering squad, you will play a pivotal role in designing, developing, and maintaining the data infrastructure that fuels analytics, reporting, and decision-making across the organization. "> This is an exciting opportunity for someone with solid technical skills and hands-on experience in building data pipelines and working with large datasets. You will contribute to developing and maintaining data pipelines (batch and real-time) to ingest, process, and transform data from various sources. "> You will work closely with senior engineers and analysts to understand business requirements and translate them into data models and flows. Your expertise will be essential in implementing and optimizing ETL/ELT workflows to move data efficiently into our data warehouse and data lake. "> Key Responsibilities: "> - Data Pipeline Development: Develop and maintain data pipelines using tools like Apache Spark, Snowflake, Airflow, and AWS. "> - ETL/ELT Workflow Optimization: Implement and optimize ETL/ELT workflows to ensure efficient data movement into our data warehouse and data lake. "> - Collaboration and Communication: Work closely with senior engineers and analysts to understand business requirements and translate them into data models and flows. "> - Problem-Solving and Troubleshooting: Monitor pipeline performance, troubleshoot data-related issues, and implement solutions to ensure high-quality, maintainable code. "> - Continuous Learning: Stay up-to-date with new tools and best practices to improve development processes and system reliability. "> "> Qualifications: "> - Strong Technical Skills: Bachelor's Degree in Computer Science, Engineering, or related field; strong programming skills in Python or Scala, and familiarity with SQL. "> - Data Pipeline Experience: Experience building data pipelines using Apache Spark. "> - Cloud Platform Expertise: Hands-on experience with cloud platforms, preferably AWS (S3, Lambda, EMR, EC2, etc.). "> - Version Control and Agile Methodologies: Familiarity with version control (Git) and Agile development methodologies. "> - Problem-Solving and Collaboration: Strong problem-solving skills, ability to work independently and collaboratively within a team. "> "> Nice to Have: "> - DevOps Experience: Exposure to DevOps practices and tools such as CI/CD, Terraform, or Docker is a plus. "> - Orchestration Tools: Experience with orchestration tools such as Apache Airflow or AWS Step Functions. "> - Data Governance and Compliance: Knowledge of data governance, privacy, and security compliance standards. "> "> Seniority Level: Mid-Senior level "> Employment Type: Full-time "> Job Function: Advertising "> Industries: Advertising Services "]},

trabajosonline.net © 2017–2021
Más información