Language Proficiency: Excellent English communication skills Experience Level: Mid to Senior Job Summary: We are looking for talented and dynamic Data Engineers to join our team in Bogota, Colombia. The ideal candidates will have strong experience in Databricks technologies and Amazon Redshift, as well as hands-on experience in ETL processes, PySpark, Kafka, and Airflow. As the customer is migrating from Amazon Redshift to Databricks, experience in similar migration projects will be a significant advantage. Key Responsibilities: Design, build, and maintain robust data pipelines using Databricks and Amazon Redshift. Lead the migration from Amazon Redshift to Databricks, ensuring data integrity and performance optimization. Develop and maintain ETL processes using PySpark, Kafka, and Airflow. Implement data processing and transformation pipelines for large-scale data sets. Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions. Troubleshoot and resolve issues related to data pipeline performance and data quality. Ensure the security and compliance of data handling practices. Monitor and optimize the performance of data processing and migration workflows. Required Skills and Qualifications: Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. 5+ years of hands-on experience in Data Engineering with Databricks and Amazon Redshift. Proven experience in migrating data from Amazon Redshift to Databricks. Strong proficiency with ETL frameworks and data pipeline development. Expertise in PySpark for data processing and transformations. Experience with Kafka for real-time data streaming. Proficiency in orchestrating workflows using Apache Airflow. Solid understanding of cloud data warehouse environments. Excellent English communication and interpersonal skills. Ability to work independently and as part of a collaborative team. Preferred Qualifications: Experience working in a multi-cloud or hybrid cloud environment. Familiarity with CI/CD practices for data pipeline deployment. Knowledge of data governance and data quality best practices. Prior experience with other cloud data warehouse technologies (e.g., Snowflake, BigQuery) is a plus. Seniority level Mid-Senior level Employment type Full-time Job function Data Infrastructure and Analytics #J-18808-Ljbffr