DATA ENGINEER (AE-844)

8base


Data Engineer We are seeking an experienced Data Engineer to join our team. This role is open to candidates located in Latin America. Responsibilities: - Design and maintain cloud-based data warehouses and data lakes. - Build and orchestrate reliable, scalable ETL/ELT pipelines. - Optimize batch and streaming workloads to ensure data quality and security. - Collaborate with analysts and data scientists to deliver BI, ML, and visualization-ready datasets. Experience and Knowledge: Candidates should have at least 46 years of experience as a Data Engineer, with expertise in owning production-grade DW and Lake environments at enterprise scale. Cloud Data Warehouses: - Hands-on experience with major cloud analytical platforms, including Snowflake, Amazon Redshift, Google BigQuery, and Azure Synapse. Data Lakes & Formats: - Design and operation of object-store-based lakes using columnar formats (Parquet, ORC) and ACID table layers (Delta Lake, Apache Iceberg, Apache Hudi). Orchestration & Automation: - Workflow design with Apache Airflow, Dagster, AWS Glue, Azure Data Factory, or Cloud Composer; CI/CD with Git, Docker, Terraform. Data Quality & Observability: - Implement automated data tests and lineage/monitoring with dbt tests, Great Expectations, OpenLineage, Prometheus/Datadog, encryption, and IAM best practices. Programming & SQL: - Advanced SQL and Python proficiency; basic knowledge of Scala/Java or shell scripting is a bonus. Cloud & DevOps: - Practical experience with at least one major cloud provider (AWS, Azure, GCP) and infrastructure-as-code concepts. Requirements: - English level B2+ - Ability to work 100% remote - Flexibility to work from anywhere Benefits: - Participation in innovative regional projects - People-centric culture with autonomy and continuous learning - 10 days of PTO payments - All holidays observed

trabajosonline.net © 2017–2021
Más información