(Y-381) | DATA SOLUTIONS ARCHITECT

Bebeedataengineer


Job Overview We are seeking a Senior Data Engineer to join our team. This role involves utilizing predictive modeling, statistics, and trend analysis to identify and analyze data from internal and external sources. The successful candidate will construct software systems and algorithms to explain or predict customer behavior and solve business problems. As a Senior Data Engineer, you will be responsible for designing, coding, and testing new data management solutions, including supporting applications and interfaces. You will also support development activity in multiple projects, collaborate with other engineers and architects to plan and maintain the architecture, mentor and lead DA&I; engineers through the development lifecycle, improve the DevOps pipeline deployment model, write high-quality code compliant with regulations, and troubleshoot reported issues and bugs. - Data engineering with Databricks (Python, Pyspark, Spark SQL) - CI/CD with Azure DevOps pipeline - Azure Data Factory for job orchestration - Requirement & Business use case gathering - Meta data & Data Governance - High-level Design, Data Modeling Key Responsibilities The ideal candidate will have 5-7 years of total IT experience, with 5+ years of data engineering experience with Databricks, 2+ years of CI/CD experience with Azure DevOps pipeline, 3+ years of experience with Azure Data Factory, 3-5 years of requirement and business use case gathering experience, 5+ years of meta data and data governance experience, and 3+ years of high-level design and data modeling experience. Additionally, the successful candidate will have thoughtful skills in Python, SQL, PySpark, data warehousing, Azure Stack (Databricks, Data Factory, DevOps), and Power BI is optional but plus. Benefits Our company offers comprehensive mindfulness programs, volunteer paid time off, company volunteer and donation matching program, employee assistance program, personalized wellbeing programs through OnTrack, and on-demand digital course library for professional development. As an added bonus, we offer flexible work arrangements and opportunities for growth and advancement within the company. What We Offer At our company, we strive to create a workplace that values innovation, collaboration, and continuous learning. We believe in empowering our employees to take ownership of their work and provide them with the tools and resources necessary to succeed. Join us and discover a workplace that challenges you to grow, inspires you to innovate, and rewards you for your hard work and dedication.

trabajosonline.net © 2017–2021
Más información