(GX-807) - LEAD DATA SOFTWARE ENGINEER (PYTHON, EVENT STREAMING)

Epam Systems


We are looking for a Lead Data Software Engineer with expertise in Python and Event Streaming to create scalable and innovative data solutions. This role will focus on developing robust data applications, building seamless data pipelines, and collaborating with cross-functional teams in a cloud-based environment. Responsibilities Create data applications for seamless integration and management of large datasets Design advanced analytics using Spark/PySpark, NoSQL databases, and GCP services like BigQuery and DataFlow Partner with product teams and engineers to interpret business needs and deliver technical solutions Collaborate with architects and technical leads to align on system designs and functionality Solve technical challenges by delivering effective, high-quality solutions Perform code reviews to ensure adherence to software quality and best practices Maintain clear technical documentation of workflows and project processes Requirements Minimum of 5 years of experience in software development with Big Data technologies 1+ years of leadership experience Expertise in Python and proficiency in a secondary programming language such as Java, Scala, or Kotlin Strong competency in Spark/PySpark, SQL, and NoSQL databases Familiarity with GCP data tools, including BigQuery, DataProc, and DataFlow Understanding of CI/CD protocols for automating deployment workflows Knowledge of data ingestion pipelines and architectures for Data Warehousing and Data Lakes Flexibility to design scalable, fault-tolerant systems with effective monitoring and debugging capabilities Strong communication skills with the ability to collaborate effectively across teams and stakeholders Proficiency in containerization tools like Docker and orchestration tools such as Kubernetes Nice to have Expertise in event streaming platforms, including Kafka or Pub/Sub Background in workflow orchestration with tools like Airflow Familiarity with additional Big Data tools such as Hadoop or Flink We offer/Benefits - International projects with top brands - Work with global teams of highly skilled, diverse peers - Healthcare benefits - Employee financial programs - Paid time off and sick leave - Upskilling, reskilling and certification courses - Unlimited access to the LinkedIn Learning library and 22,000+ courses - Global career opportunities - Volunteer and community involvement opportunities - EPAM Employee Groups - Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

trabajosonline.net © 2017–2021
Más información