Overview
We are seeking a highly skilled Data Analyst with a strong background in functional programming and distributed data processing. This role encompasses approximately 50% administrative and coordination tasks combined with 50% hands-on technical work. You will play a vital role in supporting the smooth operation, documentation, and execution of data-driven initiatives within a collaborative team environment.
Key Responsibilities
Administrative & Coordination Responsibilities (50%):
- Lead the team.
- Support the organization and coordination of data-related activities across various teams.
- Maintain and update documentation for data pipelines, workflows, and system architectures.
- Plan, track, and report on data engineering tasks and deliverables.
- Ensure alignment with internal standards, processes, and data governance guidelines.
- Facilitate information flow between technical and non-technical stakeholders.
- Contribute to the continuous improvement of operational processes and tooling.
Technical Responsibilities (50%):
- Develop and maintain high-performance, reliable, and distributed applications using functional programming principles.
- Utilize Spark within DataBricks, ensuring resilience and elasticity in large-scale deployments.
- Build and optimize data-intensive workflows using Apache Spark or comparable frameworks.
- Leverage solid knowledge of runtime environments, execution contexts, and pure functional design to deliver predictable, testable software.
- Collaborate with teams to design architectural solutions based on a sound understanding of distributed and parallel data transformation.
- Write efficient, maintainable code in Python.
Must-Have Qualifications:
- Strong hands-on experience in functional programming using one or more paradigms, such as:
- ETL pipelines.
- Actor model systems (e.g., Akka, Apache Pekko).
- Category theory-based systems.
- Map-reduce frameworks.
- Real-world experience with Apache Spark (the most important) or similar libraries and technologies (e.g., Apache Flink, Cats/Cats Effect, Hadoop, Kafka Streams).
- Solid understanding of runtime systems, execution contexts, and pure functions.
- Deep understanding of compiled, JIT, and interpreted execution models.
- Proficiency in Python and in one of Scala/Java, C/C++, or Rust.
- Experience working within project environments, including planning, coordination, or tracking of technical tasks.
- Experience collaborating in multi-person teams, emphasizing task alignment, information sharing, and coordination across roles.
Apply online using the form below. Only applications matching the job profile will be considered.