Senior Big Data Engineer (M/F)

Name of the position: Senior Big Data Engineer

Reports to: Team Lead/Delivery Manager

Department/Project: Engineering

PURPOSE OF THE JOB

As Senior Engineer, you will work on developing services in one of the world's largest marketplace, dealing with one billion events per day, and contribute as part of an R&D self-organized team working in a challenging, innovative environment for our client.

Investigate, create, and implement the solutions for existing technical challenges.

MAIN TASKS AND RESPONSIBILITIES

• Obtains tasks from the project lead or Team Lead (TL), prepares functional and design specifications approves them with all stakeholders.
• Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
• Provides estimations and agrees on task duration with the manager
• Contributes to the project plan of the assigned area.
• Analyzes scope of alternative solutions and makes decisions about area implementation based on his/her experience and technical expertise.
• Leads the functional and architectural design of assigned areas. Makes sure design decisions on the project meet architectural and design requirements.
• Addresses area-level risks, provides and implements mitigation plans.
• Reports about area readiness/quality, and raises red flags in crisis situations that are beyond his/her AOR.
• Responsible for resolving crisis situations within his/her AOR.
• Initiates and conducts code reviews, creates code standards, conventions, and guidelines.
• Suggests technical and functional improvements to add value to the product;
• Constantly improves his/her professional level.
• Collaborates with other teams.

REQUIRED EDUCATION AND EXPERIENCE

Must have:

• University degree in Computer Related Sciences or similar
• 5+ years of commercial development experience including Java or Python or Scala
• 2+ years experience with Spark or Hive including an understanding of how these technologies work under the hood
• Strong experience in distributed Big Data processing (batch/offline, Terabytes, and more)
• Rigor in high code quality, automated testing, and other engineering best practices
• Strong OOP skills
• Strong communication, collaboration, and interpersonal skills
• Result-oriented approach
• Good English (oral & written) and communication skills in general

Would be a plus:

• Experience with Airflow