Job Description:
Department Overview
Data Platform Department (DPD) is building enterprise data platform for Rakuten. The platform not only looks to automate the processes involved with ingesting, discovering, governing and querying data but also support Rakuten’s drive to become completely data-driven across more than 70 services.
Position:
Why We Hire
We are looking for DevOps Engineers that are interested building and running a platform for data pipeline operations.
The platform integrates latest solutions including on-premise and public cloud computing resources, application frameworks for running new data platform applications for data processing.
You will have many opportunities to use the latest technology, and choose the best platform solutions based on good design thinking.
You will work with small and quick moving teams, and also with other data engineer and data analyst as the platform customers.
Position Details
- Design, implement and operate distributed system infrastructure
- Development for infrastructure automation and tool creation
- Collect infrastructure related metrics to create KPI dashboard
- Build and maintain monitoring system
- Provide 24/7 high availability for stable platform
Mandatory Qualifications:
- Minimum 5+ years of experience in UNIX/Linux and networking operation
- Minimum 3+ years of experience in infrastructure automation technologies, such as Docker, Kubernetes, Terraform and Ansible
- Experience in operating public cloud platform such as Google Cloud, Microsoft Azure, etc.
- Experience in building logging, monitoring solution for web application, middleware, batch jobs
- Experience with designing and building tools based on specific requirements
- Experience in using Jenkins or other CI solutions
- Ability to talk with Product Manager and our internal users to gather the requirements
Desired Qualifications:
- Bachelor or Master degree in Computer Science or Engineering
- Experience with Big Data querying tools, such as BigQuery, Trino, Hive, etc.
- Experience with building and maintaining data platform
- Experience with building data pipeline using Airflow
#engineer #applicationsengineer #technologyplatformdiv
Languages:
English (Overall - 4 - Fluent)
