OLA - Data Production Engineer I - HBase/Hadoop/Apache Flink

About Us :

Ola is India's largest mobility platform and one of the world's largest ride-hailing companies, serving 250+ cities across India, Australia, New Zealand, and the UK. The Ola app offers mobility solutions by connecting customers to drivers and a wide range of vehicles across bikes, auto-rickshaws, metered taxis, and cabs, enabling convenience and transparency for hundreds of millions of consumers and over 1.5 million driver-partners.

Ola's core mobility offering in India is supplemented by its electric-vehicle arm, Ola Electric; India's largest fleet management business, Ola Fleet Technologies and Ola Skilling, that aims to enable millions of livelihood opportunities for India's youth. With its acquisition of Ridlr, India's leading public transportation app and investment in Vogo, a dockless scooter sharing solution, Ola is looking to build mobility for the next billion Indians. Ola also extends its consumer offerings like micro-insurance and credit led payments through Ola Financial Services and a range of owned food brands through India's largest network of kitchens under its Food business.

Ola was founded in 2011 by Bhavish Aggarwal and Ankita Bhatia with a mission to build mobility for a billion people. For more details, visit Role:

We are looking for a Data Production Engineer I - Data PE to help us build and enhance big data platforms to achieve availability, scalability and operational effectiveness. The right individual will embrace the opportunity to tackle challenging problems and use their influence to drive continual improvement. You will also work on the cutting edge of technology, leveraging Hadoop, Hbase, Hive, Kafka, Burrow, Ambari, Spark, Flink, Mesos/Kubernetes, Jenkins, Chef, Prometheus etc.

Roles and Responsibilities :

- Managing availability, performance, capacity and security of big data infrastructure and applications like hadoop, hive, kafka, hbase etc.

- Building and implementing observability for applications health/performance/capacity.

- Optimizing On-call rotations and processes.

- Documenting - tribal- knowledge.

Managing Infra-platforms like :

- Hadoop

- Hbase

- Hive

- Kafka

- Kubernetes

- Flink

Other Data Platforms Infrastructure :

- Providing help in onboarding new big data applications with the production readiness review process.

- Developing tools to manage Big Data infrastructure at scale.

- Providing reports on services SLO/Error Budgets/Alerts and Operational Overhead.

- Working with Dev and Product teams to define SLO/Error Budgets/Alerts.

- Working with the Dev team to have an in-depth understanding of the big data application architecture and its bottlenecks.

- Identifying observability gaps in big data services, infrastructure and working with stake owners to fix it.

- Managing Outages and doing detailed RCA with developers and identifying ways to avoid that situation.

- Managing/Automating upgrades of the infrastructure services.

- Automate toil work.

Experience & Skills :

- 2+ Years of experience as a Big Data Reliability Engineer on large-scale Hadoop, Hive and Kafka Infrastructure.

- A collaborative spirit with the ability to work across disciplines to influence, learn, and deliver.

- A deep understanding of computer science, software development, and networking principles.

- Demonstrated experience with languages, such as Python, Java, Golang etc.

- Extensive experience with Linux administration and good understanding of the various linux kernel subsystems (memory, storage, network etc).

- Extensive experience in DNS, TCP/IP, UDP, GRPC, Routing and Load Balancing.

- Expertise in GitOps, Infrastructure as a Code tools such as Terraform etc.. and

- Expertise of Amazon Web Services (AWS) and/or other relevant Cloud Infrastructure solutions like Microsoft Azure or Google Cloud.

- Experience in managing and deploying containerized environments using Docker, Mesos/Kubernetes is a plus.

- Experience with multiple datastores is a plus (MySQL, PostgreSQL, Aerospike, Couchbase, Scylla, Cassandra, Qualifications : Bachelor's or Master's degree in Engineering or related technical discipline (from premier institutes preferred)

Bangalore, KA, IN
Apply Now