Data Engineer - Python/Big Data

Job Description :

Required qualification and skills :

- BSc / MSc in Computer Science or other related fields

- 2-3 years of Software engineering experience with Unit Testing, Integration

- Testing, Continuous Integration, Code-Style Guidelines, Continuous

- Development and Version Control System in a product-oriented professional working environment.

- Experience in Analysis, Design, Development of data architectures.

- Knowledge of Big Data, Hadoop, Data Analytics would be useful for the role

- Very strong experience in ingestion, storage, querying, processing and analysis of data from varied sources including sensors, products, assets, equipment and similar.

- Strong experience in Python and PL SQL.

- Knowledge of technologies for IoT architectures AWS, Hadoop stack,

- Kafka, NoSQL databases, MySQL, MongoDB

- Experience to Deliver an integrated solution

- Knowledge using AWS

- Good knowledge with source control tools (Git, TFS)

- Experience with systems and IT operations

- Should have good communication skills

Desirables :

- Experience designing large-scale applications.

- Strong knowledge of one industry such as manufacturing, supply chain business processes, energy & utilities

- Fluency in English (verbal and written)

- Attention to detail

- Good problem-solving skills

- Ability to multi-task, organise, and prioritise work

- Familiarity using Scrum/Agile development methodologies

- Implemented best DataOps practices in the past

Key Responsibilities :

- Responsible for creating solutions in order to help the organisation more successful within their IoT Data Architecture.

- Maintain and optimise existing backend Data architecture

- Review existing server set up and optimise for Big Data and Real Time streaming

- Work with cross-functionally to enhance overall user experience of our platforms

- Own various design tasks involved in the web development life cycle from start to finish

- Troubleshoot bugs along with the development team

- Ensure solutions designs are technically feasible and can deliver against business SLA's

Mumbai, MH, IN
Apply Now