Sorry, this job is no longer available.
loading...

(Loading More Opportunities)

Lead Data Engineer

Data Engineer / Sr Data Engineer/Lead Data Engineer
Gathi Analytics is a relentlessly client-focused group who builds ground-breaking data solutions for Smart
Cities, Payment Services, Healthcare, Finance, and so much more. Gathi Analytics leverages proprietary
frameworks and methodologies to deliver solutions faster, without compromising quality. We help our clients
gain data insights they never thought possible and understand their data assets in ways they never could
before. If this sounds like you, please read on.
About the Data Engineer Role
As a Data Engineer with ETL/ELT background, the candidate needs to design and develop reusable data
ingestion processes from variety of sources and build data pipelines for Synapse Azure cloud data
warehouse platform and reporting processes. The ideal candidate should be proficient in writing SQLs so
they can be embedded into the informatica (IICS) for data transformation. Ideal candidate should be willing
to learn open source technologies on the fly as job demands.
Responsibilities
• Design, develop & implement ETL processes on Azure Cloud using Databricks and Azure Synapse
• Advanced SQL knowledge, capable to write optimized queries for faster data work flows.
• Must be extremely well versed with handling large volume data and work using different tools to derive
the required solution.
• Work with offshore team, business analysts and other data engineering teams to ensure alignment of
requirements, methodologies and best practices
Requirements
• Bachelor's Degree or master's degree in Computer Science.
• 5+ years of hands-on software engineering experience.
• Proven work experience in Spark , Python ,SQL , Any RDBMS.
• Experience in designing solutions for multiple large data warehouses with a good understanding of
cluster and parallel architecture as well as high-scale or distributed RDBMS
• Strong database fundamentals including SQL, performance and schema design.
• Understanding of CI/CD framework is an added advantage.
• Ability to interpret/write custom shell scripts. Python scripting is a plus.
• Experience with Azure platform and Synapse
• Experience with Git / Azure DevOps
• To be able to work in a fast-paced agile development environment
Posted
07/14/2022
Location
bangalore, KA, IN