Sorry, this job is no longer available.
loading...

(Loading More Opportunities)

Sr. Data Warehouse Developer - Team Lead

Software Engineer - Database Engine
Experience - minimum 8+ years
Duration - Full-Time Permanent role
Job Location - Pune, Hybrid Model
Shift timing - Day Shift
Hiring for US Product based company
Candidates who are willing to relocate for Pune location can apply
Skills & Qualifications
Mandate Skill set Required:
Must: Distributed SQL Engine Performance Tuning, Distributed
Systems,Distributed Database
Must: open source Apache stack(Apache Spark, Apache Arrow)
Must:Working knowledge in Scala
Must: Building core Query Engine and Data Warehouse Experience
Experience Required:
● Must: Experience in building core query engine or optimising query engine.
● Must: 5+ years of experience engineering software and distributed systems /
enterprise-scale
● Must: 5+ years experience engineering software and data platforms / enterprise-
scale data warehouses, preferably with knowledge of open source Apache stack
(especially Apache Spark, Apache Arrow, Geode, Iceberg, Ignite, or similar)
● Hands-on experience actually building query engines, writing query optimizers,
and improving the processing of queries.
● Rock solid engineering fundamentals; query planning, optimizing and distributed
data warehouse systems experience
● Knowledge of concurrency, multithreading, and synchronization a plus
● Experience with rapid development cycles in a web-based environment
● Strong scripting and test automation knowledge
● Nice to have: Knowledge of blockchain indexing, web3 compute paradigms,
Proofs and
● consensus mechanisms... is a strong plus but not required
● 3+ years experience leading/growing high-performance software eng teams
Responsibilities:
● Writing Scala code with tools like Apache Spark + Apache Arrow to build a
hosted, multi-cluster data warehouse for Web3
● Developing database optimizers, query planners, query and data routing
mechanisms, cluster-to-cluster communication, and workload management
techniques
● Scaling up from proof of concept to 'cluster scale' (and eventually hundreds of
clusters with hundreds of terabytes each), in terms of both infrastructure/
architecture and problem structure
● Codifying best practices for future reuse in the form of accessible, reusable
patterns, templates, and code bases to facilitate meta data capturing and
management.
● Collaborate with a team of software engineers writing new code to build a
bigger, better, faster, more optimized HTAP database (using Apache Spark,
Apache Arrow and a wealth of other open source data tools)
● Interacting with exec team and senior engineering leadership to define,
prioritize, and ensure smooth deployments with other operational components
● Highly engaged with industry trends within analytics domain from a data
acquisition processing, engineering, management perspective
● Understand data and analytics use cases
What we offer
● Aggressive bonus structure AND tokens (similar to stock options)
● Very Flexible PTO and paid holidays, and flexible workweek
● Very flexible remote work options
● Onsite Travel
A massive list of perks including add-on bonuses for hard work, attending exciting
events/conferences/parties, we're headquartered on the beach near LA (but don't
mind you working remote) and we'll fly you to our company offsites.
Posted
06/23/2022
Location
pune, MH, IN