STREAMSETS DEVELOPER
PTS Consulting | Chennai, TN, INPosted 16 days ago
Description
We are seeking Experienced Streamsets professionals to join our growing Data Engineering practice team delivering transformative solutions.
Location: Chennai / Bengaluru/ Hyderabad
Mandatory Skills - Streamsets Data collector, Streamsets Control Hub, Streamsets Transformer
Job description
7 to 10 years of experience in Data management, SQL, Postgres DB, Change Data Capture and Replication Patterns
Required Skills
4+ Years Experience in Streamsets (Strong knowledge required)
Scrum (JIRA) knowledge required
Good verbal and written communication
Nice to have skills –
Multiple SQL databases knowledge
3-5 Years of experience with Streamsets Data Collector, Control Hub, Transformer
1-2 Years of experience with Managed File Transfer tools like GoAnywhere MFT is a huge plus
Strong understanding and experience with DataOps platforms and concepts
Experience with capacity planning, HA/DR, securing, provisioning and administration of Streamsets platform
Experience deploying and operating Streamsets on-prem and on cloud providers (Azure preferred)
Design, test and maintain Streamsets pipelines and jobs
Responsibilities
Experience with L2, L3 level support of StreamSets platform
Detailed understanding of various Streamsets stages
Good understanding to resolve the StresmSets job performance issues
Experience with Licensing, Cost Analysis and Billing of StreamSets platform
Experience with DevOps tools like Ansible, Jenkins, puppet, Erraform is a huge plus
Experience handling security of StreamSets platform - lDAP, OAuth, SSL, MFA, User Access management and vulnerability management
Experience in handling different file format such as parquet, Afro, ORC, Delimited, JSON, XML
Experience managing Streamsets platform health, performance monitoring and alerting
Maintain and upkeep the platform with frequent updates/upgrades
High level impact assessments for complexity, size, dependencies
Proposing technical changes and solutions for incidents/ problems
Perform design reviews and providing tech approvals for changes
Knowledge management, repository maintenance and knowledge sharing with project teams
Adept at Linux commands and shell scripting
Ability to train, mentor and coach other engineers in the team
Proficiency and planning, stakeholder management and communication at all levels
Experience with ETL and data stream tools like Apache Kafka is good to have
Next Steps
Please apply in confidence with your current and expected package.
Due to volume of applications, we regret only shortlisted candidates will be notified.