Data Engineer (Etl/Python/Fintech/Credit Services)


Job DescriptionData Engineer (ETL/Python/FinTech/Credit Services)Our Client is a UK based financial technology company that provides credit scoring services and a marketplace where there is efficient and easy access to financial data, including credit reports and scores, and open banking data. The companys business is dedicated to helping its users improve their financial well-being. Their products are created through cutting-edge tech, insightful analytics and beautiful design.Job Type: Hybrid | Full-timeRequirementsProficiency with Python, Java, or ScalaExperience of data orchestration using tools such as Airflow or similarETL experience using Spark, with Scala or Python, and experience of EMRKnowledge of the end-to-end data pipeline, with a focus on data cleaning, structuring and transformationUnderstanding of AWS data stack preferred (S3, MSK, EMR, Glue, Redshift, Lambda, Kinesis)A certification or bachelors degree in computer science, data analytics, big data or similar3+ years experience as a data engineer or similarAn analytical mind with an eye for detail and demonstrated history of solving complex data challengesResponsibilitiesAutomating the ingestion of data from internal and external sources into our data warehouse (Amazon Redshift)Data cleansing and preparation using Airflow and Spark (either in Scala or Python)Building and maintaining daily ETL jobsCreating structured tables in the data warehouse to make the data clear, understandable, and accessible to analysts and team membersWriting scripts to automate the ingestion of daily reports into the data warehouseBenefits:Holidays 20 paid holidays (plus public holidays) and a duvet day on your birthdayPension fund contribution of 6%Medical Aid - Top Discovery Plan Executive PlanGenerous training and development budgetFlexible work hours and the ability to work from homeFlexible, generous, and personalised maternity and paternity plansMonthly team events and office days out that we get to choose, and company events at the end of each quarter and retroIf this sounds like the perfect job opportunity then apply today!-------------------------Blackpen Recruitment is a global recruitment agency that targets European, African and American Markets with headquarters based in Malta and Cape Town. Blackpen specialises in FinTech, Cryptocurrency, Startup and iGaming Recruitment.RequirementsProficiency with Python, Java, or Scala Experience of data orchestration using tools such as Airflow or similar ETL experience using Spark, with Scala or Python, and experience of EMR Knowledge of the end-to-end data pipeline, with a focus on data cleaning, structuring and transformation Understanding of AWS data stack preferred (S3, MSK, EMR, Glue, Redshift, Lambda, Kinesis) A certification or bachelors degree in computer science, data analytics, big data or similar 3+ years experience as a data engineer or similar An analytical mind with an eye for detail and demonstrated history of solving complex data challenges Responsibilities Automating the ingestion of data from internal and external sources into our data warehouse (Amazon Redshift) Data cleansing and preparation using Airflow and Spark (either in Scala or Python) Building and maintaining daily ETL jobs Creating structured tables in the data warehouse to make the data clear, understandable, and accessible to analysts and team members Writing scripts to automate the ingestion of daily reports into the data warehouse Benefits: Holidays 20 paid holidays (plus public holidays) and a duvet day on your birthday Pension fund contribution of 6% Medical Aid - Top Discovery Plan Executive Plan Generous training and development budget Flexible work hours and the ability to work from home Flexible, generous, and personalised maternity and paternity plans Monthly team events and office days out that we get to choose, and company events at the end of each quarter and retro If this sounds like the perfect job opportunity then apply today! ------------------------- Blackpen Recruitment is a global recruitment agency that targets European, African and American Markets with headquarters based in Malta and Cape Town. Blackpen specialises in FinTech, Cryptocurrency, Startup and iGaming Recruitment.
Posted
05/05/2022
Location
Cape Town, WC, ZA