Data Engineer

Data Engineer

WT Partnership | sydney, NSW, AU

Posted 11 days ago

Apply Now

Description

Job Description

Servicing a portfolio of customers, you'll be working on high end Big Data problems. The ideal candidate is a highly analytical problem solver with experience leveraging cutting edge data engineering techniques to drive commercial advantage and efficiency.  You will own the development agenda for applications and work closely with Data Scientists and Business Analysts to achieve the optimum outcome.

Qualifications

Skills

  •          Python and/or Java
  •          Spark SQL
  •          SQL
  •          Cassandra / HBase / HIVE
  •          Scala
  •          Map-reduce
  •          Visualisation tools (Tableau, Power BI, etc)

Experience

  •          2+ years big data hands-on experience
  •          Strong knowledge of concepts within the data domain
  •          knowledge of various ETL techniques and frameworks
  •          On-prem and cloud based solutions
  •          Data quality/Data cleansing/Data manipulation/Data streaming
  •          Excellent understanding of data processing/ data ingestion
  •          Messaging/Queueing systems
  •          Network protocols
  •          Solutions integration

Optional:

  •          Machine learning
  •          Data mining experience

Additional Information

If you're keen to and advance and broaden your career within the construction industry then this  could be a great opportunity for you. Apply now to join an international cost consultancy at the forefront of Australia's major construction across all sectors: commercial, retail, residential, mixed use, infrastructure and health.