Data Engineer

Data Engineer

HCLTech | Hyderabad, TG, IN

Posted 9 days ago

Apply Now

Description

Job Description

  • Build end-to-end processes for a structured / semi-structured / unstructured data sources using a range of tools including ETL tools, open source programming (python) to ingest into Data Lake environment and contributed to buld large scale Data Warehousing solutions across multiple data sources;
  • Strong background in SQL, Python, Linux, ETL best practices by deevloping new tools/code/services to execute data engineering activities
  • Execute data ingestion activities for storing data in a local or enterprise level location
  • View data in source format, develop code to format data that supports exploration, Analyze source data formats to determine the target formats and transformations
  • Movement of structure and unstructured data using approved methods (including cloud native)
  • Develop code and tools to provide one time and on going data formatting and transformations into requisite data models
  • Awareness of best practices
  • Provide consulting services to support data transport, ingestion, curation, and management
  • Experience with: Docker, Jenkins, Hadoop Spark, Kibana, Kafka, NiFi, ElasticSearch
  • Experience in Big data platforms, eg: Hadoop, Snowflake, or AWS Redshift.
  • Working experience with Data Analytics tools to pull data from different sources (i.e.: ETL tools, ETL programming
  • Attention to detail and strong attitude to perform