PySpark Data Engineer

• 5 to 8 Yrs of experience as a data developer using Python, Spark, and PySpark.

• Preferred experience in Azure platform including Azure Data Lake, Data Bricks, and Data Factory.

• Familiarity working in a data lake environment, leveraging data streaming, and developing data pipelines driven by events/queues.

• Strong database experience in SQL server. Preferred experience in NoSQL databases like MongoDB

• Familiarity with data encryption and data masking.

• Working knowledge on different file formats such as JSON, Parquet, CSV, etc.

• Team player, reliable, self-motivated, and self-disciplined -- capable of executing on multiple projects simultaneously within a fast-paced environment working with cross functional teams.