Data Engineer



Duration: 6 months

 

Overview of Work:

Design and Build the integration jobs that move data from existing SoR
applications into and throughout the Client's Microsoft Cloud environment (Data
Lake, Azure SQL, Azure DWH) leveraging Client?s common/standard integration
patterns, tools, and languages (Azure Data Factory, Data Brick, Spark SQL,
Python, PySpark)

 

Technical Skills:

? Azure Data Factory (ADF)

? Azure Data Brick

? Python

? Spark SQL & PySpark

? Azure Synapse, Azure SQL, Azure DWH

? Azure Data Lake Storage / Analytics

? Azure Database Migration Services

? Knowledge in older integration and storage tools is beneficial (MS SQL
Server, MS SSIS, IBM DataStage, etc.)

? 10 + years' experience

 

Soft Skills:

? Ability to navigate and comprehend mapping documents

? Experience with CI/CD pipelines, branching strategies, & GIT for code
management

? Experience with Azure DevOps (ADO) tool for work management

? Practitioner of Agile/SAFe practices

? Experience with Job Scheduling tools