AZURE DATA ENGINEER JOB DESCRIPTION (3-6 years)
? Strong foundation in data query/manipulation using SQL
? Strong implementation in data transformation and orchestration solutions using Azure Data Factory,
Synapse, Synapse Data pipelines, stored procedures, packages
? Experience on Azure data engineering - Azure SQL DB/DW, Azure Data Lake, Azure Synapse, Azure Data Factory and PostgreSQL
? Experience in using Big Data File Formats and compression techniques
? Should have experience in data ingestion (Batch and real time processing) using Event Hub, Stream Analytics, ADLS
? Experience on Cloud migration methodologies and processes
? Experience working with Developer tools such as Azure DevOps, CI/CD, Visual Studio Team Server, etc. and
knowledge in Kubernetes/docker is preferred
? Should have ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
? Worked on performance optimization of Database queries, Azure pipelines or Spark enabled services like Databricks.