Tagcor

Python Apache Spark Azure Synapse Azure Data Engineering services

1. Technical Skills:

- Expertise in Python and Apache Spark for large-scale data processing.

- Strong experience in Azure Synapse Analytics, including SQL Pools and Spark Pools.

- Advanced proficiency in Azure Data Factory for ETL pipeline orchestration and management.

- Knowledge of Data Warehousing principles, with hands-on experience building solutions on Azure.

- Experience with SQL, including complex queries, optimization, and performance tuning.

- Familiarity with CI/CD tools like Azure DevOps and managing infrastructure in Azure Cloud.

- Experience in Java for API integration and microservices architecture.

- Hands-on knowledge of Kubernetes for containerized data processing environments.

- Proficiency in working with Azure Data Lake Storage (ADLS) Gen2 for data storage and management.

- Experience working with APIs (REST, SOAP) and building API-based data integrations.

2. Agile and Cross-Functional Skills:

- Experience working in an Agile environment, using Scrum or Kanban.

- Ability to lead, mentor, and coach junior developers in the team.

- Strong collaboration skills to work with data scientists, analysts, and cross-functional teams to deliver end-to-end data solutions.

3. Behavioral Skills:

- Strong analytical and problem-solving skills with a passion for data-driven solutions.

- Excellent communication and presentation skills, able to explain complex technical concepts to non-technical stakeholders.

- Ability to work in a fast-paced, dynamic environment with changing priorities.

- Self-motivated and results-oriented with attention to detail.

Preferred Qualifications

- Azure certifications in data engineering or cloud architecture.

- Experience deploying AI/ML models on cloud platforms.

- Familiarity with Data Governance best practices, ensuring compliance with data privacy regulations.