Tagcor

ETL

· Proficiency in using Azure Data Factory, Azure Synapse Analytics, and Azure Blob Storage for data ingestion, transformation, and storage.

· Create and manage data movement pipelines that integrate multiple data sources and Power BI data flows, supporting data-driven decision-making.

· Experience with ETL tools and frameworks, particularly Azure Data Factory, for orchestrating data workflows.

· Strong skills in languages such as SQL for database querying, Python for custom transformations and data manipulation.

· Knowledge of data modeling concepts, including star and snowflake schemas, and experience with data warehousing solutions.

· Familiarity with Azure Databricks or similar technologies for processing large datasets.

· Skills in integrating various data sources, including relational databases, NoSQL databases, and APIs.

· Ability to optimize ETL processes for performance, including knowledge of indexing, partitioning, and query optimization.

· Experience with monitoring tools and practices for tracking ETL job performance and troubleshooting issues.

· Understanding of CI/CD pipelines and version control systems (e.g., Git) for managing ETL code and deployments.

· Knowledge of data security best practices, including data encryption and compliance with regulations such as GDPR.

· Skills in ensuring data accuracy, consistency, and reliability through data validation and cleansing techniques.

· Experience with tools like Azure DevOps for project management and collaboration within teams.