US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 24th Oct 2023
Senior Data Engineer is responsible for building and maintaining the data infrastructure that enables an organization to efficiently collect, process, store, and analyze data for informed decision-making.
• Their role is critical in ensuring data availability, quality, and reliability throughout the data lifecycle.
Scope and Competency Requirements:
• Problem-Solving/Know How: (complexity of problems and education/experience & other knowledge required)
• A bachelor’s or master’s degree in computer science, information technology, data science, or a related field with 7+ years of experience as a data engineer, with a significant portion of that experience specifically working with Azure data services.
• Proficiency in Microsoft Azure services and tools related to data engineering, such as Azure Data Factory, Azure Databricks, Azure Analytical Service, Azure Synapse Analytics, Azure Cosmos DB, etc.
• Strong Experience in implementing data solutions in Azure Data Lake platform
• Experience with Data Governance tools like Azure Purview, Alation.etc are preferred.
• Expertise in SQL, T-SQL and experience working with various database systems, including relational databases and NoSQL databases is required.
• Experience with data modeling, schema design, and performance optimization, especially creating tabular models for Self-service analytics using Power BI.
• Strong skills in data integration, ETL (Extract, Transform, Load) processes, and data orchestration workflows.
• Expertise in data warehousing concepts and techniques.
• Programming skills in languages such as Python, PySpark, Java, Scala, or PowerShell for scripting and automation.
• Experience designing, building, and optimizing end-to-end data pipelines.
• Proven track record of implementing data solutions that meet performance, scalability, and reliability requirements.
• Experience with data migration, data warehousing, and data lake solutions.
• Experience in creating data pipelines to extract the data from SAP applications is preferred.
• The ability to analyze complex data engineering challenges and develop innovative solutions.
• Strong troubleshooting skills to identify and resolve issues in data pipelines and systems.
• Effective communication skills to work collaboratively with cross-functional teams, including data scientists, analysts, and business stakeholders.
• The ability to translate technical concepts into understandable terms for non-technical team members.
• Data accuracy and quality are paramount.
• A Senior Azure Data Engineer should be meticulous in ensuring that data pipelines and processes maintain high data integrity.
• As a senior role, this individual might be required to lead and mentor junior members of the data engineering team.