Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 6th Jun 2022

JOB DETAIL

The team is looking for a Data Engineer experienced in implementing data solutions in Azure. The Data Engineer will analyze, design and develop enterprise data and information architecture deliverables, focusing on data as an asset for the enterprise.  The Data Engineer will also support the implementation of Infrastructure as Code (IaC) by working with teams to help engineer scalable, reliable, and resilient software running in the cloud.

• Leverages enterprise standards for data domains and data solutions, focusing on simplified integration and streamlined operational and analytical uses

• Guides high level data architecture design (functional, non-functional) and ensures teams adhere to data architecture standards

• Contribute to data architecture, data quality processes, data warehousing design and implementation, table structure, fact and dimension tables, logical and physical database design

• Develops information processes for data acquisition, data transformation, data migration, data verification, data modeling, and data mining

• Monitors and optimizes data solutions

• Data modeling and advanced SQL techniques

• Work with multi-Terabyte data sets, troubleshooting issues, performance tuning of Spark and SQL queries

• Participate in team Scrum ceremonies

• Hands-on keyboard for product deliverables

 

Requirements:

• 5+ years of hands-on experience with data platforms

• 5+ years of hands-on experience in implementation and performance tuning MPP databases

• 5+ years of enterprise BI and analytics technical experience implementing data warehouse and data marts

• 3+ years of experience with PySpark/Spark

• 1+ years of experience with Databricks

• Experience with Software Development and automation methodologies

• Experience with data security best practices

• Experience in implementing data solutions in Azure including Azure SQL, Azure Synapse, Cosmos DB, Databricks, ADLS, Blob Storage, ADF, Azure Stream Analytics

 

Core Technologies:

• Azure Functions

• Python

• Spark

• SQL Server

• Azure Data Factory

• Azure Databricks

• Terraform

• Azure DevOps

• GitHub / GitHub Actions

• T-SQL and SQL stored procedures

• Azure Log Analytics

• Azure Data Lake Storage

• Azure Synapse

• Power BI

 

Company Information