Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 1st Oct 2022

JOB DETAIL


Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions.
Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools.
Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, alerting, prod support.
Provide technical leadership and collaborate within a team environment as well as work independently.
Be a part of a DevOps team that completely owns and supports their product.
Implement batch and streaming data pipelines using cloud technologies.
Success Criteria
Minimum Qualifications- Education & Prior Job Experience
Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training
3 years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
3 years data analytics experience using SQL
2 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
Combination of Development, Administration & Support experience in several of the following tools/platforms required:
Scripting: Python, Spark, Unix, SQL
Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake
Azure Data Explorer. Administration skills a plus
Azure Cloud Technologies: Azure Data Factory, Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions
CI/CD: GitHub, Jenkins, Azure DevOps, Terraform
BI Analytics Tool Stack - Cognos, Tableau, Power BI, Alteryx, Denodo, and Grafana
Data Warehousing: DataStage, Informatica
Data Governance and Privacy: Informatica Axon and EDC, BigID
1+ years exp on Power BI is required
1+ years exp on Python
1+ years exp on Spark / PySpark
1+ years exp on ADLS (Azure Data lake)
Preferred Qualifications- Education & Prior Job Experience
5+ years software solution development using agile, dev ops, product model that includes designing, developing, and implementing large-scale applications or data engineering solutions.
5+ years data analytics experience using SQL
3+ years full-stack development experience, preferably in Azure
3+ years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Functions, ADX, ASA, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI

Airline Industry Experience
Skills, Licenses & Certifications
Expertise with the Azure Technology stack for data management, data ingestion, capture, processing, curation and creating consumption layers
Expertise in providing practical direction within the Azure Native cloud services
Azure Development Track Certification (preferred)
Spark Certification (preferred)

Company Information