• US Citizen

• Green Card

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 14th Feb 2023

Data Engineer will work on implementing data pipelines to make data available in Snowflake Cloud DW from systems of records and operational data stores. The Data Engineer will get to work on best-in class cloud technologies (Nexla, Snowflake, Azure, Airflow, Python etc.)

Along with making data available in the DW, the DE will work with Business and Data Analysts to implement data models and calculate key business KPIs for the use of the wider business for reporting and analytics.

The DE will have the opportunity to learn and develop their skills by working on assignments as part of an Agile Team guided by more senior developers and Architects. They should be delivery focused and driven to problem solution.

Essential Job Functions:

Developer Data pipelines from various sources using Nexla, Python and Airflow

Large scale file processing (csv,xml,json,pdf etc) experience

Enterprise Data Lake/ Warehouse Development

Schedule and Monitor Batch and near Realtime data pipelines

Unit testing and troubleshooting

Understanding technical design and executing technical requirements

Team player, Work in a fast-paced agile environment

Required skills.

· 5+ Years’ experience in Data Engineering

· 1 year experience with Nexla or similar data ingestion & engineering tools

· 4+ years’ experience in SQL/SnowSQL

· 2+ Years’ thorough experience in Python coding and packages

· 4+ years of overall Data Integration experience with 2+ experience in Data Engineering.

· 2+ years’ experience in large volume File processing with different types and formats

· Experience in Orchestration Tools - Airflow

· Understanding of dimensional and relational data modeling.

· Understanding of BI/DW development methodologies.

Preferred Skills:

Insurance Industry work experience

Understanding of Azure cloud services (Blob Storage, ADLS, Azure Functions, Key Vault etc)

Experience in a SaaS environments – Snowflake Ecosystem Tools, Technology Partner Offerings

Knowledge of BI tools - Power BI, Tableau

Knowledge of DevOps tools - Github, Atlassian Tools(JIRA, Confluence), VS Code

Good documentation skills