Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 12th Feb 2024

JOB DETAIL

•       Snowflake Expertise:

Design, develop, and optimize data pipelines within the Snowflake data platform. Implement best practices for Snowflake data modeling, warehouse architecture, security and performance optimization.

Proficient in using Snowflake Snowpipe streaming for real-time data streaming and ingestion and different batch load ingestion.

 

•       AWS Proficiency:

Utilize AWS services for data integration, storage, and processing. Hands-on experience with AWS Data Migration Service (DMS) for seamless and secure data migration.

Implement and manage streaming data solutions using AWS Kinesis. Design and develop ETL processes using AWS Glue, MSK for efficient data transformation.

 

•       Airflow Workflow Orchestration:

Implement and maintain data workflows using Apache Airflow. Ensure the reliability and scalability of data workflows for efficient data processing. Data Aggregation and Transformation:

Develop and implement data aggregation strategies for large-scale datasets. Collaborate with data scientists and analysts to understand data requirements and ensure data quality.

 

•       Architecture Design:

Collaborate with cross-functional teams to design and implement scalable and reliable data architecture. Ensure adherence to best practices for data security, privacy, and compliance.

 

•       Languages.

Python, Scala, Java, SQL

 

•       Qualifications:

Bachelor’s degree in Computer Science, Engineering, or a related field.

Proven experience as a Data Engineer with a focus on Snowflake and AWS technologies.

Strong expertise in Snowflake Snowpipe for real-time data streaming.

In-depth knowledge of AWS services, including DMS, Kinesis, Glue, and related tools.

Experience with Apache Airflow for workflow orchestration.

Solid understanding of data modeling, aggregation, and transformation techniques.

Strong problem-solving and analytical skills.

Excellent communication and collaboration skills.

AWS Certified Big Data - Specialty or equivalent certification.

Experience with other data warehouse technologies.

Company Information