Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :-

  • PG :-

Other Information

  • No of position :- ( )

  • Post :- 7th Dec 2022

JOB DETAIL

Key requirements:

•Strong hands-on experience working in Hadoop Ecosystem ,Big data technologies and AWS Cloud and Cloudera

• Must be hands-on with writing Python or Scala Scripts development

• Well versed with Spark development (SQL and/or Spark)

• Hands on experience designing of orchestration using Airflow

• Hands on experience in AWS Service EC2, S3, SNS, SQS, Lambda, Hue, Presto, Spark , Glue, Kinesis, EMR, ECS, EKS

• Sound knowledge in Hive, Redshift, AWS RDS, My SQL and in any NoSQL database e.g., Cassandra, MongoDB

• Experience in architecting and designing batch or real time data streaming

• Ability to dynamically adapt to conventional big data frameworks and open source tools if project demands

• Knowledge of design strategies for developing scalable ,resilient, always-on data lake

• Strong development and automation skills

• Good understanding in data architecture principles ,including data access patterns, data modelling and strong in Data base concepts

• Previous experience in ESG related reporting in a financial services organization is an advantage

 

Company Information