Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 30th Mar 2023

JOB DETAIL

 

 Senior Data Engineer (Databricks with Python + AWS) position. In this role, you will provide technical guidance to teams; anchor Proof of Concept developments and support opportunity identification and pursuit processes and evangelize Infosys brand. You will collaborate with some of the best talent in the industry to create and implement innovative high-quality solutions. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.

 Required Qualifications:
•    Candidate must be located within commuting distance of Boston, MA or be willing to relocate to the area.
•    Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
•    At least 4 years of experience in data integration and pipeline development with data warehousing 
•    At least 3 years of experience in working on DWH Development as lead
•    Proficient in scripting skills in Python/Scala/Java programming skills in AWS Cloud environment.
•    Strong experience with AWS Cloud on data integration with Databricks, Apache Spark, Airflow, EMR, Glue, Kafka, Kinesis and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
•    Experience to drive an independent project from development/ lead standpoint
•    Experience with Agile development methodologies

Preferred Qualifications:
•    Experience and understanding across any key SQL and NoSQL datastores (HDFS, S3, Snowflake, MongoDB, Splunk) as well as In-memory datastores
•    Design, develop, test, deploy, maintain and improve data integration pipeline.
•    Strong experience with Unix Scripts
•    Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
•    Good experience with source control systems such as Git, Bitbucket, and Jenkins. Working experience in CI/CD deployments
•    Good understanding of Data integration, Data Quality, data models
•    Ability to work in Fast paced and Dynamic environment.
•    Experience managing team size of 4-5
•    Snowflake experience is a plus
•    AWS Certification is a plus

Company Information