Required Skills

Data engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 8th Oct 2022

JOB DETAIL

The job holder is responsible for the timely delivery of high-quality end to end data solutions, while ensuring compliance with company policies.

This role is housed in the Data and Analytics department, will be working with QA engineers and devops engineers to develop new data product features, support data analysts, data scientists and other business units.

The position holder must have the initiative and drive necessary to deliver enterprise quality solutions in an agile manner, ready to work in depth with many different AWS resources in development and production environments.

 

 

Key responsibilities:

? Maintain and manage end to end data pipelines forstructured and unstructured data.

? Work as part of a cross-functional, agile team to swiftlydeliver solutions based on requirements defined by various business units.

? Ensure that all solutions are repeatable and scalableacross the organization

? Provide robust solution documentation. 

? Must exhibit initiative and focus to troubleshoot and seekout solutions while working independently.

? Work with DQ engineers to build test plan for newdevelopment.

? Follow code development standard, support, and enhancelibrary

? Work as part of the Data and Analytics team with a focuson data management and solution delivery.

? Keep data protection and cloud security considerations atthe forefront of every deliverable.

 

 

Qualifications:

? Have designed and built scalable data pipelines in thecloud to support a wide variety of data and application solutions.

? Ability to work with different people across multipleteams effectively

? Organized and able to effectively communicate progress throughoutproject lifecycles

? Proven history of innovative problem solving and solutiondelivery

? Experience with Windows and Linux operating systems

? Experience working with container (Docker, Kubernetes)

? Strong Python skillset

? Strong SQL on a variety of platforms (such as MSSQL,Athena, Redshift), able to optimize query

? Experience maintaining AWS resources with IaC(CloudFormation, Terraform, AWS CDK)

? Experience with a broad set of AWS resources (Lambda, S3,Glue, Athena, etc.)

? Experience with source code control, Git.

? Ability to write organized, clean, well-commented code

? Experience with bash and AWS CLI

? Familiar with latest big data technology, Hadoop, spark.

? 3 - 5 years of cloud data experience

? BA/BS and ideally advanced degree or equivalentcombination of education/experience

? Ability to handle multiple priorities and meet aggressivedeadlines.

 

Company Information