US Citizen
Green Card
Corp-Corp
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 1st Jun 2022
Qualifications
• 5+ years of total IT experience
• 3+ years of experience as a Data Engineer, having built large and complex data pipelines
• Experience designing, building and operationalizing large scale enterprise data solutions and applications using AWS data and analytics services in combination with other services/platforms – Spark, EMR, RedShift, Kinesis, Kinesis Firehose, Athena, Lambda & AWS Glue
• Thorough knowledge of AWS concepts for use in day-to-day development regarding security, networking, and other concepts. This will require understanding how IAM Roles, VPCs, Security Groups, Access Control Lists, Lifecycle Policies, etc., will impact the products you build. Must also know how to adjust those pieces.
• Experience integrating with orchestration tools for data pipeline and workflow management such as: AWS Step Functions, Airflow, etc.
• Experience implementing streaming big-data pipelines as well as batch job flows in AWS
• Able to implement a change data capture (CDC) experience
• Able to support and contribute towards the building of end-to-end products on AWS in all aspects including Development, DevOps, designing, architecting, testing, and maintenance/operations
• Advanced working SQL knowledge and experience working with relational databases and NOSQL databases.
• Experience designing and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Scala.
• Must have experience with infrastructure-as-code tools such as Terraform (preferably) or CloudFormation
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Understanding of concepts regarding security, privacy, performance, etc.
• Kubernetes experience for developing, deploying, and orchestrating