US Citizen
Green Card
Corp-Corp
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 9th Apr 2022
This position will focuson developing various database and data loading/transformation efforts.Initiatives could include multiple source files and/or files sourced bothinternally and externally. Candidate is required to interact with databasesusing AWS Lambda, AWS Glue (for transformations) Python and Spark. Possiblework leveraging SnapLogic for ETL, depending upon use case. Work will beapplicable to multiple applications. Knowledge of automated testing of data aplus.
Responsibilities:
• Design and built data applications for analytical reporting
• Analyze data and design ETL frameworks using Python and Spark technologies
• Collaborate with business partners to gather requirements and translatethat to technical specifications
• Adhere to lean agile methodologies
• Production Support including root cause analysis and long term fixes.
• Implement data pipelines to meet business requirements and adhere tobest practices..
RequirementsSkills:
• Proficient in Python, Spark and database technologies
• Experience with various AWS services like AWS Glue, IAM, RDS, S3, SQS,SNS, Lambdas, Cloud Formation, AWS Glue, Cloud Watch, Event Bridge, CLI
• Experience with Unix/Linux
• Experience with SQL
• Experience with source code control, preferably Git.
• Experience in CI (Continuous Integration)/ CD (Continuous Delivery)software development pipeline stages like Commit, Build, Automated Tests, andDeploy.
• Experience in creating AWS Glue components - Jobs, Triggers, Workflows
• Experience with AWS CLI
• Experience working with databases such as Snowflake and/or Aurora
• Experience with Hashicorp tool suite - Terraform, Vault
• Experience with soap and rest services
• Experience working with XML, JSON, YAML files
• Experience with logging tools such as CloudWatch and Splunk