- You'll contribute dev ops efforts in terms of CICD, Scanning, Code, Performance testing and Test coverage
- Identify, analyze, and interpret trends or patterns in complex data sets
- Come in with an understanding of the importance of end-to-end software development-such as Agile frameworks-is key. And best of all, you’ll be working with and sharing ideas, information and innovation with our team of technologist
Required qualifications, capabilities, and skills:
- Formal training, or certification on software engineering concepts and 8+ years applied experience in Development and implementations experience with Big Data solutions in AWS services like Glue, SQS, SNS, Lambda, EMR, Kinesis
- Strong experience in Python and with implementing complex ETL transformations using Spark (Data Frame & SQL), Kafka , streaming
- Strong experience with AWS ETL/File Movement tools ( GLUE, Athena, Lambda, Kinesis, and other AWS integration stack).
- Strong experience with AWS database technologies ( Redshift, Aurora, RDS, S3 and other AWS Data Services) covering security, policies, and access management.
- Strong programming Experience with Python and Spark.
- Experience with Apache Airflow, and another automation stack.
- Experience with security models and development on large data sets.
- Experience with Big Data Operations and large volumetrics of data
- Specialized in Redshift . The ideal candidate for this role would have several years of experience working with AWS Redshift and a proven track record of delivering high-performing, scalable data warehousing solutions in the AWS cloud including setup, configuration, administration, and troubleshooting
- Experience with data warehousing and data modeling, including design and optimization of data structures for performance and scalability. Strong experience with data security and encryption, including implementing security best practices for data warehousing in AWS.
- Experience with performance tuning and optimization techniques for AWS Data warehouse services.
- Strong understanding of data warehousing best practices, including data modeling, data integration, and data governance.
- Advanced knowledge of application, data and infrastructure architecture disciplines, Understanding of architecture and design across all systems
- Working proficiency in developmental toolsets ,ability to collaborate with high-performing teams (strong interpersonal skills) and contribute in design, architecture, development, testing, implementation and support
- Must be able to communicate complex issues in a crisp and concise fashion to multiple levels of management. Demonstrated independent problem solving skills and ability to develop solutions to complex analytical/data-driven problems
- Experience performing data analytics on AWS
- Experience in implementing distributed and scalable algorithms is a plus