5+ years of experience in application development using any of these programming languages: Java, Scala, Python.
Experience working in financial industry is preferred.
3+ years of experience working with Amazon Web Services (AWS) including entitlement and IAM policy.
AWS professional certification is preferred.
3+ years of experience working on streaming data applications (Spark Streaming, Kafka, Kinesis, and Flink)
3+ years’ experience working with data pipeline open source products (Airflow, Jupyter, Anaconda)
3+ years’ hands-on experience with Hadoop data platform (MapReduce, Pig, Hive, HBase, Impala), experience working with Cloudera stack is preferred.
1+ years of experience with DevOps automation tools (AWS CloudFormation, Terraform)
1+ years of experience in developing, deploying and monitoring in building large distributed and parallel systems using container technology including Docker, Kubernetes, AWS EKS, AWD Fargate
Lead by influence, mentor junior software engineers, ability to navigate to different teams and business to find solutions to complex problems
Strong on critical thinking, great communication and team work skill is essential to this role