• US Citizen

• Green Card

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 11th Oct 2022

5+ years of experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient and distributed data pipelines.
Experience working with ETL tools such as Databricks and Redshift
• High Proficiency in at least two of Scala, Python, Spark or Flink applied to large scale data sets.
• Strong understanding of workflow management platforms (Airflow or similar).
• Familiarity with advanced SQL.
• Expertise with big data technologies (Spark, Flink, Data Lake, Presto, Hive, Apache Beam, NoSQL, ...).
• Knowledge of batch and streaming data processing techniques.
• Obsession for service observability, instrumentation, monitoring and alerting.
• Understanding of the Data Lifecycle Management process to collect, access, use, store, transfer, delete data.
• Strong knowledge of AWS or similar cloud platforms.
• Expertise with CI/CD tools (CircleCI, Jenkins or similar) to automate building, testing and deployment of data pipelines and to manage the infrastructure (Pulumi, Terraform or CloudFormation).
• Understanding of relational databases (e.g., MySQL, PostgreSQL), NoSQL databases (e.g., key-value stores like Redis, DynamoDB, RocksDB), and Search Engines (e.g., Elasticsearch). Ability to decide, based on the use case, when to use one over the other.