Required Skills

DATA ENGINEER

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 20th Dec 2022

JOB DETAIL

                                             

As a Senior Data Engineer, you will work closely with both software engineers and data scientists to:
-> Build and optimize data pipelines and ETLs to generate value for our organization and our client base.
-> Investigate new technologies to improve the availability, performance, cost, and reliability/fault tolerance of our data pipelines and workloads.
-> Optimize the performance of the current data stores and pipelines.
-> Create data pipelines to power AI/ML workloads.
-> Ensure data pipelines comply with retention policies.
-> Prepare data to optimize embedded reporting/BI for customer and internal needs.

Required Qualifications:
-> Mastery of SQL
-> Mastery with Python
-> Experience Java 8+ or Scala is a PLUS
-> Mastery with distributed data/computing tools, such as Hadoop, Hive, or Spark
-> Proficiency working with any Non SQL based data store
-> Proficiency with open source ETL frameworks, such as Apache Airflow, Luigi, or similar
-> Proficiency with Git
-> Proficiency with AWS Services
-> Familiarity with Data streaming services, such as Apache Kafka, Amazon Kinesis, or Apache Flink
-> Familiarity with code quality tools such as SonarQube
-> Familiarity with CI/CD pipelines

Desired Qualifications:
-> AWS Certified Database Specialty (DBS-C01) or AWS Certified Data Analytics Specialty (DAS-C01)
-> Familiarity with AWS Services including Redshift and DynamoDB

Company Information