Required Skills

Data Engineer Hadoop Spark Kafka EC2 EMR Athena S3 AWS Informatics

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 18th Feb 2021

JOB DETAIL

 6 – 8 years of experience in a Data Engineer role

• Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

• Experience with big data tools: Hadoop, Spark, Kafka, etc.

• Experience with relational SQL and NoSQL databases such as Cassandra.

• Experience with AWS cloud services: EC2, EMR, Athena, S3

• Experience with object-oriented/object function scripting languages such as Scala

• Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with unstructured datasets.

• Deep problem-solving skills to perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

• Build processes supporting data transformation, data structures, metadata, dependency and workload management.

• Proven experience in manipulating, processing and extracting value from large disconnected datasets.

• Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services

• Integrate new data sources and tools

• Implement scalable and reliable distributed data replication strategies

• Ability to mentor and provide direction in architecture and design to onsite/offshore developers

• Experience supporting and working with cross-functional teams in a dynamic environment. Must be able to quickly understand technical and business requirements and can translate them into technical implementations

• Experience with Agile Development methodologies

• Experience with data ingestion and transformation

• Solid understanding of secure application development methodologies

• Experienced in developing microservices using spring framework is a plus

• Understanding of automated QA needs related to Big data

Company Information