US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 27th May 2022
Challenges you will work on:
Design and develop business-critical backend systems using stream processors and high-quality data pipelines.
Work in a cross-functional team of engineers and scientists to design and code large-scale batch and real-time data pipelines.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
using SQL and AWS ‘big data’ technologies.
Build a cloud-native, real-time stream processing & data lake platform that scales into the Petabytes and beyond.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency,
and other key business performance metrics.
Perform code reviews, and lead by example on code refactoring for readability, extensibility, and testability
Lead your products, with a focus on DevOps and robust automation
Build processes that support data transformation, workload management, data structures, dependency, and metadata
Who you are:
We are looking for a candidate with 5+ years of experience in a Data Engineering role, who has attained a Graduate degree in Computer
Science, Statistics, Informatics, Information Systems, or another quantitative field. They should also have experience using the following
software/tools:
Strong verbal and written communication skills
Experience with relational SQL(Hive/Presto) and NoSQL (Dynomodb/Redis)
Experience with data pipeline and workflow management tools: Airflow
Experience with AWS cloud services: EC2, S3
Experience with object-oriented/object function scripting languages: Scala, Python, etc.