AWSS3LambdaCloudWatchSparkSpark SQL.PythonApache AirflowApache NiFiData LakesPower BI
Work Authorization
Us Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Preferred Employment
Corp-Corp
Employment Type
Consulting/Contract
education qualification
UG :- - Not Required
PG :- - Not Required
Other Information
No of position :- ( 1 )
Post :- 24th Nov 2020
JOB DETAIL
• 5 – 10 years of recent experience in data engineering.
Experience on AWS and its web service offering S3, Redshift, EC2, EMR, Lambda, CloudWatch, RDS, Step functions, Spark streaming etc.
Good knowledge of Configuring and working on Multi node clusters and distributed data processing framework Spark.
Hands on 3 years of experience with EMR Apache Spark Hadoop technologies
Experience with must have Python and PySpark, Spark SQL.
Experience in working with large volumes of data Tera-bytes, analyze the data structures
Experience in designing scalable data pipelines, complex event processing, analytics components using big data technology Spark, Python, Scala, PySpark,
Expert in SQL, redshift, NoSQL database
Experience in process orchestration tools Apache Airflow, Apache NiFi etc.
Experience in any BI technology Tableau, Power BI, etc.
Hands on knowledge of design, development and enhancement of Data Lakes, constantly evolve with emerging tools and technologies