• US Citizen

• Green Card

• EAD (OPT/CPT/GC/H4)

• H1B Work Permit

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 3rd Oct 2022

• Design and implement dynamic, metadata-driven data pipelines that ingest a variety of data from multiple data providers
• Create and manage unit and integration test catalogue in a test-driven development environment
• Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
• Excellent analytic skills associated with working on unstructured datasets
• Ability to build processes that support data transormation, workload management, data structures, dependency and metadata
• Interact with CI/CD pipelines and related tools

Requirement:

• 10+ Years of Data Engineering professional with Strong proven track record of implementation in a variety of data platforms.
• Extensive experience working on spark in performing ETL using Spark-SQL, Spark Core and Real-time data processing using Spark Streaming from Kafka.
• Analysis, Design, Development with technologies like Spark, Hive, Kafka and HDFS including programming languages such as Python, Scala and Java
• Sound RDBMS and NoSQL concepts
• Experienceith build automation tools and experience in CI/CD pipelines with tools such as Jenkins, UDeploy and Artifactory