Required Skills

Jenkins Spark.

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 24th Aug 2022

JOB DETAIL

Description

This team is responsible for ensuring Privacy regulations of Customer Data is up to par with individual states\' standards. Walmart\'s Customer 360 view is continuing to evolve and this team regulates the Customer data migrated into the Data Lake. The goal of this initiative is to reduce the customer footprint within Walmart and to have a single source of customer data.

This includes: regulatory and ethical requirements around data; Data modeling, storage, integration, and warehousing; Data value chains (identification, ingestion, processing, storage, analysis, and utilization); Data quality framework and metrics; Regulatory and ethical requirements around data privacy, security, storage, retention, and documentation; Business implications on data usage.
\*Any knowledge of privacy within data is a plus\*

--Design, develop and build database to power Big Data analytical systems.
--Design data integration pipeline architecture and ensure successful creation of the infrastructure required for optimal extraction, transformation, and loading of
data from a wide variety of data sources using Spark, SQL, HQL and other technologies.
--Build robust and scalable applications using SQL, Java and Spark.
--Create real time data streaming and processing using Kafka and/or Spark streaming.
--Work on creating data ingestion processes to maintain Global Data lake on Google cloud or Azure
--Engage with architects and senior technical leads to create and enhance complex software components.
--Design, configure and implement systems that can scale to process terabytes of data between heterogeneous systems on premise and cloud.
--Work with business customers, product managers and engineers to design feature-based solutions and implement them in an agile fashion.
--Develop proof-of-concept prototype with fast iteration and experimentation.
--Develop and maintain design documentation, test cases, performance and monitoring and performance evaluation using Git, Crontab, Putty, Jenkins, Maven, --
Confluence, ETL, Automic, Zookeeper, Cluster Manager
--Perform continuous integration and deployment using Jenkins and Git

Company Information