• US Citizen

• Green Card

• Corp-Corp

• W2-Permanent

• W2-Contract

• Contract to Hire

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 22nd Jul 2023

Submit only 10 plus years experience resume

Must be strong, Kafla,streaming,AWS Glue,python etc.,

The role will collaborate with a cross-functional team to provide data solutions with engineering, marketing, merchandising, and executive teams.
* Contribute to technology selection and strategy for big data solutions
* Build, test, and operate stable, scalable data pipelines that cleanse, structure, and integrate disparate data sets into a readable and accessible format for end-user-facing reports, data sciences, and ad-hoc analyses
* Create data pipelines to handle data ingestion in a way that is both rapidly available and fault tolerant
* Support AI/Machine Learning Initiatives to drive value for consumers and internal stakeholders
* Review and contribute to technical documentation
* Knowledge sharing and coaching
* Lead the onboarding of new data engineers
* Bachelor’s degree in Computer Science, Engineering, or a related technical field (Or equivalent knowledge/experience)
* A minimum of 5 years of Object Oriented Programming (OOP) and/or functional programming experience/education
* Familiarity with Cloud Big Data Solutions (EMR, Redshift, Big Query, Azure Data Pipelines, Azure Datawarehouse, etc.)
* Familiarity with Apache Suite for Big Data Architecture (Spark, Akka, Cassandra, Kafka)
* Strong experience in data engineering and data pipeline development in a cloud-based environment, preferably using services such as FiveTran, AWS Glue, and Redshift Spectrum.
* Knowledge of Python programming language
* Familiarity with Lambda Architecture concepts and tooling options
* Proficiency in SQL and experience working with relational databases and data warehousing concepts.

* Hands-on experience with dbt (Data Build Tool) or similar data transformation and engineering tools.
* Familiarity with data governance, data security, and compliance practices.
* Solid understanding of data modeling and database design principles.
* Experience with performance tuning and optimization of data pipelines and database queries.
* Ability to thrive in a fast-paced environment and master frequently changing technologies and techniques