Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 16th Feb 2024

JOB DETAIL

• Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients

•             Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions

•             Implement ETL processes to extract, transform, and load data from various sources

•             Ensure data quality, integrity, and consistency throughout the ETL pipeline

•             Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts

•             Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices

•             Integrate data from different systems and sources to provide a unified view for analytical purposes

•             Collaborate with data analysts to implement solutions that meet their data integration needs

•             Design and implement streaming workflows using PySpark Streaming or other relevant technologies

•             Develop batch processing workflows for large-scale data processing and analysis

Company Information