Required Skills

BigData Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 26th Mar 2022

JOB DETAIL


Job title: Data Engineer
Job summary:The candidate will be responsible for developing Java and Spark programs by understanding business rules and standards, and translating those needs into applied rules, tests, and reports that can be applied to data sets. The candidate will have or develop a deep understanding of information repositories and the business context of the information they contain as well as the technical skills to build repeatable, robust processes to test these information sources.
Experience 8 to12yrs
Required Technical Skills: Python, SparkSQL, PySpark, Spark Domain Skills- 5.Nice to have skills Techincal Skills- Domain Skills- 6.Technology Data Management 

Roles & Responsibilities - - Build data pipelines for batch and real-time processing/ingestion using Java Spark - - Perform ETL,ELT operations on raw data and maintain the data quality and efficiency of datasets - - Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and micro service architecture. - - Write optimized queries against SQL relational databases as well as NoSQL databases. - - Hands-on development mentality, with a willingness to troubleshoot and solve complex problems. - - Create and maintain code using version control tools like BitBucket or Git and deploy using automated CI/CD pipelines - - Work in agile /scrum delivery model in cross functional team and dynamic environment - - Strong written and oral communication skills - - Ability to work in team in diverse/ multiple stakeholder environment - - Analytical skills - - Experience and desire to work in a Global delivery environment - - Bachelors / Master degree in IT - - Prior experience on Java programming - - Prior experience on Big Data – Spark Programming - - Basic knowledge on Devops

 

Company Information