Required Skills

Bigdata Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 19th Oct 2023

JOB DETAIL


 
Bachelors  degree in
 Engineering or Computer Science or equivalent OR Masters in Computer
 Applications or equivalent.
 
7-10+ years of software
 development experience and leading teams of engineers and scrum teams
 
4+ years of experience in applying
 Statistics along with end to end ML engineering (design, development &
 implementation of end-to-end AI/ML models)
 
Hands-on experience on writing and
 understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while
 processing huge amount of data
 
Good understanding of various
 AI/ML models including Classification, Clustering, Regression in detecting
 Product anomalies and building early warning systems
 
Expertise with data structures,
 data modeling, and software architecture


Good to have Qualifications:


 
Expert on Hadoop and Spark
 Architecture and its working principle
 
Experience in UNIX shell scripting
 
Ability to design and develop
 optimized Data pipelines for batch and real time data processing
 
Should have experience in
 analysis, design, development, testing, and implementation of system
 applications
 
Demonstrated ability to develop
 and document technical and functional specifications and analyze software
 and system processing flows
 
Aptitude for learning and applying
 programming concepts.
 
Ability to effectively communicate
 with internal and external business partners. Preferred Additional:
 
Experience in cloud platforms like
 GCP/AWS, building Microservices and scalable solutions is highly desired
 
Knowledge of Financial reporting
 ecosystem will be a plus
 
2+ years of experience in
 designing and building solutions using Kafka streams or queues
 
Experience with GitHub and
 leveraging CI/CD pipelines
 
Experience with NoSQL i.e., HBase,
 Couchbase, MongoDB

Company Information