• Citizen

• Full Time

• Direct Hire

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 29th Jun 2022

We are hiring a Senior Engineer- Big Data for a top IT company in Navi Mumbai location. Please find other details below-

Education: A degree in Computer Science, Information Technology, Engineering, or a relevant field.

Industry: Information Technology/BFSI
 

Experience:

2-6 years of relevant industry experience

• Should have 2+ years on Big Data Systems such as Hadoop, Spark and/or Kafka
• Should have competence in one Programming /Scripting language Java, Scala, R or Python
• Should have hands-on experience in Apache Sqoop
• Should have working experience on on-premises big data infrastructure handling large and diverse datasets along with its resource management, experience in data processing languages and frameworks like Hive, Pig and Impala
• Should have working experience with on-premises Kubernetes clusters
• Should have working experience in Linux ecosystem and its associated data processing commands
• Experience in one or more of the below technologies is preferred
• Airflow / Prefect
• MongoDB, HBase, Redis, and Memcached
• MySQL, Cassandra, Oracle SQL and PL/SQL

Responsibilities:

With variety of data, should be capable of implementing data pipelines

• Identify valuable data sources and automate collection processes
• Undertake preprocessing of structured and unstructured data
• Undertake Data wrangling and cleaning
• Collaborate with all stakeholders of product development teams
• Identify valuable data sources and automate collection processes
• Analyze large amounts of information to discover trends and patterns
• Should have business expertise:
• Data landscape understanding
• Solution conceptualization
• Understanding of business context
• Business benefit estimation
• Change management
• Interaction with senior leaders and business stakeholders

Skills and Qualifications:

1. Proven industry experience as Big Data Engineer or Data Analyst or Systems Engineer

2. Should have practical hands-on experience in working/delivering 2 to 3 big data / data intensive projects preferably in BFSI domain within Hadoop Tech-stack

3. Experience of setup and management of data pipelines

4. Experience of data structures, data modeling, data mining and software architecture

5. Experience of operation research and data extraction on public domain data.

6. Hands-on experience in Java, Scala, Python and R, experience to scale modular code to operate on large data set, operate trigger-based and time-based workflow to scale modular code

7. Understanding of machine learning frameworks (like Keras/ Tensorflow/ PyTorch/PyCharm/Kite), libraries (like scikit-learn) and its dependency management will be an added advantage

8. Image Processing Knowledge would be a plus

9. Any Big Data Ecosystem Certification is a plus

10. Outstanding analytical and problem-solving aptitude

11. Excellent communication and presentation skills

Call/Whatsapp Apoorva on +91 9810193265 or share your CV at apoorva@gist.org.in.