• Citizen

• Full Time

• Direct Hire

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 2nd Dec 2022

Looking for candidates with good hands on experience of 5+ years in building SQL/NoSQL databases and big data processing pipelines.

 

Necessary Skills

1. Proficient in building and optimizing big data data pipelines, architectures and datasets using technologies like Spark,/Pyspark Hive, AWS Data Pipeline, Azure Data Factory and Apache Airflow etc.

2. Experience in Python, with working knowledge of at least one Python web framework {such as Django, Flask, etc.

3. Strong proficiency in SQL and NoSQL database design, development and maintenance.

a. SQL technologies: SQL Server, Oracle, Redshift and Bigquery

b. NoSQL technologies: Cassandara, HBase and Mongo DB

4. Proficient in stream-processing systems: Storm, Spark-Streaming, etc.

5. Proficient in building processes supporting data transformation, data structures, metadata, dependency and workload management

6. Experience in building reusable and metadata driven components for data ingestion, transformation and delivery

7. Experience of working closely with Data Science / ML Engineers. Experience of any one DS platform like Knime, Alteryx or Dataiku is desired

8. Experience of integrating various systems using Rest APIs or Message Queues is desired

9. Experience of using TDD (Test Driven Development) approach with automated unit tests

10. Experience of working in large teams and using collobration tools like GIT, Jira and Confluence

11. Good understanding of any one cloud platform AWS, Azure or GCP

12. Good understanding of modern architecture patterns like serverless and microservices

13. Experience of working in complete Software Development life cycle involving analysis, technical design, development, testing, , trouble shooting, maintenance, documentation and Agile Methodology

14. Should have an attitude of willing to learn, accept the challenging environment and confidence in delivering the results within timelines. Should be inclined towards self motivation and self-driven to find solutions for problems.

15. For the technical lead role, following additional skills are required:

a. Should be able to participate in technical architecture discussions and share ideas

b. Should be able to mentor and guide a small team of 4-5 people under him/her

• Logical Thinking Able to think analytically, use a systematic and logical approach to analyze data, problems, and situations. Notices discrepancies and inconsistencies in information and materials.
• Task Management Basic level of task management knowledge and experience. Should be able to plan own tasks, discuss and work on priorities, track and report progress
• Communication Able to convey ideas and information clearly and accurately to self or others whether in writing or verbal.

 

ELIGIBILITY CRITERIA:

• Education:

- B-Tech or BE in any engineering discipline from Tier 1-2 college with 5-7 years of experience

• Required Experience:

- Minimum of at least 5 years of relevant experience as Data Engineer

• Behavioral Competency

- Excellent communication skills (must be able to interface with both technical and business

leaders in the organization)

- Strong analytical skills to solve and model complex business requirements are a plus

• Desirable qualities:

- Customer Focus - Dedicated to meeting the expectations of internal and external clients.

- Problem Solving - Uses rigorous logic and methods to solve difficult problems with effective solutions. Probes all fruitful sources for answers. Is excellent at honest analysis. Looks beyond the obvious and doesn't stop at the first answers.

- Learning on the Fly - Learns quickly when facing new problems. A relentless and versatile learner.

- Drive for result - Able to set priorities; pursue tasks tenaciously & with a need to finish. Able to overcome setbacks which may occur along the way.