Position: Python Spark (PySpark) Developer
Location: Pune
Mode: Full-Time
Experience Required: 3 to 9 Yrs
Technical:
- Fundamentals of Spark using the Dataframe API
- Understanding partitioning of data
- Analysing and performance tuning Spark queries e.g. looking at the DAG
- Knowledge of Hadoop and its ecosystem of technologies especially Hive
- Python
- OOP concepts using Python
- Knowledge of Conditional Statements & Loops: If-else Control Structures, For/While Loops
- Demonstrate a comprehensive understanding of Complex Data Types: Shallow & Deep Copies, Working with Lists & Tuples, Dictionaries & Sets
- Understand Fundamental Data Structures & their Implementation
- Good knowledge of Exceptions & Command Line Arguments
- Contributes to quality assurance by writing unit and functional tests.
- Ensures development happens for all Software Components in accordance with Detailed Software Requirements specification, the functional design and the technical design document.
- Basic knowledge of UNIX
- Demonstrate source control knowledge (preferably GIT)
- Ability to analyse databases directly using query language tools such as SQL
- Experience on ETL process on Big Data
- Have an understanding of data relationships, normalisation
Non-Technical:
- Use of JIRA / Confluence
- Appreciation of release management and software maintenance
- Provides Level 3 support
- Contributes to problem and root cause analysis.
- Collaborates with colleagues participating in other stages of the Software Development Lifecycle (SDLC).
- Strong analytical skills.
- Should have good understanding of architecture
- Ability to work in virtual teams
- Excellent team player and open minded approach
- Ability to share information, transfer knowledge and expertise to team members.
- Ability to design and write code in accordance with provided business requirements
- Ability to work in a fast paced environment with competing and alternating priorities with constant focus on delivery.
- Candidate is expected to have high desire to learn new technologies and implement various solutions in fast paced environment.
Nice To Have:
- Knowledge of control M
- Hands on experience of Team City
- Understanding of Financial Products
- Ability to interpret and write complex SQLs
Role:Full Stack Developer
Salary: 10,00,000 - 20,00,000 P.A.
Industry:IT Services & Consulting
Functional Area:Engineering - Software
Role Category:Software Development
Employment Type:Full Time, Permanent