Bachelor’s degree in Computer Science, Engineering, or a related field.
10+ years of extensive experience as a Python Developer, with a strong emphasis on data processing, Django, PySpark, and SQL.
Proficiency in Python programming, particularly for web development, data processing, and data analysis.
Strong understanding of Django for web application development, including RESTful APIs, ORM, and security best practices.
Expertise in PySpark for distributed data processing, data transformation, and analytics on big data.
Solid knowledge of SQL for querying, data manipulation, and performance optimization in relational databases and data warehouses.
Effective communication and collaboration skills to work with cross-functional teams and stakeholders.
Lead the architecture, design, and development of data processing applications using Python, Django, and PySpark, ensuring efficient and scalable processing of large datasets.
Collaborate with cross-functional teams to understand business requirements, data processing needs, and translate them into efficient and reliable technical solutions.
Implement and optimize PySpark jobs, ensuring compliance with industry standards, data security, and performance tuning for large-scale data processing.
Develop and optimize SQL queries for data manipulation, querying, and performance tuning to support data processing requirements.
Leverage cloud-based technologies and distributed computing frameworks for scalable and resilient data processing solutions.