- Proficient in Python for data processing, scripting, and automation.
- Experience with Spark for data transformation, distributed processing, and ETL workflows.
- Hands-on experience with core AWS services like S3, Lambda, Glue, EMR, Redshift, and RDS. Knowledge of IAM, CloudFormation, and/or Terraform for infrastructure management is a plus.
- Strong understanding of SQL, data warehousing, and database design principles.
- Familiarity with data modeling, schema design, and query optimization.
Other Skills:
- Experience with version control (Git) and CI/CD practices.
- Strong problem-solving skills and ability to work in an Agile environment.
- Excellent communication skills and ability to work with non-technical stakeholders.
Preferred Qualifications:
- Familiarity with additional tools like Airflow for workflow orchestration.
- Experience with data streaming technologies (e.g., Kafka, Kinesis).