Bachelor’s degree in IT, information security, computer science, or a related field with 10 years of relevant hands-on working knowledge on the following.
Job summary We are looking for a strong Cloud Engineer with AWS , Python and Airflow skills
Should have experience working as a Data Engineer with AWS skillsets.
Data engineer develops, builds, maintains end to end data pipelines working with large datasets by leveraging AWS Analytics services like Glue ,EMR, RDS etc.
Should have experience in Python
Should have experience in PySpark
Handling data ingestion from all types of data source, utilize appropriate AWS ETL tools
Required Skills ,AWS Big Data
Nice to have skills ,Python, PySpark, AWS
Handling data ingestion from all types of data source, utilize appropriate AWS ETL tools to process and load in destination with Enterprise grade security.
Data cleaning and wrangling & Ensuring the accuracy of data.
Promoting data quality & Transforming data into more useful formats.
This can involve writing code to automate processes, leveraging ML algorithms to detect patterns/anomalies in data to ensure Data Quality.
Should have experience in Git/GitLab handling a code repository, engineering workflow
Should have General data transformation experience
Strong Database skills.
Experience in JIRA
Strong understanding of software testing, benchmarking, and continuous integration