Perform administrative tasks like maintaining windows and unix servers, coordinating user provisioning, system account authorizations with IT security team based on Google IAM access rules and job scheduling in Airflow.
Monitor performance of the GCP services and overall data platform, propose solutions to Cloud Engineering team for Implementation of the fixes as needed.
Create scripts to automate alerts and monitoring on the platform services, assist with automation of deployment for the platform along with offshore engineers.
Manage User access for Talend products including Talend Studio and Talend Management Console, troubleshoot and manage remote engine clusters. – Will be trained by Customer, if they don’t have the prior Talend experience.
Requirements:
Experience in Google Data Platform administration and familiar with ETL process, messaging patterns, streaming data, Kafka , API and SQL.
Hands-on experience in the administration of GCP services such as Cloud dataflow, Cloud Pub-Sub, Big Query, Cloud Storage,Composer etc
Understand the fundamentals of Git workflows and SDLC cycle supporting multiple non-production and production environments.
Provided technical support in trouble shooting environment, tools or application specific issues by responding to Incidents and Alerts.
Experience in optimization of existing cloud-based services running in production environments, monitoring the cloud cost and providing periodic reports to leadership team.
Experience in scripting using Python and Windows/Unix commands.
Involved in cluster performance tuning and Big Query optimization is a plus.
Experience in automation of the deployment of services and configuration updates is a plus.