- Design and implement Data ingestion and pipeline workflows as per business needs and technical specifications.
- Works independently and collaboratively with team; keeping the project team and leaders in the loop.
- Prepares detailed specifications from which data ingestion and pipeline processes are developed.
- Develops and implements technical solutions by code development and tool configuration.
- Querying databases using SQL (Structured Query Language) to extract relevant data for analysis and troubleshooting of defects/bugs.
- Responsible for the development and execution of testing and implementation plans. Can perform unit, system, integration and user acceptance testing. Documents results.
- Participates in project planning and development or assumes responsibility for a project of limited scope.
- Provides options for and estimates of possible coding.
- May be responsible for the completion of a phase of a project or small projects depending on complexity.
- Estimates and tracks time required to complete work, for project budgeting and financial tracking.
- Conducts and participates in reviews of solution designs, configurations and code.
- Provides technical expertise for project and baseline support teams.
- Adheres to security standards to comply in the handling/processing/storing of sensitive data.
- Adheres to development standards and provides development standards recommendations.
Education Level: 4-Year Bachelor's Degree
Years of Experience: 3+ years of professional experience
Technical Skills and Qualifications:
- Must have:
- Google Pub/Sub
- BigQuery
- Google Dataform
- Data ingestion to Big Query experience
- Google Cloud Storage
- Cloud Composer
- GitHub
- SQL
- Good to have:
- Cloud Data fusion
- DBMS connectivity and interaction experience (SQL Server, DB2, Oracle)
- Experience calling RESTful API’s and SOAP Webservices
- Experience integrating with other Google resources, databases, and services
- Jira
- Confluence