• US Citizen

• Green Card

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 16th Sep 2022

As a Senior Data Engineer, you will beresponsible for:

?       Database optimizationand security

?       Expanding andoptimizing our data and data pipeline architecture.

?       Build and optimizeOLTP databases in support of scalable, high throughput solutions (preferredPostgres)

?       The ideal candidate isan experienced data pipeline builder and data wrangler who enjoys optimizingdata systems and building them from the ground up.

?       Create and maintainoptimal data pipeline architecture

?       Automating manualprocesses, optimizing data delivery

?       Optimal extraction,transformation, and loading of data from a wide variety of data sources

?       Create replicationpipelines, secure shares & Data Engineering pipelines to build proposeddata model for reporting.

?       Unit and Integrationtesting of data engineering pipelines built.

Skills/Experience:

Experience with Database security and access control as aseparate item, around GCP IAM and CloudSQL integration is a MUST HAVE

•            Advancedworking knowledge and experience working with relational databases, queryauthoring as well as working familiarity with a variety of databases –PostgreSQL (aka CloudSQL on GCP)

•            Strongexperience in ETL processes using wide variety of data sources

•            Advancedworking knowledge and experience working with relational databases, queryauthoring as well as working familiarity with a variety of databases –PostgreSQL (aka CloudSQL on GCP)

•            StrongExperience with Code Management DevOps: Github

•            Experiencewith Google Cloud Platform (GCP) cloud services: BigQuery, DataFlow, PubSub,CloudSQL, Cloud Storage, Cloud Composer, VertexAI

•            Workingknowledge of Cloud platforms and the technologies that make them work. (GoogleCloud Platform)

•            Experiencein design and development of large-scale data solutions using GCP services likeDataProc, Dataflow, Cloud Bigtable, BigQuery, Cloud SQL, Pub/Sub, Cloud DataFusion, Cloud Composer, Cloud Functions, Cloud storage, Compute Engine, Lookerand Cloud IAM

•            Experiencebuilding data processing pipelines to integrate large datasets from multiplesources and formats

•            Experiencedesigning and developing data pipelines from ingestion to consumption within bigdata architecture using Python, Java, SQL etc.

•            Experiencewith building data pipelines in streaming and batch mode

•            Bachelor’sDegree 

Certification(s) Preferred:

?       GCP Professional DataEngineer

?       GoogleCloud Professional Cloud Architect certification and/or other Google Cloudcertifications