Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 22nd Apr 2024

JOB DETAIL

Must have 8+ years of experience working for US companies in the US.

Must have 4+ years of Recent (with in the last 7 years) Experience working in a Banking or Brokerage environment.

Must have 4+ years of experience with Azure SQL and Azure Cloud Environments versions 2012-2023.

Must have experience with Blob Storage, Queue Storage, table storage, and files.

Must have minimum of 5 years scripting and automation experience with PowerShell, Spark, Scala, Lambda, Python, and Python/R.

Must have experience with USQL and experience in building pipeline from multiple sources.

Must have experience with Azure Data Lake Store(ADLS), Integration Run Time(IR), Azure Data Factory(ADF),File System Data Ingestion, Relational Data Ingestion.

Experience designing and building production data pipelines from ingestion to consumption

Must have experience with Data Lake, Data Factory experience.

Experience in building a data pipeline.

Experience in designing and implementing data engineering, ingestion and curation functions on Azure cloud using Azure native or custom programming

Must have 5 years of experience in design, development, and maintenance of large scale database projects.

Must have 5 years of experience in database maintenance and release operations.

Must have experience with Database Code Promotion and Release Process.

Must have experience with Microsoft SQL, ETL processes using SQL Server Integration Services (SSIS) for large-scale OLTP and data warehouse systems.

Must have experience with evangelizing database best practices across company.

Must have experience with emerging technologies to data management such as Hadoop, MongoDB, and other NoSQL platforms.

Expert knowledge of SQL Server environments for designing and developing databases.

Familiarity with Microsoft .NET framework and C# is preferred.

Exposure to Service Oriented Architecture (SOA) and web services is preferred.

Experience working in an Agile/Scrum environment.

Familiarity with K-12 data warehousing and analytics is preferred.

Bachelor's degree in Computer Science or equivalent degree in a related field is required.

Company Information