Required Skills

Big Data Engineer

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 9th Jan 2021

JOB DETAIL

Title: Big Data Engineer with Python
Location: Charlotte, NC (Remote till Covid)


Overall Responsibility:

  • Develop sustainable data driven solutions with current new gen data technologies to meet the needs of our organization and business customers.
  • Apply domain driven design practices to build out data applications. Experience in building out conceptual and logical models.
  • Build out data consumption views and provisioning self-service reporting needs via demonstrated dimensional modeling skills.
  • Measuring data quality and making improvements to data standards, helping application teams to publish data in the correct format so it becomes easy for downstream consumption.
  • Big Data applications using Open Source frameworks like Apache Spark and Kafka on Azure cloud based data warehousing services.
  • Build pipelines to enable features to be provisioned for machine learning models. Familiar with data science model building concepts as well as consuming and from data lake.

 

Basic Qualifications:

· At least 8 years of experience with the Software Development Life Cycle (SDLC)
· At least 5 years of experience working on a big data platform
· At least 3 years of experience working with unstructured datasets
· At least 3 years of experience developing microservices: Python, TwistedPy, PySpark, Django
· At least 1 year of experience building data pipelines, CI/CD pipelines, and fit for purpose data stores
· At least 1 year of experience in cloud technologies: Azure, Docker, Ansible, or Terraform
· At least 1 year of Agile experience
· At least 1 year of experience with a streaming data platform including Apache Kafka and Apache Spark,

Preferred Qualifications:

5+ years of data modeling and data engineering skills
3+ years of experience with JSON, Parquet, Protobuf or Avro formats
2+ years of creating data quality dashboards establishing data standards
2+ years of experience in RDBMS, NOSQL
2+ years of experience working with Azure platforms, services, and component technologies, including Blob store, and Azure Databricks

1+ years of microservices architecture, RESTful web service and ORM frameworks

 

Abdul Hameed Suhail

Recruiter

 

Xforia INC, 2727 Lyndon B Johnson Freeway, Suite# 915, Dallas TX 75234

Desk : (469)606-0689| Mob : 614-669-5810| Email: abdul.hs@xforia.com|Website: www.xforia.com|

Company Information