Required Skills

Apache NiFi Informatica Talend

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 25th Sep 2024

JOB DETAIL

Data Architecture Design

: Develop and maintain scalable data

architectures and pipelines to support data integration, transformation,

and visualization.

ETL Development

: Design, implement, and manage Extract,

Transform, Load (ETL) processes to ensure the efficient flow of data

from source systems to data warehouses and data lakes.

Database Management

: Optimize and manage relational and non-

relational databases, ensuring high performance and data integrity.

Data Quality Assurance

: Implement data quality checks, validation

processes, and monitoring to ensure data accuracy and consistency.

Collaboration

: Work collaboratively with data scientists, analysts, and

other stakeholders to understand data requirements and deliver

solutions that meet business objectives.

Performance Tuning

: Analyze and optimize data processing

performance, including query tuning and resource allocation.

Documentation

: Create and maintain comprehensive documentation

for data engineering processes, data flows, and data models.

Security and Compliance

: Implement data security and compliance

measures to protect sensitive information and ensure adherence to

regulatory requirements.

Innovation

: Stay up to date with the latest industry trends, tools, and

technologies to continuously improve data engineering practices.

Qualifications

Education

: Bachelor’s or Master’s degree in Computer Science,

Engineering, Information Technology, or a related field.

Experience

: Minimum of 5 years of experience in data engineering or

a related field.

Technical Skills

:

o

Proficiency in programming languages such as Python, Java, or

Scala.

o

Strong experience with SQL and database management systems

(e.g., MySQL, PostgreSQL, Oracle).

 

o

Experience with big data technologies (e.g., Hadoop, Spark,

Kafka).

o

Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud)

and their data services.

o

Knowledge of data warehousing solutions (e.g., Snowflake,

Redshift, BigQuery).

o

Experience with ETL tools (e.g., Apache NiFi, Informatica, Talend).

o

Strong understanding of data modeling, data structures, and

algorithms.

Soft Skills

:

o

Excellent problem-solving and analytical skills.

o

Strong communication and collaboration abilities.

o

Ability to work independently and manage multiple tasks

simultaneously.

o

Detail-oriented with a focus on data accuracy and quality.

Preferred Qualifications

Experience with machine learning pipelines and MLOps.

Knowledge of data governance and data privacy standards.

Familiarity with containerization and orchestration tools (e.g., Docker,

Kubernetes).

 

Company Information