Required Skills

DBT Spark AWS Glue

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 5th Jun 2024

JOB DETAIL

• Bachelor's degree in Computer Science, Data Science or a related field.
• Strong proficiency in Python and SQL.
• Expertise in data analysis.
• Experience building a modern enterprise-wide data and analytics platform.
• Able to quickly learn new technologies and stay abreast of industry trends.
• Experience with data stack technologies, such as Apache Airflow, Prefect, Dagster, Apache Iceberg, DBT, Spark, Great Expectations.
• AWS experience, particularly data services, such as Glue, Lake Formation, EMR, EventBridge, Athena.
• Experience with data warehousing such as Redshift, Snowflake or Dremio.
• Excellent communication and collaboration skills.

Bonus Points


• Experience with DevOps practices such as continuous integration and continuous delivery (CI/CD).
• Experience with data visualization tools such as Tableau or Power BI.
• Experience with metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.).



Responsibilities


• Extract, transform, and load data from various sources into our data lakehouse.
• Develop, test, maintain, and document data pipelines using DBT, Spark, AWS Glue and Airflow.
• Build data marts and data cubes to support various business intelligence initiatives.
• Automate data quality checks to ensure the accuracy and consistency of our data.
Business Knowledge
• Experience collaborating directly with stakeholders, eliciting business requirements, questioning and challenging where necessary.
• Can articulate business needs and translate them into technology solutions.
• An understanding of the asset management business and/or financial markets.

Company Information