• Citizen

• Work Permit

• Full Time

• Direct Hire

• UG :- Any UG - Not Required

• PG :- Any PG

• No of position :- ( 1 )

• Post :- 2nd Dec 2019

Job description

Requirements: Minimum 3 years of experience in Hadoop and related technology stack Strong understanding of Hadoop design principals , cluster connectivity , security and the factors that affect distributed system performance review Hadoop log files File system management and ability to audit access logs and identify new data , usage patterns and identify new patterns and anomalies Experience in data governance tool like Collibra is preferred

Roles and Responsibilities:
Be part of Data Management Organization which is tasked with ownership and management of the shared services data environments Oversees the shared data services environment and ensures company- wide adherence to the data lifecycle , privacy , security , and ultimately the data strategy Build internal systems driving the effectiveness of Twitter s shared data environment , build new and extend existing systems Manage and contribute to the strategy and engineering of the data life cycle management Responsible Data Management Operations and Auditing for the entire Data Management Org Work closely with members of the team to ensure that all data flows are consistently compliant with all the services Produce and maintain complex data workflows to meet all the quality requirements of the data management policy in partnership with Data Manager on the team

Hadoop ,AWS ,Spark ,Pyspark ,

RoleDatabase Architect/Designer

Functional AreaIT Software - DBA, Datawarehousing

Employment TypeFull Time, Permanent

Role CategoryProgramming & Design

Education

UG :Any Graduate in Any Specialization

PG :Post Graduation Not Required

Key Skills

Operations management,data services,System management,Data management,spark,Hadoop,data governance,AWS,Auditing