building distributed data processing using Java, data frames, Strong backend developer.
JOB DESCRIPTION:
Strong hands-on knowledge of Python or Java as a distributed data developer, working on large data volumes (20m+ rows per day)
Ability to deliver multiple simultaneous projects under pressure of regulatory driven deadlines
Strong relational database experience with emphasis on data processing as described above
Strong knowledge of database table partitions, data distribution, parallel loads and extracts working on DB2 DPF or Greenplum or other big data technologies
Build batch vs. event driven data processing. Design for high level of concurrency to ensure data integrity without compromising performance
Modeling and implementing database schemas
Coming up with system architecture/re-design proposals for greater efficiency and ease of maintenance and developing software to turn proposals into implementations
Skills Required:
Strong hands-on knowledge of Python or Java as a distributed data developer, working on large data volumes (20m+ rows per day)
Ability to deliver multiple simultaneous projects under pressure of regulatory driven deadlines
10+ years of relational database experience with emphasis on data processing as described above