Must be experienced in the following areas: Linux expertise; experience in the set-up and administration of the Hadoop platform; working knowledge of tools like Hive, Spark, HBase, Sqoop, Impala, Kafka, Flume, Oozie, MapReduce, etc
Languages: Understanding of scripting languages such as Java, Scala, Python, or Shell Scripting, etc. practical knowledge of end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Expertise with SQL and Data modeling working in Agile development process.
Ability to work with large data sets: Big Data involves large data sets, so applicants must be able to work with highly diverse data in multiple types and formats, and sources
Teamwork abilities: The big data architect must be able to work in a team-oriented environment with people of diverse skill sets
Analytical skills: Analyze complex problems using information provided, understand customer requests, and provide the appropriate solution
Communication skills: Engage with clients and stakeholders to understand their objectives for setting up Big Data and apply it in the architecture.
Year of Experience: 10 + with financial industry experience.