Citizen
Full Time
Direct Hire
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 23rd Nov 2022
We are looking for creative individuals with strong programming skills, who can understand complex business and architectural problems and develop solutions. The individual will work closely with the rest of our data engineering and data science team in implementing and managing Scalable Smart Data Lakes, Data Ingestion Platforms, Machine Learning and NLP based Analytics Platforms, Hyper-Scale Processing Clusters, Data Mining and Search Engines.
Requirements
3+ years of industry experience in creating and managing end-to-end Data Solutions, Optimal Data Processing Pipelines and Architecture dealing with large volume, big data sets of varied data types.
Proficiency in Python, Java, Linux and shell scripting.
Strong knowledge of Spark and Hadoop.
Core experience in setup, administration, and monitoring, tuning, optimizing, governing Large Scale Hadoop/Spark clusters and other ecosystem components.
Work with data science and infrastructure team members to implement practical machine learning solutions and pipelines in production.
Strong experience in developing the infrastructure required for data ingestion, optimal extraction, transformation, and loading of data from a wide variety of data sources using tools like Sqoop, Flume, Talend, and Kafka.
Experience with on-premise platforms like Cloudera and cloud providers like AWS.
Experience with SQL and NoSQL databases and Filesystems. HDFS, HBase, Hive, MySQL, Kudu, MongoDB, Elasticsearch etc.
Experience with stream-processing systems: Storm, Spark-Streaming, Kafka etc
Experience with creating Restful web services and API platforms.
Strong analytic skills related to working with unstructured datasets.
Knowledge of Machine Learning algorithms and libraries would be good to have, implementation experience would be an added advantage.
Knowledge and experience of Dockers and Kubernetes would be good to have.