Data Engineer/ Big Data Engineer
This is for one of the top most MNC in India
Immediate joiner highly prefered
Pyspark + Cloud Experience (AWS, AZURE, GCP, IBM ETC)
Supporting with case teams
- Supporting and enhancing original analysis and insights to case teams, typically owning the maintenance of all or part of an analytics module post implementation.
- Establishing credibility by thought partnering with case teams on analytics topics; drawing conclusions on a range of external and internal issues related to your module
- Communicating analytical insights through sophisticated synthesis and packaging of results (including PPT slides and charts) with consultants; collecting, synthesizing, analysing case team learning & inputs into new best practices and methodologies
- Ensuring proper signoff before uploading materials into internal repository for reference; sanitizing confidential client content in marketing documents
- Developing broad expertise in at least one analytics topic or platform
- Executing analytical approach and creating defined outcome; contributing to approach selection
Technical expertise
- Proficient understanding of distributed computing principles
- Management of Spark clusters, with all included services various implementations of Spark preferred
- Ability to solve ongoing issues with operating the cluster and optimize for efficiency
- Understanding of prevalent cloud ecosystems and its associated services AWS, Azure, Google Cloud, IBM Cloud. Expertise in at least one.
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
- Good understanding of Lambda Architecture, along with its advantages and drawbacks
Functional Skills:
- Selecting, integrating & supporting any Big Data tools and frameworks required to provide requested capabilities
- Enhancing/optimizing & maintaining ETL process(s) across on-premise and cloud architectures
- Monitoring performance and advising any necessary infrastructure changes
Communicating with confidence and ease
- You will be a clear and confident communicator, able to deliver messages in a concise manner with strong and effective written and verbal communication.
Thinking Analytically
- You should be strong in analytical solutioning with hands on experience in advanced analytics delivery, through the entire life cycle of analytics. Strong analytics skills with the ability to develop and codify knowledge and provide analytical advice where required.
YOU BRING (EXPERIENCE & QUALIFICATIONS)
- Bachelor's / Master's degree in computer science engineering/technology
- At least 2-4 years within relevant domain of Data Engineering across industries and work experience providing analytics solutions in a commercial setting
- Experience in consulting organization will be added advantage
If interested please share resume at manjeet.kaur@mounttalent.com