US Citizen
Green Card
W2-Permanent
W2-Contract
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 9th Mar 2024
The Data Analyst/Data Engineer with Databricks Experience will be responsible for leveraging Databricks to analyze, process, and visualize large volumes of data. You will collaborate with cross-functional teams to develop scalable data pipelines and drive actionable insights from complex datasets.
**Key Responsibilities:**
1. **Data Analysis:** Analyze large datasets using Databricks to extract actionable insights and identify trends and patterns.
2. **Data Engineering:** Design, develop, and maintain scalable data pipelines using Databricks and other relevant tools and technologies.
3. **Data Transformation:** Transform raw data into formats suitable for analysis and reporting, ensuring data quality and integrity throughout the process.
4. **Data Visualization:** Create interactive and visually appealing dashboards and reports to communicate insights and findings to stakeholders.
5. **Performance Optimization:** Optimize data pipelines and queries for performance and scalability, leveraging Databricks' advanced features and capabilities.
6. **Collaboration:** Work closely with data scientists, business analysts, and other stakeholders to understand data requirements and deliver actionable insights.
7. **Documentation:** Document data workflows, processes, and best practices to ensure reproducibility and maintainability of data solutions.
8. **Troubleshooting:** Identify and resolve issues related to data ingestion, processing, and analysis in a timely manner.
**Qualifications:**
- Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field (Master's degree preferred).
- [Insert years of experience] years of experience in data analysis and data engineering, with a focus on Databricks.
- Proficiency in Apache Spark and Scala/Python for data processing and analysis.
- Experience with building and optimizing data pipelines using Databricks.
- Strong SQL skills for data manipulation and querying.
- Knowledge of data warehousing concepts and best practices.
- Experience with data visualization tools such as Tableau or Power BI is a plus.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.