*Must have LinkedIn page
Must Have:
- 5-8+ years of relevant experience in data-focused software engineering.
- 2+ years of data analysis, AI, or data science work.
- Azure DevOps, Databricks, and data visualization/dashboarding
- implementing and maintaining CI/CD pipelines
- Python-based server-side web frameworks like FastAPI or Django
- Spark, Python, JSON, and SQL
Python, FastAPI, Django, SQL, CI/CD, Azure DevOps, GitLab, Travis, Jenkins, Data Analysis, Data Science, AI, (py)Spark, ELT/ETL Frameworks, Web Scraping, Crowdsourcing, Databricks, Optimizing Spark Clusters, PowerBI, Tableau
Header:
AIG is searching for a Senior Software Engineer, who can be based in our New York City office in a hybrid schedule.
Master’s Degree or Ph.D. in data science, computer science, or related quantitative field such as applied mathematics, statistics, engineering or operations research, or equivalent experience.
5-8+ years of relevant experience in data-focused software engineering.
2+ years of data analysis, AI, or data science work.
Python-based server-side web frameworks like FastAPI or Django.
Extensive experience with (py)Spark, Python, JSON, and SQL
Data cleaning, enrichment, and reporting to business users
SQL and NoSQL database systems
SQL and familiarity with the high-level properties of modern data stores.
Data visualization dashboarding tools (PowerBI, Tableau).
Databricks and optimizing Spark clusters
MS Azure cloud environment
Strong interest in learning about LLMs (Large Language Models) in a productized context, entity resolution, streaming technologies, ELT/ETL frameworks, web scraping, crowdsourcing technologies, Databricks, and optimizing Spark clusters.
Good interpersonal and communication skills.
QUALIFICATIONS:
- 5-8+ years of relevant experience in data-focused software engineering
- Master’s Degree or Ph.D. in data science, computer science, or related quantitative field such as applied mathematics, statistics, engineering or operations research, or equivalent experience.
- Experience working with Python-based server-side web frameworks like FastAPI or Django
- Strong knowledge of SQL and familiarity with the high-level properties of modern data stores.
- Strong understanding of the contemporary SDLC, including dev/QC/prod environments, unit/integration/UA testing, CI/CD, etc.
- Experience building and maintaining CI/CD pipelines with tools such as Azure DevOps, GitLab, Travis, Jenkins, etc.
- 2+ years of data analysis, AI, or data science work.
- Experience with data cleaning, enrichment, and reporting to business users.
- Extensive experience with (py)Spark, Python, JSON, and SQL.
- Experience integrating data from semi-structured and unstructured sources.
- Knowledge of various industry-leading SQL and NoSQL database systems.
- Experience with or strong interest in learning about LLMs in a productized context.
ADDITIONAL QUALIFICATIONS:
- Strong understanding of entity resolution, streaming technologies, and ELT/ETL frameworks.
- Experience with web scraping and crowdsourcing technologies.
- Experience with Databricks and optimizing Spark clusters.
- Experience architecting web ecosystems from the ground up, including monolith vs. microservice decisions, caching technologies, security integrations, etc.
- Experience working with data visualization dashboarding tools (PowerBI, Tableau).
- Insurance domain knowledge or strong interest in developing it.
- Experience with the MS Azure cloud environment.