Principal Software Engineer

Summary

Join Abacus Insights, a mission-driven technology company transforming healthcare data, as a Software Engineer. You will develop high-performance cloud solutions using AWS, Azure, and Databricks, build data pipelines with AWS/Azure, Airbyte, Databricks, and Snowflake, and write PySpark, Python, and SQL code. Collaborate with cross-functional teams to solve challenging business needs, troubleshoot incidents, optimize Databricks workflows, and mentor team members. This role requires a Bachelor's degree in a related field, 8+ years of software development experience, 5+ years of cloud service experience, and 3+ years building ETL pipelines with Spark/PySpark and Databricks. Strong programming skills and excellent communication skills are essential.

Requirements

• Bachelor's degree, preferably in Computer Science, Computer Engineering, or related IT discipline
• 8+ years of commercial software development experience
• 5+ years of building or using cloud services in a production environment (AWS, Azure, GCP, etc.)
• 3+ years of building ETL data pipelines at scale with Spark/PySpark and Databricks
• Strong programming skills (Python, Java, or other OOP Languages)
• Go-getter with self-starter mindset
• Someone who stays current with emerging technologies and development techniques
• Excellent oral and written communication skills; strong analytical, problem solving, organization and prioritization skills

Responsibilities

• Develop and implement virtual, high performant cloud solutions which conform to US healthcare security standards by leveraging a broad level of experience across platforms like AWS, Azure and Databricks, realized through analytical work with end users, product managers and software/data architects
• Build data processing pipelines leveraging AWS/Azure, Airbyte, Databricks and Snowflake
• Write PySpark, Python, and SQL code to meet requirements for clients or internal teams
• Deploy code using CI/CD frameworks
• Be able to critically analyze and review peer-authored designs and code
• Employ exceptional problem-solving skills, with the ability to see and solve issues before they affect business productivity
• Troubleshoot client reported incidents, identify root cause, fix, and document problems, and implement preventive measures
• Optimize the performance and cost of Databricks workflows
• Drive the technical excellence of a team, mentor other team members and lead by example
• Identify area of technical investments, work with stakeholders to prioritize them onto the roadmap and lead efforts to implement such investments