Senior Data Engineer

Summary

Join BeyondTrust as a Sr. Data Engineer and lead the development of new functionalities for our identity security product using our data lake and cutting-edge engineering tools. You will solve complex architectural challenges, design innovative data models, and optimize data workloads. This role requires strong programming skills, experience with cloud data processing and Spark, and a passion for cybersecurity. BeyondTrust fosters a culture of flexibility, trust, and continuous learning, offering a supportive and inspiring work environment.

Requirements

• Strong programming and technology knowledge in cloud data processing
• Spark experience is needed
• Technical understanding of underlying systems and computation minutiae
• Experience working with distributed systems and data processing on object stores
• Ability to work autonomously

Responsibilities

• Optimize data workloads at a software level by improving processing efficiency
• Independently tackle problem statements and bring solutions to life
• Develop new data processing routes to remove redundancy or reduce transformation overhead
• Monitor and maintain existing data workflows
• Use monitoring and observability best practices to ensure pipeline performance remains high
• Perform complex transformations on both real time and batch data assets
• Create new ML/Engineering solutions to tackle existing issues in the cybersecurity space
• Leverage CI/CD best practices to effectively develop and release source code

Preferred Qualifications

• Existing Databricks knowledge
• Interest and aptitude for cybersecurity; interest in identity security
• Data warehousing and Data Lakes for analytics use cases
• Highly proficient in Python (or another object orientated language)
• Distributed processing framework experience
• Spark
• Realtime processing experience
• Some experience with graph data stores