Lead Data Engineer

Summary

Join Quantexa's Delivery team as a Lead Data Engineer, implementing innovative technology for clients in various domains. Lead and mentor a team of junior data engineers, building and deploying data processing systems. Collaborate with architects and R&D engineers, and communicate technical concepts to non-technical audiences. The role involves hands-on programming, managing high-volume data, and ensuring operational stability. This impactful work tackles significant challenges, offering rewarding opportunities for leadership and growth within a diverse and collaborative team.

Requirements

• Have a background in hands-on technical development, with at least five years of industry experience in a data engineering role or engineering equivalent, and at least 2 years of experience acting in a lead role within a data or software engineering team
• Proficiency in Scala, Java, Python, or a programming language associated with data engineering. Our primary language is Scala, but don’t worry if that’s not currently your strongest language, we believe that strong engineering principles are universal and transferrable
• Have expertise building and deploying production level data processing batch systems maintained by application support teams. Importantly you’ll share an appreciation of what makes a high quality, operationally stable system and how to streamline all areas of development, release, and operations to achieve this
• Experience with a variety of modern development tooling (e.g. Git, Gradle, Nexus) and technologies supporting automation and DevOps (e.g. Jenkins, Docker and a little bit of good old Bash scripting). You’ll be familiar with developing within a version-controlled process that regularly makes use of these tools and technologies
• A strong technical communication ability with demonstrable experience of working in rapidly changing client environments
• Knowledge of testing libraries of common programming languages (such as ScalaTest or equivalent). Knows the difference between different test types (unit test, integration test) and can cite specific examples of what they have written themselves

Responsibilities

• Lead, support, and mentor a team of junior data engineers within an agile framework
• Write defensive, fault tolerant and efficient code for production level data processing systems
• Configure and deploy Quantexa’s software using tools such as Spark, Hadoop, Scala, Elasticsearch, with our platform being hosted on both private and public virtual clouds, such as Google cloud, Microsoft Azure and Amazon
• Be a trusted source of knowledge to your clients. Articulate technical concepts to a non-technical audience helping them to make big decisions
• Collaborate with both our solution architects and our R&D engineers to champion solutions and standards for complex big data challenges. Proactively promote knowledge sharing and ensure best practice is followed

Preferred Qualifications

• Experience growing and up-skilling team members as a career mentor, technical line manager, or acting in an equivalent guidance role
• A passion for expanding the business – and leading initiatives to do so

Benefits

• Competitive salary
• Company bonus
• 20 days annual leave (if you worked the previous year January – December), 12 compensation days, plus national holidays + your birthday off!
• Pension scheme
• Private Healthcare with DKV
• Death in Service and Income Protection
• Work from Home Allowance
• Eco Vouchers
• Meal Vouchers
• Free Calm App Subscription #1 app for meditation, relaxation and sleep
• Continuous Training and Development, including access to Udemy Business
• Spend up to 2 months working outside of your country of employment over a rolling 12-month period with our ‘Work from Anywhere’ policy
• Employee Referral Program
• Team Social Budget & Company-wide Socials