Software Engineer - Data Pipeline Optimization

Summary

Join Rimes, a leading provider of enterprise data management solutions, as a Software Engineer focusing on optimizing data pipelines. You will collaborate with engineering teams, monitor system performance, implement automated testing, and provide technical support. This role requires proficiency in Python and familiarity with data engineering concepts. Rimes offers growth opportunities, mentorship, flexible work arrangements, competitive compensation, and a supportive culture. The ideal candidate is detail-oriented, passionate about data pipeline optimization, and possesses strong analytical and communication skills. Apply today to help revolutionize financial data technology.

Requirements

• Proficiency in Python and familiarity with other programming languages such as Perl , C and C#
• Understanding of data engineering concepts (ETL, data flow, data orchestration) in multi-tenant architecture, as well as message-based architecture (RabbitMq, Apache Kafka)
• Strong analytical skills with the ability to derive insights from performance data
• Ability to work effectively in a team environment and collaborate with senior engineers and product teams
• Good communication skills, both written and verbal, with the ability to document processes and optimizations clearly

Responsibilities

• Participate inside the platform team to optimize mission critical data pipelines to maximize throughput, minimize latencies, and reduce operational costs
• Work closely with the Product Engineering and Core Engineering teams to implement improvements in data architecture and infrastructure
• Help monitor and analyse system performance data to identify optimization opportunities
• Contribute to the development and implementation of automated testing practices to ensure the robustness and reliability of data pipelines
• Provide technical support and troubleshooting for data pipeline issues, ensuring timely resolution and minimal disruption to operations
• Maintain comprehensive documentation of data pipeline processes and optimizations

Preferred Qualifications

Some experience with cloud-based data processing platform (Data Bricks, Snowflake) and data transformation frameworks/engine (e.g., Apache Spark, Python Pandas) is advantageous

Benefits

• Opportunities for professional development and career growth within a fast-paced, high-growth environment
• Guidance and mentorship from experienced engineers to support you in expending your expertise and impact
• Flexible remote work opportunities
• Competitive salary and benefits
• A supportive company culture focused on innovation, excellence, and continuous improvement
• Competitive pay and bonus eligibility
• Flexible hybrid work environment