Data Engineer

Summary

Join our team as a highly skilled Mediation Data Engineer and design, develop, and maintain data processing systems for billing and analytics platforms.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field
• 3+ years of experience in building and maintaining mediation systems or data processing pipelines in a billing or transaction-heavy environment
• Hands-on experience with ETL tools (e.g., Apache NiFi, Airflow) and strong understanding of data transformation and enrichment processes
• Proficiency in event-driven processing technologies such as Apache Kafka, Flink, or Spark Streaming
• Strong programming skills in Python, Scala, or Java for developing data pipelines and processing logic
• Experience with cloud platforms such as AWS, GCP, or Azure for building scalable mediation systems (e.g., S3, Lambda, Glue)
• Proficiency in SQL and experience with both relational and NoSQL databases for managing and querying large datasets

Responsibilities

• Design and implement mediation systems to collect, transform, and process raw usage data into standardized formats for billing and analytics platforms
• Build and maintain efficient ETL processes to process high volumes of usage data, ensuring data accuracy, consistency, and readiness for billing calculations
• Develop and manage near real-time data pipelines using tools such as Kafka, Flink, or Spark Streaming, ensuring minimal latency between data ingestion and processing
• Implement data transformation rules to normalize and enrich data from multiple sources, preparing it for accurate billing, invoicing, and reporting
• Automate mediation processes, minimizing manual intervention and improving the efficiency of data flows. Utilize orchestration tools like Apache Airflow or NiFi to manage workflows
• Ensure data quality by implementing checks, monitoring systems, and error-handling mechanisms to prevent inconsistencies, duplicates, or data loss
• Work closely with billing, product, and engineering teams to understand data requirements and ensure that mediation pipelines align with business needs
• Ensure that all mediation processes adhere to data governance, security, and regulatory requirements, particularly in relation to billing data

Preferred Qualifications

• Familiarity with billing systems and mediation engines used in industries like telecommunications, messaging, SaaS, or utilities
• Experience with high-throughput data processing and handling large volumes of transactional data (e.g., call records, message records, service usage)
• Knowledge of data privacy regulations (e.g., GDPR, CCPA) and their impact on mediation and billing processes
• Experience working with containerization and orchestration tools such as Docker and Kubernetes

Benefits

• Comprehensive market competitive medical, dental, and vision plans
• Free virtual counseling resources through our global Employee Assistance Program
• Roth and Pre-tax 401(k) options including an employer match for all participants
• Generous paid time off program
• Paid parental leave and family planning support
• Flexible remote work offerings allowing you to work wherever you’re the most productive and successful