Senior Backend Data Engineer

Summary

Join Magic Media, a global media and entertainment group, as a Senior Backend & Data Engineer to contribute to the development of a large-scale mobile gacha game. This crucial role involves building and scaling the game's backend services and data infrastructure. You will implement, maintain, and scale core backend infrastructure using PlayFab and Azure, design and build data pipelines, manage data lakes and warehousing solutions, and integrate data visualization tools. The position requires expertise in backend development for live-service games and a strong understanding of data engineering principles. It offers a permanently remote position with flexible working hours and opportunities for professional development within a fast-paced, international environment.

Requirements

• Hands-on professional experience with C# and a game backend-as-a-service platform (our stack is PlayFab and Azure Functions, so direct experience is a major plus)
• Solid understanding of data engineering fundamentals, including ETL processes, data modeling, and data lake architecture
• Practical experience building data pipelines and working with distributed processing frameworks (e.g., Spark, Databricks, Beam)
• Familiarity with a range of database technologies, including NoSQL (like MongoDB) and data warehousing solutions (like Redshift, BigQuery, or Snowflake)
• Knowledge of data privacy and compliance standards (GDPR, CCPA)

Responsibilities

• Implement, maintain, and scale the core backend infrastructure using our PlayFab and Azure environment
• Develop and deploy server-side game logic and features, and manage our databases (MongoDB) and search clusters (OpenSearch) for high performance
• Design, build, and maintain scalable and cost-effective data pipelines for both real-time and batch processing
• Own and automate the extraction, transformation, and loading of data from various sources (game client telemetry, backend services, third-party APIs) into our data lake
• Develop and manage our data lake and warehousing solutions (e.g., using Databricks or similar technologies) to ensure data is clean, structured, and ready for analysis
• Integrate and maintain connections to data visualization tools (e.g., Looker, Grafana, OpenSearch Dashboards) to empower the product and analytics teams with actionable insights
• Contribute to and help maintain our CI/CD pipelines for automated builds, testing, and deployment of both backend services and data infrastructure
• Implement and uphold best practices for data quality, security, and compliance with privacy regulations such as GDPR and CCPA

Benefits

• Permanently remote position
• An opportunity to hone and improve your skills by applying them to a diverse variety of engaging projects
• Be part of an international group with offices worldwide
• Career growth and development
• Working closely with a team of like-minded people in a fast-paced, multicultural environment
• Ongoing training and professional self-improvement opportunities
• Flexible working hours
• An inclusive culture and open communication