Data Engineer

Summary

Join the VRChat team as a Data Engineer to improve and transform data capabilities. Collaborate with Data Science, Product, and Engineering teams to maintain and optimize data infrastructure and analytics stack. Build and maintain batch and real-time data warehousing solutions using Snowflake on AWS. Develop complex data pipelines using SQL and Python. Implement and manage data orchestration tools. Integrate diverse data sources, ensuring scalability and performance. Participate in system rollouts and upgrades. Collaborate cross-functionally and ensure data privacy and security. Monitor system performance and stay updated on latest technologies. This fully remote position requires 3+ years of data engineering experience.

Requirements

• Experience: 3+ years in data engineering
• Technical Proficiency: Expert in SQL and Python for data pipeline development
• Data Warehousing: Experience with data warehousing concepts and Snowflake
• Database Knowledge: Familiarity with MongoDB and SQL databases (e.g., Postgres, MySQL)
• Cloud Services: Extensive experience with AWS or other cloud services
• Data Orchestration: Experience with tools like Dagster or Apache Airflow
• Communication: Excellent interpersonal and communication skills
• Problem-Solving: Strong analytical and problem-solving abilities
• Team Collaboration: Proven ability to work collaboratively in cross-functional teams

Responsibilities

• Design and Implement Data Solutions: Translate business requirements and end-to-end designs into technical implementations that align with VRChat's objectives
• Data Warehouse Management: Build and maintain both batch and real-time data warehousing solutions using Snowflake on AWS to support VRChat's data needs
• ETL Pipeline Development: Develop complex data pipelines using SQL queries and Python scripts to manage data extraction, transformation, and loading (ETL) processes
• Data Orchestration: Implement and manage data orchestration tools (e.g., Dagster, Apache Airflow) to ensure seamless data workflow automation
• Data Integration: Integrate diverse data sources, including MongoDB and SQL databases (e.g., Postgres, MySQL), facilitating comprehensive data analysis and decision-making processes
• Infrastructure Scalability: Ensure the scalability and performance of data infrastructure to accommodate VRChat's growing data needs, leveraging technologies like Spark
• System Upgrades and Rollouts: Participate in system rollouts, upgrades, and implementation of data system changes to streamline internal practices and support business growth
• Cross-Functional Collaboration: Collaborate with Data Science, Product, and Engineering teams to build and maintain data products that drive VRChat's innovation
• Data Privacy and Security: Ensure compliance with data privacy regulations and ethical standards in data handling, prioritizing user privacy and data security
• Monitoring and Optimization: Monitor data system performance and resolve issues to ensure uninterrupted data processing and optimal system functionality
• Stay Updated: Keep up to date on the latest technologies and practices in data engineering to continuously improve VRChat's data infrastructure

Preferred Qualifications

• Industry Experience: Experience in data engineering at a consumer technology, social media, or gaming company
• Passion for Technology: Interest in social technology, gaming, or immersive experiences
• Snowflake Expertise: Extensive experience with Snowflake
• Distributed Computing Engines: Familiarity with engines like Spark, Flink, or Hive
• Streaming Platforms: Experience with Kafka, Kinesis, or other streaming platforms
• VR and Gaming: Understanding of VR, AR, and online communities
• Certifications: Relevant certifications (e.g., SnowPro, AWS Certified Data Analytics) are a plus
• Unity 3D: Basic understanding of Unity 3D development
• Social Platforms: Experience with social platforms, social gaming, or interactive online environments
• Innovative Thinking: Ability to think creatively and solve complex data challenges
• Cloud ETL Tools: Experience with cloud-based ETL tools (e.g., Fivetran,Glue, Hevo)

Benefits

• Work from anywhere! VRChat is a 100% remote company
• Health Benefits
• 401K for US & RRSP for Canadian Employees
• Stock Options
• Generous paid holiday schedule
• Unlimited/Flexible vacation time
• Paid parental leave