Cloud File Storage Engineer

Summary

Join Egen, a fast-growing data-first company, as a Cloud File Storage Engineer. You will design, build, and maintain scalable file storage solutions for cloud-based HPC platforms on AWS. This role requires expertise in parallel filesystems (GPFS, Lustre) and cloud-native storage (S3, EFS, FSx). You will collaborate with scientists and engineers, ensuring platform robustness and security. The position is fully remote but requires working during US West Coast business hours. Egen offers a competitive salary and benefits package.

Requirements

• Deep understanding of AWS services and best practices for building scalable, secure, and cost-effective cloud environments
• Proven experience with DevOps practices, including infrastructure as code (Terraform, Ansible), continuous integration, and continuous deployment (GitLab CI/CD)
• Prior experience integrating storage with common identity and access management solutions such as Active Directory and IAM Identity Center
• Proficiency with Git and experience managing code repositories
• Expert level proficiency with POSIX file system and Network File Sy(NFS) semantics
• Proficiency with POSIX I/O profiling for high performance / high througworkloads
• Expert level proficiency in at least one high performance / parallel file sytem technology such as Weka, Lustre, GPFS, Ceph, or JuiceFS
• Have a robust understanding of storage redundancy, availability, and durability principles to effectively balance performance objectives with critical measures to prevent unintended data loss
• High proficiency with Amazon S3 object storage
• Some prior experience with AWS managed services for file storage, such as EFS, FSx for Lustre, or FSx for OpenZFS
• Knowledge of security best practices in cloud environments and experience implementing them

Responsibilities

• Design, implement, and maintain scalable and high performance file storage environments on AWS
• Develop and manage infrastructure as code using tools such as Terraform and Ansible
• Automate deployment pipelines and improve CI/CD processes using GitLab CI/CD
• Collaborate with cross-functional teams to understand the computational needs of scientists and translate them into effective platform solutions
• Monitor and optimize platform performance, ensuring reliability and scalability
• Troubleshoot and resolve issues related to infrastructure, deployment, and application performance
• Support data transfer teams' ingress and egress activities
• Identify and advance collaboration opportunities with other product teams, such as integration with existing data movement and data catalog solutions

Preferred Qualifications

• 7+ years working in engineering, solution architecture, or DevOps, with a track record of successfully delivering complex projects
• Ability to work effectively in a collaborative team environment, and comfortable independently designing solutions based on requirements
• Excellent communicator, ability to clearly share architecture plans, designs, risks, and implementation with a variety of stakeholders
• Prior experience with at least one POSIX interface solution for S3 object storage, such as S3Mountpoint, CunoFS, or goofys
• Prior experience with cloud data caching solutions such as Amazon ElastiCache or Amazon FileCache
• Prior experience with data movement and migration tools such as Aspera, DataSync, rsync/rclone

Benefits

• Health insurance
• Retirement plans
• Professional development opportunities