Big Data Architect

Summary

Join Caylent, a cloud native services company, as a Big Data Architect to design and implement big data solutions on AWS. You will design and document big data and NoSQL solutions, guiding engineers in implementation. Responsibilities include participating in daily standups and bi-weekly agile ceremonies. Your manager will provide weekly 1:1 guidance. The role involves delivering top-quality data solutions, optimizing data processing operations, and leading engineers. You will write code when needed and leverage your expertise in various technologies. Up to 25% travel may be required.

Requirements

• Design and implementation of at least two of these: ETL, Orchestration and CI/CD pipelines
• Data Lakes, Data Warehouses
• Analytics and visualization
• Design and implementation of at least two of these: Data processing: eg. Hadoop, Spark, EMR
• Streaming/Messaging: eg. Kafka, RabbitMQ, Kinesis
• NoSQL DBs like KeyValue stores, Document Databases, Graph Databases
• Caching: eg. Redis, Memcache
• Search: eg. ElasticSearch, Solr
• Design and implementation of at least one of these: Large scale application migration and modernization with a heavy focus on data
• Security, access controls and governance on cloud
• Experience with IaC tools such as CloudFormation, CDK, Terraform
• Experience with AWS Glue, Lambda, SDK
• Experience with CI/CD tools
• Excellent written and verbal communication skills

Responsibilities

• Work with a team to deliver top-quality data solutions on AWS for customers
• Participate in daily standup meetings and address technical issues
• Design, optimization and migration of web-scale data processing operations
• Be able to write code whenever needed and possible
• Lead and help engineers without any direct supervision

Benefits

• 100% remote work
• Medical Insurance for you and eligible dependents
• Generous holidays and flexible PTO
• Competitive phantom equity
• Paid for exams and certifications
• Peer bonus awards
• State of the art laptop and tools
• Equipment & Office Stipend
• Individual professional development plan
• Annual stipend for Learning and Development
• Work with an amazing worldwide team and in an incredible corporate culture