Big Data Architect

Summary

Join Caylent, a cloud native services company, as a Big Data Architect to design and implement big data solutions on AWS. You will collaborate with a cross-functional team, design and document big data and NoSQL solutions, guide engineers in implementation, and participate in agile ceremonies. The role involves working with various technologies like ETL, orchestration, CI/CD pipelines, data lakes, data warehouses, analytics, visualization, data processing tools (Hadoop, Spark, EMR), streaming/messaging systems (Kafka, RabbitMQ, Kinesis), NoSQL databases, caching mechanisms, and search technologies. You will also be involved in large-scale application migration and modernization, security, access controls, and infrastructure as code (IaC). Caylent offers a 100% remote work environment with generous benefits including flexible PTO, phantom equity, paid certifications, peer bonuses, and professional development opportunities.

Requirements

• Design and implementation of at least two of these: ETL, Orchestration and CI/CD pipelines
• Data Lakes, Data Warehouses
• Analytics and visualization
• Design and implementation of at least two of these: Data processing: eg. Hadoop, Spark, EMR
• Streaming/Messaging: eg. Kafka, RabbitMQ, Kinesis
• NoSQL DBs like KeyValue stores, Document Databases, Graph Databases
• Caching: eg. Redis, Memcache
• Search: eg. ElasticSearch, Solr
• Design and implementation of at least one of these: Large scale application migration and modernization with a heavy focus on data
• Security, access controls and governance on cloud
• Experience with IaC tools such as CloudFormation, CDK, Terraform
• Experience with AWS Glue, Lambda, SDK
• Experience with CI/CD tools
• Excellent written and verbal communication skills

Responsibilities

• Work with a team to deliver top-quality data solutions on AWS for customers
• Participate in daily standup meetings and address technical issues
• Design, optimization and migration of web-scale data processing operations
• Be able to write code whenever needed and possible
• Lead and help engineers without any direct supervision

Benefits

• 100% remote work
• Generous holidays and flexible PTO
• Competitive phantom equity
• Paid for exams and certifications
• Peer bonus awards
• State of the art laptop and tools
• Equipment & Office Stipend
• Individual professional development plan
• Annual stipend for Learning and Development
• Work with an amazing worldwide team and in an incredible corporate culture