Big Data Architect

Summary

Join Caylent as a Big Data Architect and be an integral part of a cross-functional team, designing and implementing big data solutions on AWS. You will design and document big data and NoSQL solutions, guiding engineers in implementation. Daily standups, bi-weekly agile ceremonies, and weekly 1:1s with your manager are part of the process. The role involves delivering high-quality data solutions, participating in daily standups, designing and optimizing web-scale data processing, coding when needed, and leading engineers. Caylent offers a comprehensive benefits package including medical, dental, and vision insurance, 401k matching, remote work, and unlimited PTO.

Requirements

• Design and implementation of at least two of these: ETL, Orchestration and CI/CD pipelines
• Data Lakes, Data Warehouses
• Analytics and visualization
• Design and implementation of at least two of these: Data processing: eg. Hadoop, Spark, EMR
• Streaming/Messaging: eg. Kafka, RabbitMQ, Kinesis
• NoSQL DBs like KeyValue stores, Document Databases, Graph Databases
• Caching: eg. Redis, Memcache
• Search: eg. ElasticSearch, Solr
• Design and implementation of at least one of these: Large scale application migration and modernization with a heavy focus on data
• Security, access controls and governance on cloud
• Experience with IaC tools such as CloudFormation, CDK, Terraform
• Experience with AWS Glue, Lambda, SDK
• Experience with CI/CD tools
• Excellent written and verbal communication skills

Responsibilities

• Work with a team to deliver top-quality data solutions on AWS for customers
• Participate in daily standup meetings and address technical issues
• Design, optimization and migration of web-scale data processing operations
• Be able to write code whenever needed and possible
• Lead and help engineers without any direct supervision

Benefits

• Medical Insurance for you and eligible dependents
• 100% remote work
• 401k plan with company match up to 4% and immediate vesting
• Competitive phantom equity
• Company issued laptop
• Dental and Vision insurance
• Term Disability Insurance
• Term Life Insurance
• Flexible Spending Account
• Equipment & Office Stipend
• Annual stipend for Learning and Development
• Unlimited Paid Time Off, following a 90-day probationary period
• 10 Paid Holidays