Velotio Technologies is hiring a
Senior Data Engineer

Summary

The job is for a Data Platform Engineer at Velotio Technologies, a remote-friendly product engineering company. The role involves working with clients to design and implement data platforms, defining SLAs, SLOs, and SLI, creating infrastructure-as-code, mentoring team members, and more. The desired skills include 6+ years in enterprise level data platforms, hands-on experience with Databricks, public cloud data platforms, metadata management, test plan creation, data modeling, querying, optimization, data processing programming, logical understanding of programming languages, and a bachelor's degree in Computer Science or related field.

Requirements

• 6+ years of demonstrable experience in enterprise level data platforms involving implementation of end-to-end data pipelines
• Hands-on experience in using Databricks
• Hands-on experience with at least one of the leading public cloud data platforms (Amazon Web Services, Azure or Google Cloud)
• Experience with column-oriented database technologies (e.g., Big Query, Redshift, Vertica), NoSQL database technologies (e.g., DynamoDB, BigTable, Cosmos DB, etc.) and traditional database systems (e.g., SQL Server, Oracle, MySQL)
• Experience in architecting data pipelines and solutions for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Streaming, etc
• Metadata definition and management via data catalogs, service catalogs, and stewardship tools such as OpenMetadata, DataHub, Alation, AWS Glue Catalog, Google Data Catalog
• Test plan creation and test programming using automated testing frameworks, data validation and quality frameworks, and data lineage frameworks
• Data modeling, querying, and optimization for relational, NoSQL, timeseries, graph databases, data warehouses and data lakes
• Data processing programming using SQL, DBT, Python, and similar tools
• Logical understanding of programming in Python, Spark, PySpark, Java, Javascript, and/or Scala
• Cloud-native data platform design with a focus on streaming and event-driven architectures
• Participate in integrated validation and analysis sessions of components and subsystems on production servers
• Data ingest, validation, and enrichment pipeline design and implementation
• SDLC optimization across workstreams within a solution
• Bachelor’s degree in Computer Science, Engineering, or related field

Responsibilities

• Work closely with our clients providing evaluation and recommendations of design patterns and solutions for data platforms with a focus on ETL, ELT, ALT, lambda, and kappa architectures
• Define SLAs, SLIs, and SLOs with inputs from clients, product owners, and engineers to deliver data-driven interactive experiences
• Provide expertise, proof-of-concept, prototype, and reference implementations of architectural solutions for cloud, on-prem, hybrid, and edge-based data platforms
• Provide technical inputs to agile processes, such as epic, story, and task definition to resolve issues and remove barriers throughout the lifecycle of client engagements
• Creation and maintenance of infrastructure-as-code for cloud, on-prem, and hybrid environments using tools such as Terraform, CloudFormation, Azure Resource Manager, Helm, and Google Cloud Deployment Manager
• Mentor, support and manage team members

Benefits

• Work from wherever you feel most productive
• Empowered work culture encouraging individuals to take ownership and grow quickly
• Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
• A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment