Senior Data Engineer

Summary

Join JumpCloud's Data Enablement team as a Senior Data Engineer and contribute to building foundational technology and processes to enhance data capabilities. You will work on challenging projects involving rich datasets, developing valuable skills, and collaborating with various teams. This senior-level role requires extensive experience in building scalable data solutions, proficiency in data modeling and database design, and expertise in SQL and Python. The position involves frequent engagement with stakeholders, integrating technologies like Airflow, Python, and Kafka, and ensuring data security and compliance. This remote position is based in India.

Requirements

• Extensive hands-on experience with building scalable data solutions with complex fast moving data sets
• Lead the technology on small to large sized projects from start to finish
• Strong experience with Cloud Data Warehouses and Data Lake architectures and implementations
• Proven proficiency in data modeling and database design, with an emphasis towards designing optimized self service data solutions
• Experience with both batch and streaming data pipelines and ELT processes
• Ability to work and communicate effectively with other engineers, and both technical and non-technical business stakeholders
• Ability to quickly integrate new technologies and industry best practices into your skill sets
• Expert level SQL skills
• Proficiency with the Python programming tools and ecosystem, while incorporating strong software engineering techniques
• Experience working with some of these: message brokers, data sync/mirroring tools, stream and batch processors, data orchestrators and workflow engines

Responsibilities

• Provide critical data infrastructure and systems for multiple areas of the business, including Business Analysis, Product Development, Engineering, Finance, Sales and Executive Strategy
• Interface with stakeholders to define needs and develop strategies for providing data
• Integrate Technologies such as Airflow, Python, and Kafka
• Plan, build, and maintain data pipelines from internal and external data sources
• Implement data observability and monitoring in the pipeline and in the warehouse
• Work with appropriate teams to ensure data security and data compliance
• Guide data analysts to ensure clean delivery of data
• Work with other senior level engineers and architects with the goal to achieve top level proficiency in core data engineering skills and business functions

Preferred Qualifications

• Python3 and golang Software Development, following general software engineering principles
• SQL for data transformation and analysis, with optimization and tuning in mind
• Snowflake data warehouses (or equivalent)
• Dremio data lakehouses
• Apache Airflow
• Apache Kafka (and it’s supporting tools)
• Experience of building stream and batch processing big data systems
• Experience building observable data systems
• Experience with basic data modeling and data architecture
• Experience with cloud data storage techniques
• Familiarity with data storage formats, such as JSON/Avro/Protobuf/Parquet/Iceberg
• Can work effectively both independently and as part of the data engineering team as a whole
• Experience with Data Governance, including data contracts and schema management
• Experience with Data Security standards including RBAC and sensitive data handling

Benefits

Remote work