Senior Software Engineer

Summary

Join 3Pillar, a leading company seeking senior software engineers to collaborate on transformative projects across various industries. You will design and implement scalable data pipelines using Java and big data technologies, manage data workflows, and ensure data integrity. This role requires expertise in Java, SQL, NoSQL databases, and data pipeline management tools. The company offers a flexible work environment, remote-first approach, global team collaboration, and a focus on employee well-being, including generous time off and professional development opportunities.

Requirements

• Demonstrate expertise with a minimum of 5+ years of experience as a software engineer
• Proficiency in Java 8+ and frameworks like Spring Boot with exposure to Kafka, Spark
• Proficiency in data pipeline and workflow management tools like Airflow
• Advanced SQL skills and experience with relational and NoSQL databases like MySQL, and MongoDB
• Exposure to working on Data Lakes & Data Warehouses solutions
• Excellent problem-solving, communication, and organizational skills
• Proven ability to work independently and with a team

Responsibilities

• Understand the business requirements and implement the technical solution
• Design, development, and maintenance of scalable data pipelines using Java and big data technologies
• Create data pipelines, versioning, and change management
• Manage the complexity inherent in versioned data pipelines
• Work with relational (SQL) and NoSQL databases, ensuring data integrity and performance
• Develop, maintain, and troubleshoot ETL/ELT processes for efficient data ingestion, transformation, and storage
• Automate and optimize data workflows such as data ingestion, aggregation, and ETL processing
• Design, build, and maintain batch or real-time data pipelines in production
• Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures
• Write secure and scalable data exposing APIs for data consumers
• Train and mentor junior engineers
• Execute complex activities within the current methodology and quality standards, showcasing success across diverse engagements
• Promote client success across the team by collaborating with engineers, designers, and managers to understand user pain points, anticipate potential problems, and iterate on solutions that drive client success

Preferred Qualifications

• Prior experience working with IOT devices
• Experience with Big Data technologies like Map Reduce, Hadoop, Hive, etc
• Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight, etc
• Experience with any public cloud (AWS/Azure/GCP)

Benefits

• Flexible work environment – whether it's the office, your home, or a blend of both
• Remote-first approach
• Part of a global team, learning from top talent around the world and across cultures, speaking English everyday
• Leverage global resources to accomplish our work in efficient and effective teams
• Focus on well-being – a trimester in our annual cycle focused on wellbeing, fitness offerings, mental health plans (country-dependent), and generous time off
• Professional services model enables acceleration of career growth and development opportunities - across projects, offerings, and industries