Big Data Architect

Summary

Join 3Pillar as a Data Architect and be at the heart of the organization, supporting clients in leveraging their data. You will collaborate with business leaders and information management teams to define and implement data management roadmaps. This role involves designing large data platforms, defining tools and technologies for automated data pipelines, and ensuring data architecture aligns with best practices. You will also mentor junior team members and provide thought leadership. The position requires 15+ years of experience and expertise in big data technologies such as SQL, Python, GCP, and DBT. 3Pillar offers a flexible work environment, global team opportunities, and a focus on employee well-being.

Requirements

• 15+ Years Experience
• BigData Architect with recent expertise in SQL, Python, ERD, GCP(All services, especially BigQuery, GCS, Cloud Function, Composer), DBT with Active/Heavy hands-on
• Must have worked in Big data (100TB+)
• Possess the knowledge of Modern Data Technology released
• Design and optimize conceptual and logical database models
• Extensive experience in data modeling
• Analyze system requirements, implementing data strategies, and ensuring the efficiency and securityImprove system performance by conducting tests, troubleshooting, and integrating new elements
• In-depth understanding of database structure principles
• Expertise in implementing and maintaining data pipelines
• Deep knowledge of data mining and segmentation techniques
• Familiarity with data visualization tools

Responsibilities

• Assessments of existing data components, Performing POCs, Consulting to the stakeholders
• Proposing end to end solutions to an enterprise's data specific business problems, and taking care of data collection, extraction, integration, cleansing, enriching and data visualization
• Ability to design large data platforms to enable Data Engineers, Analysts & scientists
• Strong exposure to different Data architectures, data lake & data warehouse
• Define tools & technologies to develop automated data pipelines, write ETL processes, develop dashboard & report and create insights
• Continually reassess current state for alignment with architecture goals, best practices and business needs
• DB modeling, deciding best data storage, creating data flow diagrams, maintaining related documentation
• Taking care of performance, reliability, reusability, resilience, scalability, security, privacy & data governance while designing a data architecture
• Apply or recommend best practices in architecture, coding, API integration, CI/CD pipelines
• Coordinate with data scientists, analysts, and other stakeholders for data-related needs
• Help the Data Science & Analytics Practice grow by mentoring junior Practice members, leading initiatives, leading Data Practice Offerings
• Provide thought leadership by representing the Practice / Organization on internal / external platforms

Benefits

• Imagine a flexible work environment – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach
• You will be part of a global team, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams
• We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best
• Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries