Data Engineer II

Summary

Join Invisible Technologies, a leading AI training and scaling partner, as a Data Engineer to support the daily operations of Invisible deployments. You will leverage your problem-solving skills and technical expertise to support customer implementations and workflows, gaining insights into challenging problems at major organizations. Responsibilities include building, optimizing, and maintaining ETL pipelines; modifying or developing application code and interfaces; analyzing requirements and participating in design, coding, testing, debugging, deployment, and maintenance; developing and implementing databases and data analysis strategies; conducting code and design reviews; mentoring junior colleagues; collaborating with other engineers; and sharing technical insights. The role requires 3+ years of hands-on software development or Big Data experience, excellent Python knowledge, PySpark proficiency, experience with Data Lakes or Data Warehouses, understanding of ETL frameworks and AWS, familiarity with Infra-as-Code, and strong communication skills. Up to 30% travel may be required. Invisible offers competitive compensation, bonuses, and equity.

Requirements

• 3+ years of hands-on experience in software development and/or Big Data
• Excellent knowledge of Python
• Proficiency in PySpark and strong understanding of Spark
• Experience in building and maintaining Data Lakes or Data Warehouses (preferably Snowflake or Databricks)
• Strong understanding of ETL frameworks (e.g., dbt)
• Good knowledge of AWS (IAM, S3, and Security Groups)
• Familiarity with Infra-as-Code (Terraform or similar)
• Great communication skills: able to articulate status updates, blockers, and design considerations
• Ability and interest to travel up to 30% of the time for meetings with clients

Responsibilities

• Build, optimize, and maintain ETL pipelines
• Modify existing application code or interfaces, or develop new components
• Analyze requirements, participate in design, and handle coding, testing, debugging, deployment, and maintenance
• Develop and implement databases, data collection systems, and data analysis strategies for better efficiency and quality
• Conduct code and design reviews to maintain a high-quality product
• Mentor and guide Junior colleagues and new team members
• Collaborate with other Data Engineers and Forward deploy engineers and Platform engineers to prioritize business needs
• Share technical insights with the wider engineering teams

Benefits

• $108,000 — $127,000 USD
• Bonuses and equity are included in offers above entry level