Data Engineer II
closed
Invisible Technologies
Summary
Join Invisible Technologies, a leading AI training and scaling partner, as a Data Engineer to support the daily operations of Invisible deployments. You will leverage your problem-solving skills and technical expertise to support customer implementations and workflows, gaining insights into challenging problems at major organizations. Responsibilities include building, optimizing, and maintaining ETL pipelines; modifying or developing application code and interfaces; analyzing requirements and participating in design, coding, testing, debugging, deployment, and maintenance; developing and implementing databases and data analysis strategies; conducting code and design reviews; mentoring junior colleagues; collaborating with other engineers; and sharing technical insights. The role requires 3+ years of hands-on software development or Big Data experience, excellent Python knowledge, PySpark proficiency, experience with Data Lakes or Data Warehouses, understanding of ETL frameworks and AWS, familiarity with Infra-as-Code, and strong communication skills. Up to 30% travel may be required. Invisible offers competitive compensation, bonuses, and equity.
Requirements
- 3+ years of hands-on experience in software development and/or Big Data
- Excellent knowledge of Python
- Proficiency in PySpark and strong understanding of Spark
- Experience in building and maintaining Data Lakes or Data Warehouses (preferably Snowflake or Databricks)
- Strong understanding of ETL frameworks (e.g., dbt)
- Good knowledge of AWS (IAM, S3, and Security Groups)
- Familiarity with Infra-as-Code (Terraform or similar)
- Great communication skills: able to articulate status updates, blockers, and design considerations
- Ability and interest to travel up to 30% of the time for meetings with clients
Responsibilities
- Build, optimize, and maintain ETL pipelines
- Modify existing application code or interfaces, or develop new components
- Analyze requirements, participate in design, and handle coding, testing, debugging, deployment, and maintenance
- Develop and implement databases, data collection systems, and data analysis strategies for better efficiency and quality
- Conduct code and design reviews to maintain a high-quality product
- Mentor and guide Junior colleagues and new team members
- Collaborate with other Data Engineers and Forward deploy engineers and Platform engineers to prioritize business needs
- Share technical insights with the wider engineering teams
Benefits
- $108,000 β $127,000 USD
- Bonuses and equity are included in offers above entry level
Similar Remote Jobs
