Data Engineer

Summary

Join uShip as a Data Engineer and play a pivotal role in designing, developing, and maintaining our data infrastructure. You will collaborate with developers and stakeholders to build a robust data architecture for our website and mobile application, ensuring data quality, security, and integrity. Responsibilities include implementing ETL processes, developing and optimizing data transformation workflows using various tools and technologies, and maintaining multiple database platforms. You will leverage your expertise in SQL, Python, and cloud platforms like AWS to create scalable solutions and actionable insights. This position requires 3+ years of data engineering experience and proficiency in several database systems and programming languages. uShip offers a competitive salary, remote work options, and a comprehensive benefits package.

Requirements

• Generalized data development and design experience with the ability to assist developers with proper architecture
• Strong proficiency with PostgreSQL, MSSQL, Mongo, and Dynamo for data design, management, and optimization
• Strong proficiency with AWS Lambda and RDS services
• Moderate to strong proficiency with Python for data development, advanced analytics, pipeline development and transformation tasks
• Experience with creating data insights and predictive analytics using Python, AWS Sagemaker and/or R
• Moderate to strong proficiency in data modeling, ETL pipelines, and data integration
• 3+ years of experience working in a data engineering role
• 1+ years of experience with data architecture and design
• Proven experience in data transformation and creating scalable data workflows
• Experience working with large datasets and high-performance databases
• Familiarity with AWS Sagemaker and data science development best practices
• Familiarity with cloud data platforms (AWS, GCP, Azure)
• Experience using GitHub and a CI/CD pipeline
• Experience with other data visualization tools (e.g., Tableau, Power BI)
• Knowledge of version control systems (e.g., Git)
• Strong problem-solving skills and the ability to work independently and in a team
• Good communication skills, with the ability to explain technical concepts to non-technical stakeholders

Responsibilities

• Provide and partner with developers to create general data architecture in support of a website and mobile application
• Implement and enforce data security best practices across pipelines and infrastructure, including vulnerability assessment, dependency patching, and compliance with data protection standards
• Work with developers to ensure data quality assurance and implement data validation and cleansing processes to maintain data accuracy and consistency
• Work with developers to ensure proper data lineage to understand the flow and transformation of data
• Work with developers to implement data quality and integrity
• Implement robust data validation and cleansing processes to ensure data accuracy and consistency
• Use data profiling techniques to understand data characteristics and identify potential issues
• Maintain comprehensive data metadata to provide context and facilitate data discovery
• Collaborate cross-functionally with the analytics team, architects, developers, product owners, and business stakeholders to understand data requirements and deliver scalable solutions that enable actionable insights
• Write clear documentation for data processes, code, and reports to ensure transparency and reproducibility
• Design and implement ETL (Extract, Transform, Load) processes to clean, organize, and prepare data for analysis
• Develop and optimize complex data transformation workflows using SQL, Python, Estuary, dbt and other transformation tools
• Work with large datasets to ensure data accuracy, consistency, and integrity
• Level 3 support for on-call data issues related to data transformation failures or critical data alerts
• Develop and maintain MULTIPLE database platforms/products, including the design of tables, views, and indexes for optimized query performance
• Write and support AWS Lambda functions
• Write efficient SQL queries for data extraction, aggregation, and transformation
• Troubleshoot and resolve database performance issues

Benefits

• Remote or hybrid work options
• Monthly Wellness Reimbursements
• Home office Reimbursements
• Company paid meal delivery pass
• 100% Paid Health and Dental available
• 401(k) matching, no vesting
• Stock Options
• Pet Insurance