Data Meaning is hiring a
Data Engineer

Summary

The job is for a Data Engineer to develop and maintain APIs using Python's FastAPI framework, work with data in Snowflake and Databricks, collaborate with cross-functional teams, and ensure API reliability and accuracy. The position is full-time contract, remote, and requires experience in developing APIs with Python, working with Redis, Snowflake, and Databricks.

Requirements

• Proven experience as a Data Engineer or similar role
• Strong experience in developing APIs using Python, preferably with the FastAPI framework
• Strong experience working with Redis
• Experience with Snowflake for data retrieval and management
• Familiarity with Databricks for data processing
• Experience in cloud environments (AWS, Azure, or GCP)

Responsibilities

• API Development: Design, develop, and maintain robust, scalable, and high-performance APIs using Python's FastAPI framework
• Develop APIs that leverage company data and utilize Redis for storing calculations
• Data Retrieval: Implement solutions to efficiently retrieve data from Snowflake, ensuring data integrity and security
• Data Processing: Collaborate with data scientists and analysts to process and prepare data using Databricks when necessary
• Integration: Integrate APIs with existing data systems and platforms, ensuring seamless data flow and interoperability
• Optimization: Continuously optimize the performance of APIs and data retrieval processes to ensure minimal latency and maximum efficiency
• Collaboration: Work closely with cross-functional teams including Data Scientists, Data Analysts, and Software Engineers to understand data needs and deliver high-quality solutions
• Documentation: Maintain comprehensive documentation for all developed APIs and data processes
• Testing: Implement thorough testing procedures to ensure the reliability and accuracy of the APIs and data processing workflows
• Monitoring: Monitor the performance of APIs and data pipelines, troubleshoot any issues, and implement timely fixes

Preferred Qualifications

• Experience with containerization technologies such as Docker
• Familiarity with other API frameworks and data engineering tools
• Experience with version control systems like Git
• Knowledge of data security best practices