Data Integration Engineer

Summary

Join Skillsoft as a Data Integration Engineer to support and modernize our data integration processes. You will manage the traditional ETL lifecycle while transitioning to event-driven, API-based solutions. This role involves ETL development, database administration, and driving modernization initiatives. You will support existing systems, optimize performance, and collaborate with cross-functional teams. The ideal candidate possesses strong experience in ETL, database management, and API integration, along with a passion for innovation. Skillsoft offers a dynamic environment focused on transforming learning and empowering individuals.

Requirements

• Proven experience in managing traditional ETL lifecycles
• Strong knowledge of event-driven architectures and API-based data integration
• Proficiency in SQL and experience with database management systems
• Ability to create and modify C# scripts within SSIS for custom API integrations
• Experience with cloud-based data integration tools and platforms
• Experience in working with Agile/Scrum environments
• Effective communication and collaboration skills
• Ability to manage multiple priorities and deliver in a fast-paced environment
• A passion for innovation and continuous improvement
• 5-10 years of experience in ETL development, data integration, and database administration

Responsibilities

• Design, develop, and optimize ETL processes to integrate data from multiple sources
• Ensure the data integrity, accuracy, and security across all integration workflows
• Troubleshoot and resolve ETL job failures, optimizing performance and throughput
• Support schema design, indexing strategies, and query optimization for efficient data retrieval
• Provide database administration support for ETL workflows and integration projects
• Drive the transition from traditional ETL processes to modern, event-driven, API-based data integration solutions
• Develop and implement strategies for data process modernization
• Explore and implement AI/ML-driven automation for API-based integration workflows
• Stay updated with the latest trends and technologies in data integration and apply them to improve existing systems
• Support and maintain existing data integration systems
• Optimize data pipelines for performance and efficiency
• Collaborate with cross-functional teams to understand data needs and deliver effective solutions
• Define and monitor KPIs for data integration and database performance