Data integration across Salesforce, Sage HR, PowerBI, and Runn
Dedicated team behind the project
Architect & Tech Lead
Senior Full Stack Engineer
Senior DevOps Engineer
Senior Project Manager
Software Engineer
The client
APC, founded by Dr. Mark Barrett and Prof. Brian Glennon of UCD School of Chemical and Bioprocess Engineering, specializes in accelerating drug process development for the pharma and biotech industries. Known for their commitment to breakthrough science, APC enables biopharma companies to significantly reduce drug development times through innovative processes and radical collaboration.
Client achievements:
Recognized with top honors at the 2024 Pharma Industry Awardsfor advancing pharmaceutical technology and therapeutic development. Read more.
Strengthening pharmaceutical R&D capabilities with a €100M expansion, creating a leading hub for medicine development. Read more.
Earned the Best Managed Company 2023 award, highlighting operational leadership and long-term business success. Read more.
Honored with the Pharma Leader Award, recognizing exceptional contributions to pharmaceutical innovation and healthcare impact. Read more.
Announced a €25M investment and 120 new positions to speed up COVID vaccine and advanced therapeutic production. Read more
The challenge
The client sought to integrate their newly adopted resource management platform, Runn, with their existing systems – Salesforce, Sage HR, and PowerBI – to enable real-time data synchronization and improve reporting accuracy.
The integration required:
Ensuring that any changes in Salesforce or Sage HR data were instantly reflected in Runn without manual intervention.
Consolidating and transforming data from multiple systems to meet specific business requirements and support insightful PowerBI visualizations.
Developing a system to schedule regular, automated data migrations while ensuring reliability.
Building an idempotent solution capable of handling interruptions without creating duplicate or inconsistent data.
Implementing a robust architecture to handle increasing data volumes and adapt to future needs.
What was done
To address APC’s challenges, Ralabs developed an advanced ETL solution designed to synchronize data across platforms seamlessly.
The work included:
Development of a Node.js migration application: Built to extract data from Salesforce and Sage APIs, transform it according to business rules, and load it into Runn.
Dockerized integration service: The application was containerized using Docker for scalability and ease of deployment.
Automated scheduling with Cron Jobs: Ensured data migration occurred at specified intervals without manual intervention.
Real-time data synchronization: Enabled live data updates, ensuring that changes in Salesforce or Sage HR were automatically reflected in Runn.
Business insights integration: Prepared and merged data from Sage and Salesforce with Runn, enabling detailed analytics in PowerBI.
Idempotent execution: Designed a migration process that could restart without duplicating data or introducing errors.
Implemented features:
Powerful ETL engine
Extracted and transformed data from Salesforce, Sage, and Runn APIs, enabling precise business insights.
Real-time data synchronization
Enabled live data updates between systems with configurable sync intervals and automatic error handling with retry mechanisms for accuracy.
Cloud logging
Provided real-time insights through a cloud-based logging mechanism.
Manual migration trigger
Enabled on-demand data migration checks with comprehensive reporting.
Third-party integrations
Connected Salesforce CRM API, Sage API, Runn, and Azure SQL Database to ensure seamless data flow, automated synchronization, and reliable Power BI reporting.
Extensive test coverage
Addressed 100+ business cases to ensure system reliability.
Optimized hashing
Ran scripts only when new or updated data appeared, improving efficiency.
Comprehensive documentation
Provided technical and non-technical documentation, including data preparation for Power BI, structured datasets, and guidance on charts, dashboards, and visualizations for key metrics.
Extensive test coverage
Addressed 100+ business cases to ensure system reliability.
User notifications
Developed an interface to notify users about migration results, detailing migrated and newly added data.
Client training
Provided training sessions on script usage and migration processes.
Results:
Delivered robust solutions for over 100 critical scenarios and edge cases, ensuring flawless handling of complex dependencies like client removals
Achieved lightning-fast runtime, reducing data migration checks to just 16 seconds when no source changes occurred
Thousands of records seamlessly synced
Configured Runn and Power BI databases to seamlessly store and manage thousands of records from Sage and Runn, with a caching mechanism ensuring high performance when no source data changes
Pro bono data quality improvements
Increased data integrity during UAT, addressing issues like duplicates and typos at no extra cost
Power BI integration
Implemented an ETL (Extract, Transform, Load) process, consolidating data from Salesforce, Sage, and Runn to generate structured datasets for charts, dashboards, and visualizations in Power BI
Tech stack
Our clients say
Total reviews
43
Average rating
Source
Muhamad Gamal El Dean
Senior Project Manager at APC Ltd.
“Working with Ralabs was a great experience. They helped us connect several systems, ensuring our data stayed synchronized across all platforms we use. “
Alina Tivadar
Associate Project Manager at APC Ltd.
“Ralabs was recommended by our network, and they turned out to be exactly what we needed. Their relevant experience and domain knowledge matched everything we were looking for. “
Other сases
Team size: 4 developers
Team size: 3 developers
Team size: 4 developers
Team size: 6 developers
Team size: 2 developers
Team size: 3 developers