Improving a Data Exchange Platform with Infrastructure as Code
The exchange of data is a universal problem. When trying to exchange data with someone, you face two challenges – is the transfer secure, and is it efficient? Saxony created a data exchange platform (DXP) that is highly secure, highly efficient, and will scale up as your business needs evolve.
A data broker providing specialized marketing services to clients in financial, real estate, legal, and marketing services, called on Saxony to help develop a method to centralize data from a variety of different sources. This company absorbs the data from across its various environments and needed a way to gather it in one place. With a centralized overview, the data broker would have the capability to make the information actionable for their clients.
Challenge 1: Create a centralized platform that accommodates various environments.
Data collection across a single organization is easy, but this broker accommodates several organizations in various industries that capture various types of data.
Challenge 2: Transfer the data securely and efficiently.
Transferring data within an organization is easy because everything is contained within the same environment and follows the same protocols. But when you try to connect networks outside your environment, you need to send data over the internet – increasing security risks.
Saxony overcame these challenges by creating a DXP for the data broker, cultivating a stronger data partnership between the broker and their customers.
Azure architects & developers at Saxony built a world class data environment and reporting solution from scratch. The solution involved ETL pipelines that import data feeds from multiple sources using a data exchange platform that offers endpoints for users to hook up and transfer data securely. Not only can users “click to run” their data import, but they can schedule times for data to be pulled automatically.
After the data is pulled into the data platform, machine learning models analyze the imported information and offer value predictions. This proved helpful as the data broker partnered with a law firm to collect data on legal cases; these platforms are highly flexible and can be reused to provide many valuable services and predictive modeling in forthcoming use cases.
Knowing the data broker’s need for a multitude of data exchange mediums would continue to grow as the organization scaled, Saxony’s team made it easy (and cost effective) for future DXPs to be built up and torn down. Utilizing Infrastructure as Code (IaC), the DXP can clone instances of itself. These can be created or deleted with one-click deployments.
After launching its first DXP, the data broker’s business grew so fast it needed another one within three months. The second one launched in merely eight hours. The way Saxony built the DXP enables the client to deploy it at a fraction of the speed of a traditional deployment that could take weeks.
Here are some additional bottom-line impacts from this project:
- Our client now has access to a frictionless data exchange with significantly lower effort and improved partner onboarding experience.
- They moved from a legacy system to a cloud environment, allowing the data broker to convey technology maturity to potential partners.
- There is controlled sharing of knowledge and data across the organization and customers.
- Flexible engagement options allow the data broker to intake data from any type of environment.
A Custom Data Exchange Platform: Helping You Do More with Your Data®
If your business could benefit from an improved data exchange platform, our team of developers and data analysts at Saxony Partners can help. Reach out to us here for more information.