Data Pipeline and Analytics

Achieving Polyglot Persistence through Data Integration in the Cloud

Written by ,

| Jan 09, 2017

3 MIN READ

Polyglot persistence is based on the assumption that there is no single database technology that suits all data needs equally. Hence different types of data need to be handled and stored differently in order to provide the best possible performance while offering appropriate availability. This could mean that transient data, such as user sessions, could be stored in a key-value format, while the result of a user session, such as a purchase, could be stored in a relational format.
The goal of storing data in an optimal way creates the need for various data types. This can be addressed in two ways. The first option is a multi-model database, such as EDB Postgres™, that offers multiple data types, including relational, key-value, and JSON, within the same database. This blog focuses on the second option: the combined use of various database and data store technologies. This option might be chosen when a new application must provide a holistic view of data across existing databases, or when a particular functionality of a NoSQL database is required, e.g., horizontal scalability for big data in Hadoop® or MongoDB®.
This option calls for the integration of data to avoid walking into the trap of siloed data. Data integration aims to bring together data from various data sources to provide businesses with a more complete view of their customers, products, processes, and/or supply chains to improve customer experiences and to increase operational efficiency.
To integrate data from various data sources within an enterprise, the EDB Postgres™ Platform provides an Integration Suite. It enables building a data repository across traditional relational databases, as well as new data stores under the umbrella of EDB Postgres. Supported remote data sources include Oracle®, SQL Server®, MySQL™, MongoDB, and Hadoop on-premises or in the cloud.
Instead of having to copy data in nightly batch jobs, the EDB Postgres Integration Suite provides replication from or direct access to other data sources providing near real-time results. This means that instead of waiting until the next morning for a report, a daily report could be available right after the business closes and that inter-day reports are available anytime.
Integrating data from those data sources also means, for example, that customer service organizations can access a complete customer profile, including previous purchases, customer preferences from an online profile; social media or chat history; and other information allowing companies to provide the best customer service possible.
A recent Forbes article, titled “Connecting With The Customer: How Airlines Must Adapt Their Distribution Business Model”, acknowledges the fact that the “[i]ntegration of all pieces of customer data into a holistic view of the customer, allowing personalized offers, products and distribution services” is a key capability for success.
While data integration and analytics are paramount to gain insights into the business, speed and agility are drivers for technology such as private and public clouds that enable fast deployment and agile software development. This is why many enterprises deploy new applications and databases in the cloud.
This has an impact on traditional deployment and management processes. Today’s development cannot wait for a tedious infrastructure provisioning process to finish to then wait for an operating system and databases to be installed and configured.
To support DBA and developer teams alike, EDB offers cloud management for EDB Postgres. EDB Ark™ provides Database-as-a-Service (DBaaS) with self-service provisioning and management of EDB Postgres databases in the private and public cloud, enabling developers to create new databases as required, while allowing DBAs to retain control and visibility. This solution gives IT organizations the speed and agility they need to keep up with the fast pace of modern software development to meet business demands. EDB Ark enables DBAs to manage more effectively the integrated data fabric across the cloud, whether public or private.
Summary
The EDB Postgres Platform, with the EDB Postgres Integration Suite, and EDB Ark, provide the capabilities needed to build an integrated data architecture with polyglot persistence on-premises and in the cloud for better insights into customers, products, processes, and supply chains, thereby allowing an enterprise to make the best use of all its data. The EDB Postgres Integration Suite offers EDB Postgres Replication Server that delivers legacy database integration. The EDB Postgres Data Adapters enable integration between EDB Postgres and Hadoop, MongoDB, and MySQL whether on-premises or in the cloud. EDB Ark enables rapid provisioning and management of that integrated data in the cloud.
Sandra Weicki I Director, Product Marketing, EnterpriseDB


Go to Top