|

2. Data Integration

BySourabh Gupta

Data Integration is a data preprocessing technique that combines data from multiple sources such as databases (relational and non-relational), data cubes, files, etc., and provides users a unified view of these data. It gives a complete picture of key performance indicators (KPIs), customer journeys, market opportunities, etc.

Data Integration [1]

The data sources can be homogeneous or heterogeneous. The data obtained from the sources can be structured, unstructured, or semi-structured in format.

In data integration, we talk about combining data from multiple sources, and you might be wondering what data we mean. Well, modern companies – even those that are smaller in size – have adopted numerous digital tools to assist them in their day-to-day operations. These can range from marketing and sales tools to logistics and transactional processing tools, even a small team with basic operational needs uses multiple tools; all of these tools create data that without integration processes will result in detrimental data silos. 

There are mainly 2 major approaches for data integration :

1. Tight Coupling:

  • Here, a data warehouse is treated as an information retrieval component.
  • In this coupling, data is combined from different sources into a single physical location through the process of ETL – Extraction, Transformation, and Loading.

2. Loose Coupling:  

  • Here, an interface is provided that takes the query from the user, transforms it in a way the source database can understand, and then sends the query directly to the source database to obtain the result.
  • And the data only remains in the actual source databases.

References:

1] https://www.alibabacloud.com/blog/what-is-data-integration-in-analytics_596500

Similar Posts

Anomaly Detection

BySakshi

Anomaly detection or outlier detection is identifying data points, events, or observations that deviate significantly from the majority of the data and do not follow a pre-defined notion of normal behavior. It is carried out to prevent fraud and to create a secure system or model. But before we talk about anomaly detection, let us…

ResNet or Residual Network

BySakshi

ResNet is a type of artificial neural network that is typically used in the field of image recognition. It has been presented as an alternative to deeper neural networks, which are quite difficult to train. The first problem with deeper neural networks was the vanishing/exploding gradients problem. When this was resolved with optimizers, a degradation(of…

|

Outliers

BySourabh Gupta

We all have heard of the idiom ‘odd one out ’  which means something unusual in comparison to the others in a group. Similarly, an outlier is an observation in a given dataset that lies far from the rest of the observations. That means an outlier is vastly larger or smaller than the remaining values…

|

I. Principal Component Analysis (PCA)

BySourabh Gupta

Principal Component Analysis (PCA) is an unsupervised technique used in machine learning to reduce the dimensionality of data.  It does so by compressing the feature space by identifying a subspace that captures most of the information in the complete feature matrix. It projects the original feature space into lower dimensionality.  PCA technique is used for those datasets that…

|

 II. Multicollinearity – VIF

BySourabh Gupta

Multicollinearity is a phenomenon unique to multiple regressions that occurs when two variables that are supposed to be independent in reality have a high amount of correlation and are overlapping in what they measure.  In other words, each variable doesn’t give you entirely new information. To picture what multicollinearity is, let’s start by picturing what it…

Logistic Regression (now with the math behind it!)

ByIshan Shishodiya

Logistic Regression is a type of linear model that’s mostly used for binary classification but can also be used for multi-class classification. If the term linear model sounds something familiar, then that might be because Linear Regression is also a type of linear model. To proceed with this notebook you first have to make sure that you understand ML concepts…

Leave a Reply

Your email address will not be published.