Posts

Showing posts from October, 2022

ETL From scratch using SSIS integrate to new Data warehouse By Mody Ahmed

Image
Creating a data warehouse sometimes refers to it as creating a copy of the existing transactions data sometimes referred to as "OLTP", this is a dataset that is a transaction in nature meaning it gets updated with new information as they come in, for example, data coming from an outlet store about the products being sold in each store. This data usually is very important to the company and prefers to keep it intact with very minimal interaction with it. Therefore, it is better to have a copy of the data and create a new data warehouse where we can bring the OLTP and mix it together with other sources of data generated by the company, for example, marketing data so we can slice and dice the data to figure out, for example, the correlation between the use of this new channel of marketing (google ads) and the increase or the decrease of sales. As shown in the image above, various departments data will be dumped into the new data warehouse created.  now, for the data warehouse pu...