Including flat files in the data warehouse
2 posters
Page 1 of 1
Including flat files in the data warehouse
We are struggling with adopting a new feature into our data warehouse to address certain requirements.
Background
Currently, a robust BI solution exists using a presentation layer and star schema data model that meets the reporting needs for a particular department (i.e. Department A). However, a new requirement was introduced that requires Department A to supply information to other departments to support their legacy applications and data mart needs (i.e. Department Data Feed). The requirement states that the information needs to be presented in sequential file with several supporting descriptions of code values. Basically it is a file that is a snapshot in time of how a set of information looked.
Requirement
Department A wants to make this sequential file available in the data warehouse. Some reasons behind this desire are:
- Departments that are receiving the file like how the information is grouped together in the Department Data Feed since the data structure is easy to understand. This is compared with the existing star schema data model where mechanisms like surrogate ID, logically deleted row, and Type 1/2 Dimensioning are being used.
- The Department Data Feed contains information not available in the data warehouse yet to support some reporting requirements. It may take a while before this additional data is adopted by the data warehouse.
There is a fear of introducing these files into the data warehouse that we will be breaking data warehousing standards. Are there any suggestions on how to address the request without comprising these standards?
Thank you for your help and guidance.
Background
Currently, a robust BI solution exists using a presentation layer and star schema data model that meets the reporting needs for a particular department (i.e. Department A). However, a new requirement was introduced that requires Department A to supply information to other departments to support their legacy applications and data mart needs (i.e. Department Data Feed). The requirement states that the information needs to be presented in sequential file with several supporting descriptions of code values. Basically it is a file that is a snapshot in time of how a set of information looked.
Requirement
Department A wants to make this sequential file available in the data warehouse. Some reasons behind this desire are:
- Departments that are receiving the file like how the information is grouped together in the Department Data Feed since the data structure is easy to understand. This is compared with the existing star schema data model where mechanisms like surrogate ID, logically deleted row, and Type 1/2 Dimensioning are being used.
- The Department Data Feed contains information not available in the data warehouse yet to support some reporting requirements. It may take a while before this additional data is adopted by the data warehouse.
There is a fear of introducing these files into the data warehouse that we will be breaking data warehousing standards. Are there any suggestions on how to address the request without comprising these standards?
Thank you for your help and guidance.
tmorton- Posts : 1
Join date : 2011-11-22
Re: Including flat files in the data warehouse
It is not unusual to provide extracts to other systems. But when the business says they want it 'in the data warehouse' it need not be taken literally. What they are saying is they want it accessible in a manner similar to other reports. There is no reason not to have a location to place these files where users can get to them.
Similar topics
» Using the Dimensional Data Warehouse as source data for the OLTP process
» data warehouse or not ? when is it okay to use OLAP without a data warehouse database
» data warehouse and data warehouse system
» difference between data mart and data warehouse at logical/physical level
» Data Marts, Conformed dimensions and Data Warehouse
» data warehouse or not ? when is it okay to use OLAP without a data warehouse database
» data warehouse and data warehouse system
» difference between data mart and data warehouse at logical/physical level
» Data Marts, Conformed dimensions and Data Warehouse
Page 1 of 1
Permissions in this forum:
You cannot reply to topics in this forum