Kimball Forum
Would you like to react to this message? Create an account in a few clicks or log in to continue.

Is it the end of the Relational Dimensional Data Warehouse ?

4 posters

Go down

Is it the end of the Relational Dimensional Data Warehouse ? Empty Is it the end of the Relational Dimensional Data Warehouse ?

Post  davfaibish Mon Jun 11, 2012 6:35 am

With all the technologies of cubes, columnar databases, big data, advanced semantic layers, self-service BI and tools like Power Pivot and Power View from Microsoft for example, is it still relevant to build a traditional relational data warehouse? A Kimball like with facts, dimensions (surrogate keys, Slow Changing Dimensions and etc…)

davfaibish

Posts : 1
Join date : 2012-06-11

Back to top Go down

Is it the end of the Relational Dimensional Data Warehouse ? Empty Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  BoxesAndLines Mon Jun 11, 2012 12:17 pm

Don't believe the marketing hype. Dimensional warehouses will be around for years to come.
BoxesAndLines
BoxesAndLines

Posts : 1212
Join date : 2009-02-03
Location : USA

Back to top Go down

Is it the end of the Relational Dimensional Data Warehouse ? Empty Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  ngalemmo Mon Jun 11, 2012 4:39 pm

Cubes have limited capacity.

Columnar databases are relational.

Structured big data is handled in relational environments (MPP systems). Unstructured data is sometimes. You should remember that the whole point of Hadoop is to address MPP for those who don't have an MPP database system. It is not a replacement, and a very poor substitute when dealing with structured data. It is also very inefficient both in personnel and hardware.

Semantic layers (and 'self service' tools) have, and will continue to coexist with dimensional DW implementations. They are complementary technologies.



ngalemmo
ngalemmo

Posts : 3000
Join date : 2009-05-15
Location : Los Angeles

http://aginity.com

Back to top Go down

Is it the end of the Relational Dimensional Data Warehouse ? Empty Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  John Simon Tue Jun 12, 2012 1:19 am

It's definitely not the end.

In-memory solutions actually work better against a star schema than a snow-flake or 3NF solution.
Storing your entire data warehouse in-memory is also not sustainable for large (multi-terabyte) data warehouses.

In-memory has it's place, but obviously has a cost in terms of hardware. Yahoo have a 24Tb SSAS cube (last I heard, probably bigger now) - imagine how expensive that would be to put into memory!


John Simon

Posts : 186
Join date : 2009-05-29
Location : Melbourne, Australia

http://jsimonbi.wordpress.com

Back to top Go down

Is it the end of the Relational Dimensional Data Warehouse ? Empty Re: Is it the end of the Relational Dimensional Data Warehouse ?

Post  Sponsored content


Sponsored content


Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum