Kimball Forum
Would you like to react to this message? Create an account in a few clicks or log in to continue.

Building Aggregates from Aggregates

3 posters

Go down

Building Aggregates from Aggregates Empty Building Aggregates from Aggregates

Post  zakirm Tue May 10, 2011 4:21 pm

Hello All,

New to the forum. This is a really good forum and great information. Thanks to all for contributing.

Question - We have a situation where we build an aggregate table from using a detail level table. And, then there are few more tables at different level that can either be built from the original detail table or a pre built aggregate table. I was leaning towards building the other aggregate tables from the detail table instead of using the other aggregate table just because that will force the dependency and we can't build all aggregates in parallel.

What is the recommended approach and Why? Any insight is helpful.
zakirm
zakirm

Posts : 2
Join date : 2011-01-07
Age : 49
Location : United States

Back to top Go down

Building Aggregates from Aggregates Empty Re: Building Aggregates from Aggregates

Post  ngalemmo Tue May 10, 2011 4:43 pm

First figure out if you need the additional aggregates in the first place. Do some performance testing on the aggregates you already have (and the detail table) and see if performance is acceptible and/or a little bit of tuning will make them acceptible.

Having a lot of different aggregates of the same data can become a maintenance nightmare with negligible return.
ngalemmo
ngalemmo

Posts : 3000
Join date : 2009-05-15
Location : Los Angeles

http://aginity.com

Back to top Go down

Building Aggregates from Aggregates Empty Re: Building Aggregates from Aggregates

Post  zakirm Wed May 11, 2011 2:15 pm

Thanks for the reply.

The aggregates are at different level, one is at account level and the other at fund level. The detail table is at account/fund/transaction level. Presenting this at on the fly at two different levels is goign to be a performance problem for us. So, i can build the account/fund level aggregate and then build fund level from first aggregate or i can build both from detail table. What is recomended?

My problem with building the aggregate based on aggregate is the dependency i have to place and i wouldn't be able to run building both aggregates in parallel.

Thanks for the input folks.
zakirm
zakirm

Posts : 2
Join date : 2011-01-07
Age : 49
Location : United States

Back to top Go down

Building Aggregates from Aggregates Empty Re: Building Aggregates from Aggregates

Post  ngalemmo Thu May 12, 2011 1:05 am

Either way will work. Choose which best fits your situation.
ngalemmo
ngalemmo

Posts : 3000
Join date : 2009-05-15
Location : Los Angeles

http://aginity.com

Back to top Go down

Building Aggregates from Aggregates Empty Re: Building Aggregates from Aggregates

Post  Dave Jermy Thu May 12, 2011 5:55 am

The only thing to be wary of if you are building them separately, is that any oddities in the data that affects the account-level aggregates, affects the fund-level aggregates in the same way. I.e. if the logic that builds the aggregate tables does any transformation, make sure it is the same for both.

For example, if you need to convert monetary amounts into a standard currency, summing up to account level and then converting for the account fact and summing up to fund level and then converting for the fund fact may introduce rounding errors. Convert and then sum.

Dave Jermy

Posts : 33
Join date : 2011-03-24
Location : London, UK

Back to top Go down

Building Aggregates from Aggregates Empty Re: Building Aggregates from Aggregates

Post  Sponsored content


Sponsored content


Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum