Kimball Forum
Would you like to react to this message? Create an account in a few clicks or log in to continue.

DataRelease after manual quality check

4 posters

Go down

DataRelease after manual quality check Empty DataRelease after manual quality check

Post  DilMustafa Fri Feb 27, 2009 6:59 pm

Thinking of deploying a business objects universe for the self serve reporting initiative. One of the requirements is that the user should not be able to see the data in the DW for a date, if the data has not passed a manual approval process. Please, drop your ideas about putting data access control in Business Objects.

DilMustafa

Posts : 49
Join date : 2009-02-03
Location : Calgary, Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  BrianJarrett Sat Feb 28, 2009 3:32 am

Will the records that have been approved have a flag associated with each row? An 'approved_flag' or something like it? If so, you could just put a stub join on your tables in your universe where this flag exists. That would limit the resultset automatically. A user could, however, if they have permission to see and edit the SQL, get around this. If this is a concern then you could place the stub join on the table using a view so it's filtered before it ever gets to BO.
BrianJarrett
BrianJarrett

Posts : 61
Join date : 2009-02-03
Age : 50
Location : St. Louis, MO

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  DilMustafa Sat Feb 28, 2009 1:14 pm

Hi Brian,

Thanks for the reply. We need to keep the flexibility of turning the flag on and off. Lets say it was turned "on" after checking the quality and after two hours a problem was found (which was overlooked in the orignal check) So the flag will be reverted back to "off". I do see a problem updating 10's of facts and dimensions if the flag is included in each fact and dimension table.

What is your opinion on creating a control table and adding a flag for each date there. Would BO be able to do a join on every single query with this control table for the date checks. OR alternatively I can add this flag into the date dimension, which should make things easy compared to having this flag in a seperate table. Your opinion on this is much appreciated.

Thanks once again,

Dil

DilMustafa

Posts : 49
Join date : 2009-02-03
Location : Calgary, Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  robber Sat Feb 28, 2009 3:30 pm

I would add the flag to the existing date dimension, why add a new table if you can avoid it. Either way you would need to ensure the controls are in place to govern the update of this important attribute.

robber

Posts : 41
Join date : 2009-02-28
Location : Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  BoxesAndLines Sun Mar 01, 2009 11:41 am

This should be part of your ETL load auditing processes. In any given load for my warehouse, I can easily identify new and changed rows with a load audit identifier. This identifier links back to my persistent audit table which contains among other things, row counts, load counts, start times, end times, etc. Since this table identifies a "unit of work", i.e. a load of the warehouse, this would be the ideal location for a load approved flag.
BoxesAndLines
BoxesAndLines

Posts : 1212
Join date : 2009-02-03
Location : USA

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  DilMustafa Sun Mar 01, 2009 12:02 pm

Thanks for the comments. My main concern is still around Business Objects reading the approved_flad='Y' data based on universe deployemnt for every single self serve report. I would love thoughts and comments BO and the approved_flag='Y' relationship.

DilMustafa

Posts : 49
Join date : 2009-02-03
Location : Calgary, Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  robber Sun Mar 01, 2009 1:30 pm

I'm not a BO guy but in other BI platforms I would edit the physical metadata layer for the date dimension to include the required filter:
ie. select * from dim_date where approved_flag='Y'

If BO does not cater for this then expose the date dimension through a view where you can include the filter.

robber

Posts : 41
Join date : 2009-02-28
Location : Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  DilMustafa Sun Mar 01, 2009 3:35 pm

BUT, how would I control a self serve report where DATE Dimension is not involved at all. Lets say user queries Reseller_NAME and Reseller_ADDRESS from the RESELLER Dimension without involving the DATE Field at all.

Once again thank you everybody for spending time on this thread.

DilMustafa

Posts : 49
Join date : 2009-02-03
Location : Calgary, Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  robber Mon Mar 02, 2009 9:38 am

If you need the ability to "roll back" changes to dimensions that is a much more difficult task. Daily snapshots, dimension versioning, and log scraping are the options I would explore if I had to but I would first exhaust/explore any and all options to govern these updates in the source systems, ie. do the manual approval process at the source or in a staging area, ODS, etc.

robber

Posts : 41
Join date : 2009-02-28
Location : Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  DilMustafa Mon Mar 02, 2009 3:45 pm

Just found out that BO has way to force a join on every single query. So I can force a date_dimension join even when date_dimension is not part of the self serve query.... Thanks for suggestions and comments. Closing the thread...

DilMustafa

Posts : 49
Join date : 2009-02-03
Location : Calgary, Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  robber Mon Mar 02, 2009 6:55 pm

How will you join a date dimension to a reseller dimension?

robber

Posts : 41
Join date : 2009-02-28
Location : Canada

Back to top Go down

DataRelease after manual quality check Empty Re: DataRelease after manual quality check

Post  Sponsored content


Sponsored content


Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum