Tags |
|
|
Links |
|
|
Advice You - Data Warehousing - Tom's Ten Data Tips
Data Warehousing was an innovation from the 90's that promised to change the data landscape for good. How far have we come? Many vendors have entered the marketplace because it makes sense to bring together data from throughout the organization, and this will continue to make sense in the future.
How large the Data Warehouse market will grow nobody knows yet. But for sure it is still growing fast, and currently is estimated at 4,5 billion dollar pe
How large the Data Warehouse market will grow nobody knows yet. But for sure it is still growing fast, and currently is estimated at 4,5 billion dollar pe
According to USFDA, a combination product is one composed of any combination of a drug and device; biological product and device; drug and biological product
r year (IDC).
1. Why Do Data Warehouse Projects Run Into Scope Creep?
To quote Bill Inmon (guru and author of several great books on Data Warehousing) "Traditional projects start with requirements and end with data. Data Warehousing projects start with data and end with requirements." As soon as the project gets under way, users will find new applications, and with it will come new requests for data. Interestingly, these projects
1. Why Do Data Warehouse Projects Run Into Scope Creep?
To quote Bill Inmon (guru and author of several great books on Data Warehousing) "Traditional projects start with requirements and end with data. Data Warehousing projects start with data and end with requirements." As soon as the project gets under way, users will find new applications, and with it will come new requests for data. Interestingly, these projects
; or drug, device, and biological product and fixed dose combination would include two or more combinations of drug.
Examples of combination products may in
Examples of combination products may in
ften are justified by moving Q&R work away from the 'data people'. What we've seen is that the first thing that happens as soon as the project delivers is that more requests for special queries are submitted to these same 'data people'. This may appear to undermine the initial business case but actually signals the onset of value creation from the DWH project.
2. Star Schema Versus Entity Relation Model?
There has been en
2. Star Schema Versus Entity Relation Model?
There has been en
lude drug-coated devices, drugs packaged with delivery devices in medical kits, and drugs and devices packaged separately but intended to be used together.
rmous debate in the community about the merits of different data models. At the risk of over simplifying: ER models tend to have better performance (processing time) for the end user, and are often perceived as "easier" to understand by end users. Drawbacks are that ER models require more disk space, and, because of the intrinsic redundancy in the data, have consistency problems from a maintenance perspective. Having said this, the practice seems to
here is enormous increase in the number of combination products entering the market in the recent years. Combination products have proven advantages but fixe
be that often some combination of the two is unavoidable in the practical setting, despite preferences (ER or Star) of the chief architects. Overall, Star models seem to have gained the most ground.
3. The Importance of a Data Warehouse Business Case
Much has been written about the business case for a Data Warehouse. What goes in to a good business case? IT savings are ubiquitous in DWH business cases. The important point
3. The Importance of a Data Warehouse Business Case
Much has been written about the business case for a Data Warehouse. What goes in to a good business case? IT savings are ubiquitous in DWH business cases. The important point
d dose combinations are still in the process of convincing regulatory authority on their advantages over the single ingredient formulations.
Combination pro
Combination pro
is to not limit this to 'pure' savings, but to connect to primary business processes as much as possible. As an example, faster turnaround cycles for list selections are fine (when quantified in hourly rates), but it is even better if the revenue from more customer acquisitions that follow from these selections can be tied in. Not only will the relation to revenue growth rather than savings make for a more balanced business case, more impor
ucts have become life saving products for the pharmaceutical companies who doesn’t have many innovative molecules in their product pipeline and have been inc
ant is the intrinsic business buy-in that results from a direct connection to the company bottom line. These days, changes in legislation (in particular Sarbanes-Oxley) play a major role in justifying business cases. This may be either through a higher company valuation for its transparent information gathering, or, less sleepless night for the CEO, which is of course priceless...
4. Why Do Data Warehouse Projects 'Never' Go Wrong?
4. Why Do Data Warehouse Projects 'Never' Go Wrong?
easingly used in the product life cycle management. Even the companies having product patents are trying to extend their product life cycle through the combi
Actually, Data Warehouse projects do sometimes fail. But, they fail so rarely, that it is actually very hard to believe... Especially after having talked to so many disgruntled end-users. And there are many ways a Data Warehouse project can go wrong. Delivering on time, data administration issues, and unavoidable data quality issues in feeding systems. Corporate politics (see Tip 7) are probably the best explanation for this phenomenon of
nation products and maximize the revenues. But the companies involved in this practice are overlooking that they are burdening the patients both economically
near 100% success rates on DWH projects. In my experience, the reason why a failure or 'semi-failure' can go unnoticed is either because senior management is not aware, or, let's say "unmotivated" to talk about misspending of company funds. As a result, not enough is learned. Maybe we as consultants have a stake in this as well, as this assures the industry plenty of ongoing business... J
5. What is Different About Warehousing Web Data?
5. What is Different About Warehousing Web Data?
and physically. They need to rightly judge the benefits of the combination products and they have to even look at the risks involved when combining the produ
ong>
Kimball & Merz (2000): "Although this clickstream data in many cases is raw and unvarnished, it has the potential of providing unprecedented detail about every gesture made by every human being using the Web medium". The subatomic nature of clickstream data poses unique challenges. There are fewer built in feedback mechanisms to ensure data quality, compared to other data streams. The relation between user mouse clicks and server log records i
Kimball & Merz (2000): "Although this clickstream data in many cases is raw and unvarnished, it has the potential of providing unprecedented detail about every gesture made by every human being using the Web medium". The subatomic nature of clickstream data poses unique challenges. There are fewer built in feedback mechanisms to ensure data quality, compared to other data streams. The relation between user mouse clicks and server log records i
ts. Some of the combination products were well accepted by physicians while others suffered. Companies involved in development of combination products are fi
not as tight as in "traditional" transaction processing due to technical issues like proxy servers and caching. Because of these differences, IT people need to adapt to the web process flow, rather than having the process adapt to IT needs as is common for most other DWH interfaces.
6. Which Data Should Be loaded In The Data Warehouse?
The data that enter the DWH ultimately determine its place in the organization. A "let's load a
6. Which Data Should Be loaded In The Data Warehouse?
The data that enter the DWH ultimately determine its place in the organization. A "let's load a
ding difficulty in defining their combination products and facing various challenges from selecting a combination to marketing it.
Following aspects would a
Following aspects would a
l data, to be safe"-attitude is a sure fire way to derail your DWH project. Choices as to what should and should not be included need to be made early on, to keep the project manageable. After proven success of the delivered, deployed, and profitably exploited DWH, there always will be funding somewhere to include previously ignored interfaces. Given the anticipated lifecycle of the DWH, it makes perfect sense to consciously exclude certain
dd to the challenges in developing combination products:
Which markets to tap where the combination products can do fairly well?
Which combination prod
Which markets to tap where the combination products can do fairly well?
Which combination prod
sources. The choice as to what data to include needs to be driven by business considerations, and in particular reference to the company bottom line. If it can't be shown how data will be put to use profitably, they stay out! See also tip #3.
7. Data Warehousing & Company Politics
Data Warehouses have an impact on the company bottom line. Hence, they are likely candidates for turf battles, and are also at risk of becoming "small c
7. Data Warehousing & Company Politics
Data Warehouses have an impact on the company bottom line. Hence, they are likely candidates for turf battles, and are also at risk of becoming "small c
cts are meaningful and rational?
Which therapeutic categories to select?
Which Combinations can address unmet needs of the patients?
Do combin
Which therapeutic categories to select?
Which Combinations can address unmet needs of the patients?
Do combin
ange" in budget allocation negotiations. None of these considerations benefit corporate long term goals. Managing a DWH project is hard enough as it is, and budget issues shouldn't make it any harder than it already is. Because DWH investments are in the present and revenues lie in the future, it is even more important to secure funding through a sound business case and buy-in from the appropriate (high) management level. See also Tip #3. Access to
tions increase the patient compliance?
What would be the developing cost?
How to tackle the risks encountered during combination product developmen
What would be the developing cost?
How to tackle the risks encountered during combination product developmen
data means power, and talking about power is one of the greatest management taboos, still around. Sensitive as they are, even budgets are more readily discussed...
8. Data Warehouse Projects Traps
Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:
8. Data Warehouse Projects Traps
Some commonly recurring 'roadblocks' on the path to timely delivery of a Data Warehouse project:
- ETL processes have eaten up so much time (and still need "babysitters"), that little if any time is left to develop applic
t?
As combination products don't fit into the traditional categories of drugs, medical devices, or biological products, the USFDA is in the process of devel
As combination products don't fit into the traditional categories of drugs, medical devices, or biological products, the USFDA is in the process of devel
tions needed to exploit the DWH Some data are needed, but turn out not to be unavailable, or not in a timely fashion Maintenance required for tuning, indexing, and backup and recovery is severely underestimated Different ways of calculating the same phenomenon lead to different results, and nobody is able to conclusively explain the difference(s) The data that is loaded (and recombined) turn out to contai
ping new procedures for reviewing their safety, efficacy and quality.
Professional from academic institutions, pharmaceutical industries, health care indust
Professional from academic institutions, pharmaceutical industries, health care indust
previously unknown inconsistencies in the source systems, the 'classic' data quality issues that trip DWH projects Metadata were lacking, and developers spend inordinate amounts of time finding out what a field really 'means'
9. DWH Hardware and Software Go Hand in Hand
In Data Warehousing, it is not about hardware, and not about software: it is about the perfect integration of these two
9. DWH Hardware and Software Go Hand in Hand
In Data Warehousing, it is not about hardware, and not about software: it is about the perfect integration of these two
y and representatives from various regulatory agencies are working out to design the regulatory requirements for manufacture and sale of combination products
m>. Those who begin their project from either end, will pay dearly for this mistake. Reasons are:
· in terms of price/performance, new, pre-integrated hardware-software combinations are taking the lead
· from a project management perspective, you never want to be caught between vendors when a proposed solution doesn't work as expected
· database tuning and indexing is very important and a hugely complex job, necessarily left to specialists (in-ho
· in terms of price/performance, new, pre-integrated hardware-software combinations are taking the lead
· from a project management perspective, you never want to be caught between vendors when a proposed solution doesn't work as expected
· database tuning and indexing is very important and a hugely complex job, necessarily left to specialists (in-ho
.
As there is an increasing trend of the combination products companies manufacturing such products should be able to tackle the problems involved in the de
As there is an increasing trend of the combination products companies manufacturing such products should be able to tackle the problems involved in the de
se trained)
10. Performance is Key
Although I don't often find technology factors to be this important, in Data Warehouse acceptance, no other factor will be as important as performance. As size increases over time, this factor becomes even more important. There are three reasons for this:
10. Performance is Key
Although I don't often find technology factors to be this important, in Data Warehouse acceptance, no other factor will be as important as performance. As size increases over time, this factor becomes even more important. There are three reasons for this:
- performance has a huge impact on the development speed (initial load is always very time consuming), and hence the o
elopment. They need to be wiser in analyzing the market trends and the regulatory requirements.
Companies that provide selfless information through particip
Companies that provide selfless information through particip
erall maturity of the DWH at delivery time performance can make or break end-user acceptance, in particular the predictability of performance performance has a tremendous impact on end user productivity, the ultimate driver of the business pay-off
Source Data Warehousing - Tom's Ten Data Tips
Source Data Warehousing - Tom's Ten Data Tips
tion in industry events and feedback to regulatory authorities would be able to face the challenges and will be successful in developing combination products
HTTP = HTML link (for blogs, profiles,phorums):
<a href="http://www.adviceyou.org.ua/article/2572/adviceyou-Data-Warehousing--Toms-Ten-Data-Tips.html">Data Warehousing - Tom's Ten Data Tips</a>
BB link (for phorums):
[url=http://www.adviceyou.org.ua/article/2572/adviceyou-Data-Warehousing--Toms-Ten-Data-Tips.html]Data Warehousing - Tom's Ten Data Tips[/url]
Related Articles:
Living Proof of The Joint Venture Mindset
Tips For Launching Your Bricks And Mortar Business Onto The Web
Bookmark it:
|