Business Intelligence & Data Warehousing in a Business Perspective

Business Intelligence

Business Intelligence has become a very important activity in the business arena irrespective of the domain due to the fact that managers need to analyze comprehensively in order to face the challenges.

Data sourcing, data analysing, extracting the correct information for a given criteria, assessing the risks and finally supporting the decision making process are the main components of BI.

In a business perspective, core stakeholders need to be well aware of all the above stages and be crystal clear on expectations. The person, who is being assigned with the role of Business Analyst (BA) for the BI initiative either from the BI solution providers' side or the company itself, needs to take the full responsibility on assuring that all the above steps are correctly being carried out, in a way that it would ultimately give the business the expected leverage. The management, who will be the users of the BI solution, and the business stakeholders, need to communicate with the BA correctly and elaborately on their expectations and help him throughout the process.

Data sourcing is an initial yet crucial step that would have a direct impact on the system where extracting information from multiple sources of data has to be carried out. The data may be on text documents such as memos, reports, email messages, and it may be on the formats such as photographs, images, sounds, and they can be on more computer oriented sources like databases, formatted tables, web pages and URL lists. The key to data sourcing is to obtain the information in electronic form. Therefore, typically scanners, digital cameras, database queries, web searches, computer file access etc, would play significant roles. In a business perspective, emphasis should be placed on the identification of the correct relevant data sources, the granularity of the data to be extracted, possibility of data being extracted from identified sources and the confirmation that only correct and accurate data is extracted and passed on to the data analysis stage of the BI process. Business oriented stake holders guided by the BA need to put in lot of thought during the analyzing stage as well, which is the second phase. Synthesizing useful knowledge from collections of data should be done in an analytical way using the in-depth business knowledge whilst estimating current trends, integrating and summarizing disparate information, validating models of understanding, and predicting missing information or future trends. This process of data analysis is also called data mining or knowledge discovery. Probability theory, statistical analysis methods, operational research and artificial intelligence are the tools to be used within this stage. It is not expected that business oriented stake holders (including the BA) are experts of all the above theoretical concepts and application methodologies, but they need to be able to guide the relevant resources in order to achieve the ultimate expectations of BI, which they know best.

Identifying relevant criteria, conditions and parameters of report generation is solely based on business requirements, which need to be well communicated by the users and correctly captured by the BA. Ultimately, correct decision support will be facilitated through the BI initiative and it aims to provide warnings on important events, such as takeovers, market changes, and poor staff performance, so that preventative steps could be taken. It seeks to help analyze and make better business decisions, to improve sales or customer satisfaction or staff morale. It presents the information that manager's need, as and when they need it.

In a business sense, BI should go several steps forward bypassing the mere conventional reporting, which should explain "what has happened?" through baseline metrics. The value addition will be higher if it can produce descriptive metrics, which will explain "why has it happened?" and the value added to the business will be much higher if predictive metrics could be provided to explain "what will happen?" Therefore, when providing a BI solution, it is important to think in these additional value adding lines.

Data warehousing

In the context of BI, data warehousing (DW) is also a critical resource to be implemented to maximize the effectiveness of the BI process. BI and DW are two terminologies that go in line. It has come to a level where a true BI system is ineffective without a powerful DW, in order to understand the reality behind this statement, it's important to have an insight in to what DW really is.

A data warehouse is one large data store for the business in concern which has integrated, time variant, non volatile collection of data in support of management's decision making process. It will mainly have transactional data which would facilitate effective querying, analyzing and report generation, which in turn would give the management the required level of information for the decision making.

The reasons to have BI together with DW

At this point, it should be made clear why a BI tool is more effective with a powerful DW. To query, analyze and generate worthy reports, the systems should have information available. Importantly, transactional information such as sales data, human resources data etc. are available normally in different applications of the enterprise, which would obviously be physically held in different databases. Therefore, data is not at one particular place, hence making it very difficult to generate intelligent information. The level of reports expected today, are not merely independent for each department, but managers today want to analyze data and relationships across the enterprise so that their BI process is effective. Therefore, having data coming from all the sources to one location in the form of a data warehouse is crucial for the success of the BI initiative. In a business viewpoint, this message should be passed and sold to the managements of enterprises so that they understand the value of the investment. Once invested, its gains could be achieved over several years, in turn marking a high ROI.

Investment costs for a DW in the short term may look quite high, but it's important to re-iterate that the gains are much higher and it will span over many years to come. It also reduces future development cost since with the DW any requested report or view could be easily facilitated. However, it is important to find the right business sponsor for the project. He or she needs to communicate regularly with executives to ensure that they understand the value of what's being built. Business sponsors need to be decisive, take an enterprise-wide perspective and have the authority to enforce their decisions.

Process

Implementation of a DW itself overlaps with some phases of the above explained BI process and it's important to note that in a process standpoint, DW falls in to the first few phases of the entire BI initiative. Gaining highly valuable information out of DW is the latter part of the BI process. This can be done in many ways. DW can be used as the data repository of application servers that run decision support systems, management Information Systems, Expert systems etc., through them, intelligent information could be achieved. But one of the latest strategies is to build cubes out of the DW and allow users to analyze data in multiple dimensions, and also provide with powerful analytical supporting such as drill down information in to granular levels. Cube is a concept that is different to the traditional relational 2-dimensional tabular view, and it has multiple dimensions, allowing a manager to analyze data based on multiple factors, and not just two factors. On the other hand, it allows the user to select whatever the dimension he wish to choose for analyzing purposes and not be limited by one fixed view of data, which is called as slice & dice in DW terminology.

BI for a serious enterprise is not just a phase of a computerization process, but it is one of the major strategies behind the entire organizational drivers. Therefore management should sit down and build up a BI strategy for the company and identify the information they require in each business direction within the enterprise. Given this, BA needs to analyze the organizational data sources in order to build up the most effective DW which would help the strategized BI process.

High level Ideas on Implementation

At the heart of the data warehousing process is the extract, transform, and load (ETL) process. Implementation of this merely is a technical concern but it's a business concern to make sure it is designed in such a way that it ultimately helps to satisfy the business requirements. This process is responsible for connecting to and extracting data from one or more transactional systems (source systems), transforming it according to the business rules defined through the business objectives, and loading it into the all important data model. It is at this point where data quality should be gained. Of the many responsibilities of the data warehouse, the ETL process represents a significant portion of all the moving parts of the warehousing process.

Creation of a powerful DW depends on the correctness of data modeling, which is the responsibility of the database architect of the project, but BA needs to play a pivotal role providing him with correct data sources, data requirements and most importantly business dimensions. Business Dimensional modeling is a special method used for DW projects and this normally should be carried out by the BA and from there onwards technical experts should take up the work. Dimensions are perspectives specific to a business that could be used for analysis purposes. As an example, for a sales database, the dimensions could include Product, Time, Store, etc. Obviously these dimensions differ from one business to another and hence for each DW initiative those dimensions should be correctly identified and that could be very well done by a person who has experience in the DW domain and understands the business as well, making it apparent that DW BA is the person responsible.

Each of the identified dimensions would be turned in to a dimension table at the implementation phase, and the objective of the above explained ETL process is to fill up these dimension tables, which in turn will be taken to the level of the DW after performing some more database activities based on a strong underlying data model. Implementation details are not important for a business stakeholder but being aware of high level process to this level is important so that they are also on the same pitch as that of the developers and can confirm that developers are actually doing what they are supposed to do and would ultimately deliver what they are supposed to deliver.

Security is also vital in this regard, since this entire effort deals with highly sensitive information and identification of access right to specific people to specific information should be correctly identified and captured at the requirements analysis stage.

Advantages

There are so many advantages of BI system. More presentation of analytics directly to the customer or supply chain partner will be possible. Customer scores, customer campaigns and new product bundles can all be produced from analytic structures resulting in high customer retention and creation of unique products. More collaboration within information can be achieved from effective BI. Rather than middle managers getting great reports and making their own areas look good, information will be conveyed into other functions and rapidly shared to create collaborative decisions increasing the efficiency and accuracy. The return on human capital will be greatly increased.

Managers at all levels will save their time on data analysis, and hence saving money for the enterprise, as the time of managers is equal to money in a financial perspective. Since powerful BI would enable monitoring internal processes of the enterprises more closely and allow making them more efficient, the overall success of the organization would automatically grow. All these would help to derive a high ROI on BI together with a strong DW. It is a common experience to notice very high ROI figures on such implementations, and it is also important to note that there are many non-measurable gains whilst we consider most of the measurable gains for the ROI calculation. However, at a stage where it is intended to take the management buy-in for the BI initiative, it's important to convert all the non measurable gains in to monitory values as much as possible, for example, saving of managers time can be converted in to a monitory value using his compensation.

The author has knowledge in both Business and IT. Started career as a Software Engineer and moved to work in the business analysis area of a premier US based software company.

---

You Cant Not Communicate

Most of us would like to be better communicators. As leaders, co-workers, team members and in all of the other roles we play both professionally and personally, we know that communication is a... Read More

Counseling Interviews for the Marginal Employee

ACTIVE LISTENING: The most frequent cause of failure in therapeutic counseling interviews is the interviewer's tendency to talk too much. Numerous studies have shown that in counseling interviews the average manager will talk... Read More

Mantra for Managers

What do organizations look for in a prospective employee with special reference to fresh MBA graduates? The two key assets that an organization looks for is the potential of the individual and ability... Read More

How to Reduce Temporary Employee Turnover

The use of temporary services to stock a farm of employees is beneficial in a number of ways for an employer, and detrimental in others; but the one that will always be heard... Read More

Performance Reviews That Actually Improve Performance

Employee performance reviews are one of the most dreaded tasks by most managers. It is hard to win here ? you can never say enough good things, and one word of criticism is... Read More

Well-Defined Processes ? How to Create

Interested in learning how to reduce development time, save money and stay in control? Business professionals can learn how to create well-defined processes with the easy-to-manage Process Approach of Plan-Do-Check-Act.Real Tools for Real... Read More

ISO 9001 2000, Getting Started on The Route To Registration

ISO 9001 2000, Getting startedBefore starting the ISO 9001 2000 route to registration you will need to have the top management on board. This can be achieved by highlighting to top management the... Read More

Prepare A Winning CV

There is every chance that elements of this article may not be appropriate for everyone in every situation ? and that's precisely the point! Every situation is different. No two projects are the... Read More

Employees - Treat Them the Way They Expect to be Treated

When you have to deal with one of your team who's complaining to you, rather than allowing your negative programmes to take over, get your thinking part in gear and try to see... Read More

Top Ten Tips About Communicating with Your Employees Effectively

Communication is the basis of who you are as a manager/leader in business. The rules are simple and the good news is that you can learn them and develop your skills...and it's quite... Read More

Lessons From Innovative Companies

What do the companies 3M, Polaroid, and Walt Disney have in common? All have innovation in their blood. All encourage an innovative spirit at every level of their organization.For example, 3M has a... Read More

Selective Job Cuts Often Benefits Firm More Than Broad Layoffs Over Long Term

It is difficult to pick up a newspaper or listen to a business news broadcast without being greeted with the announcement of another massive corporate layoff or cutback. The economy catches a chill... Read More

Planning a Productive Retreat

What value is there in leadership or team-building retreats? Just consider the following. An executive committee of an association, deliberating on strategic planning issues, identified "who we are" in terms of their membership.... Read More

What Personal Assistants Really Want

What would happen if the personal assistants in your organisation were away for a week? How would it affect the running of your business or department? How would it affect you?personally?If you are... Read More

One Simple Idea to Grow Your Business

Perhaps the most common theme I've heard in working with business owners or managers is that they rarely have time to plan for the future. They are so busy with day to day... Read More

What You Should Know if People Dont Buy From You and People Dont Visit Your Web Site

It is essential to understand what work and what do not work when you run business, especially through Internet. 1. You don't make people feel safe when they order. Remind people that they... Read More

Six Reasons to K.I.S.S.

Six Reasons to K.I.S.S. "Very often, people confuse simple with simplistic. The nuance is lost on most." - Clement Mok, Chief Creative Officer, Sapient We've all heard THIS acronym, K.I.S.S. ? Keep... Read More

One Crazy Cookie

In order to survive, you have to be happier than if you were in your right mind. Chinese Fortune Cookie When orienting someone new to the company, the last thing I tell them... Read More

Tales From the Corporate Frontlines: Managerial Influence

This article relates to the Manager/Supervisor competency, commonly evaluated in employee satisfaction surveys. This competency evaluates an employee's feelings regarding their direct manager or supervisor. The manager/supervisor competency covers topics like clarity of... Read More

Uncovering the Secrets to Effective Performance Management

In many ways there are no secrets to implementing effective performance management. Performance Management is a process and a process which if implemented effectively should ensure that both employees and managers remain both... Read More

Business & Family Safety and Health Rating

For good reason, practically every endeavor in life is rated. I've seen ratings on who or what's #1 in business, industry, NFL, NBA, MLB, person of the century, athlete of the century, technology,... Read More

Lead to Succeed: The Seven Essential Steps to Work Leader Success

In my book "You're In Charge?What Now?" I use a mnemonic to describe the seven essential steps to work leader success. The mnemonic is "L.E.A.D.E.R.S" and each of these letters represents an essential... Read More

Its a Training Issue!

There's a common phrase used by Organizational Development and Human Resource professionals, when identifying kinks in the growth of an organization or company - "It's a training issue." The same phrase can be... Read More

Tales from the Corporate Frontlines: Finding The Perfect Balance

This article relates to the Work/Life Balance competency, which investigates how your staff feels with regard to the balance between work and personal life. It explores issues such as priority of family and... Read More

Character: Is It Necessary In Leadership? (Part Two)

In the first part of this two part article, I talked about the importance of character in leadership. After all, the best leadership involves the people bonding with the leader in deep, human,... Read More

Lower the Bar

"Nothing great was ever achieved without enthusiasm." Ralph Waldo EmersonI'm so excited. I got a cool new power point template with orange and yellow flames. It's not too much (well, maybe it is),... Read More

Communication, Feedback, and Participation: Three Easy Tidbits For Smarter Business

On communication: One of the biggest strains on the communication process occurs when the sender or receiver is experiencing stress, anger, or frustration either at work or at home. When a situation is... Read More

One Bad Apple

One Bad Apple I know what you are thinking but no, I am not doing a tribute to Michael Jackson and the Jackson 5. Although I will... Read More

Tales from the Corporate Frontlines: Workplace Ethics: Reaching the Highest Standard

This article relates to the Ethics in the Workplace competency, commonly evaluated in employee surveys. It gives examples of how employees and customers consider ethical behavior and sound values an integral part of... Read More