Explain different approaches for constructing a data-warehouse (i.e top-down approach and the Bottom-up approach)

-

 Data Warehouse Architecture

  • A data warehouse is a heterogeneous collection of different data sources organized under a unified schema. 
  • There are 2 approaches for constructing a data-warehouse: The top-down approach and the Bottom-up approach are explained below.

1)Top-down approach



The essential components are discussed below:

1. External Sources –

The external source is a source from where data is collected irrespective of the type of data. Data can be structured, semi-structured, and unstructured as well.

2. Stage Area –

Since the data, extracted from the external sources do not follow a particular format, so there is a need to validate this data to load into the data warehouse. For this purpose, it is recommended to use the ETL tool.

• E(Extracted): Data is extracted from an external data source.

• T(Transform): Data is transformed into the standard format.

• L(Load): Data is loaded into the data warehouse after transforming it into the standard format.

3. Data-warehouse –

After cleansing of data, it is stored in the data warehouse as a central repository. It actually stores the metadata and the actual data gets stored in the data marts. Note that the data warehouse stores the data in its purest form in this top-down approach.

4. Data Marts –

Datamart is also a part of the storage component. It stores the information of a particular function of an organization which is handled by a single authority. There can be as many data marts in an organization depending upon the functions. We can also say that the data mart contains a subset of the data stored in the data warehouse.

5. Data Mining –

The practice of analyzing the big data present in the data warehouse is data mining. It is used to find the hidden patterns that are present in the database or in the data warehouse with the help of an algorithm of data mining. This approach is defined by Inmon as – data warehouse as a central repository for the complete organization and data marts are created from it after the complete data warehouse has been created.


Advantages of Top-Down Approach –

1. Since the data marts are created from the data warehouse, provides a consistent dimensional view of data marts.

2. Also, this model is considered the strongest model for business changes. That’s why big organizations prefer to follow this approach.

3. Creating a data mart from a data warehouse is easy.


Disadvantages of Top-Down Approach –

1. The cost, time is taken in designing, and its maintenance are very high.



2) Bottom-up approach:



1. First, the data is extracted from external sources (the same as happens in the top-down approach).

2. Then, the data go through the staging area (as explained above) and is loaded into data marts instead of the data warehouse. The data marts are created first and provide reporting capability. It addresses a single business area.

3. These data marts are then integrated into the data warehouse. This approach is given by Kimball as – data marts are created first and provide a thin view for analyses and a data warehouse is created after complete data marts have been created.


Advantages of Bottom-Up Approach –

1. As the data marts are created first, so the reports are quickly generated.

2. We can accommodate more data marts here and in this way the data warehouse can be extended.

3. Also, the cost and time taken in designing this model are low comparatively.


 Disadvantages of Bottom-Up Approach –

1. This model is not strong as the top-down approach as the dimensional view of data marts is not consistent as it is in the above approach.



Comments

Post a Comment

Popular posts from this blog

Suppose that a data warehouse for Big-University consists of the following four dimensions: student, course, semester, and instructor, and two measures count and avg_grade. When at the lowest conceptual level (e.g., for a given student, course, semester, and instructor combination), the avg_grade measure stores the actual course grade of the student. At higher conceptual levels, avg_grade stores the average grade for the given combination. a) Draw a snowflake schema diagram for the data warehouse. b) Starting with the base cuboid [student, course, semester, instructor], what specific OLAP operations (e.g., roll-up from semester to year) should one perform in order to list the average grade of CS courses for each BigUniversity student. c) If each dimension has five levels (including all), such as “student < major < status < university < all”, how many cuboids will this cube contain (including the base and apex cuboids)?

-
Image
a) A Snowflake Shema is shown in figure below: b) The specific OLAP operations to be performed: 1. Roll-up on course from course_id to department. 2. Roll-up on a student from student_id to university. 3. Dice on course, student with department ="CS" and university = "biguniversity" 4. Drill-down on a student from the university to student_name. c) N = 4 dimensions The cube will contain 54 = 625 cuboids.
Read more

Suppose that a data warehouse consists of the four dimensions; date, spectator, location, and game, and the two measures, count and charge, where charge is the fee that a spectator pays when watching a game on a given date. Spectators may be students, adults, or seniors, with each category having its own charge rate. a) Draw a star schema diagram for the data b) Starting with the base cuboid [date; spectator; location; game], what specific OLAP operations should perform in order to list the total charge paid by student spectators at GM Place in 2004?

-
Image
  b) The specific OLAP operations to be performed are: 1. Roll-up on date from date id to year. 2. Roll-up on spectator from spectator id to status. 3. Roll-up on location from location id to location name. 4. Roll-up on the game from game id to all. 5. Dice with status= “students”, location name= “GM Place”, and year=2004
Read more

Explain network topology .Explain tis types with its advantages and disadvantges.

-
Network topology Network topology refers to how the nodes and links in a network are arranged. A network node is a device that can send, receive, store, or forward data. A network link connects nodes and may be either cabled or wireless links. Understanding topology types provides the basis for building a successful network. There are a number of topologies but the most common are bus, ring, star, and mesh: A bus network topology is when every network node is directly connected to a main cable. In a ring topology, nodes are connected in a loop, so each device has exactly two neighbors. Adjacent pairs are connected directly; non-adjacent pairs are connected indirectly through multiple nodes. In a star network topology, all nodes are connected to a single, central hub and each node is indirectly connected through that hub.  A mesh topology is defined by overlapping connections between nodes. You can create a full mesh topology, where every node in the network is connected to every other
Read more