Versione di lingua italiana
Deutsch Sprachenversion
English language version
Choose language:

Economy-point.org



» Personal Loan No Credit Check, Online Economics » Decision theory » Topics begins with D » Decision tree


Page modified: wtorek, lipiec 12, 2011 22:16:54

Decision trees are a special representational form of decision rules. They illustrate successive, hierarchical decisions. They have a meaning

  • in the probability calculation with conditioned probabilities (example with absolute frequency),
  • in the DATA Mining and
  • in the decision theory: in medical decision making (medicine) and in the emergency medicine.
  • in Business Rule management systems (BRMS) for the definition of rules

Function mode

Decision trees begin with a trunk, at whose end a bypass is, which leads again branched branches into several - with probabilities provided -. Each terminator point of the tree is attainable by a clear way.

Decision trees are used, in order to be able to meet better and with fewer errors a decision. In the binary decision tree a series of questions is placed, which everything can be answered with or no. This series results in a result, which is certain by a rule. The rule is simply readable, if one follows from the root the branches of the tree, until one arrives at a certain sheet, which the result of the question row explains.

Decision trees separate the data into several groups, which are determined in each case by a rule with at least one condition.

In order to read off a classification, one goes along the tree downward. With each knot an attribute is queried and a decision is made. This procedure is so long continued, until one reaches a sheet.

The decision trees are generated usually in the Top down principle. With each step the attribute is looked for, with which one can classify the data best. This attribute is used for the allocation of the data, so that one can regard the remaining, yet not classified data separately, in further steps. Decision trees are called therefore also classification trees.

Decision trees can be regarded as systems for rule induction. They are simply and understandably presentable. Their generation is fast feasible.

Example of an application

A bank would like to sell a new service with a Direct Mailing action. In order to maximize the profit, those households are to be addressed with the action, which correspond to the combination of demographic variables, which the appropriate decision tree explained as optimal. This process is called DATA Segmentation or also Segmentation Modeling.

The decision tree supplies thus good Tipps, who could positively react to the dispatch. This permits the bank to write down only those households which correspond to the target group.

Pro and cons

The possible size of the decision trees can affect itself negatively. Each individual rule is easy to read off to have highlights is however very with difficulty. Pruning methods so mentioned were therefore developed, which shorten the decision trees on a reasonable size. For example one can limit the maximum depth of the trees or specify a minimum number of the objects per knot.

Often one avails oneself of the decision trees only as intermediate step to a more efficient representation of the set of rules. In order to arrive at the rules, by different procedures different decision trees are generated. Frequently arising rules are extracted. The optimizations are overlaid, in order to receive a durable, general and correct rule set. The fact that the rules in no relations stand to each other and that contradictory rules can be produced affects unfavorably this method.

A large advantage from decision trees is that they are well explainable and comprehensible. This permits the user to evaluate the result and recognize key attributes. This is above all useful, if the quality of the data does not admit is. The rules can be taken over without large expenditure to a simple language as SQL.

Effectiveness and error rate

The effectiveness of a decision tree can be read off from the number of per cent points, which the data correctly to classify. Some rules work better than others.

Combination with neural nets

Decision trees are used frequently as basis for neural nets. They need not as many examples as the neural nets. But they can be rather inaccurate, particularly if they are small. Large trees save however the danger that some examples are not seen and are not registered with the cases of training. Therefore one tries to combine decision trees with neural nets. From this the TBNN in such a way specified (Tree Based new ral network) developed, which translates the rules of the decision trees into the neural nets.

Algorithms in the comparison

The methods of decision making changed rather strongly in the last decades, with the arising of the current algorithms. Some technical terms such as root, edge, knot were however already very early used. Yet the different algorithms, which are used for the computation of the decision trees, are not very old.

Practice differentiates between different different tree types. The CARTs (Classification and involution Trees) and the CHAIDs (Chi square AUTOMATIC Interaction Detectors) are most well-known. Lately also the C4.5-Algorithmus was frequently used. In former times instead often the ID3-Algorithmus uses.

Application programs

There are some application programs, which implemented decision trees. So for example the two statistics often commodity packages SPSS and SAS. Both by the way use - like most other DATA of Mining software packages also - the CHAID algorithm.

See also

  • Artificial intelligence
  • Machine learning
  • Neural net
  • Material options
  • Top down Induction OF Decision Trees
  • Classification tree method
  • Decision table

Related links


Related Websites

We found here 5 related websites.

Page cached: czwartek, maj 24, 2012 22:16:45
Valid XHTML 1.0!  Valid CSS!

Page copy protected against web site content infringement by Copyscape