Entropy using Decision Tree's

Posted by Matt Clements on Stack Overflow See other posts from Stack Overflow or by Matt Clements
Published on 2010-05-30T12:09:49Z Indexed on 2010/05/30 12:12 UTC
Read the original article Hit count: 338

Filed under:

artificial-intelligence

|

artificial-neural-network

Train a decision tree on the data represented by attributes A1, A2, A3 and outcome C described below:

For log2(1/3) = 1.6 and log2(2/3) = 0.6, answer the following questions:

a) What is the value of entropy H for the given set of training example?

b) What is the portion of the positive samples split by attribute A2?

c) What is the value of information gain, G(A2), of attribute A2?

d) What is IFTHEN rule(s) for the decision tree?

© Stack Overflow or respective owner

Related posts about artificial-intelligence

Artificial Intelligence Research within Microsoft

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
I've got the contact with Eric Horvitz today, interview with him about Artificial Intelligence-related research within Microsoft you can see below: ...(read more) >>> More
Artificial Intelligence Research within Microsoft

as seen on ASP.net Weblogs - Search for 'ASP.net Weblogs'
I've got the contact with Eric Horvitz today, interview with him about Artificial Intelligence-related research within Microsoft you can see below: ...(read more) >>> More
Design for a machine learning artificial intelligence framework

as seen on Stack Overflow - Search for 'Stack Overflow'
This is a community wiki which aims to provide a good design for a machine learning/artificial intelligence framework (ML/AI framework). Please contribute to the design of a language-agnostic framework which would allow multiple ML/AI algorithms to be plugged into a single framework which: runs… >>> More
Design for a machine learning artificial intelligence framework (community wiki)

as seen on Stack Overflow - Search for 'Stack Overflow'
This is a community wiki which aims to provide a good design for a machine learning/artificial intelligence framework (ML/AI framework). Please contribute to the design of a language-agnostic framework which would allow multiple ML/AI algorithms to be plugged into a single framework which: runs… >>> More
what languages are used in AI research today?

as seen on Stack Overflow - Search for 'Stack Overflow'
hi. I am currently dabbling in expert systems, emacs lisp, and reading up about artificial intelligence. Traditionally, artificial intelligence is associated with LISP and expert systems with CLIPS. However, I have noticed in computational sciences how much Python is being used. What about the… >>> More

Related posts about artificial-neural-network

Support Vector Machine or Artificial Neural Network for text processing?

as seen on Stack Overflow - Search for 'Stack Overflow'
We need to decide between Support Vector Machines and Fast Artificial Neural Network for some text processing project. It includes Contextual Spelling Correction and then tagging the text to certain phrases and their synonyms. Which will be the right approach? Or is there an alternate to both of… >>> More
Artificial neural network

as seen on Stack Overflow - Search for 'Stack Overflow'
hai this is naveena My guide given a simple example to solve in artificial neural network and PSO If any body help then i m very happy the example is `A B C a1 b1 c1 a2 b2 c2 how i have to solve manually i cannot understand plz any help me and send a mail to this… >>> More
Need help with artificial neural network

as seen on Stack Overflow - Search for 'Stack Overflow'
I have an input data for neural network that consists of 2 vectors with 200 elements, that i got from some program for generating signals. So it is actually 2x200 input to my nnet. As target data, i have one 1x200 vector that i also got from the same program. That is my training data set. I gather… >>> More
Neural Net Optimize w/ Genetic Algorithm

as seen on Stack Overflow - Search for 'Stack Overflow'
Is a genetic algorithm the most efficient way to optimize the number of hidden nodes and the amount of training done on an artificial neural network? I am coding neural networks using the NNToolbox in Matlab. I am open to any other suggestions of optimization techniques, but I'm most familiar… >>> More
What problems have you solved using artificial neural networks?

as seen on Stack Overflow - Search for 'Stack Overflow'
I'd like to know about specific problems you - the SO reader - have solved using artificial neural network techniques and what libraries/frameworks you used if you didn't roll your own. Questions: What problems have you used artificial neural networks to solve? What libraries/frameworks did you… >>> More