Inthispaper,weexamineamethodforfeaturesubsetselectionbasedonInformationTheory.Initially,aframeworkfordeningthetheoreticallyoptimal,butcomputationallyintractable,methodforfeaturesubsetselectionispresented.Weshowthatourgoalshouldbetoeliminateafeatureifitgivesuslittleornoadditionalin