I'm using SQL Server Analysis Studio and I'm trying to train a naive Bayes classifier. I've got an attribute called "item description" that basically represents products you can buy at a store. I've got these products mapped to a code and I want to train a classifier to take products it hasn't seen before and give me the code of highest probability.
What I'm running into is that my attribute of "item description" has too many states and so SSAS is throwing away a lot of my items - Analysis Studio says so. I'm got a case table that has an ID and code and a nested table that represents these "item descriptions" chopped up into individual words. Naive Bayes then uses conditional probabilities to map the words to a code.
I tinkered with the MAXIMUM_STATES setting and set it to 0 but according to the documentation, it maxes out at 65k.
Does anyone know if it's possible to raise this limit some magical way? Or can anyone suggest to me an alternate implementation of a naive Bayes classifier that is more scaleable.
