1
$\begingroup$

In Naive Bayes we often do additive smoothing as a fail safe. Consider the following expression: Lets say $$P(X_i) = \frac{count(X_i) + \alpha}{\sum_i^n count(X_i) + \alpha*total\_size}$$

How to tune the parameter $\alpha$ here. I observed that my classifier accuracy increased for value from $1$ to $N$ (where N is an Integer) and then started to decrease for higher values of $\alpha$. So why does this happen and how to choose this parameter.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.