# Parameter Adjustment based only on tagged predictions

not sure that this is the best place to post this but if not, please let me know if there is a better stack community.

I have an anomaly detection method which has some parameters. I have some data that I need to find anomalies for. This data is not tagged. I use the anomaly detection method on the data using some default parameters. It predicts some anomalies. The user looks ONLY AT PREDICTED ANOMALIES and determines if he or she agrees with them or not (is the predicted anomaly truly an anomaly?) Now I need to adjust the parameters of the anomaly detection method so it can do better next time whether that is on the same data set or a new data set.

More specifically:

1) system predicts some anomalies

2) user looks at those predicted anomalies and says if they agree or disagree with them

3) system looks at those predicted anomalies and whether or not the user agrees with them and makes adjustments to the parameters based on this information.

The making adjustments" part is what I am looking for ideas about. As for why I am not listing a specific method, I was hoping for more generic ideas.