forked from moreo/QuaPy
667 B
667 B
Notes
Branch for research on classifier accuracy prediction.
I had some work done for binary (models_binary.py and main_binary.py). I would like to approach the multiclass case directly now.
I think I will frame the problem setting as follows. A Classifier Accuracy Prediction (CAP) method is method tha receives as input: - h: classifier (already trained), - V: labelled collection (for training the CAP), - acc_func: callable: any function that works on a contingency table
And implements: - fit: trains the CAP - predict: predicts the evaluation measure on unseen data (provided, calls predict_ct and acc_func) - predict_ct: predicts the contingency table