QuaPy/ClassifierAccuracy/notes.md

Notes

Branch for research on classifier accuracy prediction.

I had some work done for binary (models_binary.py and main_binary.py). I would like to approach the multiclass case directly now.

I think I will frame the problem setting as follows. A Classifier Accuracy Prediction (CAP) method is method tha receives as input: - h: classifier (already trained), - V: labelled collection (for training the CAP), - acc_func: callable: any function that works on a contingency table

And implements: - fit: trains the CAP - predict: predicts the evaluation measure on unseen data (provided, calls predict_ct and acc_func) - predict_ct: predicts the contingency table