forked from moreo/QuaPy
17 lines
667 B
Markdown
17 lines
667 B
Markdown
|
# Notes
|
||
|
|
|
||
|
|
Branch for research on classifier accuracy prediction.
|
||
|
|
|
||
|
|
I had some work done for binary (models_binary.py and main_binary.py).
|
||
|
|
I would like to approach the multiclass case directly now.
|
||
|
|
|
||
|
|
I think I will frame the problem setting as follows.
|
||
|
|
A Classifier Accuracy Prediction (CAP) method is method tha receives as input:
|
||
|
|
- h: classifier (already trained),
|
||
|
|
- V: labelled collection (for training the CAP),
|
||
|
|
- acc_func: callable: any function that works on a contingency table
|
||
|
|
|
||
|
|
And implements:
|
||
|
|
- fit: trains the CAP
|
||
|
|
- predict: predicts the evaluation measure on unseen data (provided, calls predict_ct and acc_func)
|
||
|
|
- predict_ct: predicts the contingency table
|