mixmo.core.metrics_wrapper

Wrapper functions for metric tracking Mostly taken from https://github.com/bayesgroup/pytorch-ensembles/blob/master/metrics.py

Functions

get_brier(preds, targets, **args)

Compute brier score

get_ece(proba_pred, accurate[, n_bins, …])

Compute ECE and write to file

get_ll(preds, targets, **args)

Compute log likelihood

get_tace_bayesgroup(preds, targets[, …])

Compute TACE and write to file

merge_scores(scores_test, scores_val)

Aggregate scores

show_metrics(scores_test)

Results printer

Classes

MetricsWrapper(metrics)

Metric storing object