Skip to content

Commit b96a386

Browse files
committed
[docs] update results
1 parent 2da4366 commit b96a386

File tree

1 file changed

+16
-4
lines changed

1 file changed

+16
-4
lines changed

docs/irt_tutorial.ipynb

Lines changed: 16 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -293,17 +293,29 @@
293293
"[irt_parameter_estimation](https://github.com/pluralsight/irt_parameter_estimation)\n",
294294
"and [irt](https://github.com/aimir/irt)\n",
295295
"are high-stared implementation of IRT in github.\n",
296-
"We run them on the cdbd dataset and report the result in the following tables,\n",
296+
"We run them on the cdbd dataset and report the result (AUC and MAP is reported) in the following tables,\n",
297297
"which also includes our solution:\n",
298+
"\n",
299+
"#### AUC (auroc)\n",
300+
"\n",
298301
"| | cdbd-a0910 |\n",
299302
"| ------------------------ | ---------- |\n",
300-
"| pyirt | |\n",
303+
"| pyirt | 0.501737 |\n",
301304
"| bayesian-irt | |\n",
302305
"| irt_parameter_estimation | |\n",
303306
"| irt | |\n",
304-
"| XCD-IRT | |\n",
305-
"| XCD-with-tricks | |\n",
307+
"| XCD-IRT-MXIRT | 0.703092 |\n",
308+
"| XCD-IRT-MXIRT-with-tricks | 0.739607 |\n",
306309
"\n",
310+
"#### MAP(aupoc)\n",
311+
"| | cdbd-a0910 |\n",
312+
"| ------------------------ | ---------- |\n",
313+
"| pyirt | 0.674690 |\n",
314+
"| bayesian-irt | |\n",
315+
"| irt_parameter_estimation | |\n",
316+
"| irt | |\n",
317+
"| XCD-IRT-MXIRT | 0.788603 |\n",
318+
"| XCD-IRT-MXIRT-with-tricks | 0.826107 |\n",
307319
"\n",
308320
"The scripts we used to test the performance of the baseline implementation could be found in:\n",
309321
"* [pyirt](../scripts/reproduction/pyirt)\n",

0 commit comments

Comments
 (0)