Laporan Akurasi Sistem
Evaluasi performa model komputasi IR berdasarkan validasi Ground Truth 10 Query Acuan.
Mean Avg Precision
0.0184
Avg Precision@10
0.34
Average Recall
0.0258
Average F1-Score
0.0456
Detail Metrik per Query
| Query Uji Target | Ground Truth | P@10 | Recall | F1 Score | Avg Precision |
|---|---|---|---|---|---|
| "iman" | 50 ref | 0.4 | 0.08 | 0.1333 | 0.0244 |
| "wudhu" | 76 ref | 1 | 0.1316 | 0.2326 | 0.1316 |
| "shalat" | 782 ref | 0.9 | 0.0115 | 0.0227 | 0.0101 |
| "puasa" | 290 ref | 0.6 | 0.0207 | 0.04 | 0.0152 |
| "zakat" | 433 ref | 0.2 | 0.0046 | 0.009 | 0.0015 |
| "haji" | 319 ref | 0.2 | 0.0063 | 0.0122 | 0.001 |
| "jual beli" | 463 ref | 0 | 0 | 0 | 0 |
| "nikah" | 210 ref | 0 | 0 | 0 | 0 |
| "makanan" | 302 ref | 0.1 | 0.0033 | 0.0064 | 0.0005 |
| "minuman" | 318 ref | 0 | 0 | 0 | 0 |
Analisis Confusion Matrix
Batas Penarikan: Top-50| Query | True Positive | False Positive | False Negative | True Negative |
|---|---|---|---|---|
| "iman" | 4 | 6 | 46 | 6582 |
| "wudhu" | 10 | 0 | 66 | 6562 |
| "shalat" | 9 | 1 | 773 | 5855 |
| "puasa" | 6 | 4 | 284 | 6344 |
| "zakat" | 2 | 8 | 431 | 6197 |
| "haji" | 2 | 8 | 317 | 6311 |
| "jual beli" | 0 | 10 | 463 | 6165 |
| "nikah" | 0 | 10 | 210 | 6418 |
| "makanan" | 1 | 9 | 301 | 6327 |
| "minuman" | 0 | 10 | 318 | 6310 |