Evaluating human-marked documents against current processing results.
/home/diana/gate/corpus_tool.properties
New threshold is: 1.0
Annotation set in marked docs is: Key
Using annotation types from the properties file.
Features: []
App file is: /home/diana/sale/talks/gate-course-may10/track-3/module-9-advanced-ie/hands-on/corpus-benchmark/ANNIE-no-OM.gapp
Processing directory: /home/diana/sale/talks/gate-course-may10/track-3/module-9-advanced-ie/hands-on/corpus-benchmark/test-corpus
ft-bank-of-uk-08-Aug-2001.xml
Word count: 435
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
1.0 |
1.0 |
Organization |
1.0 |
0.6666666666666666 |
Date |
1.0 |
0.875 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
ft-equitable-09-aug-2001.xml
Word count: 269
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.25 |
0.5 |
Organization |
0.9166666666666667 |
0.45833333333333337 |
Date |
1.0 |
1.0 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
ft-bank-of-england-02-aug-2001.xml
Word count: 458
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.8 |
1.0 |
Organization |
0.9 |
0.7941176470588235 |
Date |
0.875 |
0.5833333333333333 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
0.6666666666666666 |
ft-commerzbank-10-aug-2001.xml
Word count: 435
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
1.0 |
1.0 |
Organization |
0.875 |
0.5384615384615385 |
Date |
1.0 |
0.375 |
Money |
0.8888888888888888 |
1.0 |
Percent |
1.0 |
1.0 |
ft-bmi-09-may-2001.xml
Word count: 378
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.9583333333333333 |
0.9583333333333333 |
Organization |
0.9545454545454546 |
0.8076923076923077 |
Date |
1.0 |
0.75 |
Money |
0.8571428571428571 |
1.0 |
Percent |
1.0 |
1.0 |
ft-house-price-08-aug-2001.xml
Word count: 204
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.9444444444444444 |
0.9444444444444444 |
Organization |
0.5 |
1.0 |
Date |
0.9166666666666667 |
0.7857142857142857 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
ft-airlines-27-jul-2001.xml
Word count: 451
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.7777777777777778 |
0.7777777777777778 |
Organization |
0.8269230769230769 |
0.7678571428571429 |
Date |
0.8333333333333333 |
0.8333333333333333 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
ft-airtours-08-aug-2001.xml
Word count: 486
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.9583333333333333 |
0.9583333333333333 |
Organization |
1.0 |
1.0 |
Date |
0.7857142857142857 |
0.6470588235294117 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
ft-equitable-07-auf-2001.xml
Word count: 346
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
0.0 |
1.0 |
Organization |
0.5 |
0.2222222222222222 |
Date |
1.0 |
1.0 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
ft-pirelli-10-aug-2001.xml
Word count: 301
Annotation Type | Precision | Recall |
Person |
1.0 |
1.0 |
Location |
1.0 |
1.0 |
Organization |
0.7916666666666667 |
0.7307692307692307 |
Date |
1.0 |
0.7142857142857143 |
Money |
1.0 |
1.0 |
Percent |
1.0 |
1.0 |
Statistics
Annotation Type | Correct | Partially Correct | Missing | Spurious | Precision | Recall | F-Measure |
Person |
26 |
0 |
0 |
0 |
1.0 |
1.0 |
1.0 |
Location |
54 |
4 |
2 |
5 |
0.8888888888888888 |
0.9333333333333333 |
0.9105691056910569 |
Organization |
80 |
20 |
32 |
6 |
0.8490566037735849 |
0.6818181818181818 |
0.7563025210084033 |
Date |
51 |
11 |
16 |
0 |
0.9112903225806451 |
0.7243589743589743 |
0.807142857142857 |
Money |
69 |
0 |
0 |
2 |
0.971830985915493 |
1.0 |
0.9857142857142858 |
Percent |
36 |
0 |
1 |
0 |
1.0 |
0.972972972972973 |
0.9863013698630138 |
Overall average precision: 0.9185072797572799
Overall average recall: 0.8892566855802151
Overall average fMeasure : 0.8851829370219236
Finished!