Log in Help
Print
Home 〉 sale 〉 rnti-09 〉 cross-validation 〉 thumbs 〉 root 〉 train_test.txt
 
Configuration File=file:/home/saggion/temp/ml-opinion/cross-validation/thumbs/root/config.xml


*************************
A new session for NLP learning is starting.

No chunk length statistics list file in initialisation phrase.
Pre-processing the 62 documents...
Learning starts.
For the information about this learning see the log file /home/saggion/temp/ml-opinion/cross-validation/thumbs/root/savedFiles/logFileForNLPLearning.save
The number of threads used is 1
** Training mode:
time for NLP features: 1
time for fv: 0
time for filtering: 0
time for NLP training: 0
This learning session finished!.
Pre-processing the 30 documents...
Learning starts.
For the information about this learning see the log file /home/saggion/temp/ml-opinion/cross-validation/thumbs/root/savedFiles/logFileForNLPLearning.save
The number of threads used is 1
** Application mode for document from 0 to 30(not included):
This learning session finished!.


------------------------------------------------

annotation sets:
*Output*
*Key*

For the document: ThumbsUp-ThumbsDown-12.html.xml_004BA
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-129.html.xml_004BB
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-119.html.xml_004BC
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-13.html.xml_004BD
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-114.html.xml_004BE
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-14.html.xml_004BF
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-151.html.xml_004C0
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-125.html.xml_004C1
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-16.html.xml_004C2
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-127.html.xml_004C3
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-152.html.xml_004C4
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-123.html.xml_004C5
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-140.html.xml_004C6
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-165.html.xml_004C7
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-112.html.xml_004C8
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-128.html.xml_004C9
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-113.html.xml_004CA
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-104.html.xml_004CB
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-163.html.xml_004CC
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-1.html.xml_004CD
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-18.html.xml_004CE
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-3.html.xml_004CF
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-11.html.xml_004D0
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 2.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 2.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 2.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-137.html.xml_004D1
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-17.html.xml_004D2
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


For the document: ThumbsUp-ThumbsDown-167.html.xml_004D3
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-143.html.xml_004D4
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-158.html.xml_004D5
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-19.html.xml_004D6
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (1.0, 0.0, 0.0, 0.0);  (precision, recall, F1)= (1.0, 1.0, 1.0);  Lenient: (1.0, 1.0, 1.0)


For the document: ThumbsUp-ThumbsDown-2.html.xml_004D7
For the annotation type *p*
Compute the IAA for 2 Annotator(s) and on 1 document(s).
Annotation feature=*thumbs*
Fmeasures averaged over 1 pairs of annotators.
  (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators:
(0,1):   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

For each pair of annotators, and for each label:
(0,1), label= down:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.0, 1.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

(0,1), label= up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 1.0, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)


Macro averaged over 30 documents:

For each pair of annotators, each type and each label:
Annotation type *p*
For each pair of annotators
For pair (Output,Key):   (correct, paritalCorrect, spurious, missing)= (0.53333336, 0.0, 0.46666667, 0.5);  (precision, recall, F1)= (0.53333336, 0.53333336, 0.53333336);  Lenient: (0.53333336, 0.53333336, 0.53333336)

pairAnns=(Output,Key), type=p, label=down:   (correct, paritalCorrect, spurious, missing)= (0.53333336, 0.0, 0.0, 0.5);  (precision, recall, F1)= (0.53333336, 0.53333336, 0.53333336);  Lenient: (0.53333336, 0.53333336, 0.53333336)

pairAnns=(Output,Key), type=p, label=up:   (correct, paritalCorrect, spurious, missing)= (0.0, 0.0, 0.46666667, 0.0);  (precision, recall, F1)= (0.0, 0.0, 0.0);  Lenient: (0.0, 0.0, 0.0)

Overall pairs:   (correct, paritalCorrect, spurious, missing)= (0.53333336, 0.0, 0.46666667, 0.5);  (precision, recall, F1)= (0.53333336, 0.53333336, 0.53333336);  Lenient: (0.53333336, 0.53333336, 0.53333336)

Overall pairs and types:   (correct, paritalCorrect, spurious, missing)= (0.53333336, 0.0, 0.46666667, 0.5);  (precision, recall, F1)= (0.53333336, 0.53333336, 0.53333336);  Lenient: (0.53333336, 0.53333336, 0.53333336)