APPENDIX: DETAILED RESULTS FOR ALL THE AVAILABLE CONFIGURATIONS OF

FEATURES

The following tables report the fine grained results obtained for each run of the tool using in input
the reviews related to the app Minesweeper Reloaded, (i.e., a run for each possible configuration of
features).

Minesweeper Reloaded: Detailed results for Text Features

CATEGORY
FEATURE REQUEST
PROBLEM DISCOVERY
INFORMATION SEEKING
INFORMATION GIVING
OTHER
TOTAL

TP
0
1
0
30
1
32

FP
2
3
1
83
0
89

FN
15
12
2
3
57
89

PREC.
0.000
0.250
0.000
0.265
1.000
0.264

RECALL
0.000
0.077
0.000
0.909
0.017
0.264

F-MEASURE
0.000
0.118
0.000
0.411
0.034
0.264

Minesweeper Reloaded: Detailed results for Text Structures

CATEGORY
FEATURE REQUEST
PROBLEM DISCOVERY
INFORMATION SEEKING
INFORMATION GIVING
OTHER
TOTAL

TP
12
10
2
23
55
102

FP
1
1
0
3
14
19

FN
3
3
0
10
3
19

PREC.
0.923
0.909
1.000
0.885
0.797
0.843

RECALL
0.800
0.769
1.000
0.697
0.948
0.843

F-MEASURE
0.857
0.833
1.000
0.780
0.866
0.843

Minesweeper Reloaded: Detailed resuts for Text Features + Text Structures

CATEGORY
FEATURE REQUEST
PROBLEM DISCOVERY
INFORMATION SEEKING
INFORMATION GIVING
OTHER
TOTAL

TP
3
10
2
24
55
94

FP
1
0
0
12
14
27

FN
12
3
0
9
3
27

PREC.
0.750
1.000
1.000
0.667
0.797
0.777

RECALL
0.200
0.769
1.000
0.727
0.948
0.777

F-MEASURE
0.316
0.870
1.000
0.696
0.866
0.777

Minesweeper Reloaded: Detailed results for Text Structures + Sentiment

CATEGORY
FEATURE REQUEST
PROBLEM DISCOVERY
INFORMATION SEEKING
INFORMATION GIVING
OTHER
TOTAL

TP
13
11
2
22
57
105

FP
2
1
0
1
12
16

FN
2
2
0
11
1
16

PREC.
0.867
0.917
1.000
0.957
0.826
0.868

RECALL
0.867
0.846
1.000
0.667
0.983
0.868

F-MEASURE
0.867
0.880
1.000
0.786
0.898
0.868

Minesweeper Reloaded: Detailed results for Text Structures + Text Features + Sentiment
CATEGORY
FEATURE REQUEST
PROBLEM DISCOVERY
INFORMATION SEEKING
INFORMATION GIVING
OTHER
TOTAL

TP
3
10
2
24
55
94

FP
1
0
0
12
14
27

FN
12
3
0
9
3
27

PREC.
0.750
1.000
1.000
0.667
0.797
0.777

RECALL
0.200
0.769
1.000
0.727
0.948
0.777

F-MEASURE
0.316
0.870
1.000
0.696
0.866
0.777