OverviewFilesCommitsIssuesDocsReleasesPeers

atomspace-layer-discovery commits / e60f958

experiments/level2: Test LV-C results — to convergence the ported clusterer over-merges; C1-C4 FAIL
Classes worsen with data (V 0.615 -> 0.570, 10K -> 30K); largest classes ~110 members vs ~50 gold. Port unverified past merge round 1 (parked divergence). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
e60f95852a9c8fe70ab798ba8ffd9849a896ab87
by plankatron <fleeky@gmail.com> · 2026-10-19T00:49:40.000Z

Changed files (14) +1075 -0

experiments/level2/RESULTS-LVC.md +29 -0
……@@ -0,0 +1,29 @@
1# Test LV-C — Linas's clusterer run to convergence — results
2
3Run `results-LVC/1792367885` (code `9eda613`, 10 seeds). Scored against PREREG-LVC (`9eda613`) by `summarize-LVC.py` (`99794a1`,
4committed before the run finished). Every run ended by the MI cutoff (none reached the 2,000-merge cap).
5
6| | prediction (30K) | verdict |
7|---|---|---|
8| C1 | ≥ 80% of held-out tokens get a class | **FAIL** 0.734 |
9| C2 | senses: a token's own class beats one label per word | **FAIL** −0.013 [−0.043, +0.016] |
10| C3 | re-parse better than at the demo setting (200/100) | **FAIL** +0.001 |
11| C4 | re-parse within 0.02 of the exchange classes | **FAIL** −0.155 (0.545 vs 0.700) |
12
13Held-out labels, LV-I (V-measure / many-to-one / sense): 3K 0.606 / 0.676 / 0.722; 10K 0.615 / 0.682 / 0.652;
1430K **0.570 / 0.601 / 0.530**: the classes get *worse* with more data. Merges at 30K: 628 (LV-I), 436 (LV-A).
15
16State at 30K (seeds 1 and 2, measured from the dumps): 580–594 class atoms; the largest classes have ~110 members
17(the gold grammar's classes average ~50 words); 6.6–7.2K membership entries for ~1,600 words, because classes are
18also merged into classes.
19
20## What it says
21
221. **Run to convergence, Linas's clusterer (as ported) over-merges.** Classes grow past the true class sizes, and
23 class quality falls as data grows, consistent with the snowballing seen earlier on G0 data with NRANK 200.
242. **No sense separation** at any setting (#18 and here), and the re-parse never beats raw words by more than
25 noise, so these classes do not work as a layer 1 on this corpus.
263. **Caveat that limits the conclusion:** the port matches Linas exactly only through merge round 1; rounds 2+ are
27 unverified (parked divergence: Linas finds sim(class, ?) at fmi 4.04 where the port has no shared columns). Over-
28 merging could be the method, or a port divergence in exactly the rounds that matter here. Resolving that
29 divergence is the prerequisite for any further claim about Linas's clusterer.
experiments/level2/results-LVC/1792367885/commit.txt +1 -0
……@@ -0,0 +1 @@
19eda6138858721a000ce4eea4c76ba6af5891167
experiments/level2/results-LVC/1792367885/seed-1.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 1 3000 LV-I 0.62178 0.70377 912 0.61390 0.81395 0.87054
2N 1 3000 LV-I 257
3Q 1 3000 LV-A 0.69993 0.89151 894 0.23911 0.85116 0.85116
4N 1 3000 LV-A 369
5Q 1 10000 LV-I 0.57282 0.62911 902 0.64219 0.58994 0.61057
6N 1 10000 LV-I 403
7Q 1 10000 LV-A 0.73127 0.93836 953 0.20753 0.88072 0.88072
8N 1 10000 LV-A 392
9Q 1 30000 LV-I 0.61096 0.65137 785 0.66048 0.54780 0.54654
10N 1 30000 LV-I 580
11Q 1 30000 LV-A 0.72978 0.91918 855 0.38466 0.86792 0.86541
12N 1 30000 LV-A 541
13# seed=1 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=5002 kept=5002 gold=5002
15GUARD C5 PASS gold=5002 conn=5002 comp=5002
16# tier=3000 train_toks=22033
17P 1 3000 LV-I MST 0.44103 0.44103 0.44103
18X 1 3000 C-LV-I 2 6148
19X 1 3000 C-LV-I 3 10926
20X 1 3000 C-LV-I 4 11746
21X 1 3000 C-LV-I 5 10105
22X 1 3000 C-LV-I 6 7891
23A 1 3000 C-LV-I 46816 1.00000 0.57720 0.18154 4825 15341
24X 1 3000 M-LV-I-ucomp-MST 2 896
25X 1 3000 M-LV-I-ucomp-MST 3 1401
26X 1 3000 M-LV-I-ucomp-MST 4 1791
27X 1 3000 M-LV-I-ucomp-MST 5 1895
28X 1 3000 M-LV-I-ucomp-MST 6 1548
29A 1 3000 M-LV-I-ucomp-MST 7531 0.36104 0.15710 0.30751 4825 2465
30# tier=10000 train_toks=72741
31P 1 10000 LV-I MST 0.49952 0.49952 0.49952
32X 1 10000 C-LV-I 2 11823
33X 1 10000 C-LV-I 3 24655
34X 1 10000 C-LV-I 4 30896
35X 1 10000 C-LV-I 5 29899
36X 1 10000 C-LV-I 6 24752
37A 1 10000 C-LV-I 122025 1.00000 0.70031 0.15452 4825 21868
38X 1 10000 M-LV-I-ucomp-MST 2 1826
39X 1 10000 M-LV-I-ucomp-MST 3 3621
40X 1 10000 M-LV-I-ucomp-MST 4 5270
41X 1 10000 M-LV-I-ucomp-MST 5 6012
42X 1 10000 M-LV-I-ucomp-MST 6 5184
43A 1 10000 M-LV-I-ucomp-MST 21913 0.37264 0.22819 0.28391 4825 3878
44# tier=30000 train_toks=217958
45P 1 30000 LV-I MST 0.54873 0.54873 0.54873
46X 1 30000 C-LV-I 2 18429
47X 1 30000 C-LV-I 3 46635
48X 1 30000 C-LV-I 4 71338
49X 1 30000 C-LV-I 5 77898
50X 1 30000 C-LV-I 6 69709
51A 1 30000 C-LV-I 284009 1.00000 0.80456 0.14117 4825 27499
52X 1 30000 M-LV-I-ucomp-MST 2 2822
53X 1 30000 M-LV-I-ucomp-MST 3 8051
54X 1 30000 M-LV-I-ucomp-MST 4 13759
55X 1 30000 M-LV-I-ucomp-MST 5 16738
56X 1 30000 M-LV-I-ucomp-MST 6 15328
57A 1 30000 M-LV-I-ucomp-MST 56698 0.39503 0.30155 0.27767 4825 5240
58# seed=1 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=5002 kept=5002 gold=5002
60GUARD C5 PASS gold=5002 conn=5002 comp=5002
61# tier=3000 train_toks=22033
62P 1 3000 LV-A MST 0.45794 0.45794 0.45794
63X 1 3000 C-LV-A 2 7363
64X 1 3000 C-LV-A 3 12667
65X 1 3000 C-LV-A 4 12320
66X 1 3000 C-LV-A 5 10274
67X 1 3000 C-LV-A 6 7918
68A 1 3000 C-LV-A 50542 1.00000 0.46984 0.17841 4825 12707
69X 1 3000 M-LV-A-ucomp-MST 2 1121
70X 1 3000 M-LV-A-ucomp-MST 3 1453
71X 1 3000 M-LV-A-ucomp-MST 4 1691
72X 1 3000 M-LV-A-ucomp-MST 5 1787
73X 1 3000 M-LV-A-ucomp-MST 6 1494
74A 1 3000 M-LV-A-ucomp-MST 7546 0.35793 0.12124 0.31334 4825 1867
75# tier=10000 train_toks=72741
76P 1 10000 LV-A MST 0.52357 0.52357 0.52357
77X 1 10000 C-LV-A 2 16768
78X 1 10000 C-LV-A 3 35260
79X 1 10000 C-LV-A 4 37898
80X 1 10000 C-LV-A 5 33039
81X 1 10000 C-LV-A 6 25597
82A 1 10000 C-LV-A 148562 1.00000 0.57098 0.16607 4825 16589
83X 1 10000 M-LV-A-ucomp-MST 2 2900
84X 1 10000 M-LV-A-ucomp-MST 3 5036
85X 1 10000 M-LV-A-ucomp-MST 4 6109
86X 1 10000 M-LV-A-ucomp-MST 5 6353
87X 1 10000 M-LV-A-ucomp-MST 6 5268
88A 1 10000 M-LV-A-ucomp-MST 25666 0.41140 0.20083 0.31543 4825 3072
89# tier=30000 train_toks=217958
90P 1 30000 LV-A MST 0.58040 0.58040 0.58040
91X 1 30000 C-LV-A 2 29897
92X 1 30000 C-LV-A 3 82569
93X 1 30000 C-LV-A 4 101791
94X 1 30000 C-LV-A 5 95147
95X 1 30000 C-LV-A 6 75814
96A 1 30000 C-LV-A 385218 1.00000 0.65223 0.15249 4825 20638
97X 1 30000 M-LV-A-ucomp-MST 2 5818
98X 1 30000 M-LV-A-ucomp-MST 3 14365
99X 1 30000 M-LV-A-ucomp-MST 4 19039
100X 1 30000 M-LV-A-ucomp-MST 5 19905
101X 1 30000 M-LV-A-ucomp-MST 6 16839
102A 1 30000 M-LV-A-ucomp-MST 75966 0.45554 0.28062 0.31769 4825 4262
experiments/level2/results-LVC/1792367885/seed-10.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 10 3000 LV-I 0.61108 0.68499 887 0.62810 0.64079 0.64079
2N 10 3000 LV-I 278
3Q 10 3000 LV-A 0.71349 0.91015 900 0.24009 0.79026 0.79026
4N 10 3000 LV-A 337
5Q 10 10000 LV-I 0.62404 0.70446 946 0.62383 0.70411 0.68699
6N 10 10000 LV-I 330
7Q 10 10000 LV-A 0.73560 0.94091 958 0.20308 0.89315 0.89315
8N 10 10000 LV-A 347
9Q 10 30000 LV-I 0.56450 0.59507 796 0.80992 0.48213 0.54080
10N 10 30000 LV-I 689
11Q 10 30000 LV-A 0.72746 0.90802 859 0.39130 0.86446 0.86514
12N 10 30000 LV-A 495
13# seed=10 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4978 kept=4978 gold=4978
15GUARD C5 PASS gold=4978 conn=4978 comp=4978
16# tier=3000 train_toks=21781
17P 10 3000 LV-I MST 0.45485 0.45485 0.45485
18X 10 3000 C-LV-I 2 5614
19X 10 3000 C-LV-I 3 10147
20X 10 3000 C-LV-I 4 11223
21X 10 3000 C-LV-I 5 9753
22X 10 3000 C-LV-I 6 7589
23A 10 3000 C-LV-I 44326 1.00000 0.58985 0.17015 4808 16668
24X 10 3000 M-LV-I-ucomp-MST 2 858
25X 10 3000 M-LV-I-ucomp-MST 3 1367
26X 10 3000 M-LV-I-ucomp-MST 4 1771
27X 10 3000 M-LV-I-ucomp-MST 5 1876
28X 10 3000 M-LV-I-ucomp-MST 6 1617
29A 10 3000 M-LV-I-ucomp-MST 7489 0.36314 0.16743 0.29970 4808 2686
30# tier=10000 train_toks=72856
31P 10 10000 LV-I MST 0.50471 0.50471 0.50471
32X 10 10000 C-LV-I 2 13389
33X 10 10000 C-LV-I 3 27409
34X 10 10000 C-LV-I 4 33901
35X 10 10000 C-LV-I 5 31457
36X 10 10000 C-LV-I 6 25225
37A 10 10000 C-LV-I 131381 1.00000 0.67367 0.15942 4808 20318
38X 10 10000 M-LV-I-ucomp-MST 2 1951
39X 10 10000 M-LV-I-ucomp-MST 3 4037
40X 10 10000 M-LV-I-ucomp-MST 4 5650
41X 10 10000 M-LV-I-ucomp-MST 5 6354
42X 10 10000 M-LV-I-ucomp-MST 6 5470
43A 10 10000 M-LV-I-ucomp-MST 23462 0.38415 0.21859 0.28985 4808 3626
44# tier=30000 train_toks=218274
45P 10 30000 LV-I MST 0.57786 0.57786 0.57786
46X 10 30000 C-LV-I 2 17136
47X 10 30000 C-LV-I 3 47244
48X 10 30000 C-LV-I 4 73262
49X 10 30000 C-LV-I 5 79356
50X 10 30000 C-LV-I 6 70263
51A 10 30000 C-LV-I 287261 1.00000 0.77995 0.13911 4808 26958
52X 10 30000 M-LV-I-ucomp-MST 2 3221
53X 10 30000 M-LV-I-ucomp-MST 3 8327
54X 10 30000 M-LV-I-ucomp-MST 4 13622
55X 10 30000 M-LV-I-ucomp-MST 5 16338
56X 10 30000 M-LV-I-ucomp-MST 6 15216
57A 10 30000 M-LV-I-ucomp-MST 56724 0.40412 0.29929 0.27689 4808 5197
58# seed=10 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4978 kept=4978 gold=4978
60GUARD C5 PASS gold=4978 conn=4978 comp=4978
61# tier=3000 train_toks=21781
62P 10 3000 LV-A MST 0.46554 0.46554 0.46554
63X 10 3000 C-LV-A 2 7533
64X 10 3000 C-LV-A 3 12743
65X 10 3000 C-LV-A 4 12230
66X 10 3000 C-LV-A 5 10029
67X 10 3000 C-LV-A 6 7622
68A 10 3000 C-LV-A 50157 1.00000 0.45819 0.17429 4808 12640
69X 10 3000 M-LV-A-ucomp-MST 2 1121
70X 10 3000 M-LV-A-ucomp-MST 3 1501
71X 10 3000 M-LV-A-ucomp-MST 4 1702
72X 10 3000 M-LV-A-ucomp-MST 5 1760
73X 10 3000 M-LV-A-ucomp-MST 6 1550
74A 10 3000 M-LV-A-ucomp-MST 7634 0.36834 0.12833 0.30127 4808 2048
75# tier=10000 train_toks=72856
76P 10 10000 LV-A MST 0.52513 0.52513 0.52513
77X 10 10000 C-LV-A 2 16971
78X 10 10000 C-LV-A 3 35440
79X 10 10000 C-LV-A 4 37892
80X 10 10000 C-LV-A 5 33051
81X 10 10000 C-LV-A 6 25563
82A 10 10000 C-LV-A 148917 1.00000 0.55262 0.16020 4808 16586
83X 10 10000 M-LV-A-ucomp-MST 2 2928
84X 10 10000 M-LV-A-ucomp-MST 3 5005
85X 10 10000 M-LV-A-ucomp-MST 4 6074
86X 10 10000 M-LV-A-ucomp-MST 5 6294
87X 10 10000 M-LV-A-ucomp-MST 6 5434
88A 10 10000 M-LV-A-ucomp-MST 25735 0.40620 0.19093 0.29376 4808 3125
89# tier=30000 train_toks=218274
90P 10 30000 LV-A MST 0.57203 0.57203 0.57203
91X 10 30000 C-LV-A 2 29865
92X 10 30000 C-LV-A 3 81771
93X 10 30000 C-LV-A 4 101741
94X 10 30000 C-LV-A 5 94971
95X 10 30000 C-LV-A 6 75775
96A 10 30000 C-LV-A 384123 1.00000 0.64663 0.14973 4808 20764
97X 10 30000 M-LV-A-ucomp-MST 2 6039
98X 10 30000 M-LV-A-ucomp-MST 3 13922
99X 10 30000 M-LV-A-ucomp-MST 4 19344
100X 10 30000 M-LV-A-ucomp-MST 5 20118
101X 10 30000 M-LV-A-ucomp-MST 6 17210
102A 10 30000 M-LV-A-ucomp-MST 76633 0.41847 0.24293 0.27560 4808 4238
experiments/level2/results-LVC/1792367885/seed-2.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 2 3000 LV-I 0.60422 0.66733 897 0.67976 0.73953 0.73953
2N 2 3000 LV-I 285
3Q 2 3000 LV-A 0.70922 0.89247 875 0.24384 0.76651 0.76651
4N 2 3000 LV-A 379
5Q 2 10000 LV-I 0.60323 0.65443 947 0.64980 0.55110 0.55041
6N 2 10000 LV-I 340
7Q 2 10000 LV-A 0.73105 0.93740 919 0.25261 0.84945 0.84945
8N 2 10000 LV-A 434
9Q 2 30000 LV-I 0.53462 0.57368 830 0.73407 0.50544 0.55986
10N 2 30000 LV-I 594
11Q 2 30000 LV-A 0.73012 0.91752 922 0.21299 0.80544 0.80408
12N 2 30000 LV-A 432
13# seed=2 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=5023 kept=5023 gold=5023
15GUARD C5 PASS gold=5023 conn=5023 comp=5023
16# tier=3000 train_toks=21780
17P 2 3000 LV-I MST 0.46297 0.46297 0.46297
18X 2 3000 C-LV-I 2 5550
19X 2 3000 C-LV-I 3 10049
20X 2 3000 C-LV-I 4 11117
21X 2 3000 C-LV-I 5 9740
22X 2 3000 C-LV-I 6 7562
23A 2 3000 C-LV-I 44018 1.00000 0.59701 0.17233 4814 16677
24X 2 3000 M-LV-I-ucomp-MST 2 801
25X 2 3000 M-LV-I-ucomp-MST 3 1356
26X 2 3000 M-LV-I-ucomp-MST 4 1836
27X 2 3000 M-LV-I-ucomp-MST 5 1921
28X 2 3000 M-LV-I-ucomp-MST 6 1608
29A 2 3000 M-LV-I-ucomp-MST 7522 0.37453 0.17345 0.31309 4814 2667
30# tier=10000 train_toks=72490
31P 2 10000 LV-I MST 0.51437 0.51437 0.51437
32X 2 10000 C-LV-I 2 12327
33X 2 10000 C-LV-I 3 27105
34X 2 10000 C-LV-I 4 33357
35X 2 10000 C-LV-I 5 31111
36X 2 10000 C-LV-I 6 24970
37A 2 10000 C-LV-I 128870 1.00000 0.66327 0.15605 4814 20462
38X 2 10000 M-LV-I-ucomp-MST 2 1926
39X 2 10000 M-LV-I-ucomp-MST 3 4075
40X 2 10000 M-LV-I-ucomp-MST 4 5561
41X 2 10000 M-LV-I-ucomp-MST 5 6086
42X 2 10000 M-LV-I-ucomp-MST 6 5304
43A 2 10000 M-LV-I-ucomp-MST 22952 0.35812 0.19256 0.26186 4814 3540
44# tier=30000 train_toks=218306
45P 2 30000 LV-I MST 0.55857 0.55857 0.55857
46X 2 30000 C-LV-I 2 18561
47X 2 30000 C-LV-I 3 44704
48X 2 30000 C-LV-I 4 67693
49X 2 30000 C-LV-I 5 74559
50X 2 30000 C-LV-I 6 67425
51A 2 30000 C-LV-I 272942 1.00000 0.80037 0.13748 4814 28025
52X 2 30000 M-LV-I-ucomp-MST 2 3283
53X 2 30000 M-LV-I-ucomp-MST 3 7808
54X 2 30000 M-LV-I-ucomp-MST 4 13370
55X 2 30000 M-LV-I-ucomp-MST 5 16108
56X 2 30000 M-LV-I-ucomp-MST 6 14923
57A 2 30000 M-LV-I-ucomp-MST 55492 0.37329 0.27732 0.28123 4814 4747
58# seed=2 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=5023 kept=5023 gold=5023
60GUARD C5 PASS gold=5023 conn=5023 comp=5023
61# tier=3000 train_toks=21780
62P 2 3000 LV-A MST 0.46769 0.46769 0.46769
63X 2 3000 C-LV-A 2 7418
64X 2 3000 C-LV-A 3 12601
65X 2 3000 C-LV-A 4 12148
66X 2 3000 C-LV-A 5 10019
67X 2 3000 C-LV-A 6 7609
68A 2 3000 C-LV-A 49795 1.00000 0.46718 0.17817 4814 12623
69X 2 3000 M-LV-A-ucomp-MST 2 1135
70X 2 3000 M-LV-A-ucomp-MST 3 1479
71X 2 3000 M-LV-A-ucomp-MST 4 1688
72X 2 3000 M-LV-A-ucomp-MST 5 1827
73X 2 3000 M-LV-A-ucomp-MST 6 1590
74A 2 3000 M-LV-A-ucomp-MST 7719 0.37266 0.13606 0.31116 4814 2105
75# tier=10000 train_toks=72490
76P 2 10000 LV-A MST 0.53575 0.53575 0.53575
77X 2 10000 C-LV-A 2 16451
78X 2 10000 C-LV-A 3 35004
79X 2 10000 C-LV-A 4 37634
80X 2 10000 C-LV-A 5 32776
81X 2 10000 C-LV-A 6 25299
82A 2 10000 C-LV-A 147164 1.00000 0.55941 0.16110 4814 16716
83X 2 10000 M-LV-A-ucomp-MST 2 2849
84X 2 10000 M-LV-A-ucomp-MST 3 5044
85X 2 10000 M-LV-A-ucomp-MST 4 6104
86X 2 10000 M-LV-A-ucomp-MST 5 6330
87X 2 10000 M-LV-A-ucomp-MST 6 5472
88A 2 10000 M-LV-A-ucomp-MST 25799 0.41068 0.20316 0.30018 4814 3258
89# tier=30000 train_toks=218306
90P 2 30000 LV-A MST 0.58540 0.58540 0.58540
91X 2 30000 C-LV-A 2 31185
92X 2 30000 C-LV-A 3 83773
93X 2 30000 C-LV-A 4 102452
94X 2 30000 C-LV-A 5 95793
95X 2 30000 C-LV-A 6 76124
96A 2 30000 C-LV-A 389327 1.00000 0.62505 0.14751 4814 20399
97X 2 30000 M-LV-A-ucomp-MST 2 6281
98X 2 30000 M-LV-A-ucomp-MST 3 14275
99X 2 30000 M-LV-A-ucomp-MST 4 19185
100X 2 30000 M-LV-A-ucomp-MST 5 20099
101X 2 30000 M-LV-A-ucomp-MST 6 16915
102A 2 30000 M-LV-A-ucomp-MST 76755 0.45305 0.27316 0.30503 4814 4311
experiments/level2/results-LVC/1792367885/seed-3.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 3 3000 LV-I 0.59739 0.66254 910 0.64885 0.67949 0.68109
2N 3 3000 LV-I 270
3Q 3 3000 LV-A 0.71181 0.90545 893 0.22271 0.87420 0.87420
4N 3 3000 LV-A 352
5Q 3 10000 LV-I 0.62451 0.68211 930 0.62362 0.76299 0.79695
6N 3 10000 LV-I 358
7Q 3 10000 LV-A 0.73697 0.94885 974 0.17785 0.84130 0.84338
8N 3 10000 LV-A 366
9Q 3 30000 LV-I 0.60373 0.64822 845 0.66101 0.56766 0.56834
10N 3 30000 LV-I 551
11Q 3 30000 LV-A 0.73724 0.93082 954 0.23208 0.81732 0.81732
12N 3 30000 LV-A 399
13# seed=3 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4908 kept=4908 gold=4908
15GUARD C5 PASS gold=4908 conn=4908 comp=4908
16# tier=3000 train_toks=21946
17P 3 3000 LV-I MST 0.44663 0.44663 0.44663
18X 3 3000 C-LV-I 2 5820
19X 3 3000 C-LV-I 3 10438
20X 3 3000 C-LV-I 4 11392
21X 3 3000 C-LV-I 5 9969
22X 3 3000 C-LV-I 6 7842
23A 3 3000 C-LV-I 45461 1.00000 0.59584 0.17511 4716 16047
24X 3 3000 M-LV-I-ucomp-MST 2 880
25X 3 3000 M-LV-I-ucomp-MST 3 1286
26X 3 3000 M-LV-I-ucomp-MST 4 1672
27X 3 3000 M-LV-I-ucomp-MST 5 1849
28X 3 3000 M-LV-I-ucomp-MST 6 1555
29A 3 3000 M-LV-I-ucomp-MST 7242 0.36005 0.16561 0.29306 4716 2665
30# tier=10000 train_toks=72679
31P 3 10000 LV-I MST 0.53834 0.53834 0.53834
32X 3 10000 C-LV-I 2 12024
33X 3 10000 C-LV-I 3 26054
34X 3 10000 C-LV-I 4 32736
35X 3 10000 C-LV-I 5 30941
36X 3 10000 C-LV-I 6 25162
37A 3 10000 C-LV-I 126917 1.00000 0.70844 0.16156 4716 20680
38X 3 10000 M-LV-I-ucomp-MST 2 1753
39X 3 10000 M-LV-I-ucomp-MST 3 3920
40X 3 10000 M-LV-I-ucomp-MST 4 5523
41X 3 10000 M-LV-I-ucomp-MST 5 6018
42X 3 10000 M-LV-I-ucomp-MST 6 5255
43A 3 10000 M-LV-I-ucomp-MST 22469 0.42282 0.25827 0.31612 4716 3853
44# tier=30000 train_toks=218379
45P 3 30000 LV-I MST 0.56434 0.56434 0.56434
46X 3 30000 C-LV-I 2 19752
47X 3 30000 C-LV-I 3 48188
48X 3 30000 C-LV-I 4 73483
49X 3 30000 C-LV-I 5 79327
50X 3 30000 C-LV-I 6 70287
51A 3 30000 C-LV-I 291037 1.00000 0.79707 0.14177 4716 26514
52X 3 30000 M-LV-I-ucomp-MST 2 3039
53X 3 30000 M-LV-I-ucomp-MST 3 8542
54X 3 30000 M-LV-I-ucomp-MST 4 14349
55X 3 30000 M-LV-I-ucomp-MST 5 17037
56X 3 30000 M-LV-I-ucomp-MST 6 15888
57A 3 30000 M-LV-I-ucomp-MST 58855 0.41455 0.30958 0.28820 4716 5066
58# seed=3 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4908 kept=4908 gold=4908
60GUARD C5 PASS gold=4908 conn=4908 comp=4908
61# tier=3000 train_toks=21946
62P 3 3000 LV-A MST 0.46677 0.46677 0.46677
63X 3 3000 C-LV-A 2 7787
64X 3 3000 C-LV-A 3 12915
65X 3 3000 C-LV-A 4 12370
66X 3 3000 C-LV-A 5 10222
67X 3 3000 C-LV-A 6 7858
68A 3 3000 C-LV-A 51152 1.00000 0.47752 0.18488 4716 12181
69X 3 3000 M-LV-A-ucomp-MST 2 1189
70X 3 3000 M-LV-A-ucomp-MST 3 1578
71X 3 3000 M-LV-A-ucomp-MST 4 1706
72X 3 3000 M-LV-A-ucomp-MST 5 1739
73X 3 3000 M-LV-A-ucomp-MST 6 1491
74A 3 3000 M-LV-A-ucomp-MST 7703 0.37299 0.13444 0.32748 4716 1936
75# tier=10000 train_toks=72679
76P 3 10000 LV-A MST 0.53761 0.53761 0.53761
77X 3 10000 C-LV-A 2 17070
78X 3 10000 C-LV-A 3 35397
79X 3 10000 C-LV-A 4 37741
80X 3 10000 C-LV-A 5 32905
81X 3 10000 C-LV-A 6 25603
82A 3 10000 C-LV-A 148716 1.00000 0.56255 0.16200 4716 16377
83X 3 10000 M-LV-A-ucomp-MST 2 2899
84X 3 10000 M-LV-A-ucomp-MST 3 5077
85X 3 10000 M-LV-A-ucomp-MST 4 6033
86X 3 10000 M-LV-A-ucomp-MST 5 6218
87X 3 10000 M-LV-A-ucomp-MST 6 5330
88A 3 10000 M-LV-A-ucomp-MST 25557 0.43808 0.19953 0.30035 4716 3133
89# tier=30000 train_toks=218379
90P 3 30000 LV-A MST 0.58684 0.58684 0.58684
91X 3 30000 C-LV-A 2 31412
92X 3 30000 C-LV-A 3 84067
93X 3 30000 C-LV-A 4 101644
94X 3 30000 C-LV-A 5 94882
95X 3 30000 C-LV-A 6 75803
96A 3 30000 C-LV-A 387808 1.00000 0.63974 0.15058 4716 20036
97X 3 30000 M-LV-A-ucomp-MST 2 6343
98X 3 30000 M-LV-A-ucomp-MST 3 14383
99X 3 30000 M-LV-A-ucomp-MST 4 18948
100X 3 30000 M-LV-A-ucomp-MST 5 19655
101X 3 30000 M-LV-A-ucomp-MST 6 16986
102A 3 30000 M-LV-A-ucomp-MST 76315 0.45483 0.27354 0.30861 4716 4180
experiments/level2/results-LVC/1792367885/seed-4.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 4 3000 LV-I 0.59885 0.66967 886 0.65213 0.58002 0.64339
2N 4 3000 LV-I 278
3Q 4 3000 LV-A 0.71756 0.92313 893 0.27324 0.79699 0.79699
4N 4 3000 LV-A 341
5Q 4 10000 LV-I 0.62157 0.70524 968 0.61279 0.67576 0.69318
6N 4 10000 LV-I 302
7Q 4 10000 LV-A 0.73568 0.93739 943 0.19993 0.83561 0.83561
8N 4 10000 LV-A 397
9Q 4 30000 LV-I 0.57840 0.63110 851 0.68574 0.65017 0.63932
10N 4 30000 LV-I 563
11Q 4 30000 LV-A 0.74175 0.93438 917 0.25052 0.83729 0.84203
12N 4 30000 LV-A 431
13# seed=4 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4900 kept=4900 gold=4900
15GUARD C5 PASS gold=4900 conn=4900 comp=4900
16# tier=3000 train_toks=21802
17P 4 3000 LV-I MST 0.45613 0.45613 0.45613
18X 4 3000 C-LV-I 2 5627
19X 4 3000 C-LV-I 3 10277
20X 4 3000 C-LV-I 4 11325
21X 4 3000 C-LV-I 5 9792
22X 4 3000 C-LV-I 6 7630
23A 4 3000 C-LV-I 44651 1.00000 0.60327 0.18142 4716 15682
24X 4 3000 M-LV-I-ucomp-MST 2 822
25X 4 3000 M-LV-I-ucomp-MST 3 1332
26X 4 3000 M-LV-I-ucomp-MST 4 1696
27X 4 3000 M-LV-I-ucomp-MST 5 1825
28X 4 3000 M-LV-I-ucomp-MST 6 1640
29A 4 3000 M-LV-I-ucomp-MST 7315 0.35751 0.15946 0.29723 4716 2530
30# tier=10000 train_toks=72633
31P 4 10000 LV-I MST 0.51706 0.51706 0.51706
32X 4 10000 C-LV-I 2 13063
33X 4 10000 C-LV-I 3 27141
34X 4 10000 C-LV-I 4 33524
35X 4 10000 C-LV-I 5 31186
36X 4 10000 C-LV-I 6 25097
37A 4 10000 C-LV-I 130011 1.00000 0.67027 0.15880 4716 19905
38X 4 10000 M-LV-I-ucomp-MST 2 1928
39X 4 10000 M-LV-I-ucomp-MST 3 4077
40X 4 10000 M-LV-I-ucomp-MST 4 5644
41X 4 10000 M-LV-I-ucomp-MST 5 6256
42X 4 10000 M-LV-I-ucomp-MST 6 5359
43A 4 10000 M-LV-I-ucomp-MST 23264 0.40437 0.24025 0.30416 4716 3725
44# tier=30000 train_toks=217946
45P 4 30000 LV-I MST 0.54143 0.54143 0.54143
46X 4 30000 C-LV-I 2 21001
47X 4 30000 C-LV-I 3 51250
48X 4 30000 C-LV-I 4 76514
49X 4 30000 C-LV-I 5 81608
50X 4 30000 C-LV-I 6 71274
51A 4 30000 C-LV-I 301647 1.00000 0.76378 0.14138 4716 25477
52X 4 30000 M-LV-I-ucomp-MST 2 3135
53X 4 30000 M-LV-I-ucomp-MST 3 8116
54X 4 30000 M-LV-I-ucomp-MST 4 14533
55X 4 30000 M-LV-I-ucomp-MST 5 17790
56X 4 30000 M-LV-I-ucomp-MST 6 16017
57A 4 30000 M-LV-I-ucomp-MST 59591 0.36578 0.25445 0.25279 4716 4747
58# seed=4 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4900 kept=4900 gold=4900
60GUARD C5 PASS gold=4900 conn=4900 comp=4900
61# tier=3000 train_toks=21802
62P 4 3000 LV-A MST 0.47547 0.47547 0.47547
63X 4 3000 C-LV-A 2 7533
64X 4 3000 C-LV-A 3 12667
65X 4 3000 C-LV-A 4 12177
66X 4 3000 C-LV-A 5 10054
67X 4 3000 C-LV-A 6 7667
68A 4 3000 C-LV-A 50098 1.00000 0.48092 0.18481 4716 12272
69X 4 3000 M-LV-A-ucomp-MST 2 1228
70X 4 3000 M-LV-A-ucomp-MST 3 1500
71X 4 3000 M-LV-A-ucomp-MST 4 1656
72X 4 3000 M-LV-A-ucomp-MST 5 1711
73X 4 3000 M-LV-A-ucomp-MST 6 1597
74A 4 3000 M-LV-A-ucomp-MST 7692 0.38104 0.14165 0.33737 4716 1980
75# tier=10000 train_toks=72633
76P 4 10000 LV-A MST 0.54013 0.54013 0.54013
77X 4 10000 C-LV-A 2 16921
78X 4 10000 C-LV-A 3 35470
79X 4 10000 C-LV-A 4 37817
80X 4 10000 C-LV-A 5 32856
81X 4 10000 C-LV-A 6 25446
82A 4 10000 C-LV-A 148510 1.00000 0.55831 0.16068 4716 16387
83X 4 10000 M-LV-A-ucomp-MST 2 2968
84X 4 10000 M-LV-A-ucomp-MST 3 5154
85X 4 10000 M-LV-A-ucomp-MST 4 6109
86X 4 10000 M-LV-A-ucomp-MST 5 6343
87X 4 10000 M-LV-A-ucomp-MST 6 5407
88A 4 10000 M-LV-A-ucomp-MST 25981 0.42239 0.20611 0.29991 4716 3241
89# tier=30000 train_toks=217946
90P 4 30000 LV-A MST 0.60138 0.60138 0.60138
91X 4 30000 C-LV-A 2 30899
92X 4 30000 C-LV-A 3 82942
93X 4 30000 C-LV-A 4 102300
94X 4 30000 C-LV-A 5 94869
95X 4 30000 C-LV-A 6 75538
96A 4 30000 C-LV-A 386548 1.00000 0.63634 0.14870 4716 20181
97X 4 30000 M-LV-A-ucomp-MST 2 6290
98X 4 30000 M-LV-A-ucomp-MST 3 14447
99X 4 30000 M-LV-A-ucomp-MST 4 19468
100X 4 30000 M-LV-A-ucomp-MST 5 20162
101X 4 30000 M-LV-A-ucomp-MST 6 17167
102A 4 30000 M-LV-A-ucomp-MST 77534 0.47455 0.29262 0.30824 4716 4477
experiments/level2/results-LVC/1792367885/seed-5.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 5 3000 LV-I 0.61469 0.67741 886 0.59572 0.78481 0.77605
2N 5 3000 LV-I 267
3Q 5 3000 LV-A 0.70975 0.88462 883 0.28327 0.83350 0.83350
4N 5 3000 LV-A 356
5Q 5 10000 LV-I 0.59911 0.64532 927 0.63525 0.60900 0.60520
6N 5 10000 LV-I 379
7Q 5 10000 LV-A 0.73500 0.93255 942 0.19193 0.84918 0.85298
8N 5 10000 LV-A 368
9Q 5 30000 LV-I 0.57987 0.61239 848 0.71249 0.56698 0.60498
10N 5 30000 LV-I 559
11Q 5 30000 LV-A 0.73084 0.91755 909 0.19464 0.82430 0.82430
12N 5 30000 LV-A 440
13# seed=5 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4953 kept=4953 gold=4953
15GUARD C5 PASS gold=4953 conn=4953 comp=4953
16# tier=3000 train_toks=21900
17P 5 3000 LV-I MST 0.45103 0.45103 0.45103
18X 5 3000 C-LV-I 2 6200
19X 5 3000 C-LV-I 3 11037
20X 5 3000 C-LV-I 4 11780
21X 5 3000 C-LV-I 5 10039
22X 5 3000 C-LV-I 6 7758
23A 5 3000 C-LV-I 46814 1.00000 0.58293 0.18150 4757 15278
24X 5 3000 M-LV-I-ucomp-MST 2 892
25X 5 3000 M-LV-I-ucomp-MST 3 1376
26X 5 3000 M-LV-I-ucomp-MST 4 1753
27X 5 3000 M-LV-I-ucomp-MST 5 1870
28X 5 3000 M-LV-I-ucomp-MST 6 1583
29A 5 3000 M-LV-I-ucomp-MST 7474 0.36178 0.16838 0.30445 4757 2631
30# tier=10000 train_toks=73066
31P 5 10000 LV-I MST 0.50976 0.50976 0.50976
32X 5 10000 C-LV-I 2 11742
33X 5 10000 C-LV-I 3 25318
34X 5 10000 C-LV-I 4 32447
35X 5 10000 C-LV-I 5 30938
36X 5 10000 C-LV-I 6 25240
37A 5 10000 C-LV-I 125685 1.00000 0.69834 0.15680 4757 21186
38X 5 10000 M-LV-I-ucomp-MST 2 1743
39X 5 10000 M-LV-I-ucomp-MST 3 3785
40X 5 10000 M-LV-I-ucomp-MST 4 5668
41X 5 10000 M-LV-I-ucomp-MST 5 6233
42X 5 10000 M-LV-I-ucomp-MST 6 5327
43A 5 10000 M-LV-I-ucomp-MST 22756 0.38512 0.23607 0.29093 4757 3860
44# tier=30000 train_toks=218533
45P 5 30000 LV-I MST 0.51113 0.51113 0.51113
46X 5 30000 C-LV-I 2 19509
47X 5 30000 C-LV-I 3 48028
48X 5 30000 C-LV-I 4 71450
49X 5 30000 C-LV-I 5 76952
50X 5 30000 C-LV-I 6 68869
51A 5 30000 C-LV-I 284808 1.00000 0.79125 0.13996 4757 26893
52X 5 30000 M-LV-I-ucomp-MST 2 3274
53X 5 30000 M-LV-I-ucomp-MST 3 7681
54X 5 30000 M-LV-I-ucomp-MST 4 13285
55X 5 30000 M-LV-I-ucomp-MST 5 16487
56X 5 30000 M-LV-I-ucomp-MST 6 15027
57A 5 30000 M-LV-I-ucomp-MST 55754 0.32415 0.22283 0.22524 4757 4706
58# seed=5 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4953 kept=4953 gold=4953
60GUARD C5 PASS gold=4953 conn=4953 comp=4953
61# tier=3000 train_toks=21900
62P 5 3000 LV-A MST 0.45837 0.45837 0.45837
63X 5 3000 C-LV-A 2 7292
64X 5 3000 C-LV-A 3 12553
65X 5 3000 C-LV-A 4 12319
66X 5 3000 C-LV-A 5 10155
67X 5 3000 C-LV-A 6 7766
68A 5 3000 C-LV-A 50085 1.00000 0.49107 0.18261 4757 12792
69X 5 3000 M-LV-A-ucomp-MST 2 1151
70X 5 3000 M-LV-A-ucomp-MST 3 1405
71X 5 3000 M-LV-A-ucomp-MST 4 1632
72X 5 3000 M-LV-A-ucomp-MST 5 1743
73X 5 3000 M-LV-A-ucomp-MST 6 1518
74A 5 3000 M-LV-A-ucomp-MST 7449 0.35043 0.13328 0.29962 4757 2116
75# tier=10000 train_toks=73066
76P 5 10000 LV-A MST 0.53646 0.53646 0.53646
77X 5 10000 C-LV-A 2 16499
78X 5 10000 C-LV-A 3 35170
79X 5 10000 C-LV-A 4 37999
80X 5 10000 C-LV-A 5 33190
81X 5 10000 C-LV-A 6 25766
82A 5 10000 C-LV-A 148624 1.00000 0.56758 0.16330 4757 16534
83X 5 10000 M-LV-A-ucomp-MST 2 2930
84X 5 10000 M-LV-A-ucomp-MST 3 5048
85X 5 10000 M-LV-A-ucomp-MST 4 6149
86X 5 10000 M-LV-A-ucomp-MST 5 6388
87X 5 10000 M-LV-A-ucomp-MST 6 5345
88A 5 10000 M-LV-A-ucomp-MST 25860 0.40887 0.19802 0.28571 4757 3297
89# tier=30000 train_toks=218533
90P 5 30000 LV-A MST 0.59285 0.59285 0.59285
91X 5 30000 C-LV-A 2 30934
92X 5 30000 C-LV-A 3 82918
93X 5 30000 C-LV-A 4 102661
94X 5 30000 C-LV-A 5 95967
95X 5 30000 C-LV-A 6 76411
96A 5 30000 C-LV-A 388891 1.00000 0.64431 0.15064 4757 20346
97X 5 30000 M-LV-A-ucomp-MST 2 6253
98X 5 30000 M-LV-A-ucomp-MST 3 14615
99X 5 30000 M-LV-A-ucomp-MST 4 18861
100X 5 30000 M-LV-A-ucomp-MST 5 19614
101X 5 30000 M-LV-A-ucomp-MST 6 16716
102A 5 30000 M-LV-A-ucomp-MST 76059 0.45133 0.26929 0.29791 4757 4300
experiments/level2/results-LVC/1792367885/seed-6.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 6 3000 LV-I 0.61202 0.68256 918 0.62551 0.78023 0.76972
2N 6 3000 LV-I 264
3Q 6 3000 LV-A 0.71099 0.90667 909 0.19575 0.86646 0.86646
4N 6 3000 LV-A 368
5Q 6 10000 LV-I 0.62582 0.71611 963 0.58807 0.64648 0.65352
6N 6 10000 LV-I 370
7Q 6 10000 LV-A 0.73183 0.93325 958 0.18919 0.90000 0.90000
8N 6 10000 LV-A 395
9Q 6 30000 LV-I 0.51642 0.51209 731 0.81204 0.41069 0.33559
10N 6 30000 LV-I 808
11Q 6 30000 LV-A 0.72874 0.90817 887 0.23729 0.83085 0.83829
12N 6 30000 LV-A 463
13# seed=6 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=5030 kept=5030 gold=5030
15GUARD C5 PASS gold=5030 conn=5030 comp=5030
16# tier=3000 train_toks=22127
17P 6 3000 LV-I MST 0.45085 0.45085 0.45085
18X 6 3000 C-LV-I 2 5989
19X 6 3000 C-LV-I 3 10736
20X 6 3000 C-LV-I 4 11691
21X 6 3000 C-LV-I 5 10137
22X 6 3000 C-LV-I 6 7952
23A 6 3000 C-LV-I 46505 1.00000 0.58202 0.17907 4828 15692
24X 6 3000 M-LV-I-ucomp-MST 2 832
25X 6 3000 M-LV-I-ucomp-MST 3 1358
26X 6 3000 M-LV-I-ucomp-MST 4 1813
27X 6 3000 M-LV-I-ucomp-MST 5 1874
28X 6 3000 M-LV-I-ucomp-MST 6 1562
29A 6 3000 M-LV-I-ucomp-MST 7439 0.35998 0.15410 0.28938 4828 2571
30# tier=10000 train_toks=73282
31P 6 10000 LV-I MST 0.50768 0.50768 0.50768
32X 6 10000 C-LV-I 2 12915
33X 6 10000 C-LV-I 3 27353
34X 6 10000 C-LV-I 4 34016
35X 6 10000 C-LV-I 5 31833
36X 6 10000 C-LV-I 6 25726
37A 6 10000 C-LV-I 131843 1.00000 0.66715 0.15944 4828 20202
38X 6 10000 M-LV-I-ucomp-MST 2 1788
39X 6 10000 M-LV-I-ucomp-MST 3 3846
40X 6 10000 M-LV-I-ucomp-MST 4 5674
41X 6 10000 M-LV-I-ucomp-MST 5 6234
42X 6 10000 M-LV-I-ucomp-MST 6 5336
43A 6 10000 M-LV-I-ucomp-MST 22878 0.39292 0.22680 0.29357 4828 3730
44# tier=30000 train_toks=217426
45P 6 30000 LV-I MST 0.53253 0.53253 0.53253
46X 6 30000 C-LV-I 2 15656
47X 6 30000 C-LV-I 3 42888
48X 6 30000 C-LV-I 4 67651
49X 6 30000 C-LV-I 5 75271
50X 6 30000 C-LV-I 6 67991
51A 6 30000 C-LV-I 269457 1.00000 0.80779 0.13712 4828 28443
52X 6 30000 M-LV-I-ucomp-MST 2 2743
53X 6 30000 M-LV-I-ucomp-MST 3 7558
54X 6 30000 M-LV-I-ucomp-MST 4 12993
55X 6 30000 M-LV-I-ucomp-MST 5 16119
56X 6 30000 M-LV-I-ucomp-MST 6 15050
57A 6 30000 M-LV-I-ucomp-MST 54463 0.36558 0.27237 0.24788 4828 5305
58# seed=6 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=5030 kept=5030 gold=5030
60GUARD C5 PASS gold=5030 conn=5030 comp=5030
61# tier=3000 train_toks=22127
62P 6 3000 LV-A MST 0.45916 0.45916 0.45916
63X 6 3000 C-LV-A 2 7795
64X 6 3000 C-LV-A 3 12983
65X 6 3000 C-LV-A 4 12524
66X 6 3000 C-LV-A 5 10381
67X 6 3000 C-LV-A 6 7987
68A 6 3000 C-LV-A 51670 1.00000 0.45568 0.18048 4828 12190
69X 6 3000 M-LV-A-ucomp-MST 2 1177
70X 6 3000 M-LV-A-ucomp-MST 3 1489
71X 6 3000 M-LV-A-ucomp-MST 4 1759
72X 6 3000 M-LV-A-ucomp-MST 5 1724
73X 6 3000 M-LV-A-ucomp-MST 6 1536
74A 6 3000 M-LV-A-ucomp-MST 7685 0.36330 0.12241 0.31105 4828 1900
75# tier=10000 train_toks=73282
76P 6 10000 LV-A MST 0.52596 0.52596 0.52596
77X 6 10000 C-LV-A 2 16998
78X 6 10000 C-LV-A 3 35882
79X 6 10000 C-LV-A 4 38367
80X 6 10000 C-LV-A 5 33533
81X 6 10000 C-LV-A 6 26043
82A 6 10000 C-LV-A 150823 1.00000 0.55468 0.16040 4828 16696
83X 6 10000 M-LV-A-ucomp-MST 2 2962
84X 6 10000 M-LV-A-ucomp-MST 3 5152
85X 6 10000 M-LV-A-ucomp-MST 4 6149
86X 6 10000 M-LV-A-ucomp-MST 5 6291
87X 6 10000 M-LV-A-ucomp-MST 6 5431
88A 6 10000 M-LV-A-ucomp-MST 25985 0.41591 0.19780 0.29742 4828 3211
89# tier=30000 train_toks=217426
90P 6 30000 LV-A MST 0.58871 0.58871 0.58871
91X 6 30000 C-LV-A 2 29625
92X 6 30000 C-LV-A 3 80999
93X 6 30000 C-LV-A 4 100129
94X 6 30000 C-LV-A 5 94320
95X 6 30000 C-LV-A 6 75219
96A 6 30000 C-LV-A 380292 1.00000 0.63318 0.14586 4828 20958
97X 6 30000 M-LV-A-ucomp-MST 2 6116
98X 6 30000 M-LV-A-ucomp-MST 3 13929
99X 6 30000 M-LV-A-ucomp-MST 4 18861
100X 6 30000 M-LV-A-ucomp-MST 5 19742
101X 6 30000 M-LV-A-ucomp-MST 6 16882
102A 6 30000 M-LV-A-ucomp-MST 75530 0.46106 0.27382 0.29735 4828 4446
experiments/level2/results-LVC/1792367885/seed-7.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 7 3000 LV-I 0.59853 0.67302 908 0.63231 0.78543 0.77429
2N 7 3000 LV-I 257
3Q 7 3000 LV-A 0.71469 0.91309 893 0.20406 0.80061 0.80061
4N 7 3000 LV-A 374
5Q 7 10000 LV-I 0.61409 0.68468 928 0.64251 0.60457 0.61399
6N 7 10000 LV-I 375
7Q 7 10000 LV-A 0.73674 0.94285 947 0.24305 0.86348 0.86416
8N 7 10000 LV-A 397
9Q 7 30000 LV-I 0.56270 0.60401 827 0.74461 0.63570 0.66025
10N 7 30000 LV-I 575
11Q 7 30000 LV-A 0.73125 0.91739 924 0.20552 0.80358 0.80425
12N 7 30000 LV-A 402
13# seed=7 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4942 kept=4942 gold=4942
15GUARD C5 PASS gold=4942 conn=4942 comp=4942
16# tier=3000 train_toks=22049
17P 7 3000 LV-I MST 0.46340 0.46340 0.46340
18X 7 3000 C-LV-I 2 5596
19X 7 3000 C-LV-I 3 10230
20X 7 3000 C-LV-I 4 11371
21X 7 3000 C-LV-I 5 9940
22X 7 3000 C-LV-I 6 7788
23A 7 3000 C-LV-I 44925 1.00000 0.60285 0.17478 4764 16432
24X 7 3000 M-LV-I-ucomp-MST 2 847
25X 7 3000 M-LV-I-ucomp-MST 3 1382
26X 7 3000 M-LV-I-ucomp-MST 4 1846
27X 7 3000 M-LV-I-ucomp-MST 5 1924
28X 7 3000 M-LV-I-ucomp-MST 6 1573
29A 7 3000 M-LV-I-ucomp-MST 7572 0.37175 0.17045 0.30746 4764 2641
30# tier=10000 train_toks=73005
31P 7 10000 LV-I MST 0.51502 0.51502 0.51502
32X 7 10000 C-LV-I 2 12775
33X 7 10000 C-LV-I 3 27140
34X 7 10000 C-LV-I 4 33866
35X 7 10000 C-LV-I 5 31743
36X 7 10000 C-LV-I 6 25459
37A 7 10000 C-LV-I 130983 1.00000 0.67989 0.16039 4764 20194
38X 7 10000 M-LV-I-ucomp-MST 2 1854
39X 7 10000 M-LV-I-ucomp-MST 3 4082
40X 7 10000 M-LV-I-ucomp-MST 4 5741
41X 7 10000 M-LV-I-ucomp-MST 5 6353
42X 7 10000 M-LV-I-ucomp-MST 6 5339
43A 7 10000 M-LV-I-ucomp-MST 23369 0.39526 0.23552 0.29082 4764 3858
44# tier=30000 train_toks=217853
45P 7 30000 LV-I MST 0.52348 0.52348 0.52348
46X 7 30000 C-LV-I 2 18680
47X 7 30000 C-LV-I 3 45767
48X 7 30000 C-LV-I 4 69560
49X 7 30000 C-LV-I 5 76388
50X 7 30000 C-LV-I 6 68594
51A 7 30000 C-LV-I 278989 1.00000 0.79807 0.13968 4764 27220
52X 7 30000 M-LV-I-ucomp-MST 2 2869
53X 7 30000 M-LV-I-ucomp-MST 3 7520
54X 7 30000 M-LV-I-ucomp-MST 4 13223
55X 7 30000 M-LV-I-ucomp-MST 5 16725
56X 7 30000 M-LV-I-ucomp-MST 6 15441
57A 7 30000 M-LV-I-ucomp-MST 55778 0.33081 0.23552 0.23706 4764 4733
58# seed=7 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4942 kept=4942 gold=4942
60GUARD C5 PASS gold=4942 conn=4942 comp=4942
61# tier=3000 train_toks=22049
62P 7 3000 LV-A MST 0.47177 0.47177 0.47177
63X 7 3000 C-LV-A 2 7648
64X 7 3000 C-LV-A 3 12869
65X 7 3000 C-LV-A 4 12375
66X 7 3000 C-LV-A 5 10232
67X 7 3000 C-LV-A 6 7830
68A 7 3000 C-LV-A 50954 1.00000 0.45886 0.17736 4764 12325
69X 7 3000 M-LV-A-ucomp-MST 2 1201
70X 7 3000 M-LV-A-ucomp-MST 3 1555
71X 7 3000 M-LV-A-ucomp-MST 4 1804
72X 7 3000 M-LV-A-ucomp-MST 5 1830
73X 7 3000 M-LV-A-ucomp-MST 6 1513
74A 7 3000 M-LV-A-ucomp-MST 7903 0.36839 0.12573 0.31643 4764 1893
75# tier=10000 train_toks=73005
76P 7 10000 LV-A MST 0.53942 0.53942 0.53942
77X 7 10000 C-LV-A 2 16504
78X 7 10000 C-LV-A 3 34897
79X 7 10000 C-LV-A 4 37799
80X 7 10000 C-LV-A 5 33176
81X 7 10000 C-LV-A 6 25683
82A 7 10000 C-LV-A 148059 1.00000 0.56654 0.16080 4764 16785
83X 7 10000 M-LV-A-ucomp-MST 2 2889
84X 7 10000 M-LV-A-ucomp-MST 3 5112
85X 7 10000 M-LV-A-ucomp-MST 4 6205
86X 7 10000 M-LV-A-ucomp-MST 5 6336
87X 7 10000 M-LV-A-ucomp-MST 6 5352
88A 7 10000 M-LV-A-ucomp-MST 25894 0.42317 0.21264 0.30969 4764 3271
89# tier=30000 train_toks=217853
90P 7 30000 LV-A MST 0.59000 0.59000 0.59000
91X 7 30000 C-LV-A 2 30683
92X 7 30000 C-LV-A 3 82902
93X 7 30000 C-LV-A 4 101892
94X 7 30000 C-LV-A 5 95302
95X 7 30000 C-LV-A 6 75588
96A 7 30000 C-LV-A 386367 1.00000 0.63413 0.14826 4764 20377
97X 7 30000 M-LV-A-ucomp-MST 2 6181
98X 7 30000 M-LV-A-ucomp-MST 3 14495
99X 7 30000 M-LV-A-ucomp-MST 4 19184
100X 7 30000 M-LV-A-ucomp-MST 5 20075
101X 7 30000 M-LV-A-ucomp-MST 6 16701
102A 7 30000 M-LV-A-ucomp-MST 76636 0.45613 0.26658 0.29542 4764 4299
experiments/level2/results-LVC/1792367885/seed-8.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 8 3000 LV-I 0.60672 0.65636 867 0.64388 0.68019 0.75849
2N 8 3000 LV-I 291
3Q 8 3000 LV-A 0.71371 0.89444 841 0.21959 0.79717 0.79717
4N 8 3000 LV-A 374
5Q 8 10000 LV-I 0.65690 0.71712 946 0.61480 0.67751 0.71367
6N 8 10000 LV-I 333
7Q 8 10000 LV-A 0.74113 0.94927 937 0.21789 0.85322 0.85322
8N 8 10000 LV-A 392
9Q 8 30000 LV-I 0.54689 0.56139 753 0.80899 0.48141 0.53753
10N 8 30000 LV-I 735
11Q 8 30000 LV-A 0.73883 0.92909 916 0.19285 0.87965 0.86815
12N 8 30000 LV-A 374
13# seed=8 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4825 kept=4825 gold=4825
15GUARD C5 PASS gold=4825 conn=4825 comp=4825
16# tier=3000 train_toks=21908
17P 8 3000 LV-I MST 0.44742 0.44742 0.44742
18X 8 3000 C-LV-I 2 5768
19X 8 3000 C-LV-I 3 10446
20X 8 3000 C-LV-I 4 11412
21X 8 3000 C-LV-I 5 9975
22X 8 3000 C-LV-I 6 7780
23A 8 3000 C-LV-I 45381 1.00000 0.60459 0.17780 4661 15849
24X 8 3000 M-LV-I-ucomp-MST 2 845
25X 8 3000 M-LV-I-ucomp-MST 3 1322
26X 8 3000 M-LV-I-ucomp-MST 4 1636
27X 8 3000 M-LV-I-ucomp-MST 5 1819
28X 8 3000 M-LV-I-ucomp-MST 6 1579
29A 8 3000 M-LV-I-ucomp-MST 7201 0.34928 0.16070 0.28975 4661 2585
30# tier=10000 train_toks=72661
31P 8 10000 LV-I MST 0.53623 0.53623 0.53623
32X 8 10000 C-LV-I 2 12809
33X 8 10000 C-LV-I 3 27231
34X 8 10000 C-LV-I 4 33380
35X 8 10000 C-LV-I 5 31268
36X 8 10000 C-LV-I 6 25233
37A 8 10000 C-LV-I 129921 1.00000 0.69663 0.16340 4661 19872
38X 8 10000 M-LV-I-ucomp-MST 2 1899
39X 8 10000 M-LV-I-ucomp-MST 3 4106
40X 8 10000 M-LV-I-ucomp-MST 4 5760
41X 8 10000 M-LV-I-ucomp-MST 5 6268
42X 8 10000 M-LV-I-ucomp-MST 6 5270
43A 8 10000 M-LV-I-ucomp-MST 23303 0.42652 0.25080 0.30051 4661 3890
44# tier=30000 train_toks=217378
45P 8 30000 LV-I MST 0.53648 0.53648 0.53648
46X 8 30000 C-LV-I 2 15840
47X 8 30000 C-LV-I 3 38453
48X 8 30000 C-LV-I 4 59204
49X 8 30000 C-LV-I 5 67636
50X 8 30000 C-LV-I 6 63337
51A 8 30000 C-LV-I 244470 1.00000 0.84360 0.13548 4661 29023
52X 8 30000 M-LV-I-ucomp-MST 2 2734
53X 8 30000 M-LV-I-ucomp-MST 3 6209
54X 8 30000 M-LV-I-ucomp-MST 4 11603
55X 8 30000 M-LV-I-ucomp-MST 5 14741
56X 8 30000 M-LV-I-ucomp-MST 6 13934
57A 8 30000 M-LV-I-ucomp-MST 49221 0.35314 0.27634 0.25156 4661 5120
58# seed=8 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4825 kept=4825 gold=4825
60GUARD C5 PASS gold=4825 conn=4825 comp=4825
61# tier=3000 train_toks=21908
62P 8 3000 LV-A MST 0.47141 0.47141 0.47141
63X 8 3000 C-LV-A 2 7261
64X 8 3000 C-LV-A 3 12529
65X 8 3000 C-LV-A 4 12205
66X 8 3000 C-LV-A 5 10158
67X 8 3000 C-LV-A 6 7805
68A 8 3000 C-LV-A 49958 1.00000 0.48852 0.17885 4661 12731
69X 8 3000 M-LV-A-ucomp-MST 2 1141
70X 8 3000 M-LV-A-ucomp-MST 3 1517
71X 8 3000 M-LV-A-ucomp-MST 4 1609
72X 8 3000 M-LV-A-ucomp-MST 5 1753
73X 8 3000 M-LV-A-ucomp-MST 6 1524
74A 8 3000 M-LV-A-ucomp-MST 7544 0.37546 0.13881 0.30780 4661 2102
75# tier=10000 train_toks=72661
76P 8 10000 LV-A MST 0.54469 0.54469 0.54469
77X 8 10000 C-LV-A 2 16819
78X 8 10000 C-LV-A 3 35327
79X 8 10000 C-LV-A 4 37944
80X 8 10000 C-LV-A 5 33017
81X 8 10000 C-LV-A 6 25580
82A 8 10000 C-LV-A 148687 1.00000 0.56769 0.16245 4661 16288
83X 8 10000 M-LV-A-ucomp-MST 2 2913
84X 8 10000 M-LV-A-ucomp-MST 3 5051
85X 8 10000 M-LV-A-ucomp-MST 4 5989
86X 8 10000 M-LV-A-ucomp-MST 5 6195
87X 8 10000 M-LV-A-ucomp-MST 6 5320
88A 8 10000 M-LV-A-ucomp-MST 25468 0.44175 0.20961 0.30781 4661 3174
89# tier=30000 train_toks=217378
90P 8 30000 LV-A MST 0.59842 0.59842 0.59842
91X 8 30000 C-LV-A 2 31418
92X 8 30000 C-LV-A 3 84416
93X 8 30000 C-LV-A 4 102992
94X 8 30000 C-LV-A 5 95033
95X 8 30000 C-LV-A 6 75292
96A 8 30000 C-LV-A 389151 1.00000 0.64300 0.15123 4661 19818
97X 8 30000 M-LV-A-ucomp-MST 2 6327
98X 8 30000 M-LV-A-ucomp-MST 3 14685
99X 8 30000 M-LV-A-ucomp-MST 4 19659
100X 8 30000 M-LV-A-ucomp-MST 5 20169
101X 8 30000 M-LV-A-ucomp-MST 6 16794
102A 8 30000 M-LV-A-ucomp-MST 77634 0.47029 0.27848 0.30751 4661 4221
experiments/level2/results-LVC/1792367885/seed-9.tsv +102 -0
……@@ -0,0 +1,102 @@
1Q 9 3000 LV-I 0.59883 0.68013 908 0.61299 0.73355 0.78783
2N 9 3000 LV-I 264
3Q 9 3000 LV-A 0.71676 0.92218 891 0.23838 0.84046 0.84046
4N 9 3000 LV-A 410
5Q 9 10000 LV-I 0.61203 0.67750 927 0.62005 0.69870 0.70075
6N 9 10000 LV-I 375
7Q 9 10000 LV-A 0.73750 0.94664 950 0.17449 0.88480 0.88480
8N 9 10000 LV-A 393
9Q 9 30000 LV-I 0.59809 0.61652 813 0.70854 0.44735 0.43662
10N 9 30000 LV-I 624
11Q 9 30000 LV-A 0.73473 0.92516 931 0.18959 0.81556 0.81489
12N 9 30000 LV-A 382
13# seed=9 V=1607 heldout_sents=2000
14GUARD C1 PASS tp=4964 kept=4964 gold=4964
15GUARD C5 PASS gold=4964 conn=4964 comp=4964
16# tier=3000 train_toks=22082
17P 9 3000 LV-I MST 0.46625 0.46625 0.46625
18X 9 3000 C-LV-I 2 5871
19X 9 3000 C-LV-I 3 10600
20X 9 3000 C-LV-I 4 11558
21X 9 3000 C-LV-I 5 10032
22X 9 3000 C-LV-I 6 7902
23A 9 3000 C-LV-I 45963 1.00000 0.60208 0.18222 4800 15860
24X 9 3000 M-LV-I-ucomp-MST 2 854
25X 9 3000 M-LV-I-ucomp-MST 3 1400
26X 9 3000 M-LV-I-ucomp-MST 4 1822
27X 9 3000 M-LV-I-ucomp-MST 5 1819
28X 9 3000 M-LV-I-ucomp-MST 6 1558
29A 9 3000 M-LV-I-ucomp-MST 7453 0.38021 0.17333 0.33508 4800 2483
30# tier=10000 train_toks=73202
31P 9 10000 LV-I MST 0.51042 0.51042 0.51042
32X 9 10000 C-LV-I 2 12169
33X 9 10000 C-LV-I 3 25905
34X 9 10000 C-LV-I 4 32790
35X 9 10000 C-LV-I 5 31175
36X 9 10000 C-LV-I 6 25465
37A 9 10000 C-LV-I 127504 1.00000 0.70375 0.16116 4800 20961
38X 9 10000 M-LV-I-ucomp-MST 2 1771
39X 9 10000 M-LV-I-ucomp-MST 3 3769
40X 9 10000 M-LV-I-ucomp-MST 4 5640
41X 9 10000 M-LV-I-ucomp-MST 5 6178
42X 9 10000 M-LV-I-ucomp-MST 6 5402
43A 9 10000 M-LV-I-ucomp-MST 22760 0.39479 0.23563 0.29522 4800 3831
44# tier=30000 train_toks=217891
45P 9 30000 LV-I MST 0.55410 0.55410 0.55410
46X 9 30000 C-LV-I 2 19187
47X 9 30000 C-LV-I 3 48132
48X 9 30000 C-LV-I 4 72217
49X 9 30000 C-LV-I 5 77974
50X 9 30000 C-LV-I 6 69321
51A 9 30000 C-LV-I 286831 1.00000 0.77083 0.13842 4800 26730
52X 9 30000 M-LV-I-ucomp-MST 2 3321
53X 9 30000 M-LV-I-ucomp-MST 3 7781
54X 9 30000 M-LV-I-ucomp-MST 4 12877
55X 9 30000 M-LV-I-ucomp-MST 5 15897
56X 9 30000 M-LV-I-ucomp-MST 6 14758
57A 9 30000 M-LV-I-ucomp-MST 54634 0.35958 0.25208 0.24684 4800 4902
58# seed=9 V=1607 heldout_sents=2000
59GUARD C1 PASS tp=4964 kept=4964 gold=4964
60GUARD C5 PASS gold=4964 conn=4964 comp=4964
61# tier=3000 train_toks=22082
62P 9 3000 LV-A MST 0.47229 0.47229 0.47229
63X 9 3000 C-LV-A 2 7668
64X 9 3000 C-LV-A 3 12939
65X 9 3000 C-LV-A 4 12495
66X 9 3000 C-LV-A 5 10340
67X 9 3000 C-LV-A 6 7950
68A 9 3000 C-LV-A 51392 1.00000 0.46229 0.17684 4800 12548
69X 9 3000 M-LV-A-ucomp-MST 2 1142
70X 9 3000 M-LV-A-ucomp-MST 3 1559
71X 9 3000 M-LV-A-ucomp-MST 4 1745
72X 9 3000 M-LV-A-ucomp-MST 5 1777
73X 9 3000 M-LV-A-ucomp-MST 6 1504
74A 9 3000 M-LV-A-ucomp-MST 7727 0.36417 0.12687 0.30163 4800 2019
75# tier=10000 train_toks=73202
76P 9 10000 LV-A MST 0.53552 0.53552 0.53552
77X 9 10000 C-LV-A 2 17026
78X 9 10000 C-LV-A 3 35631
79X 9 10000 C-LV-A 4 38268
80X 9 10000 C-LV-A 5 33508
81X 9 10000 C-LV-A 6 26011
82A 9 10000 C-LV-A 150444 1.00000 0.56292 0.16335 4800 16541
83X 9 10000 M-LV-A-ucomp-MST 2 2943
84X 9 10000 M-LV-A-ucomp-MST 3 5036
85X 9 10000 M-LV-A-ucomp-MST 4 6181
86X 9 10000 M-LV-A-ucomp-MST 5 6240
87X 9 10000 M-LV-A-ucomp-MST 6 5470
88A 9 10000 M-LV-A-ucomp-MST 25870 0.42021 0.19917 0.29997 4800 3187
89# tier=30000 train_toks=217891
90P 9 30000 LV-A MST 0.59416 0.59416 0.59416
91X 9 30000 C-LV-A 2 31757
92X 9 30000 C-LV-A 3 84275
93X 9 30000 C-LV-A 4 102635
94X 9 30000 C-LV-A 5 95535
95X 9 30000 C-LV-A 6 75792
96A 9 30000 C-LV-A 389994 1.00000 0.64187 0.15204 4800 20265
97X 9 30000 M-LV-A-ucomp-MST 2 6377
98X 9 30000 M-LV-A-ucomp-MST 3 14550
99X 9 30000 M-LV-A-ucomp-MST 4 19099
100X 9 30000 M-LV-A-ucomp-MST 5 19858
101X 9 30000 M-LV-A-ucomp-MST 6 16704
102A 9 30000 M-LV-A-ucomp-MST 76588 0.46146 0.27625 0.30638 4800 4328
experiments/level2/results-LVC/1792367885/src.sha256 +4 -0
……@@ -0,0 +1,4 @@
1c5d77d6ed343a2928e677d52ea1acc2245df33cc7f4bb0e9e4cd4c7c50e70c7c l2.c
2d836689422948fa141f5a5981082a9b563246adbbb39514996a63219c648d3dd lv.py
3577e806dc7c1942cd5624cecd81f48baaa5f19e81add39602fca7edde8f24fee ../ladder/port/cluster.c
42f4343faaa8bd25592fdadbc5bd38807f63d6823bcf85aff9eaeda50e96b8396 ../across-cluster/ac.c
experiments/level2/results-LVC/1792367885/summary.txt +21 -0
……@@ -0,0 +1,21 @@
1## Held-out labels (mean): V-measure / many-to-one / labels / share in a class / sense / sense-COLL / merges (runs at the 2000 cap)
23000 LV-I: 0.606 / 0.676 / 897.900 / 0.633 / 0.722 / 0.744 / 271.1 (0)
33000 LV-A: 0.712 / 0.904 / 887.200 / 0.236 / 0.822 / 0.822 / 366.0 (0)
410000 LV-I: 0.615 / 0.682 / 938.400 / 0.625 / 0.652 / 0.663 / 356.5 (0)
510000 LV-A: 0.735 / 0.941 / 948.100 / 0.206 / 0.865 / 0.866 / 388.1 (0)
630000 LV-I: 0.570 / 0.601 / 807.900 / 0.734 / 0.530 / 0.543 / 627.8 (0)
730000 LV-A: 0.733 / 0.921 / 907.400 / 0.249 / 0.835 / 0.834 / 435.9 (0)
8
9## Re-parse (mean): link F1 / ucomp type recall / ucomp precision; demo-setting LV-I F1; L-MST F1
103000 LV-I: 0.454 / 0.165 / 0.304 demo 0.449 L-MST 0.626
113000 LV-A: 0.467 / 0.131 / 0.313 demo 0.462 L-MST 0.626
1210000 LV-I: 0.515 / 0.232 / 0.293 demo 0.504 L-MST 0.689
1310000 LV-A: 0.534 / 0.202 / 0.301 demo 0.528 L-MST 0.689
1430000 LV-I: 0.545 / 0.270 / 0.259 demo 0.544 L-MST 0.700
1530000 LV-A: 0.589 / 0.273 / 0.302 demo 0.572 L-MST 0.700
16
17## Predictions (at 30000)
18C1: FAIL — share of held-out tokens in a class 0.734 (bar 0.8)
19C2: FAIL — sense LV-I − LV-I-COLL -0.013 [-0.043, +0.016]
20C3: FAIL — link F1 LV-I converged − demo setting +0.001 [-0.014, +0.017]
21C4: FAIL — link F1 LV-I − L-MST -0.155 [-0.170, -0.140] (bar: lower > -0.02)