OverviewFilesCommitsIssuesDocsReleasesPeers

atomspace-layer-discovery / experiments / level2 / results-reparse / 1792366099 / summary.txt

31 lines · txt ref:
R0: PASS — 10/10 seeds reproduce Test A-U exactly

## Per round (mean): link F1 / many-to-one / ucomp type recall / ucomp precision
tier 3000:  G-MST F1 0.719   L-MST F1 0.626, L ucomp recall 0.423
  round 0: 0.455 / 0.914 / 0.113 / 0.378
  round 1: 0.585 / 0.601 / 0.377 / 0.243
  round 2: 0.606 / 0.665 / 0.406 / 0.250
  round 3: 0.612 / 0.682 / 0.407 / 0.249
  round 4: 0.615 / 0.685 / 0.411 / 0.250
  round 5: 0.619 / 0.699 / 0.414 / 0.252
tier 10000:  G-MST F1 0.733   L-MST F1 0.689, L ucomp recall 0.511
  round 0: 0.514 / 0.914 / 0.185 / 0.382
  round 1: 0.684 / 0.729 / 0.501 / 0.258
  round 2: 0.688 / 0.746 / 0.513 / 0.257
  round 3: 0.688 / 0.741 / 0.511 / 0.254
  round 4: 0.691 / 0.759 / 0.512 / 0.256
  round 5: 0.689 / 0.745 / 0.513 / 0.255
tier 30000:  G-MST F1 0.735   L-MST F1 0.700, L ucomp recall 0.541
  round 0: 0.570 / 0.914 / 0.254 / 0.379
  round 1: 0.715 / 0.775 / 0.541 / 0.260
  round 2: 0.714 / 0.803 / 0.551 / 0.261
  round 3: 0.713 / 0.806 / 0.553 / 0.262
  round 4: 0.712 / 0.811 / 0.551 / 0.261
  round 5: 0.709 / 0.812 / 0.547 / 0.260

## Predictions
P1: PASS — link F1 round 1 − round 0 3000: +0.130 [+0.115, +0.145]; 10000: +0.170 [+0.149, +0.192]; 30000: +0.145 [+0.137, +0.153]
P2: FAIL — link F1 round 5 − round 1 at 30000 -0.005 [-0.011, +0.001]
P3: FAIL — link F1 round 5 − L-MST at 30000 +0.009 [-0.006, +0.025]
P4: FAIL — ucomp type recall round 5 − L-MST at 30000 +0.006 [-0.024, +0.036]