Offline: per-feature throughput deltas vs roseinfer+inproc

说明:improve_pct = (variant - inproc) / inproc,所以 正数代表吞吐变快

原始结构化数据见同目录 offline_deltas.csv(同时也包含 vs_base 口径)。

rank feature improve inproc tok/s variant tok/s
1 lastlogits +10.53% 65314.13 72191.59
2 fanopast +3.26% 65314.13 67445.26
3 nopad +2.99% 65314.13 67269.86
4 rnopast +1.52% 65314.13 66308.00
5 tokbuf +0.66% 65314.13 65748.01
6 pstream +0.30% 65314.13 65511.07
7 qdec -0.04% 65314.13 65287.94
8 pprio1 -0.20% 65314.13 65183.33
9 chunkbkt -0.75% 65314.13 64822.70
10 wupcg16 -0.80% 65314.13 64789.61
11 bffwd -1.02% 65314.13 64646.62
12 pbuild -1.13% 65314.13 64577.50
13 pslots -1.25% 65314.13 64496.48
14 idleka -1.26% 65314.13 64489.86
15 pfront -1.38% 65314.13 64415.37
16 aflush -1.50% 65314.13 64334.99
17 peager -1.51% 65314.13 64328.54
18 opool -1.62% 65314.13 64254.11
19 pbuild2 -1.65% 65314.13 64238.98
20 tokbuf2 -1.86% 65314.13 64101.55
21 fbsync -2.12% 65314.13 63931.33
22 scfp -9.31% 65314.13 59230.57
23 pcap8 -27.82% 65314.13 47143.17