Precision sweep: b0-gt-pid on b0-nominal
Generated by precision_sweep_b0-gt-pid (docs/plan/precision-sweep/). Do not edit; rerun the command instead.
- Command:
precision_sweep_b0-gt-pid --scenario scenarios/b0-nominal.yaml --seeds 500 --timing --commit 1d86f32(--jobsand--out-diromitted; they change no result) - Commit: 1d86f32
- Seeds: 1700..2199 (500 seeds)
- The simulator, FC, scorer and log run in double; only the stack runs in the listed type.
- P1: success rate ≥ 99.0 %.
- Lap Δ: |lap time − double’s| over the laps of seeds where both succeeded.
| Type | Stack | Success | P1 | Lap time p50 / p95 [s] | True gate error p50 / p99 [m] | Max speed p50 / max [m/s] | Lap Δ p50 / p95 / max [s] | Wall time [s] |
|---|---|---|---|---|---|---|---|---|
| double | built | 500 / 500 (100.0 %) | yes | 34.406 / 34.928 | 0.006 / 0.424 | 4.487 / 4.500 | reference | 4.3 |
| float | built | 500 / 500 (100.0 %) | yes | 34.406 / 34.928 | 0.006 / 0.424 | 4.487 / 4.500 | 5.37e-07 / 8.14e-07 / 1.13e-02 | 4.2 |
| cfloat<32,8> | built | 500 / 500 (100.0 %) | yes | 34.406 / 34.928 | 0.006 / 0.424 | 4.487 / 4.500 | 5.37e-07 / 8.14e-07 / 1.13e-02 | 11.5 |
| posit<32,2> | built | 500 / 500 (100.0 %) | yes | 34.406 / 34.928 | 0.006 / 0.424 | 4.487 / 4.500 | 5.50e-08 / 7.70e-08 / 1.74e-05 | 72.9 |
| bfloat16 (cfloat<16,8>) | built | 500 / 500 (100.0 %) | yes | 36.085 / 36.724 | 0.048 / 0.373 | 4.402 / 4.475 | 1.51e+00 / 1.81e+00 / 1.88e+00 | 9.1 |
| binary16 (cfloat<16,5>) | failed (note) | — | no | — | — | — | — | 0.0 |
| posit<16,1> | built | 500 / 500 (100.0 %) | yes | 34.441 / 34.978 | 0.006 / 0.402 | 4.482 / 4.485 | 2.38e-02 / 5.88e-02 / 6.79e-02 | 31.5 |
Failures
Section titled “Failures”- binary16 (cfloat<16,5>): the stack did not build: vehicle ‘rp1’ does not give valid reflex model parameters; rotor.thrust_coefficient = 8.9e-07 is subnormal in this scalar type
Gate error by gate
Section titled “Gate error by gate”- Per built type and gate, over the passages of runs without a run error, as in the table above.
- Paired excess: the median of (this type’s true gate error − double’s) over the passages of the same seed, lap and gate in both.
- In-plane ULP: the type’s resolution at the gate’s center, on the world axes that span the gate’s plane (its error is measured in that plane).
double
Section titled “double”| Gate | Center [m] | Passages | True error p50 / p99 [m] | Paired excess p50 [m] | In-plane ULP [m] | ¼ in-plane ULP [m] |
|---|---|---|---|---|---|---|
| 1 | (10, 4, 2) | 1000 | 0.051 / 0.331 | reference | 8.88e-16 | 2.22e-16 |
| 2 | (25, 4, 2) | 1000 | 0.010 / 0.031 | reference | 8.88e-16 | 2.22e-16 |
| 3 | (40, 4, 2) | 1000 | 0.003 / 0.009 | reference | 8.88e-16 | 2.22e-16 |
| 4 | (55, 4, 2) | 1000 | 0.001 / 0.003 | reference | 8.88e-16 | 2.22e-16 |
| 5 | (68, 4, 2) | 1000 | 0.000 / 0.001 | reference | 8.88e-16 | 2.22e-16 |
| 6 | (72, 9, 2) | 1000 | 0.401 / 0.436 | reference | 1.42e-14 | 3.55e-15 |
| 7 | (60, 14, 2) | 1000 | 0.118 / 0.132 | reference | 1.78e-15 | 4.44e-16 |
| 8 | (45, 14, 2) | 1000 | 0.006 / 0.009 | reference | 1.78e-15 | 4.44e-16 |
| 9 | (30, 14, 2) | 1000 | 0.002 / 0.002 | reference | 1.78e-15 | 4.44e-16 |
| 10 | (15, 14, 2) | 1000 | 0.000 / 0.001 | reference | 1.78e-15 | 4.44e-16 |
| 11 | (5, 9, 2) | 1000 | 0.360 / 0.410 | reference | 8.88e-16 | 2.22e-16 |
| Gate | Center [m] | Passages | True error p50 / p99 [m] | Paired excess p50 [m] | In-plane ULP [m] | ¼ in-plane ULP [m] |
|---|---|---|---|---|---|---|
| 1 | (10, 4, 2) | 1000 | 0.051 / 0.331 | -1.12e-07 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 2 | (25, 4, 2) | 1000 | 0.010 / 0.031 | -1.92e-08 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 3 | (40, 4, 2) | 1000 | 0.003 / 0.009 | -9.55e-09 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 4 | (55, 4, 2) | 1000 | 0.001 / 0.003 | -4.09e-09 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 5 | (68, 4, 2) | 1000 | 0.000 / 0.001 | -3.11e-09 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 6 | (72, 9, 2) | 1000 | 0.401 / 0.436 | 5.17e-07 (1000 pairs) | 7.63e-06 | 1.91e-06 |
| 7 | (60, 14, 2) | 1000 | 0.118 / 0.132 | -8.03e-07 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 8 | (45, 14, 2) | 1000 | 0.006 / 0.009 | -7.56e-09 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 9 | (30, 14, 2) | 1000 | 0.002 / 0.002 | -5.01e-09 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 10 | (15, 14, 2) | 1000 | 0.000 / 0.001 | -3.44e-09 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 11 | (5, 9, 2) | 1000 | 0.360 / 0.410 | -2.95e-06 (1000 pairs) | 4.77e-07 | 1.19e-07 |
cfloat<32,8>
Section titled “cfloat<32,8>”| Gate | Center [m] | Passages | True error p50 / p99 [m] | Paired excess p50 [m] | In-plane ULP [m] | ¼ in-plane ULP [m] |
|---|---|---|---|---|---|---|
| 1 | (10, 4, 2) | 1000 | 0.051 / 0.331 | -1.12e-07 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 2 | (25, 4, 2) | 1000 | 0.010 / 0.031 | -1.92e-08 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 3 | (40, 4, 2) | 1000 | 0.003 / 0.009 | -9.55e-09 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 4 | (55, 4, 2) | 1000 | 0.001 / 0.003 | -4.09e-09 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 5 | (68, 4, 2) | 1000 | 0.000 / 0.001 | -3.11e-09 (1000 pairs) | 4.77e-07 | 1.19e-07 |
| 6 | (72, 9, 2) | 1000 | 0.401 / 0.436 | 5.17e-07 (1000 pairs) | 7.63e-06 | 1.91e-06 |
| 7 | (60, 14, 2) | 1000 | 0.118 / 0.132 | -8.03e-07 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 8 | (45, 14, 2) | 1000 | 0.006 / 0.009 | -7.56e-09 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 9 | (30, 14, 2) | 1000 | 0.002 / 0.002 | -5.01e-09 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 10 | (15, 14, 2) | 1000 | 0.000 / 0.001 | -3.44e-09 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 11 | (5, 9, 2) | 1000 | 0.360 / 0.410 | -2.95e-06 (1000 pairs) | 4.77e-07 | 1.19e-07 |
posit<32,2>
Section titled “posit<32,2>”| Gate | Center [m] | Passages | True error p50 / p99 [m] | Paired excess p50 [m] | In-plane ULP [m] | ¼ in-plane ULP [m] |
|---|---|---|---|---|---|---|
| 1 | (10, 4, 2) | 1000 | 0.051 / 0.331 | 7.95e-09 (1000 pairs) | 2.98e-08 | 7.45e-09 |
| 2 | (25, 4, 2) | 1000 | 0.010 / 0.031 | 1.26e-09 (1000 pairs) | 2.98e-08 | 7.45e-09 |
| 3 | (40, 4, 2) | 1000 | 0.003 / 0.009 | 6.87e-10 (1000 pairs) | 2.98e-08 | 7.45e-09 |
| 4 | (55, 4, 2) | 1000 | 0.001 / 0.003 | 4.57e-10 (1000 pairs) | 2.98e-08 | 7.45e-09 |
| 5 | (68, 4, 2) | 1000 | 0.000 / 0.001 | 1.28e-10 (1000 pairs) | 2.98e-08 | 7.45e-09 |
| 6 | (72, 9, 2) | 1000 | 0.401 / 0.436 | 3.83e-07 (1000 pairs) | 9.54e-07 | 2.38e-07 |
| 7 | (60, 14, 2) | 1000 | 0.118 / 0.132 | -3.99e-08 (1000 pairs) | 5.96e-08 | 1.49e-08 |
| 8 | (45, 14, 2) | 1000 | 0.006 / 0.009 | 1.10e-09 (1000 pairs) | 5.96e-08 | 1.49e-08 |
| 9 | (30, 14, 2) | 1000 | 0.002 / 0.002 | 2.38e-09 (1000 pairs) | 5.96e-08 | 1.49e-08 |
| 10 | (15, 14, 2) | 1000 | 0.000 / 0.001 | 1.50e-10 (1000 pairs) | 5.96e-08 | 1.49e-08 |
| 11 | (5, 9, 2) | 1000 | 0.360 / 0.410 | 2.68e-07 (1000 pairs) | 2.98e-08 | 7.45e-09 |
bfloat16 (cfloat<16,8>)
Section titled “bfloat16 (cfloat<16,8>)”| Gate | Center [m] | Passages | True error p50 / p99 [m] | Paired excess p50 [m] | In-plane ULP [m] | ¼ in-plane ULP [m] |
|---|---|---|---|---|---|---|
| 1 | (10, 4, 2) | 1000 | 0.057 / 0.389 | 2.01e-02 (1000 pairs) | 0.0312 | 0.00781 |
| 2 | (25, 4, 2) | 1000 | 0.043 / 0.078 | 3.28e-02 (1000 pairs) | 0.0312 | 0.00781 |
| 3 | (40, 4, 2) | 1000 | 0.043 / 0.077 | 3.97e-02 (1000 pairs) | 0.0312 | 0.00781 |
| 4 | (55, 4, 2) | 1000 | 0.043 / 0.077 | 4.19e-02 (1000 pairs) | 0.0312 | 0.00781 |
| 5 | (68, 4, 2) | 1000 | 0.042 / 0.079 | 4.16e-02 (1000 pairs) | 0.0312 | 0.00781 |
| 6 | (72, 9, 2) | 1000 | 0.254 / 0.298 | -1.47e-01 (1000 pairs) | 0.5 | 0.125 |
| 7 | (60, 14, 2) | 1000 | 0.099 / 0.125 | -1.80e-02 (1000 pairs) | 0.0625 | 0.0156 |
| 8 | (45, 14, 2) | 1000 | 0.027 / 0.054 | 2.05e-02 (1000 pairs) | 0.0625 | 0.0156 |
| 9 | (30, 14, 2) | 1000 | 0.030 / 0.053 | 2.87e-02 (1000 pairs) | 0.0625 | 0.0156 |
| 10 | (15, 14, 2) | 1000 | 0.031 / 0.054 | 3.07e-02 (1000 pairs) | 0.0625 | 0.0156 |
| 11 | (5, 9, 2) | 1000 | 0.226 / 0.279 | -1.34e-01 (1000 pairs) | 0.0312 | 0.00781 |
posit<16,1>
Section titled “posit<16,1>”| Gate | Center [m] | Passages | True error p50 / p99 [m] | Paired excess p50 [m] | In-plane ULP [m] | ¼ in-plane ULP [m] |
|---|---|---|---|---|---|---|
| 1 | (10, 4, 2) | 1000 | 0.051 / 0.331 | 4.23e-05 (1000 pairs) | 0.00195 | 0.000488 |
| 2 | (25, 4, 2) | 1000 | 0.010 / 0.031 | 1.12e-04 (1000 pairs) | 0.00195 | 0.000488 |
| 3 | (40, 4, 2) | 1000 | 0.004 / 0.009 | 6.15e-04 (1000 pairs) | 0.00195 | 0.000488 |
| 4 | (55, 4, 2) | 1000 | 0.003 / 0.007 | 1.97e-03 (1000 pairs) | 0.00195 | 0.000488 |
| 5 | (68, 4, 2) | 1000 | 0.003 / 0.007 | 2.36e-03 (1000 pairs) | 0.00195 | 0.000488 |
| 6 | (72, 9, 2) | 1000 | 0.391 / 0.408 | -1.10e-02 (1000 pairs) | 0.125 | 0.0312 |
| 7 | (60, 14, 2) | 1000 | 0.118 / 0.132 | -1.43e-04 (1000 pairs) | 0.00391 | 0.000977 |
| 8 | (45, 14, 2) | 1000 | 0.006 / 0.009 | -2.86e-04 (1000 pairs) | 0.00391 | 0.000977 |
| 9 | (30, 14, 2) | 1000 | 0.004 / 0.007 | 1.95e-03 (1000 pairs) | 0.00391 | 0.000977 |
| 10 | (15, 14, 2) | 1000 | 0.003 / 0.007 | 2.72e-03 (1000 pairs) | 0.00391 | 0.000977 |
| 11 | (5, 9, 2) | 1000 | 0.357 / 0.404 | -2.59e-03 (1000 pairs) | 0.00195 | 0.000488 |