22y: live ctx capture pipeline works (scripts/dualtrace.py, realtime playback + chunked heap snapshot); found config-dependent reduction curves 0x540768/788/7f8 (peak follows band fc; 7f8 min exactly 1.0 => R=1/mask, notch-shaped); acc/f6f8 arrays ZERO in steady state; DECISIVE: applied filter != pointwise R (dual skirt 3dB vs real 11.8) -> FFT-conv wide-window spreading is the missing mechanism

This commit is contained in:
2026-08-23 18:40:25 +03:00
parent 64beaa7131
commit 91101b2135
3 changed files with 252 additions and 0 deletions
+37
View File
@@ -157,3 +157,40 @@ the ctx object only materializes during a realtime transport play.
during band processing; still TBD (but LUT curve params A/B/γ are RPP-derived per roadmap). during band processing; still TBD (but LUT curve params A/B/γ are RPP-derived per roadmap).
- Two more ctx-like bases found (0x2120040, 0x1780040) also have +0x24==48000; 0x2370040 is the - Two more ctx-like bases found (0x2120040, 0x1780040) also have +0x24==48000; 0x2370040 is the
populated one (0x2120040 has 0x540658..698 = 1.0 fill pattern — likely a second/free instance). populated one (0x2120040 has 0x540658..698 = 1.0 fill pattern — likely a second/free instance).
## 2026-08-23 (22y): LIVE CTX CAPTURE DURING DUAL/T1KQ/RES PLAYBACK — scripts/dualtrace.py
Method works reproducibly: reaper <cfg>.rpp play_loop.lua (repeat ON) → yabridge-host
→ chunked snapshot ×2 → ctx marker +0x24==48000 ∧ sens>100 → ONLY ONE populated base
(0x2370040; others empty instances). Snapshots byte-stable over seconds.
### Pointer-table catalog (ctx+0x540600..0x540a00, dereferenced u64 → f32[2049])
- Static weights confirmed live: [00]identity@0x540688(ones), window@0x540698(0.5→0.8),
WA/WB/WC/WD @0x5406b8/c8/d8/e8, warp@0x540748(1.3→6.68, structure at LOW bins),
freqaxis@0x540758(v85=995.6Hz ✓ internal 48k/4096).
- **acc/f6f8 arrays ALL ZERO during steady looped playback** (0x5406f8,
0x5407a8/b8/c8/d8 — zero as f32 AND f64): combine accumulators idle in steady state.
- **CONFIG-DEPENDENT CURVE FAMILY** (peak follows band fc: bin43@fc500 → bin85@fc1000):
- 0x540768 == 0x540778 (identical twins): smooth curve, peak at center
(dual: 4.15@43, valley 1.60@171, upturn 1.86@400; t1kq: 3.55@85).
- 0x540788: sharper version (floor ~0.52-1.0, max 4.38).
- **0x5407f8: min EXACTLY 1.0 → reduction multiplier R(f)=1/mask ≥ 1**
(res500 cfg: R(500Hz)=12.0 dB, falls to ~0 by 6 kHz; notch-shaped ✓).
- bands[] slots from static asm (@0x540678+i·16) read as identity/ones tables LIVE —
the per-band working data is NOT sitting in those ctx fields during playback.
### Decisive mismatch
For dual cfg: R(43)=3.98→12.0 dB (real 10.32 ok-ish) BUT R(171)=1.41→3.0 dB while
real cut@2000 = 11.82 dB. ⇒ Applied filter ≠ pointwise copy of R: massive spectral
coupling between template and actual filtering. Prime suspect: FFT-conv stage with
the 8193-wide WIN_freq window ([01]) — smearing/spreading step completely absent in
our pointwise render48k path. This ALSO explains why faithful v1 (pointwise) cannot
balance dual tones regardless of law constants.
### Caveats / next
- Quick Welch TF estimate unreliable (window/alignment) — Goertzel-at-tones stays canon;
for full-spectrum truth use chirp/two-tone refs or per-fc capture sweep.
- NEXT: (1) fc-scan captures (res_only1_{fc}.rpp, 11×) → correlate R_cap(bin85) with
real cut@1000 across fc — validates R as THE applied curve; (2) decode the FFT-conv
0x535a70 body + WIN_freq usage — reconstruct mask→FIR spreading; (3) re-check whether
0x540768-family updates frame-by-frame (two-point diff showed stable — maybe only
rebuilt on param change / note onset).
+17
View File
@@ -0,0 +1,17 @@
-- play_loop.lua : realtime playback with repeat ON, held alive for keep_secs.
local keep_secs = 240
if reaper.GetSetRepeat(0) == 0 then
reaper.Main_OnCommand(1068, 0) -- Transport: Repeat ON
end
reaper.Main_OnCommand(1007, 0) -- Transport: Play
local t0 = reaper.time_precise()
local function keepalive()
if reaper.time_precise() - t0 < keep_secs then
reaper.defer(keepalive)
else
reaper.OnStopButton()
end
end
reaper.defer(keepalive)
+198
View File
@@ -0,0 +1,198 @@
#!/usr/bin/env python3
"""dualtrace.py — live capture of the DSP ctx during realtime playback of
dual_b1q_0.5.rpp (two tones 500+2000 Hz, one band @500 q=0.5).
Method (NOTES_CAPTURE.md 2026-08-20c): reaper + play_loop.lua keeps the audio
callback alive; chunked /proc/pid/mem snapshot of the yabridge host; find ctx
by marker +0x24 == 48000.0f; dump scalars + pointer table + all ~2049-float
arrays, flag those with energy at tone bins 43/171.
Usage: python3 scripts/dualtrace.py [rpp]
"""
import json
import os
import struct
import subprocess
import sys
import time
import numpy as np
SNAP1 = '/tmp/opencode/dualtrace_s1.bin'
SNAP2 = '/tmp/opencode/dualtrace_s2.bin'
def find_host():
import glob
for p in glob.glob('/proc/[0-9]*'):
pid = int(os.path.basename(p))
try:
cmd = open(f'/proc/{pid}/cmdline', 'rb').read().replace(b'\0', b' ').decode('utf8', 'replace')
maps = open(f'/proc/{pid}/maps').read()
except Exception:
continue
if 'soothe2' in maps and 'reaper' not in cmd:
return pid
return None
def snapshot(host, path):
fd = os.open(f'/proc/{host}/mem', os.O_RDONLY)
out = open(path, 'wb')
nreg = nbytes = 0
for line in open(f'/proc/{host}/maps').read().splitlines():
p = line.split()
if len(p) < 2 or 'r' not in p[1]:
continue
lo, hi = (int(x, 16) for x in p[0].split('-'))
a = lo
while a < hi:
n = min(hi - a, 8 * 1024 * 1024)
try:
d = os.pread(fd, n, a)
except Exception:
a += n
continue
if d:
out.write(struct.pack('<QQ', a, len(d)))
out.write(d)
nreg += 1
nbytes += len(d)
a += n
out.close()
os.close(fd)
return nreg, nbytes
def parse_snap(path):
data = open(path, 'rb').read()
regs = []
i = 0
while i + 16 <= len(data):
lo, sz = struct.unpack_from('<QQ', data, i)
regs.append((lo, data[i + 16:i + 16 + sz]))
i += 16 + sz
return regs
def readabs(regs, addr, n):
for lo, body in regs:
if lo <= addr < lo + len(body) and addr - lo + n <= len(body):
return body[addr - lo:addr - lo + n]
return None
def find_ctx(regs):
sig = struct.pack('<I', 0x473b8000) # 48000.0f
cands = []
for lo, body in regs:
j = 0
while True:
j = body.find(sig, j)
if j < 0:
break
base = lo + j - 0x24
b = readabs(regs, base + 0x540870, 4)
if b and struct.unpack('<f', b)[0] > 100: # sens scalar ~441
cands.append(base)
j += 1
return sorted(set(cands))
def dump_ctx(regs, ctx, tag, store):
"""Scalars + pointer table 0x540600..0x540900 + dereferenced arrays."""
def f32(addr):
b = readabs(regs, addr, 4)
return struct.unpack('<f', b)[0] if b else None
scal = {hex(a): f32(ctx + a) for a in range(0x540860, 0x5408a8, 4)}
store[f'{tag}_scalars'] = scal
arrays = {}
ptrinfo = []
for off in range(0x540600, 0x540900, 8):
b = readabs(regs, ctx + off, 8)
if not b:
continue
ptr = struct.unpack('<Q', b)[0]
if ptr < 0x10000 or ptr > 0x7fffffffffff:
continue
body = readabs(regs, ptr, 2049 * 4 + 64)
if body is None or len(body) < 2049 * 4:
continue
arr = np.frombuffer(body[:2049 * 4], dtype='<f4').astype(np.float64)
if not np.isfinite(arr).all():
continue
arrays[off] = arr
ptrinfo.append((hex(ctx + off), hex(ptr)))
# classify: energy at tone bins relative to local median
flagged = {}
med = None
for off, arr in arrays.items():
m = float(np.median(arr))
if m <= 0 or not np.isfinite(m) or float(np.max(np.abs(arr))) > 1e6:
continue
r43 = arr[43] / m
r171 = arr[171] / m
if r43 > 3 or r171 > 3 or (arr.max() / max(m, 1e-30)) > 5:
flagged[off] = dict(ratio43=r43, ratio171=r171,
vmin=float(arr.min()), vmax=float(arr.max()))
store[f'{tag}_arr_{hex(off)}'] = arr
store[f'{tag}_ptrinfo'] = ptrinfo
store[f'{tag}_flagged'] = {hex(k): v for k, v in flagged.items()}
return flagged
def main():
rpp = sys.argv[1] if len(sys.argv) > 1 else '/home/m/soothe-bt/dual_b1q_0.5.rpp'
os.makedirs('/tmp/opencode', exist_ok=True)
subprocess.run('pkill -9 -x reaser 2>/dev/null; pkill -9 -x reaper 2>/dev/null; '
"pkill -9 -f '[y]abridge' 2>/dev/null; sleep 1", shell=True)
proc = subprocess.Popen(
['/usr/bin/reaper', '-nosplash', '-ignoreerrors', rpp,
'/home/m/re-tools/play_loop.lua'],
stdout=open('/dev/null', 'w'), stderr=subprocess.STDOUT)
t0 = time.time()
host = None
while time.time() - t0 < 60 and not host:
host = find_host()
time.sleep(0.2)
if not host:
print('NO HOST')
return 1
print('host', host, 'at %.1fs' % (time.time() - t0), flush=True)
time.sleep(12) # init + several looped passes -> steady state
store = {}
try:
n1, b1 = snapshot(host, SNAP1)
print(f'snap1: {n1} regs {b1/1e6:.0f}MB', flush=True)
time.sleep(6)
n2, b2 = snapshot(host, SNAP2)
print(f'snap2: {n2} regs {b2/1e6:.0f}MB', flush=True)
for tag, path in (('s1', SNAP1), ('s2', SNAP2)):
regs = parse_snap(path)
cands = find_ctx(regs)
print(tag, 'ctx candidates:', [('0x%x' % c) for c in cands][:5], flush=True)
if cands:
fl = dump_ctx(regs, cands[0], tag, store)
for k, v in list(fl.items())[:10]:
print(' ', k, {kk: round(vv, 2) if isinstance(vv, float) else vv
for kk, vv in v.items()}, flush=True)
finally:
if proc.poll() is None:
proc.kill()
np.savez_compressed('/tmp/opencode/dualtrace.npz',
**{k: v for k, v in store.items()
if isinstance(v, np.ndarray)})
json.dump({k: v for k, v in store.items() if not isinstance(v, np.ndarray)},
open('/tmp/opencode/dualtrace.json', 'w'), indent=1)
print('\nsaved /tmp/opencode/dualtrace.npz|.json')
return 0
if __name__ == '__main__':
sys.exit(main())