01
Human listening, machine data
Problem
A listener’s vocabulary, judgement and perception correspond only partly to signal, meter and parameter data. Shared patterns exist, but usage is individual, so a mapping averaged across listeners misrepresents each of them.
Level differences bias comparisons, and a model that sets parameters in one step leaves nothing to inspect: its output can only be accepted or rejected.
Approach
- Studied in one working system, a family of audio plug-ins with a listening assistant, so that listening is studied while the work is being done.
- Each listener’s vocabulary is modelled individually; perceived quality and affective response are kept apart. Where the signal data cannot resolve a term, the assistant asks the listener once instead of guessing.
- All comparisons are blind and loudness-matched. Disagreement between listener judgement and meter data is kept as a finding, and the change a processor makes is examined, not only its output.
- A listening decision is decomposed into typed machine judgements, each with a stated confidence and an explicit “not sure”. The model sets no values; each plug-in declares the controls that may move and their range; every proposal goes to the comparison slot, and the listener decides.
- The judgements run on Jev, a model built for small typed judgements. The plug-ins work fully without the assistant.
- A bench isolates each processing stage inside the session, so that a listener’s perception reaches the design intact. Controls carry the listener’s vocabulary, have a neutral point, and stay only once listening confirms them.
Instruments
The plug-ins this research runs in are published as Paranorm Audio, a brand of Márton Fenyvesi.
- The Master’s Agent
Listening assistant; listener vocabulary and machine judgements.
- The Master’s Power
Mastering limiter; listener judgement and meter data.
- The Master’s Movement
Two-band dynamic EQ; learning a technique by ear.
- The Master’s Bench
Stage-by-stage listening; listener perception carried into design.