EE Seminar: Novel View Synthesis Gone Aural
https://tau-ac-il.zoom.us/j/84771891478?pwd=JuUvIlm4vKOAWox8aN9Iax6lGtu1gf.1
Electrical Engineering Systems ZOOM Seminar
Speaker: Or Weiser
M.Sc. student under the supervision of Prof. Lior Wolf and Prof. Shai Avidan
Monday, 16th February 2026, at 15:00
Novel View Synthesis Gone Aural
Abstract
This work addresses the task of audio novel view synthesis. We introduce HOLOSOUND, a method for estimating the acoustics of a given source at new locations in a room, using audio recordings only. Given a set of recordings at multiple locations of the same source signal, we estimate how the binaural signal would be perceived at novel arbitrary locations and orientations. We parameterize the problem as the convolution of room impulse responses (RIRs) with the source signal. Utilizing a pretrained RIR prediction model, HOLOSOUND apply a novel test-time optimization scheme in the model’s embedding space to recover the properties of the environment and estimate the binaural signal. This approach allows us to eliminate the need for additional modalities, such as visual cues and depth measurements, which have been used in prior work, and instead rely solely on audio recordings. Empirically, we demonstrate that HOLOSOUND generalizes well to complex environments, enabling queries of our representation to synthesize the signal at novel locations and orientations. Results suggest that the proposed method is superior or comparable to the evaluated baselines while eliminating the requirement for additional features and modalities.
-סמינר זה ייחשב כסמינר שמיעה לתלמידי תואר שני ושלישי-
This Seminar Is Considered A Hearing Seminar For Msc/Phd Students-
כדי לקבל קרדיט שמיעה יש לחתום שם מלא ומספר ת.ז. בצ'ט
