AudioScope: in-the-wild on-screen sound enhancement

Input video

Video clip from "Land unter!" by SusanneK, license: CC-BY-SA 2.0, with additional background audio clip from "Luchador and Yellow Jumpsuit" by tenaciousme, license: CC-BY 2.0.

Audio clip from "Land unter!" by SusanneK, license: CC-BY-SA 2.0, with additional background audio clip from "Luchador and Yellow Jumpsuit" by tenaciousme, license: CC-BY 2.0.

Audio clip from "Land unter!" by SusanneK, license: CC-BY-SA 2.0.

Audio clip from "Luchador and Yellow Jumpsuit" by tenaciousme, license: CC-BY 2.0.


On-screen estimate from the input video and corresponding attention map

Video clip from "Land unter!" by SusanneK with modified audio and overlaid attention map, license: CC-BY-SA 2.0.





Separated sources with input video and corresponding attention maps

Video clip from "Land unter!" by SusanneK with modified audio and overlaid attention map, license: CC-BY-SA 2.0.


Video clip from "Land unter!" by SusanneK with modified audio and overlaid attention map, license: CC-BY-SA 2.0.


Video clip from "Land unter!" by SusanneK with modified audio and overlaid attention map, license: CC-BY-SA 2.0.


Video clip from "Land unter!" by SusanneK with modified audio and overlaid attention map, license: CC-BY-SA 2.0.



Attention maps over time for on-screen estimate

Still frames from "Land unter!" by SusanneK with overlaid attention maps, license: CC-BY-SA 2.0.