Annotating YouTube Videos Using Its Just Announced Auto-Caption Program?

YouTube is adding automated captions to its videos. Aside from the obvious benefits, this also allows for very specific annotations.
Video is an ‘external-paced medium’ which means as viewer you can’t decide how fast you consume the given information. You just have to go along with the speed the maker of the video decided. This is a big different with texts, which are internal-paced (the reader decides the speed and rhythm). The fact text is internal-paced makes it possible for people to annotate it. Something which is really difficult with video.
However, with YouTube introducing captions for every video, this means you could theoretically have the text besides the video, so you can watch the video and highlight interesting content, write a quick comment and expand it after watching the full thing.
Very interesting. Perhaps something we at *openmargin might work on in the future.