 |
The next step is Extending Metadata with Contextual Data.
Object frequencies and scripts extracted from videos have the characteristics of time series data.
Object frequencies are expressed as the number and type of objects observed in each frame.
Scripts appear across multiple frames and are generated as contextual data from the frame where the dialog starts.
The object frequencies and scripts are then synchronized.
When dividing the context data into scenes, we do so based on scripts.
We use iterative experiments to divide the scripts into appropriately sized sentences or paragraphs, as too small a division would clutter the data, too large a division would distort the features.
|
IEEE/ICACT20240357 Slide.16
[Big Slide]