An Accurate Scene Segmentation Method Based on Graph Analysis Using Object Matching and Audio Feature
スポンサーリンク
概要
- 論文の詳細を見る
A method for accurate scene segmentation using two kinds of directed graph obtained by object matching and audio features is proposed. Generally, in audiovisual materials, such as broadcast programs and movies, there are repeated appearances of similar shots that include frames of the same background, object or place, and such shots are included in a single scene. Many scene segmentation methods based on this idea have been proposed; however, since they use color information as visual features, they cannot provide accurate scene segmentation results if the color features change in different shots for which frames include the same object due to camera operations such as zooming and panning. In order to solve this problem, scene segmentation by the proposed method is realized by using two novel approaches. In the first approach, object matching is performed between two frames that are each included in different shots. By using these matching results, repeated appearances of shots for which frames include the same object can be successfully found and represented as a directed graph. The proposed method also generates another directed graph that represents the repeated appearances of shots with similar audio features in the second approach. By combined use of these two directed graphs, degradation of scene segmentation accuracy, which results from using only one kind of graph, can be avoided in the proposed method and thereby accurate scene segmentation can be realized. Experimental results performed by applying the proposed method to actual broadcast programs are shown to verify the effectiveness of the proposed method.
論文 | ランダム
- 移動方向の異なる呼におけるDS-CDMA方式の上りリンク容量に関する検討
- ギター運指解析および日本舞踊を事例としたMotion Capture適用に関する検討
- A-20-12 かな文のIT支援によるナビゲーションシステムについての一検討(A-20.スマートインフォメディアシステム,一般講演)
- 8-336 サレジオ高専プロジェクト教育 その3 : Imagine_Cup世界大会を目指した東京高専との競争・連携取組(口頭発表論文,(6)工学教育の個性化・活性化-XI)
- D-15-19 狂言を事例とした所作を伴う芸術分野の実時間遠隔教育システムの構想(D-15.教育工学,一般講演)