HCRF和网络文本的精彩事件自动检测定位

doi:10.3969/j.issn.1001-2400.2015.04.014

J4 ›› 2015, Vol. 42 ›› Issue (4): 81-87.doi: 10.3969/j.issn.1001-2400.2015.04.014

HCRF和网络文本的精彩事件自动检测定位

同鸣;王硕;丁力伟;王纲

(西安电子科技大学电子工程学院，陕西西安 710071)

收稿日期:2014-04-15 出版日期:2015-08-20 发布日期:2015-10-12
通讯作者: 同鸣
作者简介:同鸣(1963-)，女，教授，博士，E-mail：mtong@xidian.edu.cn．
基金资助:
国家自然科学基金资助项目(61072110)；陕西省重点难题攻关资助项目(2013KTZB03-03-03)

Wonderful events automatic detection and location of the HCRF and webcast text

TONG Ming;WANG Shuo;DING Liwei;WANG Gang

(School of Electronic Engineering, Xidian Univ., Xi'an 710071, China)

Received:2014-04-15 Online:2015-08-20 Published:2015-10-12
Contact: TONG Ming

摘要/Abstract

摘要：

利用隐条件随机场(HCRF)在表达和识别语义事件方面的强大功能，并结合网络直播文本信息，提出了一种新的精彩事件自动检测框架．首先，通过对网络直播文本进行分析处理，获得每种精彩事件对应的关键词组合; 其次，对待检测的网络直播文本进行分类，获得每个精彩事件发生的时间标签;然后，构建用于提出的语义镜头标注的HCRF模型，实现多种语义镜头的同时标注，得到视频语义镜头标签序列; 最后，结合多模态语义线索，在小规模训练样本的情况下，有效建立了精彩事件检测与定位的HCRF模型．文中基于视频底层特征、多模态语义线索及精彩语义事件之间的映射关系，从结构语义的多个维度挖掘了精彩事件的内在规律，准确实现了精彩事件的自动检测、定位与分割．实验结果证明了该模型的有效性．

关键词: 视频语义分析, 事件检测, 网络文本, 隐条件随机场, 语义镜头标注

Abstract:

Based on the powerful function of the hidden conditional random fields (HCRF) model in the expression and identification of semantic events and combining the webcast text information, a new framework for wonderful events automatic detection is put forward. Firstly, by analyzing and processing the webcast text, keyword combinations corresponding to each exciting event are obtained. Secondly, by classifying the webcast text to be detected, the happening time labels of each wonderful event are obtained. Thirdly, an HCRF model for semantic shot annotation is built to realize the semantic annotation of multiple types of semantic shots simultaneously, and the semantic shot sequence of the video clip is obtained. Finally, combining the multi-modal semantic clues, an HCRF model for the wonderful events detection and localization is effectively built in the case of small-scale training samples. Based on the mapping relationship among video low-level features, the multi-modal semantic clues and the wonderful semantic events, the inherent patterns of the wonderful events are excavated deeply in the multiple dimensions of the semantic structure, and then the wonderful events automatic detection, localization and segmentation are precisely achieved. Experiments show the effectiveness of this model.

Key words: video semantic analysis, event detection, webcast text, hidden conditional random field (HCRF), semantic shots annotation

中图分类号:

TP391

同鸣;王硕;丁力伟;王纲 . HCRF和网络文本的精彩事件自动检测定位[J]. J4, 2015, 42(4): 81-87.

TONG Ming;WANG Shuo;DING Liwei;WANG Gang. Wonderful events automatic detection and location of the HCRF and webcast text[J]. J4, 2015, 42(4): 81-87.

参考文献

［1］ Kolekar M H. Bayesian Belief Network Based Broadcast Sports Video Indexing ［J］. Multimedia Tools and Applications, 2011, 54(1): 27-54.
［2］ Cheng H Y, Weng C C, Chen Y Y. Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks ［J］. IEEE Transactions on Image Processing, 2012, 21(4): 2152-2159.
［3］ Huang C L, Shih H C, Chao C Y. Semantic Analysis of Soccer Video Using Dynamic Bayesian Network ［J］. IEEE Transactions on Multimedia, 2006, 8(4): 749-760.
［4］ Murty M N, Devi V S. Hidden Markov Models ［M］. London: Springer, 2011: 103-122.
［5］张玉珍, 丁思捷, 王建宇, 等. 基于HMM的融合多模态的事件检测［J］. 系统仿真学报, 2012, 24(8): 1638-1642.
Zhang Yuzhen, Ding Sijie, Wang Jianyu, et al. Event Detection by Fusing Multimodal Objects Using HMM ［J］. Journal of System Simulation, 2012, 24(8): 1638-1642.
［6］李英, 田春娜, 颜建强, 等. 一种图像中的文字区域检测新方法［J］. 西安电子科技大学学报, 2013, 40(6): 187-192.
Li Ying, Tian Chunna, Yan Jianqiang, et al. New Technique for Text Region Location in Images ［J］. Journal of Xidian University, 2013, 40(6): 187-192.
［7］ Vilas N, Havin R. Entropy Features Trained Support Vector Machine Based Logo Detection Method for Replay Detection and Extraction from Sports Videos ［J］. International Journal of Graphics and Multimedia, 2013, 4(1): 20-30.
［8］ Delaye A, Liu C L. Contextual Text／Non-text Stroke Classification in Online Handwritten Notes with Conditional Random Fields ［J］. Pattern Recognition, 2014, 47(3): 959-968.
［9］ Shyu M L, Xie Z X, Chen M, et al. Video Semantic Event／Concept Detection Using a Subspace-based Multimedia Data Mining Framework ［J］. IEEE Transactions on Multimedia, 2008, 10(2): 252-259.
［10］ Tjondronegoro D W, Chen Y P P. Knowledge-discounted Event Detection in Sports Video ［J］. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 2010, 40(5): 1009-1024.
［11］ Xu C S, Wang J J, Lu H Q, et al. A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video ［J］. IEEE Transactions on Multimedia, 2008, 10(3): 421-436.
［12］ Zhao Y, Juang B H. Stranded Gaussian Mixture Hidden Markov Models for Robust Speech Recognition ［C］//Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. Piscataway: IEEE, 2012: 4301-4304.
［13］ Bargi A, Xu R Y D, Piccardi M. An Online HDP-HMM for Joint Action Segmentation and Classification in Motion Capture Data ［C］//IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Piscataway: IEEE, 2012: 1-7.
［14］ Van Urgen G J, Saatci Y, Teh Y W, et al. Beam Sampling for the Infinite Hidden Markov Model ［C］//Proceedings of the 25th International Conference on Machine Learning. New York: ACM, 2008: 1088-1095.
［15］同鸣, 丁力伟, 姬成龙. 融合HCRF和AAM的足球视频精彩事件检测［J］. 计算机研究与发展, 2014, 51(1): 225-236.
Tong Ming, Ding Liwei, Ji Chenglong. Fusion of HCRF and AAM Highlight Events Detection in Soccer Videos ［J］. Journal of Computer Research and Development, 2014, 51(1): 225-236.
［16］ Wang J J, Xu C S, Chng E, et al. Automatic Generation of Personalized Music Sports Video ［C］//Proceedings of the 13th ACM International Conference on Multimedia. New York: ACM, 2005: 735-744.
［17］ Xu C S, Wang J J, Wan K, et al. Live Sports Event Detection Based on Broadcast Video and Web-casting Text ［C］//Proceedings of the 14th Annual ACM International Conference on Multimedia. New York: ACM, 2006: 221-230.

HCRF和网络文本的精彩事件自动检测定位

Wonderful events automatic detection and location of the HCRF and webcast text

PDF (PC)

赞

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 1

Metrics

本文评价

推荐阅读 0