EFFECTIVE AND EFFICIENT QUERY PROCESSING FOR VIDEO SUBSEQUENCE IDENTIFICATION

BY MADHUKAR REDDY RAHUL P

08911A0516 08911A0532

PROJECT IN CHARGE-MR M.RAVI(HOD ,CSE)

Objective
o To find a generic database management solution towards effectively and efficiently searching similar videos, with tolerance to different variations introduced during not only transformation process but post-production editing. o To retrieve similar frames from two videos

Why do we need this?

o To aid Recognition for Copyright Enforcement o TV Commercial Detection o Aid Investigating Agencies o Aid Film Certification Board

Introduction
o Rapid advances in multimedia and network technologies have popularized many applications using video databases o A video sequence is an ordered set of a large number of frames o Each frame is represented as a highdimensional vector

How the existing system works?

o Content Based Video Retrieval o We need to check manually whether a video is a part of a long stream by browsing its entire length o Identification cannot be done in case of any editing in the video o Time taking

Features of Proposed System

o Subsequence based video retrieval o Any subsequence of a long database video that shares a similar content to a query clip is retrieved o Relevant videos can be identified even if there exist transformation distortions, partial content reordering ,insertion, deletion or replacement o Time efficient

Preferred Technologies
o o o o Windows XP Operating System JDK 6.0 Java Media Framework Edit Plus

Modules
o Video Copy Detection
o o o o o

Sliding of query video frame by frame on database video with a fixed length window Globe signatures have been used to avoid distortions while video transformations Video is depicted globally Applicable for queries with multiple shots Detects videos of same temporal order and length

o Video Similarity Search

o o o o o

Shortcomings of the former module are rectified Sub sampled frame-based matching is done Average inter frame similarity is taken into consideration Frame alignment, gap, noise for accurate identification are also considered Scores of different factors are aggregated to derive the most similar subsequence based on overall video similarity

Feasibility Study
o o o o Is it worth doing ? Technical Feasibility Operational Feasibility Economic Feasibility

Software Requirement Specification

o Spiral Model o Different stages of SDLC Why Spiral Model? o Estimates become realistic o Easy to cope with changes

Functional Requirements
o Input Video o Database Video o Conversion of Input Video into frames o Conversion of Output Video into frames o Subsequence Identification o Frames matching o Show the duplicate frames from the input video

Data Flow

Use Case Diagram

Select Input Video

Select Database Video

Convert Both Video into No.of Frames

User Sub sequence identification

Shows the sub sequence frames

Sequence Diagram
User Input Database Frames sub sequence Duplicates 1 : input video() 2 : convert to frames()

3 : DB video() 4 : convert to frames()

5 : both frames()

6 : compare() 7 : duplicate frames()

Collaboration Diagram
Duplicates 7 : duplicate frames() 6 : compare() sub sequence 5 : both frames() 4 : convert to frames() Frames

Database 2 : convert to frames()

3 : DB video()

1 : input video() User

Input

Class Diagram

Activity Diagram
Select Input Video Select DB Video

Convert to Frames

Sub sequence identification

Show duplicate frames

Testing
o Correctness, completeness, security and quality are achieved o Manual testing
Unit testing System Testing Acceptance Testing Regression Testing

o Operation testing is done by testing whether all components perform its intended operations

Implementation
o Java Swings o JLabels, JFrames, JTextArea,JList,JFileChooser o Inherited from JComponent class o Pluggable look and feel o Javax.swing package

Snapshots

Future Enhancements
Improvement of Video clarity o Elimination of distortions o Investigate the effect of representing videos by other features, such as ordinal signature o The weight of each factor for measuring video similarity might be adjusted by user feedback to embody the degree of similarity
o

Conclusion
o Similar frames are retrieved by algorithms o Bipartite graph is constructed o Dense segments are chosen o Irrelevant segments are pruned o Relevant segments are processed

Bibliography
o

A.W.M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, Content-Based Image Retrieval at the End of the Early Years, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 12,pp. 1349-1380, Dec. 2000. C. Faloutsos, M. Ranganathan, and Y. Manolopoulos, Fast Subsequence Matching in Time-Series Databases, Proc. ACM SIGMOD 94, pp. 419-429, 1994. H. Wang, A. Divakaran, A. Vetro, S.-F. Chang, and H. Sun, Survey of Compressed-Domain Features Used in Audio-Visual Indexing and Analysis, J. Visual Comm. and Image Representation, vol. 14, no. 2, pp. 150-183, 2003. R. Mohan, Video Sequence Matching, Proc. IEEE Intl Conf. Acoustics, Speech, and Signal Processing (ICASSP 98), pp. 36973700, 1998. C. Kim and B. Vasudev, Spatiotemporal Sequence Matching for Efficient Video Copy Detection, IEEE Trans. Circuits and Systems for Video Technology, vol. 15, no. 1, pp. 127-132, 2005. X.-S. Hua, X. Chen, and H. Zhang, Robust Video Signature Based on Ordinal Measure, Proc. IEEE Intl Conf. Image Processing (ICIP 04), pp. 685-688, 2004.

Thank you!