A Database Model for Querying Visual Surveillance Videos by Integrating Semantic and Low-Level Features

  • Ediz Şaykol
  • Uğur Güdükbay
  • Özgür Ulusoy
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3665)


Automated visual surveillance has emerged as a trendy application domain in recent years. Many approaches have been developed on video processing and understanding. Content-based access to surveillance video has become a challenging research area. The results of a considerable amount of work dealing with automated access to visual surveillance have appeared in the literature. However, the event models and the content-based querying and retrieval components have significant gaps remaining unfilled. To narrow these gaps, we propose a database model for querying surveillance videos by integrating semantic and low-level features. In this paper, the initial design of the database model, the query types, and the specifications of its query language are presented.


Surveillance Video Salient Object Video Object Database Model Video Shot 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Stringa, E., Regazzoni, C.: Real-time video-shot detection for scene surveillance applications. IEEE Trans. on Image Processing 9, 69–79 (2000)CrossRefGoogle Scholar
  2. 2.
    Foresti, G., Marcenaro, L., Regazzoni, C.: Automatic detection and indexing of video-event shots for surveillance applications. IEEE Trans. on Multimedia 4, 459–471 (2002)CrossRefGoogle Scholar
  3. 3.
    Collins, R., Lipton, A., Kanade, T., Fujiyoshi, H., Duggins, D., Tsin, Y., Tolliver, D., Enomoto, N., Hasegawa, O., Burt, P., Wixson, L.: A system for video surveillance and monitoring. Technical Report CMU-RI-TR-00-12, Carnegie Mellon University, The Robotics Institute (2000)Google Scholar
  4. 4.
    Brodsky, T., Cohen, R., Cohen-Solal, E., Gutta, S., Lyons, D., Philomin, V., Trajkovic, M.: Visual surveillance in retail stores and in the home. In: Video-Based Surveillance Systems: Computer Vision and Distributed Processing, pp. 51–65. Kluwer Academic Pub., Dordrecht (2001)Google Scholar
  5. 5.
    Latecki, L., Wen, X., Ghubade, N.: Detection of changes in surveillance videos. In: IEEE Conf. on Adv. Video and Signal Based Surv. (AVSS 2003), pp. 237–242 (2003)Google Scholar
  6. 6.
    Stefano, L.D., Mattoccia, S., Mola, M.: A change-detection algorithm based on structure and colour. In: IEEE Conf. on Adv. Video and Signal Based Surv (AVSS 2003), pp. 252–259 (2003)Google Scholar
  7. 7.
    Töreyin, B., Çetin, A., Aksay, A., Akhan, M.: Moving object detection in wavelet compressed video. Signal Processing: Image Communication 20, 255–264 (2005)CrossRefGoogle Scholar
  8. 8.
    Jung, Y., Lee, K., Ho, Y.: Content-based event retrieval using semantic scene interpretation for automated traffic surveillance. IEEE Trans. on Intelligent Transportation Systems 2, 151–163 (2001)CrossRefGoogle Scholar
  9. 9.
    Eaton, R., Scassellati, B.: ViSIT: Visual surveillance and interaction tracking, (Social Robotics Laboratory, Yale University, accessed at February 27, 2005)
  10. 10.
    Stringa, E., Regazzoni, C.: Content-based retrieval and real time detection from video sequences acquired by surveillance systems. In: Int. Conf. on Image Processing, pp. 138–142 (1998)Google Scholar
  11. 11.
    Regazzoni, C., Sacchi, C., Stringa, E.: Remote detection of abandoned objects in unattended railway stations by using a DS/CDMA video surveillance system. In: Regazzoni, C., Fabri, G., Vernezza, G. (eds.) Advanced Video-Based Surveillance System, pp. 165–178. Kluwer, Boston (1998)Google Scholar
  12. 12.
    Kim, C., Hwang, J.: Fast and automatic video object segmentation and tracking for content-based applications. IEEE Trans. on Circuits and Systems for Video Technology 12, 122–129 (2002)CrossRefGoogle Scholar
  13. 13.
    Kim, C., Hwang, J.: Object-based video abstraction for video surveillance systems. IEEE Trans. on Circuits and Systems for Video Technology 12, 1128–1138 (2002)CrossRefGoogle Scholar
  14. 14.
    Canny, J.: A computational approach to edge detection. IEEE Trans. on Pattern Analysis and Machine Intelligence 8, 679–698 (1986)CrossRefGoogle Scholar
  15. 15.
    Lyons, D., Brodsky, T., Cohen-Solal, E., Elgammal, A.: Video content analysis for surveillance applications. In: Philips Digital Video Technologies Workshop (2000)Google Scholar
  16. 16.
    Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. In: Int. Conf. on Computer Vision and Pattern Recognition, Workshop on Motion (1999)Google Scholar
  17. 17.
    Haritaoğlu, İ., Harwood, D., Davis, L.: W4: Real-time surveillance of people and their activities. IEEE Trans. on Pattern Analysis and Machine Intelligence 22, 809–830 (2000)CrossRefGoogle Scholar
  18. 18.
    Swain, M., Ballard, D.: Color indexing. Int. J. of Comp. Vis. 7, 11–32 (1991)CrossRefGoogle Scholar
  19. 19.
    Şaykol, E., Sinop, A., Güdükbay, U., Ulusoy, Ö., Çetin, E.: Content-based retrieval of historical Ottoman documents stored as textual images. IEEE Trans. on Image Processing 13, 314–325 (2004)CrossRefGoogle Scholar
  20. 20.
    Dedeoğlu, Y.: Moving object detection, tracking and classification for smart video surveillance. Technical Report BU-CE-0412, Bilkent University, Dept. of Computer Eng. (2004),
  21. 21.
    Dönderler, M., Şaykol, E., Arslan, U., Ulusoy, Ö., Güdükbay, U.: BilVideo: Design and implementation of a video database management system. Multimedia Tools and Applications (accepted for publication) (2005)Google Scholar
  22. 22.
    Dönderler, M., Ulusoy, Ö., Güdükbay, U.: Rule-based spatio-temporal query processing for video databases. The VLDB Journal 13, 86–103 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Ediz Şaykol
    • 1
  • Uğur Güdükbay
    • 1
  • Özgür Ulusoy
    • 1
  1. 1.Department of Computer EngineeringBilkent UniversityBilkent, AnkaraTurkey

Personalised recommendations