Методы маскирования искажений в видео потоке после сбоев в работе кодека
Диссертация
Объект исследования и актуальность темы. С развитием вычислительных мощностей компьютеров всё большее внимание уделяется цифровой обработке сигналов, особенно видео сигналов. С 1998 года, когда впервые было осуществлено вещание цифрового видео, данная область исследований начала бурно развиваться. Сейчас цифровое видео используется практически везде: оптические носители (CD, DVD, BluRay… Читать ещё >
Список литературы
- Д. Л. Куликов, Д. Ватолин. Оценка качества работы видео деко- деров стандарта MPEG-2 при работе в ненадежной среде передачи данных // Труды конференции Graphicon-2006. — Новосибирск, Академгородок: 2006. —1−4 Июля. — 367−370.
- К.И. Стрельников, Д. Л. Куликов, А. Лукин. Построение и применение модели зерна пленки на основе спектральных образцов // Труды конференции Graphicon-2007. — Москва, Россия: 2007. — 23−27 Июня. — 248−252.
- Dmitriy Kulikov. Spatio-Temporal Error Concealment Scheme Using Hybrid Algorithm with Postprocessing // Proceedings Graph-icon-2008. — Moscow: 2008. — June. — Pp. 106−110.
- Sergey Putilin, Dmitriy Kulikov. Low-Complexity Video Watermarking Using Mean Block Luminance Quantization // Proceedings Graph-icon-2008. — Moscow: 2008. — June. — P. 302.
- К. Стрельников, Д. Куликов. Система моделирования окружения управляемой камеры на основе анализа и обработки видеоданных // Программные продукты и системы. — 2008. — Т. 3. — 66−69.
- Д. Л. Куликов. Временной метод маскирования искажений в видео на основе обработки оптического потока // Програмные системы и инструменты. Тематический сборник. — 2008. — Т. 9. — 63−73.
- Д. Л. Куликов. Пространственно-временной алгоритм маскирования искажений в видео при ошибках передачи // Вестник компьютерных и информационных технологий. — 2009. — Т. 1. — 8−14.
- Д. Ватолин, А. Ратушняк, М. Смирнов, В. Юкин. Методы сжатия данных. Устройство архиваторов, сжатие изображений и видео. — Диалог-МИФИ, 2002.
- ITU-T Recommendation H.261, Video Codec for Audiovisual Services at px64 kbits, 1993. — Mar.
- ITU-T Draft Recommendation H.263, Video Coding for Low Bitrate Communication, 1997. — Dec.
- ISO/IEC DIS 13 818−2, Information Technology — Generic Coding of Moving Pictures and Associated Audio Information — Part 2: Video, 1994.
- Iain E. Richardson. H.264 and MPEG-4 Video Compression: Video Coding for Next Generation Multimedia. — 1 edition. — Wiley, 2003. — August.
- Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H.264/ISO/IEC 14 496−10 AVC). Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVTG050, 2003.
- T. Wiegand, G.J. Sullivan, G. Bjontegaard, A. Luthra. Overview of the H.264/AVC video coding standard // Circuits and Systems for Video Technology, IEEE Transactions on. — 2003. — July. — Vol. 13, no. 7. — Pp. 560−576.
- Э. Таненбаум. Компьютерные сети. — Питер, 2007.
- Д. Грис. Конструирование компиляторов для цифровых вычислительных машин, Под ред. Ю. М. Баяковского, В. Штаркмана. — Москва: Издательство «Мир», 1975.
- R. W. Conway, W. L. Maxwell. CORC — the Cornell computing language // CACM. — 1963. — June. — Vol. 6. — Pp. 317−321.
- R. W. Conway, W. L. Maxwell. PL/C. A high perfomance subset of PL/1. TR-70−55: Tech. rep.: Computer Science Dept, Cornell Univ, 1970.
- D. Freeman. Error correction in CORC: the Cornell computing language: Ph.D. thesis / Cornell Univ. — 1963.
- H. L. Morgan. Spelling correction in system programs // С ACM.— 1970.-Feb.-Vol. 1 3. — P p. 90−94.
- A. Albanese, J. Blomer, J. Edmonds et al. Priority encoding transmission // SFCS '94: Proceedings of the Proceedings 35th Annual Symposium on Foundations of Computer Science. — Washington, DC, USA:. IEEE Computer Society, 1994. — Pp. 604−612.
- H. Ohta, T. Kitami. A cell loss recovery method using FEC in ATM networks // IEEE Journal on Selected Areas in Communications. — Vol. 9. — 1991. — December. — Pp. 1471−1483.
- C. Perkins, O. Hodson, V. Hardman. A survey of packet loss recovery techniques for streaming audio // IEEE Network.— 1998.— Sep/Oct. — Vol. 12. — Pp. 40−48.
- O.J. Wasem, D.J. Goodman, С A. Dvorak, E.G. Page. The effect of waveform substitution on the quality of PCM packetcommunica-tions / / IEEE Transactions on Acoustics, Speech and Signal Process ing. — Vol. 36. — 1988. — Mar. — Pp. 342−348.
- P. Lauber, R. Sperschneider. Error Concealment for Compressed Digi tal Audio / / Proc. of the 111th AES Conv. — 2001. — Preprint 5460.
- S. Quackenbush, P.F. Driessen. Error Mitigation in MPEG-4 Audio Packet Communication Systems. / / Proc. of the 115th AES Conv.— 2003. —Preprint 5981.
- H. Ofir, D. Malah. Packet Loss Concealment for Audio Streaming Based on the GAPES Algorithm / / Proc. of the 118th AES Conv.— 2005. — Preprint 6334.
- Andreas Flows, Markos Avlonitis, Panayiotis Vlamos. Frequency-do main stochastic error concealment for wireless audio applications / / Mob. Netw. Appl. — 2008. — Vol. 13, no. 3−4. — Pp. 357−365.
- N. Ohta. Packet Video: Modeling and Signal Processing. — Artech House, 1994.
- Dean Sklar Charles Wang, Diana Johnson. Forward Error-Correc tion Coding / / The Aerospace Corporation magazine of advances in aerospace technology. — Winter 2001/2002. — Vol. 3, no. 1.
- S. Lin, Jr. D. J. Costello. Error Control Coding: Fundamentals and Applications, second edition. — Prentice Hall: Englewood Cliffs, NJ, 2004.
- Hong H. Yu. Error detection using data hiding for robust wireless multimedia communications // SPIE proceedings series / Ed. by M. Atiquz-zaman, M. Hassan. — Vol. 5245. — SPIE, 2003. — Pp. 35−45.
- К. M. Rose, A. Heiman. Enhancement of one-dimensional variable-length DPCM images corrupted by transmission errors // IEEE Trans. Commun. — 1989. — Vol. 37. — Pp. 372−379.
- Generic coding of moving pictures and associated audio information: Video. ISO/IEC ISO/IEC 13 818−2, 1996.
- S. Wenger, T. Stockhammer. An overview on the H.26L NAL concept. — 2002. — Feb.
- E Delp P Salama, N Shroff. Error Concealment in Encoded Video / / IEEE Journal on Selected Areas in Communications. — 2000. — 06. — Vol. 18, no. 6. — Pp. 1129−114.
- Q.F. Zhu, Y. Wang, L. Shaw. Coding and cell-loss recovery in DC- T-based packet video / / IEEE Trans. Cir. Syst. Video Technol, Spe cial Issue on Packet Video. — 1993. — June. — Vol. Vol. 3, no. 3. — Pp. 248−258.
- MM. Oliveira, B. Bowen, R. McKenna, Y.S. Chang. Fast digital im age inpainting / / Proc. International Conf. on Visualization, Imaging and Image Processing. — Marbella, Spain: 2001. — Pp. 261−266.
- M. Bertalmio, A. L. Bertozzi, G. Sapiro. Navier-Stokes, Fluid Dynam ics, and Image and Video Inpainting / / Proc. IEEE Computer Vision and Pattern Recognition (CVPR). — Hawaii: 2001. — December.
- W. Kwok, H. Sun. Multi-directional interpolation for spatial error con cealment / / Consumer Electronics, IEEE Transactions on. — 1993. — Vol. 39, no. 3. — Pp. 455−460.
- W. Zhu, Y. Wang. A comparison of smoothness measures for error concealment in transform coding / / Proc. SPIE Conf. Visual Commun. and Image Proc. — Taipei, Taiwan: 1995.
- Huifang Sun, Senior Member, Wilson Kwok. Concealment of Damaged Block Transform Coded Images Using Projections onto Convex Sets // IEEE Trans. Image Processing. — 1995. — Vol. 4. — Pp. 470−477.
- A. Criminisi, P. Perez, K. Toyama. Region filling and object removal by exemplar-based image inpainting // Image Processing, IEEE Transactions on. — 2004. — Vol. 13, no. 9. —Pp. 1200−1212.
- Lin Liang, Ce Liu, Ying-Qing Xu et al. Real-time texture synthesis by patch-based sampling // A CM Trans. Graph.— 2001. —July. — Vol. 20, no. 3. — Pp. 127−150.
- Andre Каир, Katrin Meisinger, Til Aach. Frequency selective signal extrapolation with applications to error concealment in image communication // Int. J. Electron. Commun.— 2005. —June.— Vol. 59.— Pp. 147−156.
- Alexei A. Efros, Thomas K. Leung. Texture Synthesis by Non-Parametric Sampling // ICCV '99: Proceedings of the International Conference on Computer Vision-Volume 2. — Washington, DC, USA: IEEE Computer Society, 1999. — P. 1033.
- S. S. Hemami, Т. H. Y. Meng. Transform coded image reconstruction exploiting interblock correlation // Image Processing, IEEE Transactions on. — 1995. — Vol. 4, no. 7. — Pp. 1023−1027.
- Iddo Drori, Daniel Cohen-Or, Hezy Yeshurun. Fragment-based image completion // A CM Trans. Graph. — 2003. — July. — Vol. 22, no. 3. — Pp. 303−312.
- M. Bertalmio, L. Vese, G. Sapiro, S. Osher. Simultaneous structure and texture image inpainting // Image Processing, IEEE Transactions on. — 2003. — Vol. 12, no. 8. — Pp. 882−889.
- S. D. Rane, G. Sapiro, M. Bertalmio. Structure and texture filling-in of missing image blocks in wireless transmission and compression applications // Image Processing, IEEE Transactions on. — 2003. — Vol. 12, no. 3 .—Pp. 296−303.
- Tanaphol Thaipanich, Wu, Jay Kuo. Low-Complexity Mobile Video Error Concealment Using OBMA. — 2007. — December.
- T. Thaipanich, Ping-Hao Wu, C. J. Kuo. Low-complexity video error concealment for mobile applications using OBMA // Consumer Electronics, IEEE Transactions on.— 2008.— Vol. 54, no. 2.— Pp. 753−761.
- Ajit S. Bopardikar, Odd I. Hillestad, Andrew Perkis. Temporal concealment of packet-loss related distortions in video based on Structural Alignment // In Proceedings of the Eurescom summit.— Heidelberg, Germany: 2005.— April.
- Tien-Ying Kuo, Sheng-Hui Li. Hybrid temporal-spatial error concealment technique for video communications // Multimedia and Expo, 2004. ICME '04. 2004 IEEE International Conference on. — Vol. 3. -2004.- Pp. 1743−1746 Vol.3.
- Y. Chen, Y. Ни, О. Au et al. Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation // Multimedia, IEEE Transactions on. — 2008. — Vol. 10, no. 1. — Pp. 2−15.
- М. Е. Al-Mualla, N. Canagarajah, D. R. Bull. Error concealment using motion field interpolation // Image Processing, 1998. ICIP 98. Proceedings. 1998 International Conference on. — 1998. — Pp. 512−516 vol.3.
- Che S. Chen, Mei J. Chen, Chin H. Huang, Shih С Sun. Motion Vector Based Error Concealment Algorithms // PCM '02: Proceedings of the Third IEEE Pacific Rim Conference on Multimedia. — London, UK: Springer-Verlag, 2002. — Pp. 425−433.
- Suh J- W, Ho Y-S. Error Concealment Based on Motion Vector Recovery Using Optical Flow Fields // IEICE Trans Commun. — 2003. — April.-Vol. Vol. L. E86-B, no. No. 4. — P p. 1383−1390.
- Jae-Won Suh, Yo-Sung Ho. Motion vector recovery using optical flow // Consumer Electronics, 2000. ICCE. 2000 Digest of Technical Papers. International Conference on. — 2000. — Pp. 234−235.
- M. Bertalmio, G. Sapiro, V. Caselles, Ballester C. Image Inpainting // Proceedings SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series / Ed. by K. Akeley. — Reading, MA: Addison-Wesley, 2000. — Pp. 417−424.
- Luminita A. Vese, Stanley J. Osheri. Modeling textures with total variation minimization and oscillating patterns in image processing // Journal of Scientific Computing. — 2003. — Vol. 19. — Pp. 553−572.
- Leonid I. Rudin, Stanley Osher, Emad Fatemi Nonlinear total varia tion based noise removal algorithms / / Phys. D. — 1992. — Vol. 60, no. 1−4. — Pp. 259−268.
- Yves Meyer. Oscillating Patterns in Image Processing and Nonlinear Evolution Equations. — ser. AMS Univ. Lecture Series, 2002. — Vol. 22.
- K. Karu, A. K. Jain, R. M. Bolle. Is there any texture in the image? / / Pattern Recognition, 1996., Proceedings of the 13th International Con ference on. — Vol. 2. — 1996. — Pp. 770−774 vol.2.
- David J. Heeger, James R. Bergen. Pyramid-based texture analy sis/synthesis / / SIGGRAPH '95: Proceedings of the 22nd annual con ference on Computer graphics and interactive techniques. — New York, NY, USA: ACM, 1995. — Pp. 229−238.
- E.P. Simoncelli, J. Portilla. Texture Characterization via Joint Statis tics of Wavelet Coefficient Magnitudes. — 1998. — Pp. I: 62−66.
- C. Ballester, M. Bertalmio, V. Caselles et al. Filling-in by joint in terpolation of vector fields and gray levels / / Image Processing, IEEE Transactions on.— 2001. —Vol. 10, no. 8. — Pp. 1200−1211.
- T. Chan, J. Shen. Local inpainting models and TV inpainting / / SIAM J. Appl. Math. — 2001. — Vol. 62:3.—Pp. 1019−1043.
- J. M. Ogden, E. H. Adelson, J. R. Bergen, P. J. Burt. Pyramid-based computer graphics / / RCA Engineer. — 1985. — Vol. 30, no. 5. — Pp. 4−15.
- G. Davis, S. Mallat, M. Avellaneda. Adaptive greedy approximations // Constructive Approximation.— 1997.— March. — Vol. 13, no. l. — P p. 57−98.
- Joel A. Tropp. Greed is good: Algorithmic results for sparse approximation // IEEE Trans. Inform. Theory.— 2004.— Vol. 50.— Pp. 2231−2242.
- Allen Gersho, Robert M. Gray. Vector quantization and signal compression. — Norwell, MA, USA: Kluwer Academic Publishers, 1991.
- Timothy, Chang Rong-Chi. Super-resolution inpainting // Journal of Zhejiang University — Science A.— 2005. —June. — Vol. 6, no. 6.— Pp. 487−491.
- S. Shirani, F. Kossentini, R. Ward. A concealment method for video communications in an error-prone environment // Selected Areas in Communications, IEEE Journal on. — 2000. — Vol. 18, no. 6. — Pp. 1122−1128.
- Плагин для Photoshop от компании Akvis. Интернет-ресурс: http://akvis.com/en/retoucher/index.php.
- J. Zhang, J. F. Arnold, M. R. Frater. A cell-loss concealment technique for MPEG-2 coded video // Circuits and Systems for Video Technology, IEEE Transactions on. — 2000. — Vol. 10, no. 4. — Pp. 659−665.
- Проект FPmpeg. Интернет-ресурс: http://ffmpeg.mplayerhq.hu/.
- В. D. Lucas, Т. Kanade. An Iterative Image Registration Technique with an Application to Stereo Vision // IJCAI81. — 1981. — Pp. 674−679.
- R. Duda, P.E. Hart, D.G. Stork. Pattern Classification.— 2nd edition. — Wiley-Interscience, 2001.
- S. Simonyan, K. Grishin, D. Vatolin. Confidence Measure for Block- -Based Motion Vector Field // Proc. Graphicon-2008. — Moscow: 2008.-June.-Pp. 110−113.
- Jinghong Zheng, Lap-Pui Chau. A motion vector recovery algorithm for digital video using Lagrange interpolation // Broadcasting, IEEE Transactions on. — 2003. — Vol. 49, no. 4. — Pp. 383−389.
- Donghyung Kim, Sanghyup Cho, Jechang Jeong. A Motion Vector Recovery Algorithm for Temporal Error Concealment using Optical Flow in H.264 Video Coding // Multimedia and Expo, 2006 IEEE International Conference on. — 2006. — Pp. 1713−1716.
- Библиотека Open Computer Vision Library. Интернет-ресурс: http://sourceforge.net/projects/opencvlibrary/.
- ITU-T ВТ 500.11. — Methodology for the subjective assessment of the quality of television pictures., 2002.
- VQEG. — Final report from the VQEG on the validation of objective models of video quality assessment., 2000.
- ITU-T J.149.— Method for specifying accuracy and cross-calibration of Video Quality Metrics (VQM).
- Steinmann V. Sunna P. Wyckens E Kozamernik, F. SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multime dia / / SMPTE motion imaging journal— 2005.— Vol. 114, no. 4.— Pp. 152−160.
- EBU-UER BNP 056: SAMVIQ — Subjective Assessment Methodology for Video Quality.
- Marcus J. Nadenau, David Alleysson, Murat Kunt. Human Vision Models for Perceptually Optimized Image Processing—A Review, / / submitted to Proc. of the IEEE. — 2000. — September.
- Zhou Wang, Alan C. Bovik, L. Lu. Why is image quality assessment so difficult? / / Proc. IEEE Int. Conf. Acoust., Speech, and Signal Pro cessing. — Vol. 4. — Orlando, FL: 2002. — May. — Pp. 3313−3316.
- Bernd Girod. What’s wrong with mean-squared error? / / Digital im ages and human vision. — 1993. — Pp. 207−220.
- Zhou Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli. Image qual ity assessment: from error visibility to structural similarity / / Im age Processing, IEEE Transactions on.— 2004.— Vol. 13, no. 4.— Pp. 600−612.
- М. Н. Pinson, S. Wolf. A new standardized method for objectively measuring video quality // IEEE Transactions on broadcasting. — 2004. — September. — Vol. 50, no. 3. — Pp. 312−322.
- P. Marziliano, F. Dufaux, S. Winkler, T. Ebrahimi. Perceptual blur and ringing metrics: application to JPEG2000 // Signal Processing: Image Communication.— 2004. — February. — Vol. 19, no. 2.— Pp. 163−172.
- J. Mannos, D. Sakrison. The effects of a visual fidelity criterion of the encoding of images // Information Theory, IEEE Transactions on. — 1974.- Vol. 20, no. 4. — Pp. 525−536.
- H. Rushmeier, G. Ward, C. Piatko et al. Comparing Real and Synthetic Images: Some Ideas About Metrics // Sixth Eurographics Workshop on Rendering. — Dublin, Ireland: 1995. — Pp. 82−91.
- Ajeetkumar Gaddipatti, Raghu Machiraju, Roni Yagel. Steering Image Generation with Wavelet Based Perceptual Metric // Computer Graph-ics Forum (Eurographics). — 1997. — September. — Vol. Volume 16, no. Number 3 Conference. — Pp. 241−251(11).
- Gaurav Sharma, Wencheng Wu, Edul N. Dalai. The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations // Color Research & Application. — 2004. — February. — Vol. 30, no. 1. — Pp. 21−30.
- M. R. Luo, G. Сиг, B. Rigg. The development of the CIE 2000 colour-difference formula: CIEDE2000 // Color Research & Application.— 2001.- Vol. 26, no. 5. — Pp. 340−350.
- Система автоматической оценки качества видео/изображений MSU Video Quality Measurement Tool. Интернет-ресурс: http://www.compression.ru/video/ quali-ty_measure/video_measurement_tool_en.html.