CDVT: A Cluster-Based Distributed Video Transcoding Scheme for Mobile Stream Services

Cheng Xu, Wei Ren, Daxi Tu, Linchen Yu, Tianqing Zhu, Yi Ren

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Distributed video transcoding has been used to huge video data storage overhead and reduce transcoding delay caused by the rapid development of mobile video services. Distributed transcoding can leverage the computing power of clusters for various user requests and diverse video processing demands. However, it imposes a remaining challenge on how to efficiently utilize the computing power of the cluster as well as achieve optimized performance through reasonable system parameters and video processing configurations. In this paper, we design a Cluster-based Distributed Video Transcoding System called CDVT using Hadoop, FFmpeg, and Mkvmerge to achieve on-demand video splitting, on-demand transcoding, and distributed processing, which can be applied to large scale video sharing over mobile devices. In order to further optimize system performance, we conducted extensive experiments on various data sets to find relevant factors that affect transcoding efficiency. We dynamically reconfigure the cluster and evaluate the impacts of different intermediate tasks, splitting strategies, and memory configuration strategies on system performance. Experimental results obtained under various workloads demonstrate that the proposed system can ensure the quality of transcoding tasks while reducing the time cost by up to 50%.

Original languageEnglish
Title of host publicationWireless Algorithms, Systems, and Applications - 16th International Conference, WASA 2021, Proceedings
EditorsZhe Liu, Fan Wu, Sajal K. Das
PublisherSpringer Science and Business Media Deutschland GmbH
Pages608-628
Number of pages21
ISBN (Print)9783030859275
DOIs
Publication statusPublished - 2 Sep 2021
Event16th International Conference on Wireless Algorithms, Systems, and Applications, WASA 2021 - Nanjing, China
Duration: 25 Jun 202127 Jun 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12937 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Conference on Wireless Algorithms, Systems, and Applications, WASA 2021
CountryChina
CityNanjing
Period25/06/2127/06/21

Keywords

  • Distributed transcoding
  • FFmpeg
  • Hadoop
  • Video processing

Cite this