Forword. Preface. About the Authors. About the Series Editors. 1 Introduction. 1.1 Why 4G? 1.2 4G Status and Key Technologies. 1.2.1 3GPP LTE. 1.2.2 Mobile WiMAX. 1.3 Video Over Wireless. 1.3.1 Video Compression Basics. 1.3.2 Video Coding Standards. 1.3.3 Error Resilience. 1.3.4 Network Integration. 1.3.5 Cross-Layer Design for Wireless Video Delivery. 1.4 Challenges and Opportunities for 4G Wireless Video. References. 2 Wireless Communications and Networking. 2.1 Characteristics and Modeling of Wireless Channels. 2.1.1 Degradation in Radio Propagation. 2.1.2 Rayleigh Fading Channel. 2.2 Adaptive Modulation and Coding. 2.2.1 Basics of Modulation Schemes. 2.2.2 System Model of AMC. 2.2.3 Channel Quality Estimation and Prediction. 2.2.4 Modulation and Coding Parameter Adaptation. 2.2.5 Estimation Error and Delay in AMC . 2.2.6 Selection of Adaptation Interval. 2.3 Orthogonal Frequency Division Multiplexing. 2.3.1 Background. 2.3.2 System Model and Implementation. 2.3.3 Pros and Cons. 2.4 Multiple-Input Multiple-Output Systems. 2.4.1 MIMO System Model. 2.4.2 MIMO Capacity Gain: Multiplexing. 2.4.3 MIMO Diversity Gain: Beamforming. 2.4.4 Diversity-Multiplexing Trade-offs. 2.4.5 Space-Time Coding. 2.5 Cross-Layer Design of AMC and HARQ. 2.5.1 Background. 2.5.2 System Modeling. 2.5.3 Cross-Layer Design. 2.5.4 Performance Analysis. 2.5.5 Performance. 2.6 Wireless Networking. 2.6.1 Layering Network Architectures. 2.6.2 Network Service Models. 2.6.3 Multiplexing Methods. 2.6.4 Connection Management in IP-Based Data Networks. 2.6.5 QoS Handoff. 2.7 Summary. References. 3 Video Coding and Communications. 3.1 Digital Video Compression - Why and How Much? 3.2 Basics. 3.2.1 Video Formats. 184.108.40.206 Scanning. 220.127.116.11 Color. 18.104.22.168 Luminance, Luma, Chrominance, Chroma. 3.3 Information Theory. 3.3.1 Entropy and Mutual Information. 3.3.2 Encoding of an Information Source. 3.3.3 Variable Length Coding. 3.3.4 Quantization. 3.4 Encoder Architectures. 3.4.1 DPCM . 3.4.2 Hybrid Transform-DPCM Architecture. 3.4.3 A Typical Hybrid Transform DPCM-based Video Codec. 3.4.4 Motion Compensation. 3.4.5 DCT and Quantization. 3.4.6 Procedures Performed at the Decoder. 3.5 Wavelet-Based Video Compression. 3.5.1 Motion-Compensated Temporal Wavelet Transform Using Lifting. References. 4 4G Wireless Communications and Networking. 4.1 IMT-Advanced and 4G. 4.2 LTE. 4.2.1 Introduction. 4.2.2 Protocol Architecture. 22.214.171.124 E-UTRAN Overview Architecture. 126.96.36.199 User Plane and Control Plane. 188.8.131.52 LTE Physical Layer. 4.2.3 LTE Layer 2. 4.2.4 The Evolution of Architecture. 4.2.5 LTE Standardization. 4.3 WIMAX-IEEE 802.16m. 4.3.1 Network Architecture. 4.3.2 System Reference Model. 4.3.3 Protocol Structure. 184.108.40.206 MAC Layer. 220.127.116.11 PHY Layer. 4.3.4 Other Functions Supported by IEEE 802.16m for Further Study. 4.4 3GPP2 UMB. 4.4.1 Architecture Reference Model. 4.4.2 Layering Architecture and Protocols. Acknowledgements. References. 5 Advanced Video Coding (AVC)/H.264 Standard. 5.1 Digital Video Compression Standards. 5.2 AVC/H.264 Coding Algorithm. 5.2.1 Temporal Prediction. 18.104.22.168 Motion Estimation. 22.214.171.124 P and B MBs. 126.96.36.199 Multiple References. 188.8.131.52 Motion Estimation Accuracy. 184.108.40.206 Weighted Prediction. 220.127.116.11 Frame and Field MV. 18.104.22.168 MV Compression. 5.2.2 Spatial Prediction. 5.2.3 The Transform. 22.214.171.124 4 x 4 Integer DCT and Inverse Integer DCT Transform. 126.96.36.199 8 x 8 Transform. 188.8.131.52 Hadamard Transform for DC. 5.2.4 Quantization and Scaling. 5.2.5 Scanning. 5.2.6 Variable Length Lossless Codecs. 184.108.40.206 Exp-Golomb Code. 220.127.116.11 CAVLC (Context Adaptive VLC). 18.104.22.168 CABAC . 5.2.7 Deblocking Filter. 5.2.8 Hierarchy in the Coded Video. 22.214.171.124 Basic Picture Types (I, P, B, B R ). 126.96.36.199 SP and SI Pictures. 5.2.9 Buffers. 5.2.10 Encapsulation/Packetization. 5.2.11 Profiles. 188.8.131.52 Baseline Profile . 184.108.40.206 Extended Profile. 220.127.116.11 Main Profile. 18.104.22.168 High Profile. 22.214.171.124 High10 Profile. 126.96.36.199 High 4:2:2 Profile. 188.8.131.52 High 4:4:4 Predictive Profile. 184.108.40.206 Intra Only Profiles. 5.2.12 Levels. 220.127.116.11 Maximum Bit Rates, Picture Sizes and Frame Rates. 18.104.22.168 Maximum CPB, DPB and Reference Frames. 5.2.13 Parameter Sets. 22.214.171.124 Sequence Parameter Sets (SPS). 126.96.36.199 Picture Parameter Sets (PPS). 5.2.14 Supplemental Enhancement Information (SEI). 5.2.15 Subjective Tests. References. 6 Content Analysis for Communications. 6.1 Introduction. 6.2 Content Analysis. 6.2.1 Low-Level Feature Extraction. 188.8.131.52 Edge. 184.108.40.206 Shape. 220.127.116.11 Color. 18.104.22.168 Texture. 22.214.171.124 Motion. 126.96.36.199 Mathematical Morphology. 6.2.2 Image Segmentation. 188.8.131.52 Threshold and Boundary Based Segmentation. 184.108.40.206 Clustering Based Segmentation. 220.127.116.11 Region Based Approach. 18.104.22.168 Adaptive Perceptual Color-Texture Segmentation. 6.2.3 Video Object Segmentation. 22.214.171.124 COST211 Analysis Model. 126.96.36.199 Spatial-Temporal Segmentation. 188.8.131.52 Moving Object Tracking. 184.108.40.206 Head-and-Shoulder Object Segmentation. 6.2.4 Video Structure Understanding. 220.127.116.11 Video Abstraction. 18.104.22.168 Video Summary Extraction. 6.2.5 Analysis Methods in Compressed Domain. 6.3 Content-Based Video Representation. 6.4 Content-Based Video Coding and Communications. 6.4.1 Object-Based Video Coding. 6.4.2 Error Resilience for Object-Based Video. 6.5 Content Description and Management. 6.5.1 MPEG-7. 6.5.2 MPEG-21. References. 7 Video Error Resilience and Error Concealment. 7.1 Introduction. 7.2 Error Resilience. 7.2.1 Resynchronization Markers. 7.2.2 Reversible Variable Length Coding (RVLC). 7.2.3 Error-Resilient Entropy Coding (EREC). 7.2.4 Independent Segment Decoding. 7.2.5 Insertion of Intra Blocks or Frames. 7.2.6 Scalable Coding. 7.2.7 Multiple Description Coding. 7.3 Channel Coding. 7.4 Error Concealment. 7.4.1 Intra Error Concealment Techniques 7.4.2 Inter Error Concealment Techniques. 7.5 Error Resilience Features of H.264/AVC. 7.5.1 Picture Segmentation. 7.5.2 Intra Placement. 7.5.3 Reference Picture Selection. 7.5.4 Data Partitioning. 7.5.5 Parameter Sets. 7.5.6 Flexible Macroblock Ordering. 7.5.7 Redundant Slices (RSs). References. 8 Cross-Layer Optimized Video Delivery over 4G Wireless Networks. 8.1 Why Cross-Layer Design? 8.2 Quality-Driven Cross-Layer Framework. 8.3 Application Layer. 8.4 Rate Control at the Transport Layer. 8.4.1 Background. 8.4.2 System Model. 8.4.3 Network Setting. 8.4.4 Problem Formulation. 8.4.5 Problem Solution. 8.4.6 Performance Evaluation. 8.5 Routing at the Network Layer. 8.5.1 Background. 8.5.2 System Model. 8.5.3 Routing Metric. 8.5.4 Problem Formulation. 8.5.5 Problem Solution. 8.5.6 Implementation Considerations. 8.5.7 Performance Evaluation. 8.6 Content-Aware Real-Time Video Streaming. 8.6.1 Background. 8.6.2 Background. 8.6.3 Problem Formulation. 8.6.4 Routing Based on Priority Queuing. 8.6.5 Problem Solution. 8.6.6 Performance Evaluation. 8.7 Cross-Layer Optimization for Video Summary Transmission. 8.7.1 Background. 8.7.2 Problem Formulation. 8.7.3 System Model. 8.7.4 Link Adaptation for Good Content Coverage. 8.7.5 Problem Solution. 8.7.6 Performance Evaluation. 8.8 Conclusions. References. 9 Content-based Video Communications. 9.1 Network-Adaptive Video Object Encoding. 9.2 Joint Source Coding and Unequal Error Protection. 9.2.1 Problem Formulation. 22.214.171.124 System Model. 126.96.36.199 Channel Model. 188.8.131.52 Expected Distortion. 184.108.40.206 Optimization Formulation. 9.2.2 Solution and Implementation Details. 220.127.116.11 Packetization and Error Concealment. 18.104.22.168 Expected Distortion. 22.214.171.124 Optimal Solution. 9.2.3 Application on Energy-Efficient Wireless Network. 126.96.36.199 Channel Model. 188.8.131.52 Experimental Results. 9.2.4 Application on Differentiated Services Networks. 9.3 Joint Source-Channel Coding with Utilization of Data Hiding. 9.3.1 Hiding Shape in Texture. 9.3.2 Joint Source-Channel Coding. 9.3.3 Joint Source-Channel Coding and Data Hiding. 184.108.40.206 System Model. 220.127.116.11 Channel Model. 18.104.22.168 Expected Distortion. 22.214.171.124 Implementation Details. 9.3.4 Experimental Results. References. 10 AVC/H.264 Application - Digital TV. 10.1 Introduction. 10.1.1 Encoder Flexibility. 10.2 Random Access. 10.2.1 GOP Bazaar. 10.2.1.1 MPEG-2 Like, 2B, GOP Structure. 10.2.1.2 Reference B and Hierarchical GOP structures. 10.2.1.3 Low Delay Structure. 10.2.1.4 Editable Structure. 10.2.1.5 Others. 10.2.2 Buffers, Before and After. 10.2.2.1 Coded Picture Buffer. 10.2.2.2 Decoded Picture Buffer (DPB). 10.3 Bitstream Splicing. 10.4 Trick Modes. 10.4.1 Fast Forward. 10.4.2 Reverse. 10.4.3 Pause. 10.5 Carriage of AVC/H.264 Over MPEG-2 Systems. 10.5.1 Packetization. 10.5.1.1 Packetized Elementary Stream (PES). 10.5.1.2 Transport Stream (TS). 10.5.1.3 Program Stream. 10.5.2 Audio Video Synchronization. 10.5.3 Transmitter and Receiver Clock Synchronization. 10.5.4 System Target Decoder and Timing Model. References. 11 Interactive Video Communications. 11.1 Video Conferencing and Telephony. 11.1.1 IP and Broadband Video Telephony. 11.1.2 Wireless Video Telephony. 11.1.3 3G-324M Protocol. 126.96.36.199 Multiplexing and Error Handling. 188.8.131.52 Adaptation Layers. 184.108.40.206 The Control Channel. 220.127.116.11 Audio and Video Channels. 18.104.22.168 Call Setup. 11.2 Region-of-Interest Video Communications. 11.2.1 ROI based Bit Allocation. 22.214.171.124 Quality Metric for ROI Video. 126.96.36.199 Bit Allocation Scheme for ROI Video. 188.8.131.52 Bit Allocation Models. 11.2.2 Content Adaptive Background Skipping. 184.108.40.206 Content-based Skip Mode Decision. 220.127.116.11 rho Budget Adjustment. References. 12 Wireless Video Streaming. 12.1 Introduction. 12.2 Streaming System Architecture. 12.2.1 Video Compression. 12.2.2 Application Layer QoS Control. 18.104.22.168 Rate Control. 22.214.171.124 Rate Shaping. 126.96.36.199 Error Control. 12.2.3 Protocols. 188.8.131.52 Transport Protocols. 12.2.4 Video/Audio Synchronization. 12.3 Delay-Constrained Retransmission. 12.3.1 Receiver-Based Control. 12.3.2 Sender-Based Control. 12.3.3 Hybrid Control. 12.3.4 Rate-Distortion Optimal Retransmission. 12.4 Considerations for Wireless Video Streaming. 12.4.1 Cross-Layer Optimization and Physical Layer Consideration. 12.5 P2P Video Streaming. References. Index.
Haohong Wang received the B.S. degree in computer science and the M.Eng. degree in computer & its application both from Nanjing University, the M.S. degree in computer science from University of New Mexico, and the Ph.D. degree in Electrical and computer engineering from Northwestern University. He is currently a Senior System Architect and Manager at Marvell Semiconductors at Santa Clara, California. Prior to joining Marvell, he held various technical positions at AT&T, Catapult Communications, and Qualcomm. Dr. Wang's research involves the areas of multimedia communications, graphics and image/video analysis and processing. He has published more than 40 articles in peer-reviewed journals and International conferences. He is the inventor of more than 40 U.S. patens and pending applications. He is the co-author of 4G Wireless Video Communications (John Wiley & Sons, 2009), and Computer Graphics (1997). Dr. Wang is the Associate Editor-in-Chief of the Journal of Communications, Editor-in-Chief of the IEEE MMTC E-Letter, an Associate Editor of the Journal of Computer Systems, Networks, and Communications and a Guest Editor of the IEEE Transactions on Multimedia. He served as a Guest Editor of the IEEE Communications Magazine, Wireless Communications and Mobile Computing, and Advances in Multimedia. Dr. Wang is the Technical Program Chair of IEEE GLOBECOM 2010 (Miami). He served as the General Chair of the 17th IEEE International Conference on Computer Communications and Networks (ICCCN 2008) (US Virgin Island), and the Technical Program Chair of many other International conferences including IEEE ICCCN 2007 (Honolulu), IMAP 2007 (Honolulu), ISMW 2006 (Vancouver), and the ISMW 2005 (Maui). He is the Founding Steering Committee Chair of the annual International Symposium on Multimedia over Wireless (2005-). He chairs the TC Promotion & Improvement Sub-Committee, as well as the Cross-layer Communications SIG of the IEEE Multimedia Communications Technical Committee. He is also an elected member of the IEEE Visual Signal Processing and Communications Technical Committee (2005-), and IEEE Multimedia and Systems Applications Technical Committee (2006-). Lisimachos P. Kondi received a diploma in electrical engineering from the Aristotle University of Thessaloniki, Greece, in 1994 and the M.S. and Ph.D. degrees, both in electrical and computer engineering, from Northwestern University, Evanston, IL, USA in 1996 and 1999, respectively. He is currently an Assistant Professor in the Department of Computer Science at the University of Ioannina, Greece. His research interests are in the general area of multimedia communications and signal processing, including image and video compression and transmission over wireless channels and the Internet, super-resolution of video sequences and shape coding. Dr Kondi is an Associate Editor of the EURASIP Journal of Advances in Signal Processing and an Associate Editor of IEEE Signal Processing Letters . Ajay Luthra received his B.E. (Hons) from BITS, Pilani, India in 1975, M.Tech. in Communications Engineering from IIT Delhi in 1977 and Ph.D. from Moore School of Electrical Engineering, University of Pennsylvania in 1981. From 1981 to 1984 he was a Senior Engineer at Interspec Inc., where he was involved in digital signal and image processing for bio-medical applications. From 1984 to 1995 he was at Tektronix Inc., where from 1985 to 1990 he was manager of the Digital Signal and Picture Processing Group and from 1990 to 1995 Director of the Communications/Video Systems Research Lab. He is currently a Senior Director in the Advanced Technology Group at Connected Home Solutions, Motorola Inc., where he is involved in advanced development work in the areas of digital video compression and processing, streaming video, interactive TV, cable head-end system design, advanced set top box architectures and IPTV. Dr Luthra has been an active member of the MPEG Committee for more than twelve years where he has chaired several technical sub-groups and pioneered the MPEG-2 extensions for studio applications. He is currently an associate rapporteur/co-chair of the Joint Video Team (JVT) consisting of ISO/MPEG and ITU-T/VCEG experts working on developing the next generation of video coding standard known as MPEG-4 Part 10 AVC/H.264. He is also the USA's Head of Delegates (HoD) to MPEG. He was an Associate Editor of IEEE Transactions on Circuits and Systems for Video Technology (2000-2002) and a Guest Editor for its Special Issues on the H.264/AVC Video Coding Standard, July 2003 and Streaming Video, March 2001. He holds 30 patents, has published more than 30 papers and has been a guest speaker at numerous conferences. Song Ci is an Assistant Professor of computer and electronics engineering at the University of Nebraska-Lincoln. He received his B.S. from Shandong University, Jinan, China, in 1992, M.S. from the Chinese Academy of Sciences, Beijing, China, in 1998, and a Ph.D. from the University of Nebraska-Lincoln in 2002, all in Electrical Engineering. He also worked with China Telecom (Shandong) as a telecommunications engineer from 1992 to 1995, and with the Wireless Connectivity Division of 3COM Cooperation, Santa Clara, CA, as a R&D Engineer in 2001. Prior to joining the University of Nebraska Lincoln, he was an Assistant Professor of computer science at the University of Massachusetts Boston and the University of Michigan-Flint. He is the founding director of the Intelligent Ubiquitous Computing Laboratory (iUbiComp Lab) at the Peter Kiewit Institute of the University of Nebraska. His research interests include cross-layer design for multimedia wireless communications, intelligent network management, resource allocation and scheduling in various wireless networks and power-aware multimedia embedded networked sensing system design and development. He has published more than 60 research papers in referred journals and at international conferences in those areas. Dr Song Ci serves currently as Associate Editor on the Editorial Board of Wiley Wireless Communications and Mobile Computing (WCMC) and Guest Editor of IEEE Network Magazine Special Issue on Wireless Mesh Networks: Applications, Architectures and Protocols , Editor of Journal of Computer Systems, Networks, and Communications and an Associate Editor of the Wiley Journal of Security and Communication Networks . He also serves as the TPC co-Chair of IEEE ICCCN 2007, TPC co-Chair of IEEE WLN 2007, TPC co-Chair of the Wireless Applications track at IEEE VTC 2007 Fall, the session Chair at IEEE MILCOM 2007 and as a reviewer for numerous referred journals and technical committee members at many international conferences. He is the Vice Chair of Communications Society of IEEE Nebraska Section , Senior Member of the IEEE and Member of the ACM and the ASHRAE.