TANDBERG

Philip Pedersens vei 22 N-1366 Lysaker Norway +47 67125125 tom.kristensen@tandberg.com, tomkri@ifi.uio.no http://www.tandberg.com

Polycom

94 Derech Em Hamoshavot Petach Tikva 49130 Israel roni.even@polycom.co.il http://www.polycom.com

Real-time Applications and Infrastructure Area Audio/Video Transport WG I-D Internet-Draft H.264 H.241 RTP Video SDP media type This document updates RFC 3984. It defines new optional parameters addressing recent extensions currently supported in H.323 systems: The signalling of the maximum rate of static macroblocks a decoder is able to process. The signalling of the sample aspect ratio supported by the sender or the receiver.

The ITU-T H.264 codec and the extended video procedures and control signals for H.300 series terminals in ITU-T H.241 , continue to evolve. The IETF RTP payload formats and parameters need to be updated to include important new functionalities not covered in RFC 3984 . This document describes new parameters used to signal maximal number of static macroblocks per second and the sample aspect ratio of the H.264 video stream. The new parameters are already defined in the latest version of H.241 . This proposal defines media type parameters for them and allows their use in SDP based systems.

Running H.264 encode and decode operations require large amounts of video processing power. The challenge being to sustain high frame rate (e.g. 30 frames/sec) with the large frame sizes that stems from recent demand for HD resolution. In practice, a certain amount of macroblocks in the video stream, which do not change in a frame, can be defined as static and, this way, free up additional processing cycles for the handling of non-static macroblocks. Based on a given amount of video processing resources and a given resolution, a higher number of static macroblocks enables a correspondingly higher frame rate. A new parameter MaxStaticMBPS (maximum static macroblocks per second) was introduced in H.241 to address this issue. The MaxStaticMBPS parameter is specified in Section 8.3.2.8 of H.241 .

Sample Aspect Ratio (SAR) is the intended ratio of the horizontal distance between the columns to the vertical distance between the rows of the luma sample array in a frame. SAR is expressed as h:v, where h is horizontal width and v is vertical height (in arbitrary units of spatial distance). A sample is an individual luma picture element ("pixel") making up the complete displayed image (including both fields in the case of interlaced-scan video). For example, the sample aspect ratio for a CIF picture with a 4:3 Picture Aspect Ratio (PAR) is 12:11. For a CIF picture with a 16:9 PAR, the sample aspect ratio is 16:11. All systems which send H.264 video should indicate the sample aspect ratio in the VUI parameters specified in Annex E of H.264 . In the absence of a H.264 VUI parameter aspect_ratio_idc value in the received H.264 bitstream, and in the case of an aspect_ratio_idc value equal to 0, the sample aspect ratio may be assumed to have a value according to Table 1b in H.241 . This draft enables the receiver to indicate what sample aspect ratio it can support without distortion. This may help an encoder to support the different monitors being used today, which support different PAR such as 4:3 and 16:9.

The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in .

The optional H264 media subtype parameters max-smbps, sar and esar specified below comes in addition to the list of optional H264 media subtype parameters defined in Section 8.1 of RFC 3984 .

New optional parameters: The value of max-smbps is an integer indicating the maximum static macroblock processing rate in units of static macroblocks per second, under the hypothetical assumption that all macroblocks are static macroblocks. When max-smbps is signalled the MaxMBPS value in Table A-1 of H.264 should be replaced with the result of the following computation: If the parameter max-mbps is signalled, set a variable MaxMacroblocksPerSecond to the value of max-mbps. Otherwise, set MaxMacroblocksPerSecond equal to the value of MaxMBPS for the level in Table A-1 of H.264 . Set a variable P_non-static to the proportion of non-static macroblocks in picture n. Set a variable P_static to the proportion of static macroblocks in picture n. The value of MaxMBPS in Table A-1 of H.264 should be considered by the encoder to be equal to:

The encoder should recompute this value for each picture. The value of max-smbps MUST be greater than the value of MaxMBPS for the level given in Table A-1 of H.264 . Senders MAY use this knowledge to send pictures of a given size at a higher picture rate than is indicated in the signalled level. The value of this parameter is an integer that indicates support of sample aspect ratios corresponding to H.264 aspect_ratio_idc values in the range from 1 to N inclusive, where N is the value of this parameter (see Table E-1 of H.264 ). The value of this parameter is 1 or 0. 1 indicates support for all sample aspect ratios which are expressible using the H.264 aspect_ratio_idc value of 255 (Extended_SAR, see Table E-1 of H.264 ). If the parameter does not exist, its value is 0.

The optional parameters max-smbps, sar and esar when present, MUST be included in the "a=fmtp" line of SDP. These parameters are expressed as a media type string, in the form of a semicolon separated list of paremeter=value pairs.

When H.264 is offered over RTP using SDP in an offer/answer exchange for negotiation of unicast streams, the following limitations and rules applies: The optional parameter max-smbps is treated the same way as max-mbps, when used in both the SDP offer/answer model and declarative session descriptions. Its interpretation depends on the direction attribute. When the direction attribute is sendonly, then the parameters describe the limits of the RTP packets and the NAL unit stream that the sender is capable of producing. When the direction attribute is sendrecv or recvonly, the parameters describe the limitations of what the receiver accepts. The profile-level-id parameter MUST be present in the same receiver capability description that contains this parameter. The interpretation of the optional parameter sar depends on the direction attribute. When the direction attribute is sendonly, then it indicates the range of sample aspect ratios the stream will contain. When the direction attribute is sendrecv or recvonly, the value of this parameter indicates the range of sample ratios that the receiver is able to display without geometric (shape) distortion. The receiver shall still display pictures encoded at other sample aspect ratios (though perhaps with geometric distortion). H.264 compliant encoders should choose to send a SAR which can be displayed without geometric distortion. However, H.264 compliant encoders may choose to send pictures using any SAR. The optional parameter esar is a receiver capability that permits a terminal to signal additional abilities to display any decoded video expressible using the H.264 aspect_ratio_idc value of 255 (Extended_SAR, see Table E-1 of H.264 ). The actual extended aspect ratio is conveyed using H.264 VUI.

TBD

This draft updates RFC 3984 by adding three new optional parameters to the H264 media subtype. The parameters are specified in Section of this document.

No separate considerations introduced in this document. Refer to section 9 of RFC 3984 .

Harvard University

1350 Mass. Ave. Cambridge MA 02138 - +1 617 495 3864 sob@harvard.edu

General keyword International Telecommunications Union International Telecommunications Union

draft-kristensen-avt-rtp-h264-params-00: - 2007-06-19: Based on static macroblocks part of draft-kristensen-avt-rtp-h264-extension-00, restructured. Added sample aspect ratio parameter from H.241. draft-ietf-avt-rtp-h264-params-00: - 2007-06-30: Editorial changes. Input from G. Sullivan's review considered. - 2007-07-01: Better descriptions, tightened text. Introduced the term PAR to explicitly distuingish it from SAR. draft-ietf-avt-rtp-h264-params-00 to -01: - 2007-07-03: Moved requirement/acronyms sections to after Introduction. - 2008-01-30: Mainly a keep-alive-submission. Adding missing PAR for the first example with 12:11 SAR in Section 2.2.