1 · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF...

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N6083Waikoloa, HI, December 2003

Source Leonardo Chiariglione, Convenor

Title Report of the 67th meetingStatus

Report of the 67th meeting

1 Opening The 66th WG meeing was held at Brisbane, QLD, AU from 2003/10/20T09:00 to 24T20:30 at the kind invitation of Standards Australia.

2 Roll call of participants The attendance list is given in Annex 1.

3 Approval of agenda The adopted agenda is given in Annex 2.

4 Allocation of contributions The list of input documents is given in Annex 3.

5 Communications from Convenor No specific communications were made.

6 Report of previous meeting This was approved.

7 Processing of NB Position Papers NB papers were presented, discussed and responses provided. 8 MPEG Phase 2 8.1 Part 1 – Systems

8.1.1 Amendments The following documents were approved

1

N6200 Request for ISO/IEC 13818-1:2000/Amd.5

N6201 Text of ISO/IEC 13818-1:2000/PDAM5

8.2 Part 4 – Conformance 8.2.1 Amendments

The following documents were approved

8.3 Part 5 – Reference software

8.3.1 AmendmentThe following documents were approved

8.4 Part 7 – Advanced Audio Coding8.4.1 Corrigenda

The following document was approved

6126 Study on 13818-7:2003/DCOR 1

8.5 Workplan This was approved (N6103).

9 MPEG Phase 4 9.1 Requirements The following document was approved

6262 MPEG-4 Profiles under Consideration

9.2 Part 1 – Systems 9.2.1 Amendments


N6202 Text of ISO/IEC 14496-1/FDAM2

N6232 Text of ISO/IEC 13818-4:200X/FPDAM 1

N6233 Request for Amd 2 of ISO/IEC 13818-4:200X

N6234 Text of ISO/IEC 13818-4:200X/PDAM2

N6235 Text of ISO/IEC TR 13818-5:200X/DAM 1N6236 Text of ISO/IEC TR 13818-5:1997AMD1:1999/DCOR2

2

9.3 Part 2 – Visual 9.3.1 Corrigenda


6183 Study Text of ISO/IEC 14496-2:200X DCOR 1

9.4 Part 3 – Audio 9.4.1 Amendments


6129 DoC on 14496-3:2001:/FPDAM 2, Parametric Coding6130 Text of 14496-3:2001:/FDAM 2, Parametric Coding6131 DoC on 14496-3:2001/PDAM 3, MP3onMP46132 Text of 14496-3:2001/FPDAM 3, MP3onMP46133 WD 2 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)6134 WD 1 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable Lossless Coding

(SLS)

9.4.2 CorrigendaThe following documents were approved

6127 Study on ISO/IEC 14496-3:2001/AMD1:2003/DCOR1

6128 Study on 14496-3:2001 DCOR 2

9.5 Part 4 – Conformance Testing 9.5.1 Amendments


9.6 Part 7 – Optimised software 9.6.1 Amendment


N6237 DoC on ISO/IEC 14496-4:2003/FPDAM 5N6238 Text of ISO/IEC 14496-4:2003/FDAM 5N6239 DoC on ISO/IEC 14496-4:2003/PDAM 6N6240 Text of ISO/IEC 14496-4:2003/FPDAM 6N6241 Request for Amd 8 of ISO/IEC 14496-4:2003N6242 Text of ISO/IEC 14496-4:2003/PDAM 8

N6243 DoC on ISO/IEC 14496-5:2003/FPDAM 4N6244 Text of ISO/IEC 14496-5:2003/FDAM 4N6245 DoC on ISO/IEC 14496-5:2003/FPDAM 5N6246 Text of ISO/IEC 14496-5:2003/FDAM 5N6247 DoC on ISO/IEC 14496-5:2003/PDAM 6N6248 Text of ISO/IEC 14496-5:2003/FPDAM 6N6249 DoC on ISO/IEC 14496-5:2003/PDAM 7N6250 Text of ISO/IEC 14496-5:2003/FPDAM 7

3

9.7 Part 9 – Hardware Reference Description 9.7.1 Amendments


N6091 ISO/IEC 14496-9/WD of AMD 1: Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description.

9.8 Part 10 – Advanced Video Coding 9.8.1 Standard


6231

Report Of The Formal Verification Tests on AVC (ITU-T Rec. H.264 | ISO/IEC 14496-10)

9.8.2 Amendments The following document was approved

N6108 Text of ISO/IEC 14496-10 FPDAM 1 AVC Professional Extensions

9.8.3 Corrigenda The following document was approved

N6109 Text of ISO/IEC 14496-10 DCOR 1

9.9 Part 11 – Scene Description and Application Engine 9.9.1 Amendments


N6204 DoC on ISO/IEC 14496-11/FPDAM2N6205 Text of ISO/IEC 14496-11/FDAM2N6206 Request for ISO/IEC

14496-11/Amd.3N6207 Text of ISO/IEC 14496-11/PDAM3N6209 Request for ISO/IEC

14496-11/Amd.4N6210 Text of ISO/IEC 14496-11/PDAM4


N6203 Text of ISO/IEC 14496-11/COR1N6208 Items for ISO/IEC 14496-11/COR2

4

9.10 Part 12 – ISO Base Media File Format9.10.1 Amendments


N6089 Request for ISO/IEC 14496-12/Amd.1

N6090 Text of ISO/IEC 14496-12/PDAM1

9.11 Part 16 Animation Framework eXtension (AFX)9.11.1 Amendment


6097 ISO/IEC 14496-16/AMD1 WD 3.0

9.12 Part 17 Streaming Text Format 9.12.1 Standard


N6212 Referencing Explanatory Report for 3GPP specificationN6213 DoC on ISO/IEC 14496-17/CDN6214 Text of ISO/IEC 14496-17/FCD

9.13 Part 18 Font Compression and Streaming9.13.1 Standard


N6215 Text of ISO/IEC 14496-18/FDIS

9.14 Part 19 Synthesized Texture Stream9.14.1 Standard


N6216 Request for ISO/IEC 14496-19N6217 Text of ISO/IEC 14496-19/FDIS

9.15 Workplan This was approved (N6103)

10 MPEG Phase 7 10.1 Part 1 – Systems

10.1.1 AmendmentsThe following documents were approved

N6218 Draft DoC on ISO/IEC 15938-1/FPDAM1N6219 Study Text of ISO/IEC 15938-1/FDAM1

5


N6220 Draft DoC on ISO/IEC 15938-1/DCOR1N6221 Study Text of ISO/IEC 15938-1/COR1

10.2 Part 3 – Visual 10.2.1 Amendments


6187 DoC on ISO/IEC 15938-3/FPDAM16188 Text of ISO/IEC 15938-3/FDAM 1

10.2.2 CorrigendaThe following document was approved

6186 Text of ISO/IEC 15938-3:2002/COR 1

10.3 Part 4 – Audio 10.3.1 Amendments


6145 Proposed Tools for MPEG-7 AMD 2


6146 Proposed Draft Corrigendum for MPEG-7 Audio

10.4 Part 5 – Description Schemes 10.4.1 Amendments


6161 Study of Draft Comments on MPEG-7 MDS PDAM2


N6162 MPEG-7 MDS COR/1 WD v2.0

6

10.5 Part 6 Reference Software 10.5.1 Amendments


N6251 Text of ISO/IEC 15938-6:2003/FPDAM1

10.6 Part 7 Conformance10.6.1 Amendments


N6252 DoC on ISO/IEC 15938-7:2003/PDAM1


10.7 Part 8 – Extraction and use of visual descriptors 10.7.1 Amendment


6191 Study Text of ISO/IEC TR 15938-8/PDAM1

10.8 Part 9 – Profiles10.8.1 Standard


6263 Study of ISO/IEC 15938-9/Committee Draft

10.9 Part 10 – Schema definition10.9.1 Standard


6163 MPEG-7 Schema Definition Study of CD


11 MPEG phase 21 11.1 RequirementsThe following document was approved

6267 Draft MPEG-21 Profiles under Consideration Document

7

11.2 Part 1 – Vision, Technologies and Strategy 11.2.1 Technical Report


6269 Text of PDTR of ISO/IEC 21000-1 Second Edition

11.3 Part 2 – Digital Item Declaration 11.3.1 Standard


6164 ISO/IEC 21000-2 DID 2nd Edition WD v.2

11.4 Part 4 – Intellectual Property Management and Protection11.4.1 Standard


6270 Final Call for Proposals for MPEG-21 IPMP

11.5 Part 6 – Rights Data Dictionary11.5.1 Standard


6166 Evaluation Criteria for Appointing the RA for ISO/IEC 21000-6

11.6 Part 7 – Digital Item Adaptation 11.6.1 Standard


6167 DoC on ISO/IEC 21000-7 FCD

6168 ISO/IEC 21000-7 FDIS – Part 7: Digital Item Adaptation

11.7 Part 8 – Reference software 11.7.1 Standard


N6254 WD4.0 of ISO/IEC 21000-8/CD Reference Software

11.8 Part 9 – File format11.8.1 Standard


8

N6224 WD5.0 of ISO/IEC 21000-9

11.9 Part 10 – Digital Item Processing11.9.1 Standard


6173 ISO/IEC 21000-10 CD – Part 10; Digital Item Processing

11.10 Part 11 – Persistent Association11.10.1 Technical Report


6274 Text of PDTR of ISO/IEC 21000-11

11.11 Part 12 Test Bed for MPEG-21 Resource Delivery 11.11.1 Technical Report


N6255 Text of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery

11.12 Part 13 – Scalable video coding11.12.1 Standard


6192 Request for Subdivision of ISO/IEC 21000: Part 13 Scalable Video Coding

6193 Call for Proposals on Scalable Video Coding Technology

11.13 Part 14 – Conformance11.13.1 Standard


N6256 WD2.0 of ISO/IEC 21000-14 MPEG-21 Conformance


12 Overall WG11 workplanThis was approved (N6103)

13 Liaison matters Liaisons were received and responses provided where appropriate. Internally generated liaison statements were produced and approved.

9

14 Administrative matters 14.1 Schedule of future MPEG meetings The following meeting schedule was approved

Meeting City Country

Yr

Mo Days

67th Waikaloa, HI US 03 12 08-12

68th München DE 04 03 15-19

69th Seattle US 04 07 19-23

70th Palma de Mallorca

ES 04 10 18-22

71st Hong Kong CN 05 01 17-21

72nd Busan KR 05 04 18-22

73rd Poznań PL 05 07 25-29

15 Organisation of this meeting 15.1 Joint meetings The following joint meetings were held

Groups What Where Day TimeReq, Sys, Snh MPEG-4 Profiles Sys Mon 17:00-

18:00Req, Sys, Snh Simple Scene Description Req Tue 09:00-

10:00Req, Mds Several Mds Tue 10:00-

11:00Sys, ISG Complexity of LSD Sys Tue 10:00-

11:00Vid, Req 3DAV Req Tue 11:00-

11:30Vid, Req Intra-only Req Tue 11:30-

12:00Vid, MDS, Aud, Sys J on 4 Sys Tue 12:00-

13:00Vid, Tst SVC Vid Tue 14:00-

16:00Req, Aud Profiles, Music notation, 3 on 4 Aud Tue 14:00-

15:00Req, Sys M3W Sys Tue 15:00-

16:00Vid, Tst, Jvt AVC VT Vid Tue 16:00-

19:00Snh, Mds Avatar preference Mds Tue 16:00-

10

17:00Audio, Mds Audio adaptation Mds Tue 16:30-

17:00Vid, Snh 3D shape descriptor Vid Wed 11:00-

11:30Req, Mds, Aud, Vid MPEG-7 Profiles Req Wed 11:30-

12:15Req, Mds Several Req Wed 12:15-

13:00 DMP update Req Wed 13:00-

14:00Req, Int, Mds, Sys MPEG-21 Ref SW Reqs Req Wed 14:00-

15:00Audio, Sys Time stamps and codec

behaviourAud Wed 15:00-

16:00Mds, Int REL, RDD Ref SW Mds Wed 15:00-

16:00Snh, Vid 3DAV Vid Wed 16:00-

16:30Mds, Int DIA Ref SW Mds Wed 16:00-

17:00Req, Sys, Vid, MDS, Aud

MAF Req Wed 16:30-17:00

Audio, Sys Audio BIFS Aud Wed 17:00-18:00

Mds, Int MPEG-21 conformance Mds Wed 17:00-18:00

Sys, Mds, Vid MP 21 FF Sys Thu 09:00-10:00

Req, Aud Spatial audio coding Aud Thu 09:00-09:30

Req, Sys MPEG-21 IPMP Architecture Req Thu 10:00-11:00

Req, Sys, Snh Several (MPEG-4) Sys Thu 11:00-12:00

Req, Jvt AVC profess. ext prof. Jvt Thu 12:00-13:00

Jvt, Tst AVC VT Jvt Thu 14:30-15:30

15.2 Planning of future activities The following ad hoc groups were established:

6228 Convener Ad Hoc Group on MPEG-4 Scene Representation6227 Convener Ad Hoc Group on MPEG-7 Systems6096 SNHC AFX CE description6098 SNHC AFX VM 13.0

11

6198 Convener AHG on 3DAV Coding6106 Convener AHG on AFX conformance6099 Convener AHG on AFX document editing and Core Experiments6160 Convener AHG on Audio Explorations6182 Convener AHG on Editing and Core Experiments for DIP6197 Convener AHG on Editing MPEG-7 Visual related Documents6280 Convener AHG on Intra-only Coding in MPEG6179 Convener AHG on Low-Complexity and Efficient Digital Item Resource Adaptation6195 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software

and Conformance6229 Convener AHG on MPEG File format 6259 Convener AHG on MPEG Multimedia Test Bed6154 Convener AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software6152 Convener AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP46260 Convener AHG on MPEG-21 Conformance6178 Convener AHG on MPEG-21 DIA Editing6180 Convener AHG on MPEG-21 DIA Reference Software6181 Convener AHG on MPEG-21 DIP Reference Software6286 Convener AhG on MPEG-21 Event Reporting6176 Convener AHG on MPEG-21 Media Locators 6258 Convener AHG on MPEG-21 Reference Software6177 Convener AHG on MPEG-21 REL-RDD Reference Software6153 Convener AHG on MPEG-4 Audio Conformance6155 Convener AHG on MPEG-4 Audio Extensions 1 and 26156 Convener AHG on MPEG-4 Audio Lossless Coding6093 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6157 Convener AHG on MPEG-7 Audio6284 Convener AHG on MPEG-7 Interoperability and Profiling6230 Convener AHG on MPEG-J Extensions 6285 Convener AHG on Multimedia Application Format (MAF)6158 Convener AHG on Music Notation Application Requirements 6283 Convener AHG on Profiles and Extensions for the MPEG-21 REL6199 Convener AHG on Scalable Video Coding6282 Convener AHG on study of MPEG-21 and broadcasting6159 Convener AHG on Timestamps and Audio Codec Behavior6196 Convener AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-76281 Convener AHG to complete requirements for MPEG-21 IPMP

16 Resolutions of this meeting These were approved

17 A.O.B There was no other business

12

18 Closing The meeting closed at 2003/12/12T20:20

13

Annex 1Attendance list

1. Brown Craig CISRA Australia2. Burnett Ian enikos/U of W Australia3. Drury Gerrard enikos Australia4. Timmerer Christian University Klagenfurt Austria5. DeKeukelaere Frederik Ghent Univ-Multimedia

LabBelgium

6. Delfosse Eric IMEC Belgium7. DeSutter Robbie Ghent Univ-Multimedia

LabBelgium

8. DeVillers Sylvain IMEC Belgium9. Rogge Boris Metanous Belgium10. Salomie Alexandru Vrije Univ Brussel Belgium11. Feiten Bernhard T-Systems Germany12. Luccisano Alex Scientific Atl Canada Canada13. Winger Lowell LSI Logic Canada14. Gao Wen Cinese Academy of Science China15. He Yun Tsinghua Univ. China16. Avaro Olivier France Telecom R & D France17. Benjelloun Abdellatif France Telecom R & D France18. Coturanac'h Alexandre France Telecom France19. Dufourd Jean-Claude ENST France20. Giola Patrick France Telecom France21. Guez Mr. Marc SCPP France22. Hang M. Nguyen Alcatel France23. Loras Frederic France Telecom France24. Nuttal F. X. CISAC France25. Philippe Pierrick France Telecom France26. Preda Marius INT France27. Preteux Francoise INT France28. Rault Jean-Bernard France Telecom France29. Seyrat Claude Expway France30. Touimi Abdellatif France Telecom France31. Vucher Mark SLPP France32. Base Gero Siemens AG Germany33. Baum Oliver Fraunhofer IIS Germany34. Benzler Ulrich Robert Bosch GmbH Germany35. Geiger Ralf Fraunhofer IIS Germany36. Grill Bernhard Fraunhofer Germany37. Gruhne Matthias Fraunhofer Germany38. Herre Juergen Fraunhofer Germany39. Hutter Andreas Siemens Germany40. Liebchen Tilman Tech Univ of Berlin Germany41. List Peter Deutsche Telekom Germany42. Medina/Otalor Raul Munich Univ of Tech Germany43. Ohm Jens-Rainer RWTH Aachen Germany44. Schmidt Juergen Deutsche Thomson Germany45. Schwark Mathias Tech Univ of Ilmenau Germany46. Sperschneider Ralph Fraunhofer IIS Germany

14

47. Spille Jens Thomson Germany48. Thomas Herbert Fraunhofer Germany49. Wiegand Thomas Fraunhofer Germany50. Wolf Ingo T-Systems Germany51. Birman Shlomo Vimatix Israel52. Lifshitz Zvi Optibase Israel53. Baroncini Vittorio Sharp Notevision Italy54. Chiariglione Leonardo CEDEO Italy55. Cordara Giovanni Telecom Italia LAB Italy56. Flaiani Roberto Aethra Italy57. Leonardi Riccardo Univ of Brescia Italy58. Nomizu Yasuyuki Japan59. Aoki Terumasa University of Tokyo Japan60. Asai Kohtaro Mitsubishi Elec Company Japan61. Azami Tomohiro Victor Co of Japan Japan62. Chen Zhibo Sony Corporation Japan63. Chujoh Takeshi Tochiba Japan64. Fujii Toshiaki Nagoya University Japan65. Hayashi Junichi Canon Japan66. Ito Satoshi Toshiba Japan67. Kajiwara Hiroshi Canon Japan68. Kaneko Itaru Waseda University Japan69. Kimata Hideaki NTT Japan70. Kimoto Takahiro NEC Corp Japan71. Kitaura Ryuji Sharp Corp Japan72. Kogure Takuyo Matsushita Elec Japan73. Koike Mayumi Univ of Tokyo Japan74. Miyoshi Hidenobu Fujitsu Japan75. Moriya Takehiro NTT Japan76. Murakami Tokumichi Mitsubishu Japan77. Nishikawa Hirofumi Mitsubishi Elec. Co. Japan78. Noguchi Youko Hitachi Japan79. Nomura Toshiyuki NEC Japan80. Ogura Yukiko IPSJ/ITSCJ Japan81. Sano Masanori NHK Japan82. Sasaki Mikio Denso Corp Japan83. Schultz Craig Multimedia Arch Japan84. Senoh Taka Matsushita Elec Japan85. Sugihara Yushinori Jeita Japan86. Suzuki Teruhiko Sony Japan87. Suzuki Yoshinori Hitachi Japan88. Takashi Shinoda Ricoh Japan89. Tanaka Naoya Matsushita Elec Japan90. Tanimoto Masayuki Nagoya University Japan91. Ueno Takafumi Matsushita Elec Japan92. Watanabe Hiroshi Waseda Univ Japan93. Yamada Akio NEC Japan94. Yamada Yoshihisa Mitsubishi Elec Co Japan95. Yamazawa Kazumasa Nara Inst of Sc & Tech Japan96. Cho Yongju ETRI Korea97. Cho Chang Sik ETRI Korea

15

98. Han Woo-Jin Samsung Korea99. Han Mahn Jin Samsung Korea100. Hee Ji Kyung Seoul Inf/Tech Univ Korea101. Ho Yo-Sung K-JIST Korea102. Jang Eueeseon Hanyang Univ Korea103. Jeon Byeungwoo Sungkyankuan Univ Korea104. Jeong Senator ETRI Korea105. Kim Woo-Shik Samsung Korea106. Kim Sang-Kyun Samsung Korea107. Kim Duck Hoon Seoul Natl Univ Korea108. Kim Mun Churl Inf & Commun Univ Korea109. Kim Kyuheon ETRI Korea110. Kim T. G. Korea111. Kim Jong-Nam KBS Korea112. Kim Hae Kwang Sejong Univ Korea113. Kim Wook-Joong ETRI Korea114. Kim Taek-Soo LG Elec Korea115. Kim Joohee Samsung Korea116. Kim Hyun Samsung Korea117. Kim Sang-wook Samsung Korea118. Kim Kiseob Kangwon Nat Univ Korea119. Kim Hyoung-Joong KIangwon Nat Univ Korea120. Kim James Do Kyoon Samsung Korea121. Kim Rin Chul Univ of Seoul Korea122. Kim Yong-Goo OnTimeTek, Inc Korea123. Kim Cheon Seog Movain, Interjungbo Korea124. Kim Jaejoon Daegu Univ Korea125. Kim Jong-Tae KAIST Korea126. Kim Jae-Gon ETRI Korea127. Kim Hyun Mun Samsung Korea128. Kim Won-Ha Kyung Hee Univ Korea129. Lee Yung-Lyul Sejong Korea130. Lee Jongwon Samsung Korea131. Lee SangRae Samsung Korea132. Lee Shi Hwa Samsung Korea133. Lim Young-Kwon net&tv, Inc. Korea134. Lim Choong-Gyoo ETRI Korea135. Moon Nam Mee Seoul Inf Tech Univ Korea136. Nam Jeho ETRI Korea137. Oh Seoung Jun Kwangwoon Univ Korea138. Oh Eun Mi Samsung Korea139. Park In Soo Agency for Tech & Stds Korea140. Park In Kyu Samsung Korea141. Park Sung Hee Pixtree Korea142. Park Soo Jun ETRI Korea143. Seo Jeongil ETRI Korea144. Seok Jongwon ETRI Korea145. Shin Jae-Seob Pixtree Tech Korea146. Son Sehoon Pixtree Korea147. Song Min Kyu Samsung Korea148. Song Young-Joo ETRI Korea

16

149. Yoon Jeong Hyun Movain Korea150. Yun Il Dong Hankuk Univ Korea151. Gelissen Jean H.A. Philips Research Lab Netherlands152. Middelink M. K. Philips PDSL-E Netherlands153. Oomen Werner Philips Netherlands154. Van Den Heuvel Bas Royal Philips Netherlands155. Van der Meer Jan Royal Philips Netherlands156. Fuldseth Arild Tanberg Norway157. Oh Weongeum ETRI Korea158. Thang Truong Cong Inf & Comm Univ Korea159. Yoo W. Y. ETRI Korea160. Chong Kok Seng Panasonic Singapore161. Haibin Huang Inst for Infocomm Research Singapore162. Huang Zhongyang Panasonic Singapore163. Ji Ming Panasonic Singapore164. Lee Men Huong Panasonic Singapore165. Lim Keng-Pang Inst for Infocomm Singapore166. Lim Chong-Soon Panasonic Singapore167. Lin Weisi I2R Singapore168. Liu Jing Panasonic Singapore169. Rahardja Susanto Inst for Infocomm Research Singapore170. Shen S. M. Panasonic Singapore171. Sun Qibin Inst for Infocomm Res Singapore172. Tan T. K. M-Sphere Consulting Singapore173. Yu Rongshan Inst for Infocomm Singapore174. Zhang Zhishou Inst for Infocomm Singapore175. Gauvin Mr. Marc sDae Spain176. Dietz Martin Coding Technologies Sweden177. Frojdh Per Ericsson Research Sweden178. Kjoerling Kristopher Coding Technologies Sweden179. Purnhagen Heiko Coding Technologies Sweden180. Alberti Claudio EPFL Switzerland181. DiGiacomo Thomas MIRA Lab, Univ of Geneva Switzerland182. Mattavelli Marco EPFL Switzerland183. Vexo Frederic VRLab-EPFL Switzerland184. Wuermlin Stephan ETH Zurich Switzerland185. Zoia Giorgio EPFL Switzerland186. Tung Yi-Shin Natl Taiwan Univ Taiwan187. Wang Allen Natl Chiao Tung Univ Taiwan188. Barlas Chris Rightscom UK189. Bober Miroslaw Mitsubishi Elec Co UK190. Casey Michael City University, London UK191. Cieplinski Leszek Mitsubishi Elec Co UK192. Gooch Richard IFPI Secretariat UK193. Grant Kate Nine Tiles UK194. Green Brian EDITEUR UK195. Harwood Don Oxford Semiconductor UK196. Jessop Paul IFPI Secretariat UK197. Nilsson Mike BT Exact UK198. Rump Niels Rightscom Ltd. UK199. Stride Jean BSI UK

17

200. Wu Ping Tandberg UK201. May Tony Motorola UK202. Banerji Ashish Hughes Network USA203. Block Bruce RIAA USA204. Bosi Marina MPEG LA, LLC USA205. Bossen Frank DoCoMo USA Labs USA206. Bourges-

SevenierMikael Mindego, Inc. USA

207. Chang Wo NIST USA208. Chau Kwok NJR Corporation USA209. Chen Fang-Chu ITRI, Inc. USA210. Chiang Tihao Mitsubishi USA211. DeMartini Thomas ContentGuard USA212. Fenimore Chuck NIST USA213. Fernandes Felix Texas Inst USA214. Fu Jiang Broadcom USA215. Gandee Brad ContentGuard USA216. Gish Walter Dolby Labs USA217. Gomila Cristina Thomson USA218. Gordon Steve Sand Video USA219. Haskell Barry Apple Computer USA220. Horie Toshihiro Conextant USA221. Horowitz Michael Polycom USA222. Hurtado Marco IBM USA223. Husak Walter Dolby USA224. Johnston James D. Microsoft USA225. Kar Mukta Cable Labs USA226. Kneib Kristine KNK Sem & Strategies USA227. Koenen Rob InterTrust USA228. Lei Shawmin Sharp USA229. Levantovsky Vladimir Agfa Monotype USA230. Lightstone Michael Nvidia USA231. Lu Jiuhuai Panasonic USA232. Luthra Ajay Motorola USA233. McMahon Tom Dolby Labs USA234. Melby Alan BYU USA235. Moore Ron Dolby USA236. Mukherjee Debargha Hewlett Packard USA237. Nalebuff Martha Microsoft USA238. Narasimhan Sam Motorola USA239. Pahwa Ash DV Studio USA240. Quackenbush Schuyler Audio Research Labs USA241. Rabani Majid Eastman Kodak USA242. Reznik Yurly A. REAL Networks USA243. Ridge Justin Nokia USA244. Rodriguez Arturo Scientific-Atlanta USA245. Rubinfeld Mike NIST USA246. Russell Chris MPAA, US Nat Body USA247. Sagetong Phoom Qualcomm Inc. USA248. Schirling Pete IBM Research USA249. Schumacher Paul Xilinx USA

18

250. Sharpe Louis Picture Elements USA251. Singer David Apple USA252. Smith John R. IBM TJ Watson USA253. Sullivan Gary Microsoft USA254. Swaminathan V. Sun Microsystems USA255. Tescher Andrew Microsoft USA256. Topiwala Pankraj FastVDO USA257. Turney Bob Xilinx Research USA258. Vetro Anthony Mitsubishi Elec USA259. Vinton Mark Dolby USA260. Visharam Mohammed

ZubairSony USA

261. Viswanathan Sam Cable Labs USA262. Wang Feng Chi Conexant Systems USA263. Wang Xin ContentGuard USA264. Woods John W. Rensselaer Polytech USA265. Wu Fang Cisco Systems USA266. Xu Jizheng Microsoft USA267. Yu Haoping Thomson USA268. Zhong Sheng Broadcom USA

19

Annex 2Agenda

1 Opening

2 Roll call of participants

3 Approval of agenda

4 Allocation of contributions

5 Communications from Convenor

6 Report of previous meeting

7 Processing of NB Position Papers

8 MPEG Phase 1 8.1 Part 1 – Systems 8.2 Part 2 – Video 8.3 Part 3 – Audio 8.4 Part 4 – Conformance 8.5 Part 5 – Reference software

9 MPEG Phase 2 9.1 Requirements 9.2 Part 1 – Systems 9.2.1 Standard 9.2.2 Amendment 1 - Carriage of metadata over 13818-1 streams9.2.3 Amendment 2 - Support of IPMP on MPEG-2 Systems 9.2.4 Amendment 3 - Carriage of AVC Content 9.2.5 Amendment 4 - Metadata application format codepoints9.2.6 Amendment 5 - New audio profile and level signaling9.3 Part 2 – Video 9.3.1 Standard 9.3.2 Amendment 1 - Content description data 9.4 Part 3 – Audio 9.5 Part 4 – Conformance 9.5.1 Standard 9.5.2 Amendment 1 - IPMP Conformance Extensions9.6 Part 5 – Reference software 9.6.1 Standard

9.6.2 Amendment 1 - IPMP Reference Software9.6.3 Corrigenda 9.7 Part 6 – DSM-CC 9.7.1 Standard 9.7.2 Amendment 1 - Additions to support data broadcasting 9.7.3 Amendment 2 - Additions to support synchronized download services, opportunistic

data services and resource announcement in broadcast and interactive services

20

9.7.4 Amendment 3 - Transport buffer model in support of synchronized user-to-network download protocol

9.8 Part 7 – Advanced Audio Coding 9.8.1 Standard 9.8.2 Amendment 1 - Embedding of bandwidth extension 9.8.3 Corrigenda 9.9 Part 9 – System extension RTI 9.10 Part 10 – Conformance extension - DSM-CC 9.11 Part 11 – IPMP on MPEG-2 Systems 9.11.1 Standard 9.12 Workplan

10 MPEG Phase 4 10.1 Requirements 10.2 Part 1 – Systems 10.2.1 Standard 10.2.2 Amendment 1 – FlexTime 10.2.3 Amendment 2 – XMT BIFS nodes 10.2.4 Amendment 4 - SL extensions and AFX streams10.2.5 Amendment 7 – Use of AVC in MPEG-4 Systems 10.2.6 Corrigenda 10.3 Part 2 – Visual 10.3.1 Standard 10.3.5 Amendment 1 – Error resilient simple scalable profile10.3.6 Corrigenda 10.4 Part 3 – Audio 10.4.1 Standard 10.4.2 Amendment 1 – Bandwidth Extension 10.4.3 Amendment 2 – Parametric Extension 10.4.4 Amendment 3 – MP3 on MP410.4.5 Amendment 4 - Lossless Audio10.4.6 Amendment 5 - Scalable to lossless audio coding10.4.7 Corrigenda10.5 Part 4 – Conformance Testing 10.5.1 Standard 10.5.2 Amendment 1 – SP, FGS, FlexTime 10.5.3 Amendment 2 – XMT 10.5.4 Amendment 3 – Visual New Levels & Tools 10.5.5 Amendment 4 – IPMP Extension Conformance 10.5.6 Amendment 5 - Error Resilience Scalable Profile Conformance 10.5.7 Amendment 6 - AVC Conformance 10.5.8 Amendment 7 - AFX Conformance 10.5.7 Corrigenda 10.6 Part 5 – Reference software 10.6.1 Standard 10.6.2 Amendment 1 – SP, FGS, FlexTime 10.6.3 Amendment 2 – XMT and media nodes10.6.4 Amendment 3 – Visual New Levels & Tools10.6.5 Amendment 4 – IPMP Extension 10.6.6 Amendment 5 - Error Resilience Scalable Profile10.6.7 Amendment 6 - AVC

21

10.6.8 Amendment 7 - AFX 10.6.7 Corrigenda 10.7 Part 6 – DMIF 10.8 Part 7 – Optimised software 10.8.1 Technical Report 10.8.2 Amendment 1 - Optimised software for simple profile and error resilience 10.8.3 Corrigenda 10.9 Part 8 – 4 on IP Framework 10.9.1 Standard 10.10 Part 9 – Hardware Reference Description 10.10.1 Technical Report 10.10.2 Amendment 1 - Extension10.11 Part 10 – Advanced Video Coding 10.11.1 Standard 10.11.2 Amendment 1 - Professional extensions10.11.3 Corrigenda 10.12 Part 11 – Scene Description and Application Engine 10.12.1 Standard 10.12.2 Amendment 1 – AFX 10.12.3 Amendment 2 – Advanced Text and 2D Graphics 10.12.4 Amendment 3 – Audio BIFS Extensions 10.12.5 Amendment 4 – XMT and MPEG-J extension10.13 Part 12 – ISO Base Media File Format 10.13.1 Standard 10.13.2 Amendment 1 - ISO File Format extension10.14 Part 13 – IPMP Extensions 10.14.1 Standard 10.15 Part 14 – MP4 File Format 10.15.1 Standard 10.16 Part 15 – AVC File Format 10.16.1 Standard 10.17 Part 16 - AFX10.17.2 Amendment 1 - AFX Extensions10.18 Part 17 - Streaming Text Format10.18.1 Standard 10.19 Part 18 – Font compression and streaming10.19.1 Standard 10.20 Explorations10.20.1 Simple Scene Description and Simple Aggregation Format10.20.2 MPEG-J Extensions 10.20.3 Music notation10.21 Workplan

11 MPEG Phase 7 11.1 Requirements 11.2 Part 1 - Systems 11.2.1 Standard 11.2.2 Amendment 1 - Systems Extensions 11.2.3 Corrigenda 11.3 Part 2 - Description Definition Language 11.3.1 Standard

22

11.3.2 Corrigenda 11.4 Part 3 - Visual 11.4.1 Standard 11.4.2 Amendment 1 - Visual Descriptors Extensions 11.4.3 Corrigenda 11.5 Part 4 - Audio 11.5.1 Standard 11.5.2 Amendment 1 - Audio Visual Descriptors Extensions11.5.3 Corrigenda 11.6 Part 5 - Multimedia Description Schemes 11.6.1 Standard 11.6.2 Amendment 1 - Extensions 11.6.3 Amendment 2 - User Preference Extensions11.7 Part 6 - Reference software 11.7.1 Standard 11.7.2 Amendment 1 - Reference software extensions 11.8 Part 7 - Conformance Testing 11.8.1 Standard 11.8.2 Amendment 1 - Conformance extensions 11.9 Part 8 - Extraction and use of visual descriptors 11.9.1 Technical Report 11.9.2 Amendment 1 - Extensions11.10 Part 9 - Profiles 11.10.1 Standard 11.11 Part 10 - Schema definition11.11.1 Standard 11.12 Workplan

12 MPEG phase 21 12.1 Requirements 12.2 Part 1 – Vision, Technologies and Strategy 12.2.1 Technical Report12.3 Part 2 – Digital Item Declaration 12.3.1 Standard 12.4 Part 3 – Digital Item Identification 12.4.1 Standard 12.5 Part 4 – IPMP Framework12.5.1 Standard 12.6 Part 5 – Rights Expression Language 12.6.1 Standard 12.7 Part 6 – Rights Data Dictionary 12.7.1 Standard 12.8 Part 7 – Digital Item Adaptation 12.8.1 Standard 12.9 Part 8 – Reference software 12.9.1 Standard 12.10 Part 9 – File format 12.10.1 Standard 12.11 Part 10 - Digital Item Processing12.11.1 Standard 12.12 Part 11 - Evaluation Tools for Persistent Association

23

12.12.1 Technical Report12.13 Part 12 - Test Bed for MPEG-21 Resource Delivery12.13.1 Standard 12.14 Part 13 - Scalable video coding12.14.1 Standard 12.15 Part 14 - Conformance12.15.1 Standard 12.16 Explorations12.16.1 Event reporting 12.16.2 Broadcasting 12.16.3 Scalable audio coding12.16.4 Multimedia Middleware12.13 Work plan

13 Overall WG11 work plan

14 Explorations 14.1 3D AV coding 14.2 Intra-only video coding14.3 Test material 14.4 Timestamps and Audio Codec Behavior 14.5 Coding of multi-channel signals using spatial audio technology

15 Liaison matters

16 Administrative matters 16.1 Schedule of future MPEG meetings 16.2 Promotional activities

17 Organisation of this meeting 17.1 Tasks for subgroups 17.2 Joint meetings

18 Planning of future activities

19 Resolutions of this meeting

20 A.O.B

21 Closing

24

Annex 3List of documents submitted

No. Authors Title

10206 Wo Chang Document Register for SC29/WG11 Meeting Hawaii, USA

10207 Robert TurneyMarco Mattavelli

AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2

10208Xin WangJaime DelgadoChris Barlas

AHG on MPEG-21 REL and RDD Reference Software

10209Anthony VetroChristian TimmererSylvain Devillers

AHG on Editing MPEG-21 DIA Study of FCD & AM

10210

Thomas DeMartiniChris BarlasSylvain DevillersAnthony Vetro

AHG on Integration of DIA with REL and RDD

10211JC DufourdThomas DeMartiniRiccardo Leonardi

AHG on Virtual Resources in DIA

10212

Gerrard DruryMyriam AmielhSylvain DevillersYongju Cho

AHG on MPEG 21 Media Locators

10213 Jeho NamDebargha Mukherjee AHG on Core Experiments for MPEG-21 DIA

10214Gerrard DruryRik Van de WalleMunchurl Kim

AHG on Editing MPEG-21 DID/DIP and Core Experiments for DIP

10215T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual Draft Corrigendum, Reference Software and Conformance

10216 Miroslaw BoberSang-Kyun Kim

AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7

10217L. Cieplinski S.K.KimA. Yamada

AHG on Editing MPEG-7 Visual related Documents

10218 Aljoscha SmolicHideaki Kimata AHG on 3DAV Coding

10219

Mihaela van der SchaarA. BeckerJ. RidgeC.J. Tsai

AHG on Scalable Video Coding

10220Marius PredaMahnjin HanMika‰l Bourges-S‚venier

AHG on AFX documents editing and Core Experiments

10221 Patrick GioiaJames D. K. Kim AHG on AFX SW Implementation

25

http://mpeg.nist.gov/reg/_update.php?docnum=10221

mailto:??


mailto:??


mailto:??


mailto:??

http://mpeg.nist.gov/mpeg/docs/67_Hawaii/contrib/m10218.zip


mailto:[email protected]


mailto:??




mailto:??



mailto:??














mailto:??


















mailto:??




http://mpeg.nist.gov/reg/_list67.php?k=6,kv=1

http://mpeg.nist.gov/reg/_list67.php?k=5,kv=1

10222Mahnjin HanAlain MignotMikael Bourges-Sevenier

AHG on AFX Conformance

10223 Marius PredaMahnjin Han AHG on SNHC Profiles

10224 Claude SeyratAli Tabatabai AHG on MPEG-7 Systems

10225Jean-Claude DufourdYuval FisherJuergen Schmidt

AHG on MPEG-4 Scene Representation

10226 Zvi Lifshitz AHG on IM1

10227 Dave Singer AHG on MPEG File format

10228 Mikael Bourges-SevenierVishy Swaminathan AHG on MPEG-J Extensions

10229 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

10230 Ralph Sperschneider Report of the AHG on MPEG-4 Audio Conformance

10231 Ralph SperschneiderHeiko Purnhagen

Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

10232 T. Nomura AHG on MPEG-4 Audio Extensions 1 and 2

10233 Tilman Liebchen AHG on MPEG-4 Audio Lossless Coding

10234 Markus Cremer AHG on MPEG-7 Audio

10235 Paolo NesiGiorgio Zoia AHG on Music Notation Requirements

10236 Alexandre Cotarmanac.hSchuyler Quackenbush AHG on Timestamps and Audio Codec Behavior

10237 Schuyler Quackenbush AHG on Audio Explorations

10238Tobias OelbaumTK TanVittorio Baroncini

AHG on AVC Verification Tests

10239

Olivier AvaroIan BurnettJean GelissenYoung Kwon LimYuval Noimark

AHG on MPEG Multimedia Middleware

10240 Brad GandeeChris Barlas AHG on MPEG-21 Profiles and Extensions

10241

Artur LugmayrAbdellatif Benjelloun TouimiJong-Nam KimItaru KanekoJaejoon Kim

AHG on study of MPEG-21 and broadcasting

10242 Wo ChangMasanori Sano AHG on MPEG-7 Interoperability and Profiling

10243 FX Nuttall Andrew Tokmakoff AHG on MPEG-21 Event Reporting

26


mailto:??














mailto:??





mailto:??



mailto:??


mailto:??





mailto:??


mailto:??


mailto:??




















mailto:??



mailto:??


mailto:??


mailto:??

10244 Simon WattBas van den Heuvel

AHG on Requirements for MPEG-21 Architecture and MPEG-21 IPMP

10245 Niels RumpRichard Gooch AHG on Editing the Persistent Association WD

10246 Kohtaro Asai AHG on Intra-only Coding in MPEG

10247 ITTF Table of Replies on ISO/IEC FDIS 13818-11 [SC 29 N 5598]



10250 IEC TC 100 IEC CDV 61883-4: Consumer audio/video equipment -- Digital interface -- Part 4: MPEG2-TS data transmission [SC 29 N 5630]

10251 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/PDAM 1

10252 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:200X/PDAM 1

10253 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/PDAM 1 [SC 29 N 5656]

10254 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/FPDAM 2 [SC 29 N 5657]


10256 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-3/DCOR 1

10257 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/DCOR 1

10258 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 5

10259 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/PDAM 3



10262 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/FPDAM 2



10265 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 21000-7




10269 Jean-Claude Dufourd Brisbane Integration Report

10270 SC 37 ISO/IEC CD 19794-2: Information technology -- Biometric data interchange formats -- Part 2: Finger minutiae data [SC 29 N 5637]

10271 SC 37 ISO/IEC CD 19794-4: Information technology -- Biometric data interchange formats -- Part 4: Finger image data [SC 29 N 5638]

10272 SC 37 ISO/IEC CD 19794-5: Information technology -- Biometric data interchange formats -- Part 5: Face image data [SC 29 N 5639]

10273 SC 37 ISO/IEC CD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5640]

10274 Niels RumpRichard Gooch Editor's Input on ISO/IEC WD 21000-11

10275 Koenen Initial Thoughts on MPEG-21 Profiling

27





















































































mailto:??

10276 Jean H.A. Gelissen Additional Requirements for MPEG Multimedia MiddleWare (M3W)

10277 UK National Body Revised input relating to ISO/IEC 13818-1 ISO 639 language descriptor

10278 UKNB UK position on WG 1/11 file format working

10279 ST13-03 Liaison Committee SMPTE VC-9 Work Item and Information Exchange Between SMPTE and WG11

10280 Alexandre Cotarmanac'h French NB position on Advanced Scene Coding

10281Anthony Vetro Christian Timmerer Sylvain Devillers

Editors Input on ISO/IEC 21000-7 FDIS

10282Anthony Vetro Christian Timmerer Sylvain Devillers

MPEG-21 DIA AM v7.1

10283 James D. Johnston A proposal for testing Progressive-to-Lossless Coding

10284 ITU-T SG 16/Q.6 Liaison Statement from ITU-T SG 16/Q.6 [SC 29 N 5659]

10285 UKNB UKNB Position Paper on SC 29/WG 11 Liaison Activities

10286Silvia LlorenteJaime DelgadoEva Rodriguez

Enhanced versions of DMAG REL Reference Software

10287

Eva RodriguezJaime DelgadoRoberto GarcíaSilvia Llorente

DMAG REL license interpretation using RDD term genealogy

10288Eva RodriguezJaime DelgadoSilvia Llorente

DMAG REL Authorization Request Validation Rules Checker

10289

Thomas DeMartiniVenu VenkatramanMai NguyenXin Wang

Contributions on MPEG-21 REL Conformance

10290

Thomas DeMartiniVenu VenkatramanMai NguyenXin WangJaime DelgadoEva RodriguezSilvia Llorente

MPEG-21 REL Authorization Request Validation Rules

10291 Thomas DeMartini Issues in and Contributions for MPEG-21 DIP WD v3 (N5939)

10292

J. J. Chae Jong-Won Seok J. Y. Kim Young Kwon Lim Jin Woo Hong Jinwoong Kim

Response to Requirements for MPEG-21 Architecture and MPEG-21 IPMP

10293 Kazumasa Yamazawa(NAIST)Hideaki Kimata(NTT)Ryuji Kitaura(Sharp)

Proposal of a new level for super high-resolution video to AVC Profiles

28

































































mailto:SMPTE












Hitoshi Habe(Kyoto Univ.)

10294 Pierrick Philippe on Behalf of the FNB FNB Position on a New Work Item on Spatial Audio

10295

Truong Cong Thang Yong Ju Jung Yong Man Ro Jae-Gon Kim Jeho Nam Jin-Woo HongDebargha Mukherjee

Report of CE on Modality Conversion QoS

10296

TiHao ChiangYi-Shin TungChung-Neng WangJens-Rainer Ohm

MPEG-4 Visual: Updated List of Problems Reported, v.10.1

10297 Chun-Jen TsaiChung-Neng Wang

Proposed Draft Requirements for ISO/IEC TR21000-12 Multimedia Test Bed for Resource Delivery, v. 4

10298

Chun-Jen TsaiChung-Neng WangChia-Yang TsaiHsiao-Chiang ChuangJin-He ChenJau-Ching MaTiHao ChiangHsueh-Ming Hang

Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments

10299Chun-Jen TsaiMihaela van der ShaarYoung-Kwon Lim

Working Draft 3.0 of ISO/IEC TR21000-12 Multimedia Test Bed for Resource Delivery

10300 Soo-Jun Park Report of Cross Verification Result for VCE-1: Perceptual 3D Shape Descriptor

10301Soo-Jun ParkMyung Gil JangChee Sun Won

A Proposal for VCE-2: DS for Image Grouping

10302 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 5663]

10303 Akio Yamada Leszek Cieplinski Editor's input on ISO/IEC 15938-3/FPDAM1

10304 Akio Yamada Sang-Kyun Kim Editor's Input on ISO/IEC TR 15938-8/PDAM1

10305 Akio Yamada Report on VCE-2: A study on use scenarios and DS design for photo archive

10306 Tilman Liebchen Proposed WD 2 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS)

10307 David ViretteJean-Bernard Rault Listening Test Results for CE on Low Complexity Stereo module

10308 Woo-Jin Han Successive Temporal Approximation and Referencing (STAR) for improving MCTF in Low End-to-end Delay Scalable Video Coding

10309 Frederic Vexo Swiss NB position on Advanced Scene Coding

10310Chris JoslinThomas Di GiacomoNadia Magnenat Thalmann

Swiss NB Comment for Early Ballot Vote of PersonType to MDS PDAM2

29













































































10311 Helge Drumm CE Shadow Algorithm

10312 Frederic VexoMario Gutierrez Lightweight Coding of Animated Synthetic Scene

10313 Itaru Kaneko noneMika Onishi Neergaard Optimization of DID in MPEG-21 architecture

10314 Jing-Xin Wang Alvin W.Y. Su

Department of Computer Science and Information Engineering, National Cheng Kung University

10315Itaru Kaneko Takafumi Ueno Takanori Seno

Japanese National Body Position to MPEG-21 architecture

10316

Itaru KanekoOsama K Alshaykh Junya Tsutsumi Mark Callow Jiro Katto Daisuke Inoue

Requirements and Interoperability issues of Lightweight Graphics proposals

10317 Sang-Kyun KimYoung Sik Huh

Use Scenarios for Visual tools and DS for images or photos libraries (VCE-2)

10318 The National Body of Japan JNB comments on ISO/IEC 14496-2:200x (Visual 3rd Edition) DCOR1

10319

Gerrard DruryCraig BrownSylvain Devillers YongJu Cho

Requirements for MPEG-21 URI-based location schemes

10320 Kohtaro Asai Intra-only video coding

10321

Jeongil SeoGi Yoon ParkDaeyoung Jang Kyeongok KangJinwoong Kim

Proposal of a new AdvancedAcousticScene node in MPEG-4 BIFS

10322

Kyunghee JiNammee MoonYoungJoo SongJinWoo Hong

Additional MPEG-21 Event Reporting Requirements

10323

Won-Ha KimSeyoon JeongKyuheon KimJinwoong Kim

Interframe Wavelet Video Coding with Frame Adaptive Spatial Wavelet

10324In Kyu ParkDuck Hoon KimIl Dong Yun

Perceptual 3D shape descriptor: Result of core experiment (VCE-1)

10325 Hideaki Kimata Request of defining a new level to AVC Profiles

10326 Takehiro Moriya Verification Report on MPEG-4 ALS Core Experiment 2 (Support for multi-channel and 32-bit PCM)

10327 Hideaki Kimata Preliminary results on multiple view coding for the sparse Ray Space representation (3DAV EE2.2.1)

10328 Ryuji KitauraShawmin Lei Request of defining a new level to MPEG-4 AVC Profiles

30


mailto:[email protected]:


























mailto:([email protected])






















































10329 Shinjun LeeMahnjin Han

Updates on the Description of PointTexture Compression in Depth Image-Based Representation (DIBR)

10330 Euee S. Jang VM Contribution on Lossless 3DMC

10331 Young-Kwon LIM for KNB KNB comments on Simple Scene Description Format

10332 Goro Hamagishi Request of defining a new level to AVC Profiles

10333

Euee S. JangSun Young LeeHyun Jong OhJong Woo WonWook-Joong KimMyungsuk KiKyuheon Kim

Some results on local decoding of panoramic video (EE1)

10334 3D Consortium via SC 29 Secretariat Liaison Statement from 3D Consortium [SC 29 N 5674]

10335 Kazuya Suekage Request of defining a new level to AVC Profiles

10336

Masanori SanoBhavan GandhiAlanK MelbyRomulo Pinho

Minor Editing to CD of MPEG-7 Part 9

10337 Wo Chang Summary of MPEG-7 Multiple Profiles Benefits and Issues

10338 Jean H.A. Gelissen on behalf of the DNB DNB on spatial audio coding

10339

Edouard LamborayStephan WuermlinMichael WaschbueschMarkus GrossHanspeter Pfister

A Compression Framework for Free-Viewpoint Video based on 3D Video Fragments

10340I.WolfB.Feiten A.Graffunder

Improvements for Audio AdaptationQoS

10341

Ming JiZY HuangSM ShenTaka SenohTakafumi Ueno

MPEG-21 IPMP Use Cases and derived requirements as a response to CfR for MPEG-21 Arch and IPMP

10342 S.A.F.A. van den Heuvel Response to the requirements CfC for MPEG-21 IPMP and MPEG-21 architecture

10343Aljoscha SmolicKarsten MuellerPhilipp Merkle

Preliminary Results on EE2 Using Octree Reconstuction and View-dependent Texture Mapping

10344Karsten MüllerAljoscha SmolicTobias Rein

Preliminary Results on Core Experiments on View-Dependent Multi-Texturing for MPEG-4 AFX

10345 Naoya TanakaChong Kok Seng Check results of the proposed SBR conformance bitstreams

10346 Pierrick PhilippeJean-Bernard Rault Proposed requirements for a CfE on Spatial Audio Encoding

10347 Juergen Schmidt Update to WD 3.0 of ISO/IEC 14496-11:2003/AMD3 (Audio BIFS

31










































































Oliver BaumJerome DanielKlaus Eilts-GrimmMario Sieck

Ver 3)

10348 Juergen SchmidtOliver Baum Audio BIFS Ver. 3 Profile Proposal

10349 Ernst F. SchroederMartin Weishart

Input for GNB Comments to ISO/IEC 14496-3:2001/ PDAM3 (MP3onMP4)

10350 Ernst F. Schroeder MP3onMP4 Profile Proposal: Backwards Compatible Audio Profile

10351 Klaus Eilts-GrimmMario Sieck

Implementation of the AudioFX PROTO solution for Small Systems with reduced overhead; Preliminary Results

10352 Gyeong Ja JangJames D. K. Kim

The XMT-A specifications for BitWrapper node and its encoding parameters

10353 Marco Rittermann Proposal for the assessment of natural 3D video objects

10354

Doug Young SuhChun-Jen TsaiAlexandre CotarmanachKyuheon Kim

MOEG and Internet (1) : the avt Working Group

10355

Giorgio ZoiaPaolo NesiPierfrancesco BelliniJerome Barthelemy

Music Notation Functionality and Interface to MPEG

10356 Melanie Dulong de RosnayDaniela Parayre

Answer to Call for Requirements for MPEG-21 Architecture and MPEG-21 IPMP

10357

Paolo NesiPierfrancesco BelliniJerome BarthelemyGiorgio Zoia

Music Notation Technical Requirements

10358 Pierrick Philippe SBR conformance test report and proposed modifications

10359 H.A. Gelissen on behalf of the DNB Request for improved scalability support at MPEG-2 System level

10360Chris JoslinThomas Di GiacomoNadia Magnenat-Thalmann

Swiss NB Comment on the Promotion of AvatarPreferenceType

10361

Rongshan YuXiao LinSusanto RahardjaHaibin Huang

Proposal of Bit-Stream Syntax Revision for MPEG-4 Audio Scalable Lossless Coding

10362


Verification Report for MPEG-4 SLS Core Experiment 2 (Improving Coding Efficiency)

10363

Munchurl KimHendryJong-Nam KimKeonsoo ParkHuang Zhongyang

CE reports on DIBO explorations

10364 Ralph Sperschneider Status on MPEG-4 Audio Conformance

32
























mailto:Jean

mailto:Jean


















































10365 Vladimir Levantovsky Font Compression Reference Source Code Implementation

10366

Werner OomenErik SchuijersHeiko PurnhagenJonas Engdegård

MPEG4-Ext2: CE on Low Complexity parametric stereo

10367 Werner OomenRichard Theelen

Technical description of DST (lossless coding of 1 bit oversampled audio)

10368 Andreas Hutter on behalf of the GNB German NB comment on resolution 8.1 of the 66th MPEG meeting

10369 Andreas Hutter on behalf of the GNB Advance German NB ballot comment on ISO/IEC 15938-5 PDAM 2

10370

Kristofer KjörlingMarc Klein MiddelinkLars VillemoesAndreas Schneider

Proposed SBR conformance test tool.

10371 Werner OomenErik Schuijers MPEG-4 Ext.2, subjective results on CE Low complexity stereo

10372 Kristofer Kjörling Listening test verification of core experiment on low complexity parametric stereo.

10373 Kristofer KjörlingJonas Rödén

Proposed modification of 14496-3:2001/AMD1:2003/DCor.1. (N6008) concerning SBR and DRC

10374 Werner OomenBert den Brinker MPEG-4 Audio Extension 2, Verification test Proposal

10375Le FeuvreConcolatoDufourd

Various enhancements for MPEG-4 Systems

10376 Juergen Herre Cross-check results of MPEG-4 Audio Extension 2, Core Experiment on Low Complexity parametric stereo decoding

10377

Alexandru SalomieAdrian MunteanuRudi DeklerckPeter Schelkens

Update of flags from the MeshGrid decoder specific info

10378 Juergen Herre Spatial Audio Coding: Market Context and Requirements

10379Matthias GruhneClaas DerbovenJuergen Herre

An Appropriate Chord Pattern Representation for Music Retrieval and Comparison

10380 Giorgio Zoia New proposed conformance bitstreams for MPEG-4 SA

10381 Giorgio Zoia Bug fix proposal for AudioBIFS and related Levels

10382

Andreas HutterJoerg HeuerGabriel PanisDebargha MukherjeeChristian Timmerer

Report of CE on BSD Transformation Instructions

10383

Andreas HutterJoerg HeuerGabriel PanisChristian Timmerer

Proposal to support gBSD Transformations in a Streaming Use Case

10384 Joerg Heuer Report on ME-2: Schema transmission framework

33










































mailto:Jean-Claude

mailto:Cyril

mailto:Jean













































Daniel PeintnerAndreas Hutter

10385

Heiko PurnhagenJonas EngdegårdWerner OomenErik Schuijers

Combining Low Complexity Parametric Stereo with High Efficiency AAC

10386 Frederik De KeukelaereRik Van de Walle Results of Core Experiment on Object Map Technology

10387Robbie De SutterFrederik De KeukelaereRik Van de Walle

Digital Item Adaptation - Usage Environment Description Tools Parser

10388 Michael Casey SoundClassificationModelDS Proposed Draft Corragenda

10389

Frederik De KeukelaereGerrard DruryIan BurnettRik Van de Walle

Digital Item Adaptation - Session Mobility Demonstrator

10390 Marius PredaFrancoise Preteux

Scene Graph Node Design for Blending Meshes : the MorphShape Node

10391 Marius PredaFrancoise Preteux BBA Implementation in IM1

10392 Marius PredaFrancoise Preteux Bitstream Contribution for the Animated Character Profile

10393 Ralf Geiger Proposed WD1 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable Lossless Coding (SLS)

10394Ralf Geiger Jürgen Herre Thomas Sporer

Proposed Evaluation Methods for Fine-Grain Scalability in MPEG-4 SLS

10395 Shlomo BirmanYoram Elichai

Israeli NB Comments on Study Text of ISO/IEC 14496-11/FPDAM2 (N5979)

10396 Yongjun WuJohn W. Woods Recent improvements in the MC-EZBC video coder

10397Christian Timmerer Gerrard Drury Jeho Nam

AHG on MPEG-21 DIA Reference Software

10398 Christian Timmerer on behalf of the Austrian NB Austrian NB comments on MPEG-21 DIA (Digital Item Adaptation)

10399 Mathias Schwark Report on the implementation of a new MPEG-4 Player

10400 ST13-03 Liaison Committee SMPTE Liaison to WG11 regarding Alpha Channel Considerations in the Professional Amendment to AVC/H.264

10401 Mathias Schwark Proposal on the implementation of Decoders in IM1

10402 Thomas RusertChun-Jen Tsai

Generation of Original Test Sequences and AVC Anchors for Call for Proposals on Scalable Video Coding Technology

10403

Brad GandeeTJ PannuManuel HamThomas DeMartiniXin Wang

A Proposed MPEG-21 REL Solution for Mobile DRM Systems Based on an Analysis of OMA DRM Release 2 Requirements

34



















mailto:SMPTE



































































10404Xin WangThomas DeMartiniBrad Gandee

Comments on and Contribution to the MPEG-21 Architecture and IPMP Requirements

10405 Viktor Varsa Conformance bitstream for the Simple Profile Level 0b

10406 Per Fröjdh Presentation and file-tree extensions to the ISO base media file format

10407Per FröjdhMagnus WesterlundDavid Singer

SRTP hint track format for the ISO base media file format

10408 Masayuki TanimotoToshiaki Fujii Test Sequence for Ray-Space Coding Experiments

10409 David Singer Apple Candidature for MP4 Registration Authority

10410 Masayuki TanimotoToshiaki Fujii Ray-Space Coding Using Temporal and Spatial Predictions

10411Shih-Ta Hsiang Debargha MukherjeeSam Liu

Fully format-independent adaptation use cases using DIA SoFCD tools

10412 on behalf of AUNB AUNB Contribution: URI-based location schemes in MPEG-21

10413 Brett Powley Response to CfR for MPEG-21 Architecture and MPEG-21 IPMP

10414

Eunmi OhJung-Hoe KimMiao LeiSangWook Kim

Improvement of coding efficiency in MPEG-4 audio scalable lossless coding (SLS)

10415 Abhijeet GolwelkarJohn W. Woods

Improved Motion Vector Coding for Sliding Window (SW-) EZBC Video Coder

10416

Kazumasa Yamazawa(NAIST)Ryuji Kitaura (SHARP)Hitoshi Habe (Kyoto Univ.)Hideaki Kimata (NTT)Toshio Nomura (SHARP)

Evaluation result of divided omni-directional video using AVC (EE1)

10417Gerrard DruryFrederik De KeukelaereThomas De Martini

Report of DIP CE on DIM Object Map

10418 Claude Seyrat Editors study of the ISO/IEC 15938-1/FPDAM

10419 Gregoire Pau MPEG-7 Systems reference software status report

10420 Gregoire PauThibault Franchini

Proposed corrigendum item in ISO/IEC 15938-1/COR on BiM forward compatibility

10421Victor TorresJaime DelgadoEva Rodriguez

DMAG REL License Interpretation within DID

10422

Chun-Jen TsaiMihaela van der SchaarYoung-Kwon LimDoug Young Suh

AHG on MPEG Multimedia Test Bed

10423 Roberto GarciaJaime DelgadoEva Rodriguez

RDDOnto, Rights Data Dictionary Ontology Version 2

35
















































































Silvia Llorente

10424

Frederik De KeukelaereJeroen BekaertPatrick HochstenbachRobbie De SutterHerbert Van de SompelRik Van de Walle

Issues related to the inclusion of DIP information in DIDs

10425 ST13-03 Liaison Committee SMPTE Engineering VP SMPTE ST13 Response to WG11 Liaison N6073

10426 John R. Smith Editor’s Input on MPEG-7 Multimedia Description Schemes COR/1

10427

Jeroen BekaertPatrick HochstenbachFrederik De KeukelaereHerbert Van de SompelRik Van de Walle

Suggestions concerning MPEG-21 Digital Item Declaration

10428 Mikael Bourges-SevenierVishy Swaminathan Corrections and requests for new features in MPEG-J

10429 Young-Kwon LM WIPI, mobile standard platform in Korea

10430 Sylain DevillersEric Delfosse Improved BSDL text for DIA FDIS

10431 Reid Jonathan Teh MPEG-4 Video Verification Model version 19.0

10432 Schumacher Robert Turney MPEG-4 Part 9 virtual socket interface description

36


mailto:Paul


mailto:Angus





















mailto:SMPTE

mailto:SMPTE






Annex 4Output documents

No. Source Title 6080 Convener List of Documents from the Hawaii, USA Meeting6081 Convener Resolutions of the Hawaii, USA Meeting6082 Convener List of AHGs Established at the 67th Meeting in Hawaii, USA6083 Convener Report of the 67th Meeting in Hawaii, USA6084 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents6085 Convener Press Release of the 67th Meeting in Hawaii, USA6086 HoD Meeting Notice of the 68th Meeting in Munich, Germany6087 HoD Guide for WG 11 Meeting Hosts6088 HoD MPEG 1016089 Systems Request for amendment 1 for 14496-12 ISO Base Media File Format6090 Systems Text of Amendment 1 to 14496-12 ISO Base Media File Format PDAM6091 ISG ISO/IEC 14496-9/WD of AM 1: Information Technology – Coding of Audio

Visual Objects - Part 9: Reference Hardware Description.6092 ISG Integrated framework for MPEG-4 Part 7, Part 9 and Part 10.6093 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2.6094 ISG ISO/IEC 15938-6/FPDAM 1: Information technology -- Multimedia content

description interface -- Part 6: Reference software, AMENDMENT 1: Reference software extensions.

6095 SNHC Call for Proposals on MPEG Graphics API6096 SNHC AFX CE description6097 SNHC ISO/IEC 14496-16/AMD1 WD 3.06098 SNHC AFX VM 13.06099 Convener AHG on AFX document editing and Core Experiments6100 Convener Terms of Reference6101 Convener MPEG standards6102 Convener Table of unpublished standards at FDIS level6103 Convener Table of standards under development6104 Convener Work item assignment6105 Convener List of patent statements received6106 Convener AHG on AFX conformance6107 Video Disposition of Comments for ISO/IEC 14496-10:2003/PDAM1 (AVC

Professional Extensions)6108 Video Text of ISO/IEC 14496-10:2003/FPDAM1 (AVC Professional Extensions)6109 Video Text of ISO/IEC 14496-10:2003/DCOR 1 (AVC Corrigendum)6110 Liaison List of WG11 Liaisons6111 Liaison Responses to NB Comments6112 Liaison Information on Progress of MPEG Standards6113 Liaison Liaison Statement to TV Anytime

37

6114 Liaison Liaison Statement to 3GPP on Streaming Text6115 Liaison Liaison Statement to 3GPP2 on objectTypeIndication6116 Liaison Liaison Statement to SMPTE on Alpha Channel coding6117 Liaison Liaison Statement to SMPTE on its VC-9 work item6118 Liaison Liaison Statement to 3D Consortium6119 Liaison Liaison Statement to AVS China 6120 Liaison Liaison Statement to CRF6121 Liaison Liaison Statement to ITU-T SG16 Q.66122 Liaison Liaison Statement to EBU-B/AIM6123 Liaison Liaison Statement to ITU-T SG176124 Liaison Liaison Statement to W3C6125 Liaison Liaison Statement to ISO/IEC SC376126 Audio Study on 13818-7:2003/DCOR 16127 Audio Study on ISO/IEC 14496-3:2001/AMD1:2003/DCOR16128 Audio Study on 14496-3:2001 DCOR 26129 Audio DoC on 14496-3:2001:/FPDAM 2, Parametric Coding6130 Audio Text of 14496-3:2001:/FDAM 2, Parametric Coding6131 Audio DoC on 14496-3:2001/PDAM 3, MP3onMP46132 Audio Text of 14496-3:2001/FPDAM 3, MP3onMP46133 Audio WD 2 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)6134 Audio WD 1 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable Lossless Coding

(SLS)6135 Audio WD of lossless coding of 1-bit audio signals6136 Audio Workplan for Extension 2, Parametric Coding6137 Audio Workplan for Audio Lossless Coding (ALS)6138 Audio Workplan for Audio Scalable Lossless Coding (SLS)6139 Audio Work Plan for Lossless Coding of 1-bit Audio Signals6140 Audio Description of Audio Codec Behavior6141 Audio Workplan for Audio contribution to MPEG-4 conformance (Bandwidth

Extension)6142 Audio Status of MPEG-4 Audio Conformance6143 Audio Workplan for CE on AdvancedAcousticScene Node6144 Audio Workplan for MPEG-7 Audio Core Experiment6145 Audio Proposed Tools for MPEG-7 AMD 26146 Audio Proposed Draft Corrigendum for MPEG-7 Audio6147 Audio Status of MPEG-7 Audio Contribution to XM and Conformance6148 Audio New Subjective Sound Quality Measurement Criteria for Digital Item

Adaptation Applications6149 Audio Application Scenarios for Music Notation integrated in MPEG6150 Audio Call for Information on Spatial Audio Coding6151 Audio Draft Call for Proposals on Spatial Audio Coding6152 Convener AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

38

6153 Convener AHG on MPEG-4 Audio Conformance6154 Convener AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software6155 Convener AHG on MPEG-4 Audio Extensions 1 and 26156 Convener AHG on MPEG-4 Audio Lossless Coding6157 Convener AHG on MPEG-7 Audio6158 Convener AHG on Music Notation Application Requirements 6159 Convener AHG on Timestamps and Audio Codec Behavior6160 Convener AHG on Audio Explorations6161 MDS Study of Draft Comments on MPEG-7 MDS PDAM2 6162 MDS MPEG-7 MDS COR/1 WD v2.06163 MDS MPEG-7 Schema Definition Study of CD6164 MDS ISO/IEC 21000-2 DID 2nd Edition WD v.26165 MDS MPEG-21 REL/RDD Software Implementation Plan v.56166 MDS Evaluation Criteria for Appointing the RA for ISO/IEC 21000-66167 MDS DoC on ISO/IEC 21000-7 FCD6168 MDS ISO/IEC 21000-7 FDIS – Part 7: Digital Item Adaptation6169 MDS MPEG-21 Digital Item Adaptation AM v.86170 MDS Request for Amd/1 to ISO/IEC 21000-7 Digital Item Adaptation6171 MDS MPEG-21 DIA AMD/1 WD: DIA Conversions and Permissions6172 MDS MPEG-21 DIA Software Implementation Plan v.66173 MDS ISO/IEC 21000-10 CD – Part 10: Digital Item Processing6174 MDS Workplan for Core Experiment on DIBO Explorations6175 MDS MPEG-21 DIP Software Implementation Plan v.16176 Convener AHG on MPEG-21 Media Locators 6177 Convener AHG on MPEG-21 REL-RDD Reference Software6178 Convener AHG on MPEG-21 DIA Editing6179 Convener AHG on Low-Complexity and Efficient Digital Item Resource Adaptation6180 Convener AHG on MPEG-21 DIA Reference Software6181 Convener AHG on MPEG-21 DIP Reference Software6182 Convener AHG on Editing and Core Experiments for DIP6183 Video Study Text of ISO/IEC 14496-2:200X DCOR 16184 Video MPEG-4 Visual Verification Model 19.06185 Video MPEG-4 Visual: List of Problems Reported version 11.06186 Video Text of ISO/IEC 15938-3:2002/COR 16187 Video DoC on ISO/IEC 15938-3/FPDAM16188 Video Text of ISO/IEC 15938-3/FDAM 16189 Video Description of Core Experiments for MPEG-7 Visual Extensions6190 Video MPEG-7 Visual XM Document version 19.06191 Video Study Text of ISO/IEC TR 15938-8/PDAM16192 Video Request for Subdivision of ISO/IEC 21000: Part 13 Scalable Video Coding6193 Video Call for Proposals on Scalable Video Coding Technology6194 Video Description of Exploration Experiments in 3DAV

39

6195 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance

6196 Convener AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-76197 Convener AHG on Editing MPEG-7 Visual related Documents6198 Convener AHG on 3DAV Coding6199 Convener AHG on Scalable Video Coding6200 Systems Request for ISO/IEC 13818-1:2000/Amd.56201 Systems Text of ISO/IEC 13818-1:2000/PDAM56202 Systems Text of ISO/IEC 14496-1/FDAM26203 Systems Text of ISO/IEC 14496-11/COR16204 Systems DoC on ISO/IEC 14496-11/FPDAM26205 Systems Text of ISO/IEC 14496-11/FDAM26206 Systems Request for ISO/IEC 14496-11/Amd.36207 Systems Text of ISO/IEC 14496-11/PDAM36208 Systems Items for ISO/IEC 14496-11/COR26209 Systems Request for ISO/IEC 14496-11/Amd.46210 Systems Text of ISO/IEC 14496-11/PDAM46211 Systems Technology under consideration for 14496-12/Amd.16212 Systems Referencing Explanatory Report for 3GPP specification6213 Systems DoC on ISO/IEC 14496-17/CD6214 Systems Text of ISO/IEC 14496-17/FCD6215 Systems Text of ISO/IEC 14496-18/FDIS6216 Systems Request for ISO/IEC 14496-196217 Systems Text of ISO/IEC 14496-19/FDIS6218 Systems Draft DoC on ISO/IEC 15938-1/FPDAM16219 Systems Study Text of ISO/IEC 15938-1/FPDAM16220 Systems Draft DoC on ISO/IEC 15938-1/DCOR16221 Systems Study Text of ISO/IEC 15938-1/COR16222 Systems Core Experiments for Systems Extensions6223 Systems MPEG-7 Systems reference software workplan6224 Systems WD5.0 of ISO/IEC 21000-96225 Systems MPEG Multimedia Middleware Context and Objectives6226 Systems CfP on Lightweight Scene Representation6227 Convener Ad Hoc Group on MPEG-7 Systems6228 Convener Ad Hoc Group on MPEG-4 Scene Representation6229 Convener AHG on MPEG File format 6230 Convener AHG on MPEG-J Extensions 6231 Test Report of the Formal Verification Tests on IS 14496-10 AVC / H2.646232 Integration Text of ISO/IEC 13818-4:200X/FPDAM 16233 Integration Request for Amd 2 of ISO/IEC 13818-4:200X6234 Integration Text of ISO/IEC 13818-4:200X/PDAM26235 Integration Text of ISO/IEC TR 13818-5:200X/DAM 1

40

6236 Integration Text of ISO/IEC 13818-5:200X/DCOR26237 Integration DoC on ISO/IEC 14496-4:2003/FPDAM 56238 Integration Text of ISO/IEC 14496-4:2003/FDAM 56239 Integration DoC on ISO/IEC 14496-4:2003/PDAM 66240 Integration Text of ISO/IEC 14496-4:2003/FPDAM 66241 Integration Request for Amd 8 of ISO/IEC 14496-4:20036242 Integration Text of ISO/IEC 14496-4:2003/PDAM 86243 Integration DoC on ISO/IEC 14496-5:2003/FPDAM 46244 Integration Text of ISO/IEC 14496-5:2003/FDAM 46245 Integration DoC on ISO/IEC 14496-5:2003/FPDAM 56246 Integration Text of ISO/IEC 14496-5:2003/FDAM 56247 Integration DoC on ISO/IEC 14496-5:2003/PDAM 66248 Integration Text of ISO/IEC 14496-5:2003/FPDAM 66249 Integration DoC on ISO/IEC 14496-5:2003/PDAM 76250 Integration Text of ISO/IEC 14496-5:2003/FPDAM 76251 Integration Text of ISO/IEC 15938-6:2003/FPDAM16252 Integration DoC on ISO/IEC 15938-7:2003/PDAM16253 Integration Text of ISO/IEC 15938-7:2003/FPDAM16254 Integration WD4.0 of ISO/IEC 21000-8/CD Reference Software6255 Integration Text of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery6256 Integration WD2.0 of ISO/IEC 21000-14 MPEG-21 Conformance6257 Integration MPEG Reference Software Guide6258 Convener AHG on MPEG-21 Reference Software6259 Convener AHG on MPEG Multimedia Test Bed6260 Convener AHG on MPEG-21 Conformance6261 Liaison Liaison Statement to EBU, ATSC, DVB, DVD Forum, 3GPP, and 3GPP2 on

AVC Test Results6262 Requirements MPEG-4 Profiles under Consideration6263 Requirements Study of ISO/IEC 15938-9/Committee Draft6264 Requirements MPEG-21 Requirements Document V.2 6265 Requirements MPEG-21 in Broadcasting6266 Requirements Process and Requirements for Profiling in MPEG-216267 Requirements Draft MPEG-21 Profiles under Consideration Document 6268 Requirements Requirements for Mobile MPEG-21 REL Profile6269 Requirements Text of PDTR of ISO/IEC 21000-1 Second Edition6270 Requirements Final Call for Proposals for MPEG-21 IPMP6271 Requirements Draft requirements for MPEG-21 IPMP and Reference Model6272 Requirements Draft Specific Conversion Description Requirements6273 Requirements Call for Comments on Draft MPEG-21 Conversion Descriptor Requirements6274 Requirements Text of PDTR of ISO/IEC 21000-116275 Requirements Requirements for MPEG-21 Test Bed6276 Requirements Draft system design for Omni-directional Video

41

6277 Requirements Draft Multimedia Application Formats Document6278 Requirements MPEG-21 Event Reporting Call for Proposals 6279 Requirements MPEG-21 Event Reporting Requirements6280 Convener AHG on Intra-only Coding in MPEG6281 Convener AHG to complete requirements for MPEG-21 IPMP6282 Convener AHG on study of MPEG-21 and broadcasting6283 Convener AHG on Profiles and Extensions for the MPEG-21 REL6284 Convener AHG on MPEG-7 Interoperability and Profiling6285 Convener AHG on Multimedia Application Format (MAF)6286 Convener AhG on MPEG-21 Event Reporting

42

Annex 5Report of Requirements meeting

Source: Rob Koenen, InterTrust Technologies

NB: this report does not duplicate the resolutions, but rather complement it. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below.

Agenda

Monday 9:00-13:45 opening plenary meeting 13:30-14:30 Lunch (ends one hour after plenary ends)

14:30 -15:30

MPEG-21 Requirements Plenary; tasks for the weekWhich Calls for Proposals?IPMP & Architecture Requirements

10315 Japanese National Body Position to MPEG-21 architecture - Itaru Kaneko et.al.Event ReportingPart 1, 2nd edition (PDTR)Persistent AssociationMPEG-21 in Broadcast

10244 AHG on Requirements for MPEG-21 Architecture & MPEG-21 IPMP – Watt, V.d. Heuvel

Rqs

15:30-17:00

MPEG-21 Requirements and Profiles10240 AHG on MPEG-21 Profiles and Extensions - Brad Gandee, Chris Barlas10313 Optimization of DID in MPEG-21 architecture - Itaru Kaneko Mika Onishi Neergaard10275 Initial Thoughts on MPEG-21 Profiling - Koenen for Requirements Group in Gold Coast10196 CRF Liason contribution on Usage Environments - Simon Watt (Note: this is a Brisbane

contribution!)

Rqs

17:00-18:00

MPEG-4 Profiles (Joint with Systems and SNHC)10223 AHG on SNHC Profiles - Marius Preda, Mahnjin Han10392 Bitstream Contribution for the Animated Character Profile - Preda, Preteux10348 Audio BIFS Ver. 3 Profile Proposal - Juergen Schmidt, Oliver Baum

Sys

Tuesday

09:00-10:00

Simple Scene Description (joint with Systems and SNHC)10225 AHG on MPEG-4 Scene Representation - Jean-Claude Dufourd, Yuval Fisher, Juergen Schmidt10280 French NB position on Advanced Scene Coding - Alexandre Cotarmanac'h10309 Swiss NB position on Advanced Scene Coding - Frederic Vexo 10331 KNB comments on Simple Scene Description Format - Young-Kwon LIM for KNB10228 AHG on MPEG-J Extensions - Mikael Bourges-Sevenier, Vishy Swaminathan10316 Requirements and Interoperability issues of Lightweight Graphics proposals - Itaru Kaneko, et.al.

Rqs

10:00-11:00 Virtual Resources, location schemes (Joint with MDS)10211 AHG on Virtual Resources in DIA – JC Dufourd, Thomas DeMartini, Riccardo Leonardi MDS

11:00-11:30

3DAV Requirements Issues (joint with Video)10325 Request of defining a new level to AVC Profiles - Hideaki Kimata10328 Request of defining a new level to MPEG-4 AVC Profiles - Ryuji Kitaura, Shawmin Lei10332 Request of defining a new level to AVC Profiles - Goro Hamagishi10335 Request of defining a new level to AVC Profiles - Kazuya Suekage10293 Proposal of a new level for super high-res video to AVC Profiles – Kazumasa Yamazawa et.al.

Rqs

11:30-12:30

Intra-only and Alpha in JVT (joint with JVT and Video)10246 AHG on Intra-only Coding in MPEG - Kohtaro Asai 10320 Intra-only video coding - Kohtaro Asai10400 SMPTE Liaison to WG11 regarding Alpha Channel Considerations in the Professional Amendment

to AVC/H.264 - ST13-03 Liaison Committee

Rqs

12:30-13:00 Test Bed Requirements 10297 Proposed Draft Requirements for ISO/IEC TR21000-12 v. 4 - Chun-Jen Tsai, Chung-Neng Wang Rqs

13:00-14:00 Lunch

14:00-15:00

Joint with Audio10350 MP3onMP4 Profile Proposal: Backwards Compatible Audio Profile - Ernst F. Schroeder10235 AHG on Music Notation Requirements - Paolo Nesi, Giorgio Zoia10435 MPEG-Music-Notation- Expression-of-Interest - David Crombie

Aud

15:00-16:00M3W (joint with Systems)

10239 AHG on MPEG Multimedia Middleware - Olivier Avaro, et.al.10276 Additional Requirements for MPEG Multimedia MiddleWare (M3W) - Jean H.A. Gelissen

Syst

16:00-17:00MPEG-21 CfP Status (IPMP and Event Reporting)

10243 AHG on MPEG-21 Event Reporting - FX Nuttall , Andrew Tokmakoff10322 Additional MPEG-21 Event Reporting Requirements - Kyunghee Ji, et.al.

Rqs

43

17:00-17:30 MPEG-21 ISO/IEC WD 21000-11 (Persistent Association)10274 Editor's Input on ISO/IEC WD 21000-11 - Niels Rump, Richard Gooch Rqs

17:30-18:00 MPEG-21 ISO/IEC WD 21000-1 (Strategy, Technologies and Vision) RqsWednesday

08:59-09:00 New Level in AVC for 3GPP Rqs09:00-11:00 Plenary meeting Rqs

11:30-12:15

MPEG-7 Plenary (Profiles), joint with MDS, Audio, Video, Systems …10242 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano10336 Minor Editing to CD of MPEG-7 Part 9 - Masanori Sano, et.al.10337 Summary of MPEG-7 Multiple Profiles Benefits and Issues - Wo Chang

Rqs

12:15-13:00 Joint with MDS on several issues10319 Requirements for MPEG-21 URI-based location schemes - Gerrard Drury, et.al. Rqs

13:00-14:00 Lunch14:00-15:00 MPEG-21 Ref Soft Requirements Joint meeting with Integration, MDS, Systems Rqs15:00-15:30 MPEG-21 in Broadcasting Rqs15:30-16:30 Open ?16:30-17:00 Multimedia Application Format Requirements (Joint with just about everybody) Rqs17:00-18:00 Review of MPEG-21 CfP / Requirements work Rqs

Thursday09:00-09:30 Requirements for spatial Audio Coding (joint with Audio) Aud09:30-10:00 Joint with SNHC Rqs10:00-11:00 Review of MPEG-21 IPMP and Architecture with Systems Group Sys

11:00-12:00

Joint with Systems and SNHC on various MPEG-4 issues- Review CfP for LSR 10443 MPEG-4 Profiles under Consideration - Vladimir Levantovsky10316 Requirements and Interoperability issues of Lightweight Graphics proposals - Itaru Kaneko, et.al.

Sys

12:00-13:00 Joint with Video on Professional Extensions Profiling jvt13:00-14:00 Lunch

14:00-15:00

Joint with MDS10196 CRF Liason contribution on Usage Environments - Simon Watt (Partial - Note: Brisbane

contribution!)10313 Optimization of DID in MPEG-21 architecture - Itaru Kaneko, e.al. (relational databases part)

Rqs

15:30-16:00 Review of MPEG-21 in Broadcasting Rqs

16:00-18:00Reviewing and tentatively Approving Documents

Event Reporting Requirements and CfPMPEG-21 IPMP CfP and Requirements Document

Rqs

Friday

08:00-08:30

Concluding MPEG-7 Study of CD for MPEG-7 part 9 – Wo Resolution on changing name of part 9 Profiles under Consideration – Wo

AHG on Profiles and Interop - Wo

Rqs

08:30-09:15

Explorations/General Draft Multimedia Application Formats Document – Wo Draft system design for Omni-directional Video

AHG on 3DAV AHG on Multimedia Application Format AHG on Intra-only MPEG – Asai-san

Rqs

09:15-09:30

Concluding MPEG-4 Profiles under Consideration (Marius) Draft Call for Proposals for LSR Call for Proposals for MPEG-J Scene Rendering API

Rqs

09:30-12:30 Concluding MPEG-21 MPEG-21 Architecture and IPMP Requirements document – Simon Resolution on publication of Requirements MPEG-21 Call for Proposals for IPMP – Simon ER Requirements – FX ER CfP – FX MPEG-21 in Broadcasting – Kaneko-san MPEG-21 MM Test Bed Requirements – CJ MPEG-21 Requirements – Craig Brown MPEG-21 part 1 v.2 PDTR – Niels MPEG-21 Draft Profile Requirements Document – Brad

Rqs

44

MPEG-21 Profiles under Consideration – Brad Draft Conversion Requirements – Thomas Call for Comments to Conversion Requirements – Thomas PAT PDTR – Niels

AHG on Architecture and IPMP Requirements – Simon AHG on MPEG-21 in Broadcasting – Artur/Kaneko-san AHG on MPEG-21 Profiling – Brad

12:30-14:00 Lunch 14:00-20:30 Plenary meeting Plen

Explorations, General

Multimedia Application FormatsMPEG has started to work on a new breed of specifications, called Multimedia Application Formats. These were discussed in a joint meeting with all relevant groups. These formats are intended be become specifications for specific applications that use tools across MPEG standards, and will be supported by software. There may be application formats for streaming, but the ones we are working to date are file format-based. There are currently two such specs that are being developed:

MPEG-7-based digital camera annotation Annotation of (mp3) songs in mp4 file with mp7 metadata (3+4=7)

A document was started that will eventually outline: Explanation of what these formats are Brief explanation on the ones that are currently being developed. Common requirements for any of these formats Specific requirements on each of the individual formats

It should be clear that MPEG will only define a handful of these Formats, and that they should be very widely usable. Giving them their own specific filename extension would help.

The meeting concluded that a software plan was required. Need to make available a single body of SW per format. No need to have a single piece of

SW to support all the formats at the same time. It would be nice to have the following functions:

o Import resources (raw or in existing format) into the Format in questiono Add/Edit metadatao Play the resource while displaying metadatao Could build on other programs that are widely/publicly available

Source or Executable?o Prefer Executable, but need to look at licensing implications

An AHG will further develop this document.

3DAV10325 Request of defining a new level to AVC Profiles - Hideaki Kimata10328 Request of defining a new level to MPEG-4 AVC Profiles - Ryuji Kitaura, Shawmin Lei10332 Request of defining a new level to AVC Profiles - Goro Hamagishi10335 Request of defining a new level to AVC Profiles - Kazuya Suekage10293 Proposal of a new level for super high-res video to AVC Profiles – Kazumasa Yamazawa

et.al.

45

There were several contributions requesting a new level 5.2 in AVC. This was discussed in a joint meeting with the JVT. Several questions were raised:

Is it actually required to display (decoder) the whole image at the same time? (In some applications it would be indeed?

Would any decoder be able to decode at the required rate? Does the proposed level naturally fit in the Level table (answer: not really, but proponents

were ready to discuss many details) Would the system actually be built? Could the needs be harmonized with those from other communities, e.g., digital cinema and

government requirements?But the most important question was if the complete system was understood now. It was decided that that 3DAV group would do a study to the complete (decoding) system, and try to build it out of MPEG building blocks. It is required to obtain interoperability at all levels, not just the video level

M3W10239 AHG on MPEG Multimedia Middleware - Olivier Avaro, et.al.10276 Additional Requirements for MPEG Multimedia MiddleWare (M3W) - Jean H.A. Gelissen During a session on MPEG Multimedia Middleware, Jean Gelissen presented on behalf of two European projects, ROBOCOP & Space4U. Requirements from these projects were integrated into N6225, MPEG Multimedia Middleware Context and Objectives, an output from the Systems Group.

Intra-only in MPEG10246 AHG on Intra-only Coding in MPEG - Kohtaro Asai 10320 Intra-only video coding - Kohtaro AsaiMuch work was done on testing intra-only MPEG coding, in spite of the short time between the meetings. The Requirements Group drew up a new mandate for the AHG to continue its work. It was considered important to broaden the participation in the work. Further complexity studies could lead to the definitions of one or more Profiles. A Technical Report is also still a possibility.

Spatial Audio CodingIn a joint meeting between Audio and Requirements, it was agreed that Audio will publish the Requirements for Spatial Audio Coding this time, with a description of the goals of the work and a tentative schedule, and ask for comments. The Audio Group approved Call for Information and a Drat Call for Proposals. Requirements will be revisited at the next meeting.

Music Notation10235 AHG on Music Notation Requirements - Paolo Nesi, Giorgio Zoia10435 MPEG-Music-Notation- Expression-of-Interest - David Crombie10355 Music Notation Functionality and Interface to MPEG - Giorgio Zoia, Paolo Nesi,

Pierfrancesco Bellini, Jerome Barthelemy

The work on music notation is beginning to get more focus. Like in 3DAV, the meeting would like to see a decoding system and what MPEG components it would use. It was discussed to reduce the scope to one or two basic application scenarios, and the system (paper study) to support themThe following are likely required:

Representation of the music; Node(s) and fields to include it in the scene

46

Perhaps new DSs in MPEG-7?Bitstreams should contain a Score and a Mapping form score to performed media.A new document was issued on Music Notation.

MPEG-4

Audio (part 2)10350 MP3onMP4 Profile Proposal: Backwards Compatible Audio Profile - Ernst F. SchroederThis proposal discussed the inclusion of MPEG-1 and MPEG-2 layers I, II and III in MPEG-4 scenes and MP4 files. It was decided to add Object Types to enable this. It was unclear yet whether the absence of a specific Profile for this purpose is a problem. Need further study on that. Will also need to study the signaling of multiple channels.

AVC (part 10)

Existing Profiles

Decided to add level to AVC at request of 3GPP, and not to issue corrigendum. No delegations had expressed any preference in response to resolution 3.8.9 of the Trondheim resolutions (N5677)

Extensions

After discussing adding potentially many new profiles to deal with the possible variations and combinations of 4:2:0, 4:2:2 and 4:4:4 on the one hand and 8, 10 and 12 bit on the other, it was proposed to define the following Profiles in the Extension of AVC:

4:2:2 / 10 bit and below 4:4:4 / 12 bit end below 4:4:4 / 8 bit and below

A Main+, which operates at 8 bit and 4:2:0, was not deemed desirable at this point. Requirements

Systems-related Profiles (Notably part 11)10223 AHG on SNHC Profiles - Marius Preda, Mahnjin Han10392 Bitstream Contribution for the Animated Character Profile - Marius Preda, Francoise Preteux

New bitstreams were added to the conformance specification. There were no changes recorded in company support for the profiles 3D profiles under consideration.

10348 Audio BIFS Ver. 3 Profile Proposal - Juergen Schmidt, Oliver BaumThe current profiles do not enable true 3D sound combined with 2D video (graphics). This contribution, which addresses such a combination, represents early thinking. The meeting noted that Profiles need to be implemented in full, which did not seem the exact intention of proponents. The decision was to start further study, and the proposal was not yet added to the Profiles under Consideration document.

10443 MPEG-4 Profiles under Consideration - Vladimir LevantovskyThe Requirements and Systems Groups considered that enough support had been received for defining the three Font Compression Profiles (Simple, Advanced Simple and Main), and the profiles including their levels were adopted in the Draft Standard.

47

MPEG-J Rendering API (part 11)10228 AHG on MPEG-J Extensions - Mikael Bourges-Sevenier, Vishy SwaminathanThe Systems, SNHC and Requirements groups reviewed and Approved CfP for MPEG-J Scene Graph API.

Scene Representation10225 AHG on MPEG-4 Scene Representation - Jean-Claude Dufourd, Yuval Fisher, Juergen Schmidt10309 Swiss NB position on Advanced Scene Coding - Frederic Vexo 10280 French NB position on Advanced Scene Coding - Alexandre Cotarmanac'h10331 KNB comments on Simple Scene Description Format - Young-Kwon LIM for KNB

There was good support for the work on a new scene representation formats, both from companies directly, and expressed through a number of national bodies. After discussing, it was found best to not issue the final CfP at this time, as requested by a few NBs, but to give some more time for publishing the work outside of MPEG in order to get more support and hopefully more input.A final CfP will be issued in March and it is still the intention to go to CD in July. There will be an evaluation AHG between March and July

The name was changed to Lightweight Scene Representation. Compatibility with SVG tiny was mentioned as important. The technology shall be suitable for mobile environments

10316 Requirements and Interoperability issues of Lightweight Graphics proposals - Itaru Kaneko, et.al.10312 Lightweight Coding of Animated Synthetic Scene - Frederic Vexo, Mario Gutierrez

These two contributions’ requirements were incorporated in the Call for Proposals.

MPEG-7

Profiles and Levels (part 9)10336 Minor Editing to CD of MPEG-7 Part 9 - Masanori Sano, Bhavan Gandhi, AlanK Melby, Romulo Pinho10242 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano10337 Summary of MPEG-7 Multiple Profiles Benefits and Issues - Wo Chang

Very minor edits were made to the Profiles in the CD, resulting in a Study of CD. The Requirements Group decided not to change the names of the Profiles at this time. It was decided to change the name of part 9 from “MPEG-7 Profiles” to Profiles and levels”, with the following rationale: “Part 9 of MPEG-7 is intended to define Conformance Points. WG 11 anticipates that Conformance Points will consist of Profiles and Levels, and not just of Profiles, much like conformance points for MPEG-2 and MPEG-4. To better reflect the nature of Part 9, it is requested that the title be changed accordingly. Moreover, WG11 also decided that "MPEG-7" should be dropped from the name, as this title is not repeated in names of other parts of MPEG-7 either.”

Should we be able to signal both Unions and Intersections? The consensus is not to make that impossible at this point. Given the fact that MPEG-7 has no profiling dimensions like MPEG-4 and to some extent also MPEG-2, it is very likely that we need to be able to ‘modularize’ MPEG-7 using profiles.

48

An arbitrary union may yield descriptions that could be hard to validate, although we could have a requirement that, if we have two profiles, there would be two clearly distinguishable sub-descriptions. In any case, we need a definition of Union and how it would be used.

Would we need to allow for arbitrarily complex unions of intersections and intersections of unions? The consensus is a clear ‘no’, but don’t know where to stop. We could require a normalized form of some sort. In practice, things would probably not get too complicated anyway.

There was a short discussion on the Interop Test Bed. Current status: used for validation, not yet for real interop testing. It will be used for interop testing when Profiles are ready. The most important functionality is uploading and downloading bitstreams, and tracking their status. The meaning of “Interoperability” was discussed once more, and it was concluded that the most important aspect is intra-MPEG07 interoperability.

Other issues10196 CRF Liason contribution on Usage Environments - Simon Watt (Partial - Note: Brisbane contribution!)This contribution was not discussed in the Requirements group at the 65 th meeting. In a o joint meeting between MDS and Requirements, it was concluded that MPEG-7 covers much CR Forum’s requirements. The meeting had questions on requirements regarding user privacy, and sent these back to CR Forum.

MPEG-21

General10313 Optimization of DID in MPEG-21 architecture - Itaru Kaneko Mika, Onishi Neergaard

Small licenses and DID were discussed. Current thinking is to use BiM, which is available. Proponents will check this option with the help of BiM experts. IPMP-related requirements were discussed in the IPMP Break-out Group.

A second part of this contribution was discussed in a joint meeting with MDS, unfortunately without any of the authors present. XML can be mapped into a relational schema, and consequently, so can the REL. The MDS experts saw no advantage to defining a fixed (standard) mapping. Given the nature of the REL, the MDS experts thought that the request for a subset, which would relatively simply map into a relational database, would not be straightforward to fulfill.

10211 AHG on Virtual Resources in DIA - JC Dufourd, Thomas DeMartini, Riccardo LeonardiThe group discussed at which level of granularity MPEG should seek to standardize conversion description. The agreed framework requirements were included in the MPEG-21 Requirements Document. A Draft Conversion Requirements document was also approved, and it was decided to call for comments on that document and the notion of standardizing some of these conversions. This all for Comments on Conversion Requirements was drafted, approved and published.

10319 Requirements for MPEG-21 URI-based location schemes - Gerrard Drury, et.al.

49

The proposed requirement in this document was more a solution. Discussion brought out lots of good requirements though; and a few people sat down to identify their underlying requirements. These were included in the new MPEG-21 Requirements Document.

The new MPEG-21 Requirements Document was approved, with new requirements for Media Locators and Conversion Description Framework.

MPEG-21 in Broadcasting

The break-out group selected a few use cases to work out in further detail. The document should explain the benefits of the existing parts of MPEG-21 first, and not rely too heavily on work that still needs to be done. Of course we can point to future important work, but use cases should be attractive based on MPEG-21 parts that are ready or in a stable state. It was also decided that the document would receive limited distribution (to ‘friendly’ broadcasters).

Technical Report (Part 1) and relatedThe Technical Report second edition was promoted to PDTR. No text on conformance could be added yet; the Requirements Group expects NB’s to comment on this, and to be able to add text to the DTR in July.

Architecture and IPMP (part 4) 10244 AHG on Requirements for MPEG-21 Architecture & MPEG-21 IPMP – Watt, V.d. Heuvel10315 Japanese National Body Position to MPEG-21 architecture - Itaru Kaneko et.al.

The Requirements Group agreed with the JNB that the matter is urgent and requires a Call for Proposals at the earliest possible moment. However hard the group tried, however, it was not possible to come to a conclusion on the requirements that can be published at this meeting. The group discussed if it were possible to have and AHG meeting in January to finalize the Requirements, but the time between issuing the requirements and the due date of the proposals would have become too short. The group regrets this is the case, and is firmly committed to our current schedule which involves a final CfP at the 67th meeting, publication of the requirements at the 68th and submissions due at an AHG meeting in June ’04.

As for the second part of the JNB comment regarding language in the background document that would not reflect consensus, extensive edits were made to the relevant text and the Requirements Group trusts that these have addressed the JNB concerns.

The Requirements Document was greatly revised; many requirements were added and others were grouped. The background document was scanned for requirements and where these were found, they were included in the Requirements Document. Other language in the background document was added as an annex to the Requirements document. It was briefly considered to put that language in an annex to the CfP, but it was decided not to do so as the CfP was final at this meeting and that text might use some more editing.

A three-day AHG will be held before the main Munich meeting to make sure the requirements can be finalized in at the March meeting.

Architecture

The need for a discussion with experts on all MPEG-21 parts was discussed. A meeting just after the Munich meeting was contemplated, but in the end not pursued because of the delayed schedule

50

for IPMP responses and the fact that some people, important to the discussion would then need to spend almost 2 weeks in Munich meeting on MPEG issues. Rather, it was agreed at the chairs’ meeting that we would dedicate one or 1.5 days to a plenary MPEG-21 meeting, which would include the Tuesday.

Other suggestions that were made include: ask people to take reference software to implement their MPEG-21 IPMP

solutions/architectures; have them explain how they would piece the individual elements together (this was not done)

Or: ask IPMP proponents to explain how their tools interface with the rest of MPEG-21, in some sort of reference model (this was indeed done in the CfP)

Ask solutions for verticals (this was not done)

DIA (part 7)See discussion on Virtual Resources and Conversion requirements in section ,

Reference Software (part 8)In a joint session with Integration, requirements for Reference Software were updated. Integration included the conclusions of this discussion in the MPEG Reference Software Guide (N6257)

Persistent Association (part 11)The last edits were made to the PDTR of 21000-11, Evaluation Tools for Persistent Association. Input came from people not present in the meeting but participating through the mailing list. The PDTR was approved and published.

Test Bed Requirements (part 12)10297 Proposed Draft Requirements for ISO/IEC TR21000-12 v. 4 - Chun-Jen Tsai, Chung-Neng WangThe requirements for the test bed can now be considered stable. The document was published, and it is the plan to include the requirements in the MPEG-21 Requirements Document at the next meeting.MPEG-2/4 IPMP(X) functionality partially addressed, which is now more accurately reflected in the requirements.

Profiling10240 AHG on MPEG-21 Profiles and Extensions - Brad Gandee, Chris Barlas10275 Initial Thoughts on MPEG-21 Profiling - Koenen for Requirements Group in Gold Coast

Three documents were published in this context, capturing the discussions:N6266, Process and Requirements for Profiling in MPEG-21N6267, Draft MPEG-21 Profiles under Consideration DocumentN6268, Requirements for Mobile MPEG-21 REL Profile

N6266 begins to capture our thinking on MPEG-21 Profiles. Many parts will not require profiling, and the current thinking is that we will not define cross-part Profiles. N6267 currently contains only one profile at the moment, for a mobile MPEG-21 REL profile.

51

Event ReportingSmall updates were made to the Event Reporting Requirements and the Call for Proposals was finalized. The call was also published, and proposals are due for the March meeting.

52

Annex 6Report of Systems meeting

Source: Systems Chair and Break-out group ChairsTitle: Systems Meeting ReportStatus: DraftEditor: Olivier Avaro (France Telecom R&D)

Contributors: Olivier Avaro (France Telecom R&D), Claude Seyrat (Expway), Oliver Baum (Fraunhofer IIS), David Singer (Apple)

OverviewThe main outputs of the meeting from the Systems Sub-group perspective are:

No. Title TBP Available13818-1:2000/Amd.5 New Audio P&L Signaling

N6200 Request for ISO/IEC 13818-1:2000/Amd.5 No 03/12/12N6201 Text of ISO/IEC 13818-1:2000/PDAM5 No 03/12/12

14496-1:2003/Amd.2 New ObjectType Code PointsN6202 Text of ISO/IEC 14496-1/FDAM2 No 03/12/12

14496-11:2003/Amd.2 ATGN6203 Text of ISO/IEC 14496-11/COR1 No 04/01/05N6204 DoC on ISO/IEC 14496-11/FPDAM2 No 03/12/12N6205 Text of ISO/IEC 14496-11/FDAM2 No 04/01/05

14496-11 :2003/Amd.3 Audio BIFS ExtensionsN6206 Request for ISO/IEC 14496-11/Amd.3 No 03/12/12N6207 Text of ISO/IEC 14496-11/PDAM3 No 03/12/12

14496-11:2003/Amd.4 XMT and MPEG-J ExtensionsN6208 Items for ISO/IEC 14496-11/COR2 No 03/12/19N6209 Request for ISO/IEC 14496-11/Amd.4 No 03/12/12N6210 Text of ISO/IEC 14496-11/PDAM4 No 04/01/05

14496-12:2003/Amd.1 ISO File Format ExtensionsN6089 Request for ISO/IEC 14496-12/Amd.1 No 03/12/12N6090 Text of ISO/IEC 14496-12/PDAM1 No 03/12/12N6211 Technology under consideration for 14496-12/Amd.1 No 03/12/12

14496-17 Streaming Text FormatN6212 Referencing Explanatory Report for 3GPP

specificationNo 04/01/19

N6213 DoC on ISO/IEC 14496-17/CD No 03/12/12N6214 Text of ISO/IEC 14496-17/FCD No 04/01/19

14496-18 Font Compression and StreamingN6215 Text of ISO/IEC 14496-18/FDIS No 04/01/05

14496-19 Synthesized Texture StreamN6216 Request for ISO/IEC 14496-19 No 03/12/12N6217 Text of ISO/IEC 14496-19/FDIS No 03/12/12

15938-1 SystemsN6218 Draft DoC on ISO/IEC 15938-1/FPDAM1 No 03/12/12N6219 Study Text of ISO/IEC 15938-1/FPDAM1 No 03/12/25

53

N6220 Draft DoC on ISO/IEC 15938-1/DCOR1 No 03/12/12N6221 Study Text of ISO/IEC 15938-1/COR1 No 03/12/12N6222 Core Experiments for Systems Extensions No 03/12/12N6223 MPEG-7 Systems reference software workplan No 03/12/12

21000-9 MPEG-21 File FormatN6224 WD5.0 of ISO/IEC 21000-9 No 03/12/12

Explorations and SupportN6225 MPEG Multimedia Middleware Context and

ObjectivesNo 03/12/12

N6226 Draft CfP on Lightweight Scene Representation Yes 03/12/12

General issues

GeneralThe meeting report from Brisbanne has revised: “M10176: Proposition to include stream types for protected content. This will avoid indeterminist behavior of non-IPMP MPEG-4 terminal trying to access streams delivered by an IPMP compliant MPEG-4 streaming server. Decision to be taken in Hawaii.” Updated version has been delivered to WG11 convenor.

Discussion on signaling of protected content: Decision to rewrite the paragraph on IPMP in ISO/IEC 14496-1 Introduction. Correct ISO/IEC 14496-1 to mandate the recognition of IPMP descriptor associated with a stream and to put a warning on the objecttype section saying that the stream may have been transformed if there are some IPMP descriptors associated with it. Text for Amendment/Correction of ISO/IEC 14496-1 shall be submitted for the 68 th MPEG meeting by parties interested to progress this items.

M10409: Apple Candidature for MP4 Registration Authority. Candidature accepted by the Systems group. To be proposed for approval by WG11. Allocation of range for RA (see ISO/IEC 14496-1 Amd. 2).3GPP2: Request for ObjectTypeIndication 0x0E1 for 3GPP2 voice codec (See resolution from Systems).

List of standards under development

Pr

Pt Edit.

Project

Description CfP WD CD FCD FDIS

2 1 2000 Amd.4 Metadata Application Format CP

03/10

04/03

04/07

2 1 2000 Amd.5 New Audio Profile and Level Sig.

03/10

03/12

04/07

05/01

4 11 2003 Amd.3 Audio BIFS Extensions 03/10

03/12

04/07

05/01

4 11 2003 Amd.4 XMT and MPEG-J Extensions

03/10

03/12

04/07

05/01

4 12 2003 Amd.1 ISO File Format Extensions 03/10

03/12

04/03

04/07

54

4 17 2003 1st Ed. Streaming Text Format 03/03

03/07

03/12

04/07

7 1 2002 Cor.1 Systems Corrigendum 02/12

03/07

04/03

7 1 2002 Amd.1 Systems extensions 02/03

02/07

02/12

03/07

04/03

21 9 200x 1st Ed. File Format 03/12

04/03

04/07

05/01

DemonstrationsNone.

FAQThe FAQ were updated as needed.

AOBNone.

MPEG-2 Systems (13818-1)

13818-1:2000 Amd.4

Topics1. ISAN and VISAN Signaling.

ContributionsNo contribition.

13818-1:2000 Amd.5

Topics1. New Audio Profile and Level Indication; 2. Audio_Type Table split for ISO reserved and User Private

ContributionsM10277: Discussion on ancillary audio signaling: Decision to split the table on Audio Type value in ISO Reserved / User Private section in order to accommodate the request from the UK NB (see Systems resolution).

MPEG-4 Scene Description (14496-11)

14496-11:2003 Cor. 1

Topics1. Miscellaneous Corrigenda Item.

55

ContributionsM10257: Summary of Voting on ISO/IEC 14496-11/DCOR 1. No comments. Issue of Cor. 1.

M10375: Various enhancements for MPEG-4 Systems. Valuator (items for Cor2), Externproto (record of decision on reflector, to be included in Cor1). Remote location on OD and URL extensions (to be further discussed in AHG).

M10381: Bug fix proposal for AudioBIFS and related Levels. Accepted. To be integrated in the current Cor.

14496-11:2003 Amd.2

Topics1. Advanced Text and 2D Graphics;2. Profiles.

ContributionsM10447, M10262, M10395: French NB position on 14496-11 FPDAM2. Summary of Voting on ISO/IEC 14496-11/FPDAM 2, Israeli NB Comments on Study Text of ISO/IEC 14496-11/FPDAM2 (N5979). (See disposition of comments). Amendment finalized and issued.

14496-11:2003 Amd.3

Topics1. Advanced Audio Buffer Node;2. AudioChannelConfig;3. Pre-defined effects using ExterProto;4. Support for Ambisonic.

Contributions

Scene DescriptionM10348: See Req. Report.M10347, M10351, M10321: See Audio report.

14496-11:2003 Amd.4

Topics1. XMT Extensions;2. MPEG-J Extensions.

Contributions

Scene DescriptionM10352: The XMT-A specifications for BitWrapper node and its encoding parameters. Taken into account in 14496-11/Amd.4.

M10428: Proposal to extend the current MPEG-J framework to enable the use of other packages than the ones currently defined. Accepted. Assess need to produce WD of Cor. to ISO/IEC 14496-11. Proposed to use Java2 (consequences to be assessed in AHG). Alignment to support evolutions of the Systems spec. in terms of new nodes (Accepted). In Eventin and Eventout class, change attributes from int to static final int (Rejected, not needed. The specification has been checked and the current text is correct). Discussion on initialization of MPEGlets (consequences to be assessed in AHG).

56

ISO File Format (14496-12)

14496-12:2003 Amd.1

Topics1. Support for Static Metadata;2. Support for IPMP at the File Format Level.

Contributions

Extensions of the ISO File Format10406: Presentation and file-tree extensions to the ISO base media file format. Reviewed 10406 on use of the format as a multi-container. There was significant discussion, as the proposal has quite significant implications.

It was asked whether the existing tools in the file format could be used. The question of the implications of using tracks as containers was asked; also, is a flat structure OK or is a directory structure needed? There was some desire from the room to avoid adding decoder functionality, and we should examine how much we can leverage the existing structure and do a complexity analysis.

Is this of interest to JPEG 2000? It was noted that JPM exists but currently may not cover motion applications. A JPM review seems worthwhile.

It was noted the proposal is technology-agnostic (e.g. HTML, SMIL).

Is the / syntax right or should it be # (fragment)? “/” is what is used in RTSP.

It was proposed that we:a) add a section to the PDAM saying that this is a technology under consideration and seek NB

comment on it as part of the ballot;b) ask for formal 3GPP comment on it also in a liaison;c) add a mandate for the file-format ad-hoc to study the complexity, design, and implications

of this proposal

M10407: SRTP hint track format for the ISO base media file format. Concern about the name confusion on ‘protection information box’. Rename to SRTPProcessBox and pick a new 4CC. It was noted that this ‘forces’ the server to use SRTP when required by the content owner. But whose choice is it as to which algorithm is used? Should we allow the server/client to negotiate which algorithm is used? We propose adding a four-character codes to indicate the server should choose the algorithm based on some means outside the file, e.g. server/client should negotiate the algorithm. Accepted with the above addition.

M10077: This was presented in Brisbane, and accepted in principle into the WD of the MPEG-21 FF. However, the item location box is a feature of the proposed amendment to part 12, so needs to be discussed here.

The concern was that since when the MPEG-21 DID is in a plain XML file, the URL in the DID would have to identify the sub-part of the referenced (file) resource, then that same URL form could be used when the resource is within the file. Should we duplicate functionality? (For example, a relative file outside the XML might be X.mp4/trackid=3, and inside the MPEG-21 container file item=2/trackid=3).

57

Rather than combine sub-item information inside the item location box, which means that the item information gets repeated, this could be a separate parallel box, or be integrated into the URL form itself as shown in examples in 10406 (above). Further contribution is welcomed on this one.

M10433: This discusses the use of IPMP descriptors within the MPEG File Format. It was noted that the sample entry names must differ by media type because of a design infelicity in the file format, so the sample entry names would need to be ‘ipma’ ‘ipmv’ etc. The ‘global’ box is accepted; would it benefit from including ‘es_id_inc’ descriptors as well? The sense was no, the reference is the other way - from stream (sample entry) to the tool, by using the same toolID.

The choice seems to be one of design taste and style, between:a) sample entry names of ‘ipma’, ‘enca’ in parallel, documenting two frameworks;b) sample entry names of ‘enca’ etc. only, with ‘ipmp’ as a scheme.c) use only IPMP signaling within the ISO specs. Bodies using the ‘encX’ technique may do

so by collaboration outside ISO.Consensus after plenary review has been documented in the current Part 12 Amendment.

Streaming Text (14496-17)

Topics1. Coded Representation of Text Stream.

ContributionsM10034: All comments made have been addressed. A high level structure of the Streaming Text format was discussed and agreed (ref. Attached Powerpoint slides). FCD text will implement the DoC and this high level structure.

Discussion on the relation between Font Data Stream and Streaming Text and how it should be documented. Agreement to include the following text in an appendix of the Part 17:

“Timed Text streams may reference fonts in the receiver. These fonts may be residently available in the receiver, or downloaded or streamed to the receiver. To ensure that the desired fonts in the receiver are referenced correctly, the font name identification in textData() has to uniquely reference the name of the desired font in the receiver. In an MPEG-4 Systems context, when a font stream is used to supply fonts for a text stream, that text stream shall indicate that dependency by using the dependsonES_ID field in the ES_Descriptor of the text stream, containing the ES_ID of the font stream. Other systems contexts should indicate that dependency in an appropriate way.

In text streams which have an associated font stream, when a specific font instance in the font stream is to be used for a text access unit, the font name shall use the appropriate naming structure, which for MPEG-4 font streams is defined in 14496-18 section 5.5.”

Font Compression and Streaming (14496-18)

Topics1. Coded Representation of Font Data

58

ContributionsAll comments made have been addressed and FDIS text has been produced.M10443: MPEG-4 Profiles under Consideration (joint with requirements). Decision to include the profile in Part 18.

The following action plan was agreed upon to finalize the reference software of Part 18 and its integration in Im1:

N° What Who When

Status

1. Integrate font reference software in the CVS.

Vladimir ASAP O

2. Integration of font data stream decoder:- Im1 receives of font data stream;- Im1 trigger “font decoder” decoder.- “Font decoder” decode and store font data stream in file.

Zvi (or integration):- Provision of the Im1 framework Vladimir:- Provision of “font decoder” - Adaptation & Integration in the Im1 framework.

04/03 O

3. Encoder- Package font data in a font data elementary stream and produce and MP4 file.

David:- Provides engineering support to allow integration of font data streaming in MP4 files.Vladimir:- Provides software for packaging of font data in MP4 file.

04/03 O

59

MPEG-7 Systems (15938-1)

GeneralApplication format: The Application format allows to have universal multimedia file wrapper which contains MPEG-7 metadata. Mapping with EXIF metadata have been shown. No specific issues have been raised regarding MPEG-7 Systems.

MPEG-7 profiling: The multiple profile has been evaluated and its implication on validation has to be carefully evaluated. No specific issues have been raised regarding MPEG-7 Systems.

15938-1/Cor1

Topics1. Miscellaneous corrections to MPEG-7 Systems.

ContributionsM10446 - FNB comments on 15938-1:Amd1 and 15938-1:Cor1. The document has been reviewed. Study Of FPDAM will be produced as well as a new study of corrigendum. WG11 recommends to postpone the promotion of the FPDAM to FDAM and the DCOR to COR to solve some technical issues/reference implementation issues.

M10420 - Proposed corrigendum item in ISO/IEC 15938-1/COR on BiM forward compatibility. This document has been reviewed and the proposed item will be added in the corrigendum.

15938-1/Amd 1

Topics1. Schema Transmission;2. Specific Codecs.

ContributionsM10384 - Report on ME-2: Schema transmission framework. The contribution presents several issues and solutions. The group decided:

To relax the requirements regarding the schema regeneration as the W3C schema for schema is not properly working.

To evaluate proposed schema encoding mechanism in a mini-experiment. To adopt the progressive and partial transmission proposed. The partial/progressive/full

transmission method should be redesigned to cope with a single table. To adopt the proposed order of root types (types that derives from a type defined in an other

namespace). The benefit of transmitting the relationship of a type with its parent types is not clear and will be evaluated in a mini-experiment.

M10263- Summary of Voting on ISO/IEC 15938-1/FPDAM 1/ The document has been reviewed. A draft disposition of comments gathers all the comments to be answered by the next meeting and some first agreements.

M10418 - Study of ISO/IEC 15938-1 FPDAM1. The study has been reviewed and accepted as a starting point for a new study to be issued at this meeting. Some issues have been raised that shall

60

be addressed in the corrigendum. These issues are captured in the Draft 15938-1:DCOR1 as an ouput of this meeting.

M10419 - Reference software status. This contribution shows the status on the reference software. It appears that few modules should be finalized. This is precisely defined in reference software development workplan.

Exploratory Activities

MPEG-2 Exploratory Activities

Topics1. Scalability at the Systems Level.

ContributionsNNI National Body Comment: Noted. See Liaison output for answer.

MPEG-4 Exploratory activity

Topics1. Lightweight Application Scene Representation (Laser)2. MPEG-J Rendering APIs

ContributionsM10280, M10331, M10309: French NB position on Advanced Scene Coding, KNB comments on Simple Scene Description Format, Swiss NB position on Advanced Scene Coding. Taken into account into the draft Call for Proposal on Lightweiht Scene Description.

M10316: Requirements and Interoperability issues of Lightweight Graphics proposals. See Req. report.

M10312: Lightweight Coding of Animated Synthetic Scene. Request LSR to support for:1- 3D textured and dynamic mesh.

Accepted. To be included in the Call.

Joint meeting with ISGPurpose: set up process for the evaluation of the complexity of the answer to the LSR CfP.2 stages evaluation process:

a) Request to provide a Symbian player in executable form. (Evaluation process will be further studied in AHG). This will be used to assess high level performances evaluation (speed of execution, size of executable, memory usage, …);

b) Request to proponents to be ready to provide a C version of the player in source code for further complexity evaluation (Number of operator, memory access, size of memory, size of cache, …). ISG will provide information on the evaluation tool.

A test set will be defined to excite the player as a subset of SVGT1.2 specification (To be defined in AHG).

Call for Proposal on MPEG-J Scene Rendering APIs: See Requirement report.

61

MPEG-21 Exploratory Activities

Topics1. Architecture;2. Binarisation;3. File Format.

ContributionsArchitecture: See Req. report.

File Format: Decision to maintain file format at the WD level in order to align with the architecture (expected to reach a mature stage in March).

M10313 – Optimizations of DID: The contribution presents a set of requirements that are proposed for the MPEG-21 framework. The contribution emphasizes the need of "simple" encoding scheme, easily mapped to relational database and where data granularity/encoding can be adapted (e.g. 8000 chinese characters are not necessary for a US based MPEG-21 DID decoder). This adaptation could be achieved through a profile or set of profiles of MPEG-21 DID schema as well as BiM profile. More details are available in attachment of the contribution. WG11 suggests to conduct an activity related on the use of BiM in order to encode DID on the MPEG-7 Systems AHG.

Multimedia Application Formats

Topics1. Application specific format framework;2. Usage of MP3 in MP4 with metadata;3. Usage of JPEG in MP4 with metadata.

ContributionsSee Requirement, Audio and Visual report.

Multimedia Middleware

Topics1. Use cases;2. Middleware Architecture;3. Multimedia APIs.

ContributionsM10276: Additional Requirements for MPEG Multimedia MiddleWare. Integrated in the Context and Objectives document.

M10395: WIPI, mobile standard platform in Korea. To be discussed in the next MPEG meeting in München.

The Systems subgroup intends to progress the document further and to make an open Call for Comments in the next MPEG meeting in München.

62

Latest References and Publication Status

Pr

Pt Standard No. Issue Status Doc. with Purpose

2 1 ISO/IEC 13818-1/Amd.7 Published

2000/12

2 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd

Edition)00/12 Publishe

d 2000/12

2 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) N3844 01/01 Pisa Published

2002/03

2 1 ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2

N5867 03/07 Trondheim

Published

2003/12

2 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2)

N5604 03/03 Pattaya FDAM ITTF Await Text from ITU

2 1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2)

N5771 03/07 Trondheim

FDAM SC29 Ballot to be issued

2 11 ISO/IEC 13818-1:2003 (IPMP on 2) N5607 03/03 Pattaya AMD ITTF To be published 03/12

4 1 ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) Published

1999/12

4 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) Published

2001/11

4 1 ISO/IEC 14496-1/Cor.1 Published

2001/11

4 1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) Published

2001/11

4 1 ISO/IEC 14496-1:2001/Amd.1 (Flextime) Published

2002/10

4 1 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) Publishe 2003/12

63

d4 1 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) N5277 02/10 Shanghai FDIS SC29 Final Text Editing4 1 ISO/IEC 14496-1:2003/Amd.7(AVC on 4) N5976 03/10

BrisbanneFDAM Editor Final Text Editing

4 1 ISO/IEC 14496-1:2003/Amd.8(ObjectType Code Points)

N6202 03/12 Hawaii FDAM SC29 FDAM to be issued

4 6 ISO/IEC 14496-6:2000 Published

2000/12

4 8 ISO/IEC 14496-8 (MPEG-4 on IP Framework) N4712 02/03 Jeju FDIS SC29 Issue FDIS Ballot4 11 ISO/IEC 14496-11 (MPEG-4 Scene Description) N5279 02/10 Shanghai FDIS SC29 Final Text Editing4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/10 Awaji AMD SC29 Wait for 3rd Ed.4 11 ISO/IEC 14496-11/Cor.1 N6203 03/12 Hawaii COR Editor Final Text Editing4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and

Graphics)N6205 03/12 Hawaii FDAM Editor Final Text Editing

4 12 ISO/IEC 14496-12 (ISO Base Media File Format) N5295 02/10 Shanghai IS ITTF To be published 03/12

4 13 ISO/IEC 14496-13 (IPMP-X) N5284 02/10 Shanghai FDIS SC29 Final Text Editing4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 02/10 Shanghai 2003/12 Publishe

d4 15 ISO/IEC 14496-15 (AVC File Format) N5780 03/07

TrondheimFDIS ITTF Ballot to be issued

4 18 ISO/IEC 14496-18 (Font Compression and Streaming)

N6215 03/12 Hawaii FDIS Editor Final Text Editing

4 19 ISO/IEC 14496-19 (Synthesized Texture Stream) N6217 03/12 Hawaii FDIS Editor Final Text Editing7 1 ISO/IEC 15938-1 (MPEG-7 Systems) N4285 01/07 Sydney Publishe

d2002/07

7 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 01/07 Sydney Published

2002/02

64

Action Plan

N° What Who When Status Trace4. Check Patent

statements & License for OpenType

David ASAP O Companies that have IP on OpenType spec. submitted Patent Statement but for Apple.

- 65 -

List of reviewed contribution

N° Title Authors10257 Summary of Voting on ISO/IEC 14496-11/DCOR 1 SC 29 Secretariat10262 Summary of Voting on ISO/IEC 14496-11/FPDAM 2 SC 29 Secretariat10263 Summary of Voting on ISO/IEC 15938-1/FPDAM 1 SC 29 Secretariat10276 Additional Requirements for MPEG Multimedia MiddleWare

(M3W)Jean H.A. Gelissen

10280 French NB position on Advanced Scene Coding Alexandre Cotarmanac'h

10309 Swiss NB position on Advanced Scene Coding Frederic Vexo 10312 Lightweight Coding of Animated Synthetic Scene Frederic Vexo et al.10316 Requirements and Interoperability issues of Lightweight

Graphics proposalsItaru Kaneko et al.

10321 Proposal of a new AdvancedAcousticScene node in MPEG-4 BIFS

Jeongil Seo et al.

10331 KNB comments on Simple Scene Description Format Young-Kwon LIM for KNB

10347 Update to WD 3.0 of ISO/IEC 14496-11:2003/AMD3 (Audio BIFS Ver 3)

Juergen Schmidt et al.

10348 Audio BIFS Ver. 3 Profile Proposal Juergen SchmidtOliver Baum

10351 Implementation of the AudioFX PROTO solution for Small Systems with reduced overhead; Preliminary Results

Klaus Eilts-GrimmMario Sieck

10352 The XMT-A specifications for BitWrapper node and its encoding parameters

Gyeong Ja Jang et al.

10365 Font Compression Reference Source Code Implementation Vladimir Levantovsky 10375 Various enhancements for MPEG-4 Systems Le Feuvre Concolato

Dufourd et al.10381 Bug fix proposal for AudioBIFS and related Levels Giorgio Zoia 10384 Report on ME-2: Schema transmission framework Joerg Heuer et al.10395 Israeli NB Comments on Study Text of ISO/IEC

14496-11/FPDAM2 (N5979)Shlomo Birman et al.

10399 Report on the implementation of a new MPEG-4 Player Mathias Schwark10401 Proposal on the implementation of Decoders in IM1 Mathias Schwark10406 Presentation and file-tree extensions to the ISO base media

file formatPer Fröjdh

10407 SRTP hint track format for the ISO base media file format Per Fröjdh et al.10409 Apple Candidature for MP4 Registration Authority David Singer10418 Editors study of the ISO/IEC 15938-1/FPDAM Claude Seyrat10419 MPEG-7 Systems reference software status report Gregoire Pau10420 Proposed corrigendum item in ISO/IEC 15938-1/COR on

BiM forward compatibilityGregoire PauThibault Franchini

10428 Corrections and requests for new features in MPEG-J Mikael Bourges-SevenierVishy Swaminathan

10429 WIPI, mobile standard platform in Korea Young-Kwon LIM10433 Media Stream Protection in MP4 File without MPEG-4

SystemJing Liu et al.

66

N° Title Authors10443 MPEG-4 Profiles under Consideration Vladimir

Levantovsky10446 French NB position on 15938-1:Amd1 and 15938-1:cor1 French National Body10447 French NB position on 14496-11 FPDAM2 French National Body

67



Annex 7Report of MDS meeting

Source: John R. Smith (on behalf of MDS sub-group)

Chair (contact):John R. SmithIBM T. J. Watson Research Center30 Saw Mill River RoadHawthorne, NY 10532 [email protected]

The MPEG MDS sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. The primary work items for the week included the following:

MPEG-7:o MPEG-7 Extensions (Part 5):

MPEG-7 MDS AMD/2 Study of PDAM MPEG-7 MDS COR/1 WD v.2

o MPEG-7 Conformance (Part 7): AMD/1 (Version 2 bitstreams) FPDAM

o MPEG-7 Profiles (Part 9): Joint with Requirements, Systems, Video, Audio Study of

CDo MPEG-7 Schema Definition (Part 10):

MPEG-7 Schema Definition Study of CD MPEG-21:

o MPEG-21 Part 2 – Digital Item Declaration 2nd Edition WD v2.0o MPEG-21 Part 5 – Rights Expression Language Softwareo MPEG-21 Part 6 – Rights Data Dictionary Softwareo MPEG-21 Part 7 – Digital Item Adaptation FDISo MPEG-21 Part 10 – Digital Item Processing CD

MPEG- 21:• DI D (2nd Ed)• DI I • REL (Profiles)• RDD (RA)• DI A (FDIS)• DI P (CD)

MPEG- 7 v.2:• MDS AMD/2

(PDAM)• Conformance

Ext. (FPDAM)

MPEG- 7 v.1:• MDS (FDI S)• Profiles• Schema Def.

Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 67th Waikoloa meeting.

68

1920MPEG MDS Group activities

Num.

Contributions

Agenda, Goals and Issues for the Week for MDS Sub-Group

Agenda, Goals and Issues for the Week for MDS GroupJohn R. Smith

During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed:

Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP)

o All work held in main MDS track except where indicated for specific Break-out Groups (BoG)

Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday

Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Digital Item Declaration Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for software development for MPEG-21 REL, RDD, DIA Schedule of joint meetings

MPEG-7 activities: MPEG-7 Extensions (Part 5):

o MPEG-7 MDS AMD/2 Study of PDAMo MPEG-7 MDS COR/1 WD v.2

MPEG-7 Conformance (Part 7):o AMD/1 (Version 2 bitstreams) FPDAM

MPEG-7 Profiles (Part 9):o Joint with Requirements, Systems, Video, Audio Study of CD

MPEG-7 Schema Definition (Part 10):o MPEG-7 Schema Definition Study of CD

MPEG-21 activities: MPEG-21 Rights Expression Language (Part 5):

o Input: Software contributions on REL Input contribution on REL profile

o Actions: Review software status and integration Update REL software plan Update MPEG-21 MDS FAQ

o Output: Revised REL software plan

69

MPEG-21 Rights Data Dictionary (Part 6):o Input:

RDD Softwareo Actions:

RDD RA response evaluation Review software contribution Update RDD software plan Update MPEG-21 MDS FAQ

o Output: RA recommendation Revised RDD software plan

MPEG-21 Digital Item Adaptation (Part 7):o Input:

DIA Editors’ Input on Study of FCD, AM 7.1, AHG reports (6), CE reports (2), Proposal documents (4) NB Comments

o Actions: Review CE results and proposals Review NB comments and produce DoC Produce DIA FDIS Update DIA reference software plan Start AMD/1

o Output: MPEG-21 DIA DoC and FDIS MPEG-21 DIA Software Implementation Plan v.6

MPEG-21 Digital Item Processing (Part 10):o Input:

Input contributions (2)o Actions:

Review proposal documents Define CE’s Revise DIP WD and DIP PM

o Output: MPEG-21 DIP CD, PM v.4 MPEG-21 DIP CEs

Joint Meetings (as of Monday): MPEG-7:

o Wed (11h30 - 13h00): MPEG-7 Profiles (with Requirements, Systems, Audio, Video)

MPEG-21:o Tues (10h00 - 11h00): MPEG-21 DIA VR & Location Schemes

(with Requirements)o Tues (16h00 - 16h30): MPEG-21 Avatar Preference DIA (with

SNHC)o Tues (16h30 - 17h00): MPEG-21 Audio Adaptation (with Audio)o Wed (14h00 - 15h00): MPEG-21 Reference SW Req with Int.

Req, Sys

70

o Wed (15h00 - 16h00): MPEG-21 REL-RDD Reference SW (with Integration)

o Wed (16h00 - 17h00): MPEG-21 DIA Reference SW (with Integration)

o Exploratory:o Tues (12h00 - 13h00): J on 4 with Vid, Aud, Sys

Break-out Groups (created at kick-off meeting):

DIP BoG:o Mandates:

Review remaining contribution documents and issues outlined in DIP AHG report

Discuss CEso Time/place: Monday, 16:30—COB

Review of AHG resolutions and action points:

Doc No. Contribution Source

10208 Xin Wang, Jaime Delgado, Chris Barlas,AHG on MPEG-21 REL and RDD Reference Software

Topic: AHG on MPEG-21 REL and RDD Reference Software Mandates:

1. To continue development of conformance licenses and test cases2. To develop interpretation conformance software3. To develop the REL license interpretation using RDD term genealogy4. To coordinate work on other software in the REL/RDD reference software plan

Results: Seven contribution documents on REL-RDD SW Including reference software and conformance test licensesQuestions: How should REL be integrated within DID? There are several ways

to do this. What is preferred way? How to resolve issues when rights are granted at higher granularity

than access, eg., rights on book and access to image from bookActions: Xin Wang will present REL contributions for UPF Contributions on SW will be discussed at joint meeting with

Integration on MPEG-21 Ref. SW Contributions on conformance will be discussed at joint meeting with

Integration on MPEG-21 Conformance10212

Gerrard Drury, Myriam Amielh, Sylvain Devillers, Yongju Cho, AHG on MPEG 21 Media Locators

Topic: AHG on MPEG 21 Media Locators Mandates:

1. Investigate usage of MPEG-7 Media Locators in MPEG-21a. For referencing a location within the MPEG File Format.

71




b. For referencing locations within a media resource using the syntax and semantics of the MPEG-21 parts.

2. If MPEG-7 Media Locators are not sufficient in all cases:a. Discuss a harmonized framework for media location schemeb. Define relevant media-dependent location schemesc. Recommend proposed text.

Results: AHG investigated how to specify media locators for DID, including

using URI fragment and MPEG-7Questions: Is URI fragment sufficient for locators? How to use MPEG-7?Actions: Joint meeting with Requirements on Requirements contribution on

locators10214

Gerrard Drury, Rik Van de Walle, Munchurl Kim,


Topic: AHG on Editing MPEG-21 DID/DIP and Core Experiments for DIP Mandates:

1. Edit MPEG-21 DIP WD v.32. Edit MPEG-21 DID 2nd Edition WD v.1S.3. Produce study on MPEG-21 DIP WD v.3 and recommendations on improving

this document4. Produce study on MPEG-21 DID 2nd Edition WD v.1 and recommendations on

improving this document5. Encourage discussion on usage of DIMs and DIBOs by other parts of MPEG-21

and development of new proposals for evaluation according to the Procedure for accepting DIBOs in MPEG-21 DIP document

6. Carry out Core Experiments on DIP.7. Encourage delivery (according to the MPEG-21 software implementation

plan) of implementation software from CE participants.Results: Adopt proposed schema for objectype and arguments, discuss

contribution documentsActions: Address in MDS on Tuesday afternoon, consider BoG. 10209

Anthony Vetro, Christian Timmerer, Sylvain Devillers,


Topic: AHG on Editing MPEG-21 DIA Study of FCD & AM Mandates:

1. Produce the Study of FCD and AM by 2003/11/12. 2. Maintain the schema and description examples for the Study of FCD and

AM7.0 at http://www.midgardmedia.net.3. Investigate open issues with schema design included in the Study of FCD.4. Study terminal capabilities and network characteristics description tools.5. Discuss the issue of namespaces in the DIA specification.6. Follow up on unresolved issues from the Study of Draft Comments.7. Produce Editors Input on FDIS and AM7.1.

Results: Editing based on draft DoC from Gold Coast Schema design – needs more work Introductory text – needed more substantially throughout Editor’s input – numerous editorial changes (documented in

contribution doc) Comments from 12-13 NBs and ~200 NB commentsQuestions: Definitions of “terminal” and “network”. Some issues defining

72

http://www.midgardmedia.net/





“terminal” unambiguously. Consider to using “peer” Namespaces – needs more discussionActions: Adopt changes to AM 7.1 and Editors’ input Use draft comments review as starting point for DoC10210

Thomas DeMartini, Chris Barlas, Sylvain Devillers, Anthony Vetro, AHG on Integration of DIA with REL and RDD

Topic: AHG on Integration of DIA with REL and RDD Mandates:

1. Study the proposed solution for DIA/REL/RDD Integration as adopted to the Study of FCD [N5933] and recommend improvements to the individual tools being standardized and the integration approach.

Results: Developed plan for harmonization with DIA Virtual ResourcesActions: To be reviewed in MDS in VR session

10211JC Dufourd, Thomas DeMartini, Riccardo Leonardi, AHG on Virtual Resources in DIA

Topic: AHG on Virtual Resources in DIA Mandates:

1. Explore the notion of Virtual Resources, i.e. resources defined as a transformation of another, actual resource.

2. Integrate Transmoding into the Virtual Resources model.3. Study other kinds of adaptations within the Virtual Resources

model.4. Investigate complexity issues in relationship with Virtual

Resources5. Investigate the integration of the Virtual Resources with REL/RDD

and DID governance.Results: AHG meeting hold on SundayActions: To be reviewed in MDS in VR session10397

Christian Timmerer, Gerrard Drury, Jeho Nam, AHG on MPEG-21 DIA Reference Software

Topic: AHG on MPEG-21 DIA Reference SoftwareResults: 29 contributions on Reference SW Updates to plan No contributions on “empty” modules of utility SW or examples of

including DIA descriptors in DID Four input contributions Significant integration effort has been achieved Established workplan in AHG report (still needs clarification)Questions: Ambiguities about what exactly “integration” means for DIAActions: Check status later in week on AHG workplan Joint meetings with Integration on Ref SW and DIA SW10213 Jeho Nam, Debargha Mukherjee, AHG on Core Experiments for MPEG-21 DIA

73




mailto:??

mailto:??


10295

Truong Cong Thang, Yong Ju Jung, Yong Man Ro, Jae-Gon Kim, Jeho Nam, Jin-Woo Hong, Debargha Mukherjee, Report of CE on Modality Conversion QoS

10363Munchurl Kim, Hendry, Jong-Nam Kim, Keonsoo Park, Huang Zhongyang, CE reports on DIBO explorations

10382Andreas Hutter, Joerg Heuer, Gabriel Panis, Debargha Mukherjee, Christian Timmerer,


10386 Frederik De Keukelaere, Rik Van de Walle,Results of Core Experiment on Object Map Technology

10417Gerrard Drury, Frederik De Keukelaere, Thomas De Martini, Report of DIP CE on DIM Object Map

Topic: AHG on Core Experiments for MPEG-21 DIA Mandates:

1. Maintaining the MPEG-21 MDS CE Development process document.

2. Carry out Core Experiments on DIA and make recommendations to modify and improve the Study of FCD and Adaptation Model (AM v7.0).

3. Encourage delivery (according to software implementation plan v.5 N5935) of implementation software from participants.

Results: Carried out core experimentsActions: Results to be reviewed during week

MPEG-21 DIA Editing:


10052Anthony Vetro, Christian Timmerer, Sylvain Devillers Editors Input on DIA Study of FCD

10282Anthony Vetro, Christian Timmerer, Sylvain Devillers, MPEG-21 DIA AM v7.1

Topic: Editing of DIA since Brisbane meetingResults: Completed editing based on draft comments from Brisbane meetingActions: Editing changes to be reviewed – require NB comment for FDIA

MPEG-21 DIA Specification :


10265 SC 29 Secretariat, Summary of Voting on ISO/IEC FCD 21000-7

10398Christian Timmerer , on behalf of the Austrian NB,

Austrian NB comments on MPEG-21 DIA (Digital Item Adaptation)

10444 FNB French NB position on MPEG-21 DIA74

















Topic: ~200 National Body comments on MPEG-21 DIA (from 12 National

Bodies)Issues: Integration of DIA Reference SW Integration of DIA with REL-RDD BSD Transformation Instructions (XML transformation language) Avatar Preferences (SW + specification)Actions: Target FDIS at this meeting

MPEG-21 Responses to Call for RDD Registration Authority:


Topic: Received two responses expressing interest to serve as Registration

Authority for Rights Data Dictionary (IDF and Rightscom)Actions: Develop RA evaluation criteria (output doc) Issue request for technical responses from candidates

MPEG-21 REL Profiles :


10403Brad Gandee, TJ Pannu, Manuel Ham, Thomas DeMartini, Xin Wang,


Topic: Development of requirements for REL profile based on OMA

requirementsActions: Activity continuing in Requirements group

MPEG-21 DIA VR & Location Schemes:


10211JC Dufourd, Thomas DeMartini, Riccardo Leonardi, AHG on Virtual Resources in DIA

Topic: Virtual resources (VR) is a framework for describing DIA conversion

operators (eg., stereo-to-mono) and association with resources in Digital Items

Grew from “transmoding” activity; further work to harmonize with DIA-REL/RDD integration

Results: Identified Virtual Resource Uses as follows:

o Description of MPEG-21 terminal capabilitieso Allows “on-demand” adaptation of resources in DIAo Allows granting and limiting of rights for adaptations

Actions:75


mailto:??

mailto:??




Not yet clear what granularity the conversion operators should be specified

Adopt requirements for VR framework to MPEG-21 Req. Output document defining specific conversion operator requirements

and request for comments (Requirements) Target VR for Amendment of DIA (not DIA 1st Edition FDIS)

MPEG-21 DID Proposals:


10427

Jeroen Bekaert, Patrick Hochstenbach, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle,


Topic: Revisions needed in DID: updates to DID encoding & mimeType

attributesActions: Adopt for DID 2nd Edition

MPEG-21 DIP:


10291 Thomas DeMartini,Issues in and Contributions for MPEG-21 DIP WD v3 (N5939)

10424

Frederik De Keukelaere, Jeroen Bekaert, Patrick Hochstenbach, Robbie De Sutter, Herbert Van de Sompel, Rik Van de Walle,


Topic: Issues and problems identified for DIP CDQuestions: Use of word “engine” in Fig. 1 – not defined for respective parts Relationship between DIP and REL/RDD/DIA/IPMP – eg., it will be

possible to “play”, “adapt” resource to half-size. It current DIBO design there is an “adapt resource” DIBO used in conjunction with “play”. DIBO should be independent of IPMP/Rights, however, need to design DIML, etc., in such a way

MPEG-21 Avatar Preferences:


10360Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann,


Topic: NB to promote Avatar Preferences to DIA FDISResults: Updates based on Avatar Preferences CE and reference SW out of

sync. Reviewed jointly with SNHC groupActions: Check status later in week regarding completion of reference SW

76










MPEG-21 Audio Adaptation:


10340 I.Wolf, B.Feiten, A.Graffunder, Improvements for Audio AdaptationQoSTopic: Proposal of specific audio descriptors – not in wide useActions: Requires more work; do not adopt to DIA FDIS

MPEG-7 Profiles:


10242 Wo Chang, Masanori Sano, AHG on MPEG-7 Interoperability and Profiling

10336Masanori Sano, Bhavan Gandhi, AlanK Melby, Romulo Pinho, Minor Editing to CD of MPEG-7 Part 9

10337 Wo Chang,Summary of MPEG-7 Multiple Profiles Benefits and Issues

10200 Wo Chang Study Report on MPEG-7 Profile SignalingTopic: Profiles (MPEG-7 Part 9) and signaling (MPRG-7 MDS COR/1)Issues: Signaling of combinations (unions and intersections) of profiles Implications not fully understood Solutions not yet proposedActions: Produce Study of CD on REL profiles Continue to explore issues of signaling profiles in AHG

MPEG-21 Location Schemes:


10319

Gerrard Drury, Craig Brown, Sylvain Devillers, YongJu Cho, on behalf of the AhG for MPEG-21 media locators,


Topic: AHG investigated how to specify media locators for DID, including

using URI fragment and MPEG-7 Contribution of requirements for media locatorsQuestions: Is URI fragment sufficient for locators? How to use MPEG-7?Actions: Requirements need to be improved (BoG) MDS to hold another meeting on media locator proposal

MPEG-21 REL-RDD Reference SW:


77











10208 Xin Wang, Jaime Delgado, Chris Barlas,AHG on MPEG-21 REL and RDD Reference Software

10286Silvia Llorente, Jaime Delgado, Eva Rodriguez,


10287Eva Rodriguez, Jaime Delgado, Roberto García, Silvia Llorente,


10288Eva Rodriguez, Jaime Delgado, Silvia Llorente,


10289Thomas DeMartini, Venu Venkatraman, Mai Nguyen, Xin Wang, Contributions on MPEG-21 REL Conformance

10290

Thomas DeMartini, Venu Venkatraman, Mai Nguyen, Xin Wang, Jaime Delgado, Eva Rodriguez, Silvia Llorente,


10421Victor Torres, Jaime Delgado, Eva Rodriguez, DMAG REL License Interpretation within DID

Topic: Seven contribution documents on REL-RDD SW Including reference software and conformance test licenses REL-RDD Software contributions on License Interpretation, Validation

Rules Checker, etc.Actions: Revise MPEG-21 REL-RDD software plan Adopt changes to MPEG-21 Reference SW (Part 8) (with Integration)

MPEG-21 DIA Reference SW :Doc No. Contribution Source

10397Christian Timmerer, Gerrard Drury, Jeho Nam, AHG on MPEG-21 DIA Reference Software

10444 FNB French NB position on MPEG-21 DIA

10436Davy De Schrijver, Frederik De Keukelaere, Robbie De Sutter, Rik Van de Walle,

Digital Item Adaptation - Reference Software Tests

10387Robbie De Sutter, Frederik De Keukelaere, Rik Van de Walle,


10389Frederik De Keukelaere, Gerrard Drury, Ian Burnett, Rik Van de Walle,


Topic: 29 contributions on Reference SW and updates to plan Significant integration effort has been achievedResults: Completed integration with DID parsing Defined Java package-based organization of DIA softwareActions: Update DIA SW workplan Update MPEG-21 Ref. SW (Part 8)

MPEG-21 Conformance:


10289Thomas DeMartini, Venu Venkatraman, Mai Nguyen, Xin Wang, Contributions on MPEG-21 REL Conformance

Topic: MPEG-21 Conformance (with Integration)Results:

78






















REL Conformance test casesActions: Adopt for MPEG-21 Conformance (Part 14)

MPEG-21 DID Media Locators:


10412 on behalf of AUNB,AUNB Contribution: URI-based location schemes in MPEG-21

Topic: Proposal based for MPEG-21 media locators based on URI fragmentsResults: Reviewed in light of joint meeting with Requirement held earlier in

weekActions: Proposal not adopted Complete draft of requirements for MPEG-21 Media Locators for

MPEG-21 Req. document Create AHG to continuing developing and evaluating solutions for

MPEG-21 media locators

MPEG-7 MDS Issues:


10253 SC 29 Secretariat,Summary of Voting on ISO/IEC 15938-7/PDAM 1 [SC 29 N 5656]

Topic: NB comments on MPEG-7 ConformanceIssues: Bit streams (conformance test cases) not updatedActions: Complete DoC on MPEG-7 Conf. PDAM/1 Bitstreams were not up to date for all MPEG-7 AMDs Produce MPEG-7 Conformance FPDAM/1 and request editing period

until mid-Jan to finalize bitstreams

10043 John R. SmithMPEG-7 Schema Definition (Part 10) WD v1.1

Topic: MPEG-7 Schema DefinitionIssue: Document needs to be updated again to synchronize with ongoing

MPEG-7 AMD development work in Audio, Video, MDS, SystemsActions: Produce Study of CD with editing period sufficient to “catch” release

of AMDs from all groups

MPEG-7 MDS AMD/2:


79




http://mpeg.nist.gov/mpeg/docs/66_Brisbane/contrib/m10043.zip







10445 FNB French NB position on MPEG-7 Person Type

10310Chris Joslin, Thomas Di Giacomo, Nadia Magnenat Thalmann,


10369 Andreas Hutter on behalf of the GNB,Advance German NB ballot comment on ISO/IEC 15938-5 PDAM 2

Topic: Received NB requests for adding user-specific attributes in MPEG-7

for use in DIA applications (eg., birth-date, gender, marital status) Issues: Found conflicts with MPEG-7 Requirements concerning respect for

user privacy (originally discussed in ‘99)Actions: Descriptors not adopted proponents agreed to contribute additional input on these MPEG-7

Requirements to 68th MPEG meeting and provide specific DIA use cases showing need for this user-specific information

- DIA - USNB Comment Extension of ContentCS using DIA ModalityCS

Topic: Udpate of Content CS in MPEG-7 MDS for using in MPEG-21 DIAActions: Adopt revised definition for MPEG-7 MDS AMD/2

80







Summary of Results on MPEG Multimedia Description Schemes (MDS) work items:

Results on MDS MPEG-7 work items:

1. MPEG-7 MDS (Part 5): MPEG-7 MDS User Preference Extensions (AMD/2):

o Received NB requests for adding user-specific attributes in MPEG-7 for use in DIA applications (eg., birth-date, gender, marital status) not adopted

o Found conflicts with MPEG-7 Requirements concerning respect for user privacy (originally discussed in ‘99)

o Action: proponents agreed to … Contribute additional input on these MPEG-7 Requirements to

68th MPEG meeting and Provide specific DIA use cases showing need for this user-

specific informationMPEG-7 AMD/1 MDS Extensions FDAM MPEG-7 MDS COR/1

o Update of semantics of profile signaling MDS COR/1 WD v.2o MPEG-7 Profiles AHG is exploring how to express simple

combinations of profiles (eg., union & intersection) consider updated syntax profile signaling for MDS COR/1 at next meeting

2. MPEG-7 Conformanceo MPEG-7 Conformance Extensions (AMD/1)

Completed DoC on MPEG-7 Conf. PDAM/1 Bitstreams were not up to date for all MPEG-7 AMDs! Produce MPEG-7 Conformance FPDAM/1 and request editing

period until mid-Jan to finalize bitstreams

3. MPEG-7 Schema Definition (Part 10)o Synchronization of MDS, Video, Audio, Systems AMD/1 schemas

Study of CD

Results on MDS MPEG-21 work items:

1. Analyzed recommendations of AHGs and Core Experiments.

2. MPEG-21 Part 2 – Digital Item Declaration:o Adopted updates to DID encoding & mimeType attributes DID

2nd Ed WD v.2 o MPEG-21 Media Locators in DID:

Reviewed proposal based on URI fragments not adopted Developed requirements for MPEG-21 Media Locators for

MPEG-21 Req. document Created AHG to continuing developing and evaluating

solutions for MPEG-21 media locators

3. MPEG-21 Rights Expression Language (REL):o REL Conformance test cases adopted for MPEG-21 Conformance

(Part 14)

81

o REL-RDD Software contributions on License Interpretation, Validation Rules Checker, etc. adopted for MPEG-21 Reference SW (Part 8)

4. MPEG-21 Rights Data Dictionary (RDD):o Registration Authority (RA) for RDD:

Received responses from two parties expressing interest to serve as RA for Rights Data Dictionary (IDF and Rightscom)

Developed document defining evaluation criteria for RDD RA Requesting SC29 to request more detailed information from

candidates about their capability to serve as RDD RA

5. MPEG-21 Part 7 – Digital Item Adaptation:o Reviewed NB comments on FCD (~200 from 12 NBs)

Completed Disposition of Comments – agreed to by all NBso MPEG-21 DIA FDIS to be issued at this meeting (request editing until

March) Major decisions for DIA: Integration of DIA with REL-RDD: DIA 1st Edition will not address the relationship of rights and

permissions to adaptations Operation of DIA in governed environment addressed in

DIA AMD Start of DIA AMD/1 on “DIA Conversions and

Permissions” BSD Transformation Instructions (bitstream

transformation language) not adopted, continue exploration in AHG and consider for future DIA AMD

Avatar Preferences not adopted, interest to develop complete framework for graphics adaptation for future DIA AMD

o DIA Reference SW: Completed integration with DID parsing Defined Java package-based organization of DIA software Updated DIA SW workplan Updated MPEG-21 Ref. SW (Part 8) Very happy Integration Chair

o Virtual Resources: framework for describing DIA conversion operators and association with resources in Digital Items

Adopted requirements of framework for Conversions to MPEG-21 Req.

Created additional draft of requirements of specific Conversion operators (eg., stereo-to-mono)

Developed call for comments to get feedback on conversion operators and expand this list

Created first working draft of VR framework adopted to DIA AMD/1 WD v.1

6. MPEG-21 Part 10 – Digital Item Processing:

82

o Improved syntax of various DIP types such as ObjectType, Argument

o Validated definition of ObjectMap for distributed caseo Developed initial mapping between REL-RDD rights verbs and DIP

DIBOs (to be further developed in editing period)o Resolved DIP WD editor’s noteso Developed DIP text for MPEG-21 Ref. SW (Part 8)o Output: DIP CD

7. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.)

83

New Core Experiments (CEs):

The following MPEG-21 experiments for MPEG-21 Digital Item Adaptation (DIA) and Digital Item Processing (DIP) were approved during the Waikoloa meeting:

Organisations Application ReviewersInformatrion and Communications University (ICU)Korean Broadcasting System (KBS)Panasonic Singapore Labs

Workplan for Core Experiment on DIBO Exploration

Gerrard DruryFrederik De KeukelaereJeho Nam

84

List of MDS Output documents:

No. Title TBP

Available

15938-5 MPEG-7 Multimedia Description Schemes 616

1 Study of Draft Comments on MPEG-7 MDS PDAM2 03/12/12

6162 MPEG-7 MDS COR/1 WD v2.0 03/12/12

15938-7 MPEG-7 Conformance

15938-10 MPEG-7 Schema definition 616

3 MPEG-7 Schema Definition Study of CD 03/12/30

21000-2 MPEG-21 Digital Item Declaration616

4 ISO/IEC 21000-2 DID 2nd Edition WD v.2 03/12/1221000-5 MPEG-21 Rights Expression Language

6165 MPEG-21 REL/RDD Software Implementation Plan v.5 03/12/12

21000-6 MPEG-21 Rights Data Dictionary6166

Evaluation Criteria for Appointing the RA for ISO/IEC 21000-6 03/12/12

21000-7 MPEG-21 Digital Item Adaptation616

7 DoC on ISO/IEC 21000-7 FCD 03/12/12616

8 ISO/IEC 21000-7 FDIS – Part 7: Digital Item Adaptation 04/03/15616

9 MPEG-21 Digital Item Adaptation AM v.8 03/12/19617

0 Request for Amd/1 to ISO/IEC 21000-7 Digital Item Adaptation 03/12/12617

1 MPEG-21 DIA AMD/1 WD: DIA Conversions and Permissions Y 03/12/12617

2 MPEG-21 DIA Software Implementation Plan v.6 03/12/1221000-10 MPEG-21 Digital Item Processing

6173 ISO/IEC 21000-10 CD – Part 10: Digital Item Processing Y 04/01/19

6174 Workplan for Core Experiment on DIBO Explorations 03/12/12

6175 MPEG-21 DIP Software Implementation Plan v.1 03/12/12

85

List of AHGs approved by the MDS group:

N6176 20.1.1 AHG on MPEG-21 Media LocatorsMandates 3. Revise and improve the requirements for media locators

4. Develop, solicit and discuss solutions for MPEG-21 media locators

5. Recommend clarifications to DID specification in regard to media locators

Chair Myriam Amielh ([email protected])Co Chair Gerrard Drury ([email protected])

Sylvain Devillers ([email protected])Yongju Cho ([email protected])Craig Brown ([email protected])

Duration Until the 68th MeetingMeetings Meetings may take place as required

Bussiness will primarily be conducted by email or telephone.Reflector [email protected]

Please use the prefix [medialoc]N6177 AHG on MPEG-21 REL and RDD Reference SoftwareMandate: 1. To continue development of REL conformance licenses and

test cases2. To continue development of REL interpretation

conformance software3. To coordinate work on other software in the REL/RDD

reference software planChairman: Xin Wang, [email protected]: Jaime Delgado, [email protected]

Chris Barlas, [email protected] Duration: Until 68th Meeting Meetings A meeting will be held on Sunday before the 68th meeting.

Business will also be conducted by E-mail or Telephone.Reflector: [email protected]

Message titles prefixed [REL/RDD-RS]N6178 20.1.2 AHG on DIA EditingMandate: 1. Produce the AM8.0 by 2003/12/19.

2. Produce the FDIS and submit to SC29 by 2004/03/15.3. Maintain the schema and description examples for the FDIS and AM8.0

at http://www.midgardmedia.net.4. Produce an Editors' Input on the WD for Amd.1.5. Produce AM8.1.

Chairman Anthony Vetro (avetro_at_merl.com)Co-chairman

Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at)Sylvain Devillers (Sylvain.Devillers_at_imec.be)Thomas DeMartini (thomas.demartini_at_contentguard.com)

Duration: Until the 68th Meeting.Meetings:

AHG Meeting to be held on the weekend prior to the 68th meeting.Reflector: mpeg21-uma_at_merl.comN6179 AHG on Bit-stream Adaptation in Constrained and Streaming

EnvironmentsMandate:

86

http://www.midgardmedia.net/






1. Identification of evaluation criteria for bit-stream adaptation in constrained or streaming environment.

2. Study candidate technologies for XML-based transformations including XSLT, STX, and BSDTrI.

3. Initiate the evaluation of candidate technologies.Chairs: Jörg Heuer (Siemens AG)

Debargha Mukherjee (HP Labs)Sylvain Devillers (IMEC)Christian Timmerer (University Klagenfurt)

Duration: Until 68th Meeting Meetings A meeting will be held on the weekend before the 68th

meeting. Other business will be conducted by E-mail or telephone conference.

Reflector: [email protected]: Send email to Anthony Vetro ([email protected])N6180 AHG on MPEG-21 DIA Reference SoftwareMandate: 1. Review and collect feedback on the integrated MPEG-21 DIA

Reference Software packages as outlined in N6172.

2. Investigate transfer of the MPEG-21 DIA Reference Software packages to the NIST CVS repository.

3. Follow and maintain the MDS DIA reference software implementation document, including tracking of the proposed deliveries of software to the Reference Software Web site.

Chairman: Christian Timmerer (University Klagenfurt – [email protected])Gerrard Drury (UoW - [email protected])Frederik De Keukelaere (Ghent University – [email protected])

Duration: Until 68th Meeting Meetings A meeting will be held on the weekend before the 68th

meeting. Other business will be conducted by E-mail or telephone conference.

Reflector: [email protected]: See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-

refswN6181 20.1.3 AHG on MPEG-21 DIP Reference SoftwareMandates 1. Follow the MPEG-21 DIP Software Implementation Plan.

2. Maintain the MPEG-21 DIP Software Implementation Plan.3. Encourage delivery of software implementations according

to the MPEG-21 DIP Software Implementation Plan.4. Investigate transfer of DIP Reference SW to NIST CVS site.

Chairman Gerrard Drury ([email protected])Co Chair Frederik De Keukelaere ([email protected])

Munchurl Kim ([email protected])87


Duration Until the 68th MeetingMeetings AHG Meeting to be held on the Sunday prior to 68th meeting.

Other business to be conducted by email or phone.Subscribe See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-

refswN6182 20.1.4 AHG on Editing and Core Experiments for DIPMandates 1. Edit MPEG-21 DIP CD.

2. Study MPEG-21 DIP CD and encourage contributions on improving this document

3. Carry out Core Experiments on DIP.Chairman Gerrard Drury ([email protected])Co Chair Rik Van de Walle ([email protected])

Munchurl Kim ([email protected])Duration Until the 68th MeetingMeetings AHG Meeting to be held on the Sunday prior to 68th meeting.

Other business to be conducted by email or phone.Reflector [email protected] See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-

dip

88




MPEG MDS group schedule for 67th meeting:

MDS Sub-Group Schedule

MPEG-7 and MPEG-21 V.4.25 Numbe

r TITLE ROOM & SOURCE STD NOTES

Monday Morning (9h00-13h00)

MPEG Plenary Plenary room

Monday Afternoon (14h00-20h00)

Kick-off of MPEG MDS activities (14h00-14h30) Kohala 2 (MDS Room) ALL

Agenda, Goals and Issues for the Week for MDS Group John R. Smith

Review of AHG resolutions and action points (14h30-16h00) Kohala 2 (MDS Room) ALL

10208 Xin Wang, Jaime Delgado, Chris Barlas,


10212 Gerrard Drury, Myriam Amielh, Sylvain Devillers, Yongju Cho, AHG on MPEG 21 Media Locators

10214 Gerrard Drury, Rik Van de Walle, Munchurl Kim,


10209 Anthony Vetro, Christian Timmerer, Sylvain Devillers,


10210Thomas DeMartini, Chris Barlas, Sylvain Devillers, Anthony Vetro,

AHG on Integration of DIA with REL and RDD

10211 JC Dufourd, Thomas DeMartini, Riccardo Leonardi, AHG on Virtual Resources in DIA

10397 Christian Timmerer, Gerrard Drury, Jeho Nam,


10213 Jeho Nam, Debargha Mukherjee, AHG on Core Experiments for MPEG-21 DIA

10295Truong Cong Thang, Yong Ju Jung, Yong Man Ro, Jae-Gon Kim, Jeho Nam, Jin-Woo Hong, Debargha Mukherjee,

Report of CE on Modality Conversion QoS

10363Munchurl Kim, Hendry, Jong-Nam Kim, Keonsoo Park, Huang Zhongyang,


10382Andreas Hutter, Joerg Heuer, Gabriel Panis, Debargha Mukherjee, Christian Timmerer,


10386 Frederik De Keukelaere, Rik Van de Walle,

Results of Core Experiment on Object Map Technology

10417 Gerrard Drury, Frederik De Keukelaere, Thomas De Martini, Report of DIP CE on DIM Object Map

Define BoGs and Mandates (16h00-16h30) Kohala 2 (MDS Room) ALL

REL, RDD, DIA, BSD, DIP

MPEG-21 DIA Editing (16h30 - 17h00) Kohala 2 (MDS Room) MPEG-21

10281 Anthony Vetro, Christian Timmerer, Sylvain Devillers,

Editors Input on ISO/IEC 21000-7 FDIS

89
















mailto:??

mailto:??










10282 Anthony Vetro, Christian Timmerer, Sylvain Devillers, MPEG-21 DIA AM v7.1

MPEG-21 DIA specification (17h00 - 18h30) Kohala 2 (MDS Room) MPEG-21

10265 SC 29 Secretariat, Summary of Voting on ISO/IEC FCD 21000-7

10398 Christian Timmerer , on behalf of the Austrian NB,

Austrian NB comments on MPEG-21 DIA (Digital Item Adaptation)

10434Sylvain Devillers on behalf of the BNB and, Jean Gelissen on behalf of the DNB, ,

BNB and DNB comments on ISO/IEC 21000-7 FCD (MPEG-21 DIA)


Tuesday Morning (09h00-13h00)

MPEG-21 Responses to Call for RDD Reg. Authority (09h00 - 09h30) Kohala 2 (MDS Room) MPEG-

21

MPEG-21 REL Profiles (09h30 - 10h00) Kohala 2 (MDS Room) MPEG-21

10403Brad Gandee, TJ Pannu, Manuel Ham, Thomas DeMartini, Xin Wang,


MPEG-21 DIA VR & Location Schemes (10h00 - 11h00) with Requirements Kohala 2 (MDS Room) MPEG-

21

10211 JC Dufourd, Thomas DeMartini, Riccardo Leonardi, AHG on Virtual Resources in DIA

MPEG-21 DID Proposals (11h00 - 12h00) Kohala 2 (MDS Room) MPEG-21

10427Jeroen Bekaert, Patrick Hochstenbach, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle,


J on 4 (12h00 - 13h00) with Vid, Aud, Sys Systems MAF

MPEG-21 DIA BSD (12h00 - 13h00) Kohala 2 (MDS Room) MPEG-21

10430 Sylain Devillers, Eric Delfosse, Improved BSDL text for DIA FDIS

10411 Shih-Ta Hsiang, Debargha Mukherjee, Sam Liu,

Fully format-independent adaptation use cases using DIA SoFCD tools

10383Andreas Hutter, Joerg Heuer, Gabriel Panis, Christian Timmerer,

Proposal to support gBSD Transformations in a Streaming Use Case

Tuesday Afternoon (14h00-20h00)

MPEG-21 DIA BSD (14h00 - 16h00) Kona 2 (MDS BoG room) MPEG-21

MPEG-21 DIP (14h00 - 16h00) Kohala 2 (MDS Room) MPEG-21

90











mailto:??

mailto:??















10214 Gerrard Drury, Rik Van de Walle, Munchurl Kim,


10363Munchurl Kim, Hendry, Jong-Nam Kim, Keonsoo Park, Huang Zhongyang,


10386 Frederik De Keukelaere, Rik Van de Walle,

Results of Core Experiment on Object Map Technology

10417 Gerrard Drury, Frederik De Keukelaere, Thomas De Martini, Report of DIP CE on DIM Object Map

10291 Thomas DeMartini, Issues in and Contributions for MPEG-21 DIP WD v3 (N5939)

10424Frederik De Keukelaere, Jeroen Bekaert, Patrick Hochstenbach, Robbie De Sutter, Herbert Van de Sompel, Rik Van de Walle,


MPEG-21 Avatar Preference DIA (16h00 - 16h30) with SNHC Kohala 2 (MDS Room) MPEG-

21

10360 Chris Joslin, Thomas Di Giacomo, Nadia Magnenat-Thalmann,


MPEG-21 Audio Adaptation (16h30 - 17h00) with Audio Kohala 2 (MDS Room) MPEG-

21

10340 I.Wolf, B.Feiten, A.Graffunder, Improvements for Audio AdaptationQoS

MPEG-21 DIA DoC (17h00 - 18h00) Kohala 2 (MDS Room) MPEG-21

A. Vetro, I. Burnett DIA Configuration

10302 TVA via SC 29 Secretariat, Liaison Statement from the TV-Anytime Forum [SC 29 N 5688]

J on 4 joint meeting (17h30 - 17h45) with JPEG Kona 5 (JPEG Room) MAF

MPEG-21 DIP BoG (17h30 - ...) Kona 2 (MDS BoG room) MPEG-21

Wednesday Morning (09h00-13h00) MPEG Plenary (9h00-11h30) Plenary room MPEG Plenary

MPEG-21 DIP BoG (11h30 - 12:15) Kona 2 (MDS BoG room) MPEG-21


C. Barlas, et al. UKNB comments on DIA MPEG-7 Profiles (11h30 - 12h15) with Req., Video, Audio, Systems

Monarcy Ballroom (Requirements Room) MPEG-7

10242 Wo Chang, Masanori Sano, AHG on MPEG-7 Interoperability and Profiling

10336 Masanori Sano, Bhavan Gandhi, AlanK Melby, Romulo Pinho,

Minor Editing to CD of MPEG-7 Part 9

10337 Wo Chang, Summary of MPEG-7 Multiple Profiles Benefits and Issues

10200 Wo Chang Study Report on MPEG-7 Profile Signaling

MPEG-21 Location Schemes (12h15 - 13h00) with Requirements

Monarcy Ballroom (Requirements Room)

MPEG-21

91





























10319Gerrard Drury, Craig Brown, Sylvain Devillers, YongJu Cho, on behalf of the AhG for MPEG-21 media locators,


Wednesday Afternoon (14h00-17h30)

MPEG-21 Reference SW Req (14h00 - 15h00) with Int. Req, Sys


MPEG-21

MPEG-21 REL-RDD Reference SW (15h00 - 16h00) with Integration Kohala 2 (MDS Room) MPEG-

21

10208 Xin Wang, Jaime Delgado, Chris Barlas,


10286 Silvia Llorente, Jaime Delgado, Eva Rodriguez,


10287 Eva Rodriguez, Jaime Delgado, Roberto García, Silvia Llorente,


10288 Eva Rodriguez, Jaime Delgado, Silvia Llorente,


10289Thomas DeMartini, Venu Venkatraman, Mai Nguyen, Xin Wang,


10290Thomas DeMartini, Venu Venkatraman, Mai Nguyen, Xin Wang, Jaime Delgado, Eva Rodriguez, Silvia Llorente,


10421 Victor Torres, Jaime Delgado, Eva Rodriguez,

DMAG REL License Interpretation within DID

MPEG-21 REL Profiles BoG (16h00 - ...) Kona 2 (BoG room) MPEG-21

MPEG-21 DIA Reference SW (16h00 - 16h45) with Integration Kohala 2 (MDS Room) MPEG-

21

10397 Christian Timmerer, Gerrard Drury, Jeho Nam,



10436Davy De Schrijver, Frederik De Keukelaere, Robbie De Sutter, Rik Van de Walle,


10387 Robbie De Sutter, Frederik De Keukelaere, Rik Van de Walle,


10389Frederik De Keukelaere, Gerrard Drury, Ian Burnett, Rik Van de Walle,


MPEG-21 DIP Reference SW (16h45 - 17h00) with Integration Kohala 2 (MDS Room) MPEG-

21

Mult. Appl. Formats (16h30 - 17h00) with Syst, Req, Audio, Video


MPEG-21

MPEG-21 Conformance (17h00 - 18h00) with Integration Kohala 2 (MDS Room) MPEG-

21

10289Thomas DeMartini, Venu Venkatraman, Mai Nguyen, Xin Wang,


MPEG Social Event (18h00 - midnight)

Thursday Morning (09h00-12h30)

92





























MPEG-21 DIA Rights Issues (08h30 - 09h00) Kohala 2 (MDS Room) MPEG-21

MPEG-21 File Format (09h00 - 10h00) with Systems, Video Kohala 3 (Systems) MPEG-7

MPEG-21 DID Media Locators (10h00 - 10h30) Kohala 2 (MDS Room) MPEG-21

10412 on behalf of AUNB, AUNB Contribution: URI-based location schemes in MPEG-21


MPEG-7 MDS Issues (10h30 - 11h00) Kona 2 (BoG Room) MPEG-7

10253 SC 29 Secretariat, Summary of Voting on ISO/IEC 15938-7/PDAM 1 [SC 29 N 5656]

10043 John R. Smith MPEG-7 Schema Definition (Part 10) WD v1.1

MPEG-7 MDS Amd/2 (11h00-12h00) Kona 2 (BoG Room) MPEG-7

10445 FNB French NB position on MPEG-7 Person Type

10310 Chris Joslin, Thomas Di Giacomo, Nadia Magnenat Thalmann,


10369 Andreas Hutter on behalf of the GNB,

Advance German NB ballot comment on ISO/IEC 15938-5 PDAM 2

- DIA - USNB Comment Extension of ContentCS using DIA ModalityCS

Thursday Afternoon (14h00-19h00)


MPEG-21 Requirements (14h00 - 15h00) Monarcy Ballroom (Requirements Room)

MPEG-21

MPEG-21 DIP Issues (15h00 - 16h00) Kohala 2 (MDS Room) MPEG-21

Plenary MDS and Reports of BoG (16h00 - 17h00) Kohala 2 (MDS Room) MDS PlenaryReview of Output documents, AHGs, CEs, DoC, Std (17h00- 18h00) Kohala 2 (MDS Room)

Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Kohala 2 (MDS Room) MDS Plenary

Approval of resolutions, AHGs and Output documents

Friday Afternoon (14h00-21h00)

MPEG Plenary Plenary room MPEG Plenary

93













http://mpeg.nist.gov/mpeg/docs/66_Brisbane/contrib/m10043.zip







Annex 8Report of Video meeting

Source: Jens-Rainer Ohm

MPEG-4

Study of Corrigendum A study of the recent DCOR over 14496-2 was issued (N6163), which resolves some problems that were raised by the Japanese NB, and some other items that are mainly of editorial nature. The Video subgroup has issued a resolution that requests NBs to consider this study text in their ballot votes on the DCOR.

Documents reviewed: M10318 JNB comments on ISO/IEC 14496-2:200x (Visual 3rd Edition)

DCOR1 The National Body of Japan

New Versions of MPEG-4 Visual LPR and VMVersion 11 of the document "MPEG-4 Visual List of Problems Reported" (N5952) was issued. One issue related to VTC error resilience, which was found unresolvable in the DCOR at this time (as VTC experts requested it needs more thorough study), was put back to the LPR. Items related to the VM 18.0 were removed, since a new version of the VM was produced. All other items relate to Reference Software and Conformance, where a number of software-related issues was again resolved according to the work plan.

Documents reviewed:

M10296 MPEG-4 Visual: Updated List of Problems Reported, v.10.1

Yi-Shin TungChung-Neng WangTihao ChiangJens-Rainer Ohm

M10431 MPEG-4 Video Verification Model version 19.0 Angus ReidJonathan Teh

Software and Conformance

The FDAMs on software (N6246 + N6245 DoC) and conformance (N6238 + N6237 DoC) related to the error-resilient simple scalable profile were produced. The original work plan had foreseen to have all software related bug fixes (general bugs, not necessarily related to the newly added code) resolved by the 67th meeting. As it turned out in the meantime that this is impossible to achieve, an editing period is requested to provide the finalized FDAM software by January 31st, 2004. Two late NB comments were considered and followed which have allowed including of conformance stream specifications related to the recently defined Lvel 0b of Simple Profile yet in the new conformance amendment.

Documents reviewed: M10255 Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 5 [SC

29 N 5658] SC 29 Secretariat

M10258 Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 5 SC 29 SecretariatM10405 Conformance bitstream for the Simple Profile Level 0b Viktor Varsa

M10453 GNB comment on the addition of Level 0b conformance streams to the MPEG-4 Simple Visual Profile conformance German NB

M10454Finnish NB comment regarding addition of Level 0b conformance bitstreams to the MPEG-4 Simple Visual Profile conformance document

Finnish NB

95

Optimised Reference Software NCKU has further improved their fast version of optimised reference software for the Simple Profile. They are in contact with the Software Maintenance AHG Chair to unify efforts and use the independently developed packages for possible cross-check purposes.

Documents reviewed:M10314 NCKU MPEG-4 Simple Profile Software Encoder Contribution Jing-Xin Wang

Alvin W.Y. Su

AVC related

In Waikoloa, a JVT meeting took place in parallel with the Video Subgroup. Main topics in MPEG-4 part 10 (AVC) were related to the finalization of the verification test (N6231), the professional extensions amendment (N6108), the first corrigendum (N6109), the software (N6248) and conformance (N6240) extensions related to AVC. The video subgroup has reviewed and recommended approval of all the related documents by MPEG. Where necessary by the work status, editing periods were defined as requested by JVT.

Documents reviewed:M10248 Table of Replies on ISO/IEC FDIS 14496-10 [SC 29 N 5599] ITTF via SC 29 SecretariatM10260 Summary of Voting on ISO/IEC 14496-4/PDAM 6 SC 29 SecretariatM10261 Summary of Voting on ISO/IEC 14496-5/PDAM 6 SC 29 SecretariatM10266 Summary of Voting on ISO/IEC 14496-10/PDAM 1 SC 29 Secretariat

M10400 SMPTE Liaison to WG11 regarding Alpha Channel Considerations in the Professional Amendment to AVC/H.264 ST13-03 Liaison Committee

Output documents related to MPEG-4

No. Title TBP Available

14496-2 MPEG-4 Visual6183 Study Text of ISO/IEC 14496-2:200X DCOR 1 N 03/12/126184 MPEG-4 Visual Verification Model 19.0 N 03/12/126185 MPEG-4 Visual: List of Problems Reported version 11.0 Y 03/12/12

14496-4 MPEG-4 Conformance6237 DoC on ISO/IEC 14496-4:2003/FPDAM 5 N 03/12/126238 Text of ISO/IEC 14496-4:2003/FDAM 5 N 03/12/126239 DoC on ISO/IEC 14496-4:2003/PDAM 6 N 04/02/066240 Text of ISO/IEC 14496-4:2003/FPDAM 6 N 04/02/06

14496-4 MPEG-4 Reference Software6245 DoC on ISO/IEC 14496-5:2003/FPDAM 5 N 03/12/126246 Text of ISO/IEC 14496-5:2003/FDAM 5 N 04/01/306247 DoC on ISO/IEC 14496-5:2003/PDAM 6 N 04/02/066248 Text of ISO/IEC 14496-5:2003/FPDAM 6 N 04/02/06

14496-10 Advanced Video Coding 6107 Disposition of Comments on ISO/IEC 14496-10 PDAM 1 N 04/02/066108 Text of ISO/IEC 14496-10 FPDAM 1 AVC Professional Extensions N 04/02/066109 Text of ISO/IEC 14496-10 DCOR 1 N 03/12/156231 Report Of The Formal Verification Tests on AVC (ITU-T Rec. H.264 | ISO/IEC 14496-

10)Y 03/12/12

MPEG-7

MPEG-7 related work in Waikoloa

The MPEG-7 breakout group was active during the whole week.

96

Approval of the Core Experiments results VCE-1: Perceptual 3D Shape Descriptor -> promoted to XM (part 3)VCE-2: Visual tools and DS for images or photos libraries – good results and ideas presented, this CE will continue2.3 Input documents as reviewed are listed in the subsequent table.

M10253 Summary of Voting on ISO/IEC 15938-7/PDAM 1 [SC 29 N 5656] SC 29 Secretariat

M10256 Summary of Voting on ISO/IEC 15938-3/DCOR 1 SC 29 SecretariatM10264 Summary of Voting on ISO/IEC 15938-3/FPDAM 1 SC 29 Secretariat

M10270ISO/IEC CD 19794-2: Information technology -- Biometric data interchange formats -- Part 2: Finger minutiae data [SC 29 N 5637]

SC 37 via SC 29 Secretariat

M10271 ISO/IEC CD 19794-4: Information technology -- Biometric data interchange formats -- Part 4: Finger image data [SC 29 N 5638] SC 37 via SC 29 Secretariat

M10272 ISO/IEC CD 19794-5: Information technology -- Biometric data interchange formats -- Part 5: Face image data [SC 29 N 5639] SC 37 via SC 29 Secretariat

M10273 ISO/IEC CD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5640] SC 37 via SC 29 Secretariat

M10300 Report of Cross Verification Result for VCE-1: Perceptual 3D Shape Descriptor Soo-Jun Park

M10301 A Proposal for VCE-2: DS for Image GroupingSoo-Jun ParkMyung Gil JangChee Sun Won

M10303 Editor's input on ISO/IEC 15938-3/FPDAM1 Akio Yamada Leszek Cieplinski

M10304 Editor's Input on ISO/IEC TR 15938-8/PDAM1 Akio Yamada Sang-Kyun Kim

M10305 Report on VCE-2: A study on use scenarios and DS design for photo archive Akio Yamada

M10317 Use Scenarios for Visual tools and DS for images or photos libraries (VCE-2)

Sang-Kyun KimYoung Sik Huh

M10324 Perceptual 3D shape descriptor: Result of core experiment (VCE-1)

In Kyu ParkDuck Hoon KimIl Dong Yun

M10437 UK NB comments on Text of ISO/IEC 15938-3 FPDAM-1

The text of FDAM1 for MPEG-7 Visual (N6188 + N6187 DoC) and the text of DCOR1 (N6186) were issued.Only one Core Experiment (tools and DS for image/photo libraries) will be continued (N6189). To improve the text of 15938-8/Amd.1, a PDAM Study was released (N6191). NBs are kindly asked to consider this study in their ballot votes.

2.4 Technical work on Multimedia Application Formats continued Core Experiments Planned Started collection of the photos database (~ca 1000 images collected at this meeting,

target 10000 images) Please contribute your MPEG photos – email offers to visual reflector Currently 5 Usage Scenarios are covered

2.5 XM Software reviewThe review of XM software shown that all tool are properly integrated. New tools accepted at this meeting should be integrated within two weeks after the meeting.

Documents related to MPEG-7 issued


15938-3 MPEG-7 Visual6186 Text of ISO/IEC 15938-3:2002/COR 1 N 2004/01/16

97

6187 DoC on ISO/IEC 15938-3/FPDAM1 N 2003/12/266188 Text of ISO/IEC 15938-3/FDAM 1 N 2004/01/16

6189 Description of Core Experiments for MPEG-7 Visual Extensions

N 2003/12/12

6190 MPEG-7 Visual XM Document version 19.0 N 2003/12/1215938-8 Extraction and Use of MPEG-7 Descriptions

6191 Study Text of ISO/IEC TR 15938-8/PDAM1 N 2003/12/26

MPEG-21

Scalable Video Coding

After the CfP on new scalable video coding technology had been issued by the 66 th MPEG meeting, only a slight update was made at the 67th meeting. This concerns decision of one sequence as was previously discussed by the reflector, and slight modification of one rate point to make the prospective results of the tests more useful from the minimized number of rate points that had been decided in the last meeting.19 expressions of interest to participate in the Call had been received by the deadline of Dec. 1 st. The evaluation of proposals will be performed in the 68 th meeting (March 2004) with a 2-3 day AHG meeting before. Based on the outcome, the most promising proposals will be selected to define a set of core experiments starting a collaborative phase in scalable video coding development. A request for subdivision of MPEG-21 was made, where Scalable Video Coding will become 21000-13, with a timeline of WD-04/07; CD-05/10; FCD-06/03; FDIS 06/07.

This time, only a low number of technical contributions have been submitted that are related to the scalable video coding. These contributions proposed technologies mainly on Interframe Wavelet Coding, relating to:

– Flexible frame relationships for low-delay modes– Adaptive spatial filters– Usage of spatial prediction and interpolation in local intraframe coding– Removal of blocking artifacts– Improved encoding of motion vectors (flexible spatio-temporal prediction, CABAC)

Another request was made by the Dutch NB for implementation of light-weight scalability at systems layer. This would include a simple tandem configuration of codecs (prospectively using different standards such as MPEG-2 and AVC in base and enhancement layers). During the discussions in the video group, concerns were raised that the efficiency and the need of such technology from the background of concrete applications was not fully made clear. Even though it looks simple, the upsampling process may be quite complicated and require careful specification, e.g. for interlace, 4:3/16:9 aspect ratio change etc. Further, the new scalable video coding work that is started would definitely needs similar (but more generic) cross-standard approaches. It is hence recommended to regard this topic further within the wider scope of systems-related aspects for new scalable coding.Documents reviewed:

M10308Successive Temporal Approximation and Referencing (STAR) for improving MCTF in Low End-to-end Delay Scalable Video Coding

Woo-Jin Han

M10323 Interframe Wavelet Video Coding with Frame Adaptive Spatial Wavelet

Won-Ha KimSeyoon JeongKyuheon KimJinwoong Kim

M10359 Request for improved scalability support at MPEG-2 System level H.A. Gelissen on behalf of the DNB

M10396 Recent improvements in the MC-EZBC video coder Yongjun WuJohn W. Woods

98

M10402 Generation of Original Test Sequences and AVC Anchors for Call for Proposals on Scalable Video Coding Technology

Thomas RusertChun-Jen Tsai

M10415 Improved Motion Vector Coding for Sliding Window (SW) EZBC Video Coder

Abhijeet GolwelkarJohn W. Woods

Output documents related to MPEG-21

No. Title TBP Available21000-13 Scalable Video Coding

6192 Request for Subdivision of ISO/IEC 21000: Part 13 Scalable Video Coding

N 2003/12/12

6193 Call for Proposals on Scalable Video Coding Technology Y 2003/12/12

Explorations

3D AV Coding

In 3D AV coding, the following Exploration Experiments were performed before the Waikoloa meeting: EE1 – Evaluation of usage of mesh objects for omni-directional video: Following the

previous results which showed that it may not be necessary to use shape coding tools in encoding of the EE1 related mesh-objects, an investigation was started on localized random access, which would allow to partially decode frames. The goal was to find the best practical solution is found, which would require as low standardization effort as possible. The results obtained so far are not fully conclusive yet, in particular possible boundary effects must be further investigated if a sub-division of the entire plane into different locally accessible sub-planes is made. The random access and partial decoding applies to interactive applications, where the partial view is selected by the user. In full lookaround applications (e.g. for a cinema dome), the entire panorama must be decoded at once. However also for this application, it would be preferable to use existing devices (decoders), defined around existing profiles. This could well be realized by combining several decoder outputs into a large panorama frame. A visible artefact problem may as well occur here at the seams between the different decoder outputs, which is very similar to the problem stated above w.r.t. random access for partial decoding.

EE2 – Free viewpoint video: Further investigations were provided about the efficiency of inter-frame (motion compensated prediction) versus inter-view (disparity-compensated prediction) coding approaches. In particular, it was reported that a small gain can be achieved by adaptive switching between inter-frame and inter-view prediction, in particular when the different views are taken from nearby cameras, and when the amount of motion is high. The real challenge, finding the best combination of encoding and methods for decoder-side view generation (e.g. by depth-based interpolation) with optimum tradeoff concerning both rate and visual quality, will be investigated in upcoming experimentation. This will be possible from a newly provided test sequence set of 100 camera views, which (due to the small distance of 3 mm between the camera position) will allow to compare real views and interpolated views at almost continuous positions.Another investigation in EE2 was related to lookaround reconstruction of segmented video objects. Even though synthetic (graphics) objects were used for these first rounds of experimentation, test sets from moving objects taken by natural cameras will be available soon. The concept fits into an SNHC-based 3D representation, with texture surfaces encoded as video objects of arbitrary shape. Random access and view scalability are important features for an efficient implementation. As one of the concepts is based on producing average and difference frames from different views, it was highlighted that a certain

99

similarity exists with interframe wavelet concepts as investigated in the scalable video coding exploration.

Exploration experiments EE1 and EE2 have been re-defined (N6194). Further, a more thorough study was started to describe how complete 3D AV systems can be built from existing MPEG standards building blocks. This was summarized in a document "Draft system design for Omni-directional Video" (N6276).Documents reviewed:

M10293 Proposal of a new level for super high-resolution video to AVC Profiles

Kazumasa Yamazawa(NAIST)Hideaki Kimata(NTT)Ryuji Kitaura(Sharp)Hitoshi Habe(Kyoto Univ.)

M10327 Preliminary results on multiple view coding for the sparse Ray Space representation (3DAV EE2.2.1) Hideaki Kimata

M10332 Request of defining a new level to AVC Profiles Goro Hamagishi

M10333 Some results on local decoding of panoramic video (EE1)

Euee S. JangSun Young LeeHyun Jong OhJong Woo WonWook-Joong KimMyungsuk KiKyuheon Kim

M10334 Liaison Statement from 3D Consortium [SC 29 N 5674] 3D Consortium via SC 29 Secretariat

M10335 Request of defining a new level to AVC Profiles Kazuya Suekage

M10339 A Compression Framework for Free-Viewpoint Video based on 3D Video Fragments (SNHC)


M10343 Preliminary Results on EE2 Using Octree Reconstuction and View-dependent Texture Mapping

Aljoscha SmolicKarsten MuellerPhilipp Merkle

M10344 Preliminary Results on Core Experiments on View-Dependent Multi-Texturing for MPEG-4 AFX

Karsten MüllerAljoscha SmolicTobias Rein

M10353 Proposal for the assessment of natural 3D video objects Marco Rittermann

M10408 Test Sequence for Ray-Space Coding Experiments Masayuki TanimotoToshiaki Fujii

M10410 Ray-Space Coding Using Temporal and Spatial Predictions Masayuki TanimotoToshiaki Fujii

M10416 Evaluation result of divided omni-directional video using AVC (EE1)

Kazumasa Yamazawa(NAIST)Ryuji Kitaura (SHARP)Hitoshi Habe (Kyoto Univ.)Hideaki Kimata (NTT)Toshio Nomura (SHARP)

Output documents related to Explorations


3D AV6194 Description of Exploration Experiments in

3DAVN 2003/12/12

6276 Draft system design for Omni-directional Video N 03/12/12

AHGs established by the Video Subgroup No. Title Mtg6195

AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance N

6196 AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7 Y

100

6197 AHG on Editing MPEG-7 Visual Documents N

6198 AHG on 3DAV Coding Y

6199 AHG on Scalable Video Coding Y

101

Annex 9Report of Audio meeting

Source: S. Quackenbush, Chair, Audio Subgroup

1 OPENING OF THE MEETING................................................................................................................... 104

2 ADMINISTRATIVE MATTERS..............................................................................................................104

2.1 APPROVAL OF PREVIOUS MEETING REPORT................................................................................................1042.2 APPROVAL OF AGENDA AND ALLOCATION OF CONTRIBUTIONS...................................................................1042.3 COMMUNICATIONS FROM THE CHAIR........................................................................................................1042.4 JOINT MEETINGS....................................................................................................................................... 1042.5 RECEIVED NATIONAL BODY COMMENTS AND LIAISON MATTERS...............................................................1042.6 TASK GROUPS.......................................................................................................................................... 104

3 RECORD OF AHG MEETINGS..............................................................................................................105

3.1 MPEG-4 EXTENSION 2, PARAMETRIC AUDIO CODING (SUNDAY 1400-1500).............................................1053.2 LOSSLESS AUDIO CODING (SUNDAY 1500-1700).......................................................................................106

4 RECORD OF AUDIO PLENARY, JOINT MEETINGS AND TASK GROUP ACTIVITIES..............107

4.1 REVIEW OF AHG REPORTS........................................................................................................................ 1074.2 RECEIVED NATIONAL BODY COMMENTS AND LIAISON MATTERS.................................................................1074.3 AUDIO PLENARY DISCUSSIONS.................................................................................................................. 107

4.3.1 Response to CfP on Lossess coding of 1-bit audio representations...................................................1074.3.2 Audio Explorations.......................................................................................................................... 108Summary by the Audio Chair....................................................................................................................... 109

4.4 JOINT MEETINGS...................................................................................................................................... 1094.4.1 Joint meeting with Sys and Req on Proposed Audio BIFS profile (m10348), Music Notation Req. (m10357), MP3onMP4 profile (m10350).....................................................................................................1094.4.2 With MDS on Audio Adaptation QOS (m1030).................................................................................1104.4.3 With Systems on timestamps and AAC normative behaviour (m10143).............................................1104.4.4 With Systems on MPEG-4 Advanced Audio Bifs (m10321, m10347, m10381, m10348).....................110

4.5 TASK GROUP DISCUSSIONS....................................................................................................................... 1104.5.1 MPEG-2 Layer III............................................................................................................................ 1104.5.2 MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software.........1114.5.3 MPEG-4 Extension 1, Bandwidth Extension.....................................................................................1114.5.4 MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)................................................................1124.5.5 MPEG-4 Extension 3, Lossless Coding.............................................................................................1134.5.6 3on4 Application Specification........................................................................................................ 1154.5.7 MPEG-7 Extension 1 Tools, Conformance and Reference Software..................................................1154.5.8 Explorations on Scalable Coding of Audio.......................................................................................1164.5.9 Music Notation................................................................................................................................ 116

5 MEETING DELIVERABLES.................................................................................................................. 116

5.1 PRESS STATEMENT.................................................................................................................................... 1165.2 DISPOSITIONS OF COMMENTS.................................................................................................................... 1165.3 RESPONSES TO LIAISON AND NB COMMENTS.............................................................................................1165.4 RECOMMENDATIONS FOR FINAL PLENARY.................................................................................................1165.5 ESTABLISHMENT OF AD-HOC GROUPS.......................................................................................................1165.6 APPROVAL OF OUTPUT DOCUMENTS.......................................................................................................... 117

6 FUTURE ACTIVITIES............................................................................................................................. 117

6.1 SCHEDULE OF FUTURE MEETINGS.............................................................................................................. 117

102

6.2 AGENDA FOR NEXT MEETING.................................................................................................................... 1176.3 ALL OTHER BUSINESS............................................................................................................................... 1176.4 CLOSING OF THE MEETING........................................................................................................................ 117

ANNEX A PARTICIPANTS........................................................................................................................ 118

ANNEX B AGENDA AND SCHEDULE.....................................................................................................119

ANNEX C AGENDA AND SCHEDULE FOR THE WAIKOLOA MPEG AUDIO MEETING..............119

ANNEX D TASK GROUPS......................................................................................................................... 126

ANNEX E OUTPUT DOCUMENTS...........................................................................................................128

Annex F Agenda for the 68th MPEG Audio Meeting...................................................................................129

103

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 67 th meeting of WG11, December 8-12, Waikoloa, HI, USA. The list of participants is given in Annex A.

Administrative matters

Approval of previous meeting reportThe Audio Subgroup Brisbane meeting report had been previously distributed by e-mail and was approved.

Approval of agenda and allocation of contributionsThe agenda and schedule for the meeting, shown in Annex B, was discussed, edited and approved. The documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary, are shown in the agenda and schedule. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group.

Communications from the ChairThe Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary.

Joint meetingsThe joint meetings with Audio over the course of the week are listed here and are reported on below.

Groups What Where Day TimeAudio, Systems, Requirements

Proposed Audio BIFS profile (m10348), Music Notation Req. (m10357), MP3onMP4 profile (m10350)

Audio Tue 1400-1500

Audio, MDS Audio Adaptation QOS (m1030) MDS Tue 1630-1700All MPEG-7 Profiles Req Wed 1130-1215Audio, Systems Timestamps and AAC normative

behaviorAudio Wed 1500-1600

All Multi-Media Application Formats Systems Wed 1630-1700Audio, Systems Audio Bifs V3 (m10321, m10347,

m10381, m10348)Audio Wed 1700-1800

Audio, Requirements

Requirements for Spatial Audio Coding

Audio Thu 0900-0930

Received National Body Comments and Liaison mattersThe NB Comments and Liaison documents for the meeting that require a response are as shown below.No. Title Response by10294 FNB Position on a New Work Item on Spatial Audio J-B Rault10338 DNB on spatial audio coding W. Oomen

Task GroupsTask groups were convened for the duration of the MPEG meeting, as shown in Annex D. Results of task group activities are reported below.

Record of AhG meetings104

MPEG-4 Extension 2, Parametric Audio Coding (Sunday 1400-1500)Werner Oomen presented

10366 MPEG4-Ext2: CE on Low Complexity parametric stereo


Contribution reviewed current FFT-based stereo coding architecture and presented a new architecture that is QMF-based. In order to work with the QMF architecture, the resolution of the low bands needs to be increased via an additional band splitting via Hybrid filtering. Stereo coding is based on intensity, phase and correlation in each of 10, 20 or 34 stereo bands. Stereo information is transmitted at a variable rate so that it can adapt in response to signal statistics.An advantage of the QMF approach is that it requires significantly fewer resources (as MIPS and RAM) than the FFT architecture. Werner Oomen presented

10371 MPEG-4 Ext.2, subjective results on CE Low complexity stereo

Werner OomenErik Schuijers

The CE status is that RM4 source code was created, which supports ADPCM coding, and then the parametric stereo architecture code was added. The CMOS listening test results showed a statistically significant improvement in the global mean. Philips reported that the CE implementation had two bugs:

Sqrt(2) scaling error inside the parametric coder Transient detection error

And proposed that this might be the reason why ES01 (Suzanne Vega) had consistently lower subjective quality score in other test reports.Kristofer Kjörling, Coding Technology, presented

10372 Listening test verification of core experiment on low complexity parametric stereo. Kristofer Kjörling

which was a cross-check listening test on the Extension 2 CE. This CMOS listening tests were based on bitstreams and decoder provided by Philips. The Coding Technologies results were for the most part consistent with the Philips results, in that the grand mean showed a statistically significant improvement, although one item (ES01) showed a significantly significant reduction in quality.Jean-Bernard Rault presented

10307 Listening Test Results for CE on Low Complexity Stereo module

David ViretteJean-Bernard Rault

which was a cross-check listening test on the Extension 2 CE. This CMOS listening tests were based on bitstreams and decoder provided by Philips. The France Telecom results were for the most part consistent with the Philips results in that the grand mean showed a statistically significant improvement, although one item (ES01) showed a statistically significant reduction in quality. Informal comments on ES01 indicated that the degradation may be due to poor coding of the monophonic signal rather than the stereo coding aspect. Juergen Herre, FhG, presented

10376Cross-check results of MPEG-4 Audio Extension 2, Core Experiment on Low Complexity parametric stereo decoding

Juergen Herre

which was a cross-check listening test on the Extension 2 CE. This CMOS listening tests were based on bitstreams and decoder provided by Philips. The results were generally consistent with other test sites, including that the grand mean showed a statistically significant improvement but one item (ES01) showed a statistically significant degradation. The report specifically noted that

the test material used was not optimal for stereo testing

105























for some items the subjective quality score was primarily determined by the distortion of the parametric coding core (i.e. of the mono signal) so that it was difficult to assess the stereophonic coding distortions.

The AHG has consensus that CE2 shows significant complexity reduction (in terms of MIPS and storage). CE2 also shows statistically significant improvement in subjective quality (in terms of the

grand mean subjective score). New signals provided by Philips be made available to all listening sites and the issue of

CE2 performance for ES01 be discussed during the MPEG week. Check-phase of CE2 is successfully concluded pending resolution of the ES01 issue.

A number of Audio experts expressed the opinion that this technology should be adopted into the specification.

Lossless Audio Coding (Sunday 1500-1700)Ralf Geiger presented

10394 Proposed Evaluation Methods for Fine-Grain Scalability in MPEG-4 SLS

Ralf Geiger Jürgen Herre Thomas Sporer

This contribution discussed ITU-R Recommendation BS.1548-1. This stipulates that 1. 5 consecutive encode/decode of contribution-grade codecs followed by 3 consecutive

encode/decode of distribution-grade codecs should be subjectively indistinguishable from the source for most types of audio programme material

2. (1) followed by an additional encode/decode of an emission-grade codec should not cause a significant reduction in quality compared to the basic audio quality of the emission codec.”

The contribution recommends the following criterion for evaluating the fine-grain scalability in MPEG-4 SLS:

If it is deemed necessary to evaluate the characteristics of fine-grain scalability in MPEG-4 SLS, intermediate bitrates beyond perceptual transparency shall be evaluated in addition to the lossless compression performance.

The fine-grain scalability of MPEG-4 SLS shall be evaluated for 48 kHz / 16 bit and optionally for the 24 bit formats.

The MPEG-4 SLS codec shall operate at the bitrates listed in Table 2. The increased bitrates for higher resolution signals should account for the higher lossless bitrates.

Eight stages of tandem coding shall be performed. The final output bitstream shall be decoded and evaluated at the total bitrate (see Table

2), at the AAC core bitrate and at several intermediate bitrates (e.g. 128, 256, 384 and 512 kbps).

For subjective evaluation, a listening test according to ITU-R BS.1116 shall be performed. Alternatively, a PEAQ measurement or a MUSHRA listening test might be applied. Nevertheless, it is assumed that a test according to ITU-R BS.1116 delivers the most accurate results for small impairments.

Sr/Wd AAC core bitrate (stereo)

Enhancement bitrate (stereo)

Total SLS bitrate (stereo)

Average lossless bitrate (SLS RM0)

48 kHz / 16 bit 128 kbps 384 kbps 512 kbps 768 kbps48 kHz / 24 bit 128 kbps 640 kbps 768 kbps 1506 kbps96 kHz / 24 bit 160 kbps 864 kbps 1024 kbps 2316 kbps192 kHz / 24 bit 192 kbps 1344 kbps 1536 kbps 3808 kbps

Table 2. Proposed bitrates for tandem coding of MPEG-4 SLS106






Summary of contribution proposals: Goal of CfP for Lossless Audio Coding was to enhance MPEG-4 from perceptually

transparent to lossless MPEG-4 SLS covers a very wide range of bitrates between perceptually transparent and

lossless operation ITU-R has spent considerable effort to define evaluation criteria for near-lossless coding Tandem coding is an established technique to evaluate near-lossless coding First experiments indicate that tandem coding is appropriate for evaluating MPEG-4 SLS at

bitrates between perceptually transparent and lossless operation Proposal: If desired, the FGS feature of MPEG-4 SLS shall be evaluated by listening tests

according to ITU-R BS.1116, where the codec shall operate at 48 kHz / 16 bit, 128+384 kbps stereo, eight codecs in tandem

Yuriy Resnik, RealNetworks, raised the issue that if one wishes to tandem SLS, it is important to use the same MPEG-4 AAC encoder for all participants in the Core Experiment work. Jim Johnston, Microsoft, presented

10283 A proposal for testing Progressive-to-Lossless Coding James D. Johnston

The Chair noted that there was more agreement than disagreement. In particular, Jim Johnston, Microsoft, agreed with the major points in the FhG contribution (i.e. to use tandeming for assessing SLS performance at rates beyond perceptual transparency). Sang-Wook Kim commented that the SLS workplan does not stipulate assessment of SLS performance at rates below transparency. Jim Johnston commented that MPEG might not produce the best technical work if the SLS codec is not tested at rates below transparency.

Record of Audio plenary, joint meetings and task group activities

Review of AHG reportsThere were no requests to review any of the AHG reports that were already presented in the opening MPEG plenary.

Received national body comments and liaison mattersThe Audio Chair presented

10277 Revised input relating to ISO/IEC 13818-1 ISO 639 language descriptor UK National Body

There was no discussion. In the Liaison meetings during the week it was decided that Systems would respond to this NB comment.There were two National Body comments, one from the French National Body, the other from the Dutch National Body, which are discussed in Section .

Audio plenary discussions

Response to CfP on Lossess coding of 1-bit audio representations

Werner Oomen, Philips, presented10367 Technical description of DST (lossless coding of 1 bit

oversampled audio)Werner OomenRichard Theelen

In this zip archive is the contribution itself and also a paper that gives additional technical information. The Chair noted that part of the submission information is a cross-check of the reconstructed waveforms from the bitstreams and associated decoder, which was done by Richard Gooch, IFPI, and is included in an Annex of the report of the AhG on MPEG-4 Audio Lossless Coding (m10233). The mean compression ratio of the technology is approximately 2.4.

107









The contribution gives complexity information, in terms of MIPS and RAM as a function of number of signal channels and oversampling ratio.

Audio Explorations

Pierrick Philippe, France Telecom, presented

10294 FNB Position on a New Work Item on Spatial AudioPierrick Philippe on Behalf of the FNB

This document proposed that the next phase of the exploration be a Call for Evidence that will determine what technology that might be appropriate for multi-channel coding. Juergen Herre, FhG, noted that when the previous Call for Evidence was done, the Audio Subgroup was not directly aware of technology that was superior to MPEG technology. In contrast, FhG demonstrated at the previous MPEG meeting their implementation of spatial audio coding that appears to give clear evidence for the existence of such a new technology.Werner Oomen, Philips, presented

10338 DNB on spatial audio codingJean H.A. Gelissen on behalf of the DNB

This NB comment proposes clarifications to N6023, Investigation on Spatial Audio Coding. A summary of these proposals is that:

Any proposed MPEG work should be distinct from existing algorithms on spatial audio coding.

MPEG must be clear on how such technology will be evaluated in the course of technology development.

MPEG must be clear on the role of the core coder in the development of the technology. MPEG must be clear on the role of the stereo and multi-channel configurations.

Werner Oomen suggested that next steps might be a Call for Information that could be used to gather information on all of these topics. Pierrick Philippe, France Telecom, presented

10346 Proposed requirements for a CfE on Spatial Audio Encoding

Pierrick PhilippeJean-Bernard Rault

This contribution raised the following issues that are relevant to defining the work item. Test material. Perhaps MPEG-4 “NBC” test items could be used. Is a LFE channel

necessary? Objectives

o Compression gaino Reconstructed signal quality (e.g. “entertainment quality” or “transparency”). This

has clear implications for the test methodology. Comparison to existing MPEG-4 Technology Evaluation of possible backward compatible part.

A timetable for development of the technology was also suggested.Juergen Herre, FhG, presented

10378 Spatial Audio Coding: Market Context and Requirements Juergen Herre

This contribution presented a summary of potential market demand for a multi-channel coding technology that has the feature of two-channel backward compatible. Although the popularity of multi-channel audio reproduction systems are growing, largely driven by demand for 5.1 audio home theatre systems, it is clear that stereo reproduction systems may always be the most

108

















pervasive playback system. Hence the feature of high-fidelity two-channel backward compatibility is very desirable. The contribution reviewed possible application scenarios:

1 to 2 channel expansion 2 to 5 channel expansion

and noted that new technology offers significant compression with respect to discrete channel coding. Furthermore, the “downmix” or more generally, the relationship between the 2-channel (or 1-channel) signal to encode and the 5-channel signals to encode should not be constrained by the a normative downmix specification.

Summary by the Audio ChairThere is clear interest within the Audio Subgroup in moving ahead with this work item, and there are very interesting applications of such technology in the marketplace. The task group on Audio Explorations might discuss the following items as a means to progress this work during the MPEG meeting:

Objectives of the standardization effort. The contributions have raised many questions, and Audio experts should find common ground amongst them.

Clarify requirements in light of the objectives of the standardization effort. Consider the appropriate output documents. Should there be a Call for Information, Call

for Evidence or Call for Proposals? Should there be an Application Scenarios document? Should there be a summary of existing techniques for multi-channel coding?

Joint Meetings

Joint meeting with Sys and Req on Proposed Audio BIFS profile (m10348), Music Notation Req. (m10357), MP3onMP4 profile (m10350)

Oliver Avaro, the Systems Chair, summarized the BIFS profile contribution:10348 Audio BIFS Ver. 3 Profile Proposal Juergen Schmidt

Oliver BaumThis was presented Monday in Systems. The consensus of the System Subgroup was that the contribution did not bring forward sufficient evidence of industry support, and perhaps suggestions for a set of profiles that nicely limit the scope and complexity of compliant implementations. On the other hand, the PROTOs can be viewed as levels of a profile.Jens Spille, Thompson, presented

10350 MP3onMP4 Profile Proposal: Backwards Compatible Audio Profile Ernst F. Schroeder

Rob Kohnen suggested that Audio might solve the problem of how to expand the address space of the audioObjectType in the MPEG-4 Audio specification. The question is what is the best profile for this audioObjectType, and also how to signal the number of channels. Olivier suggested that a profile for each audioObjectType is a reasonable possibility. Rob suggested that it would be nice to have an “Unspecified” audio profile. Giorgio Zoia, EFPL, presented

10357 Music Notation Technical Requirements


The Audio and Requirements Chairs agreed that the requirements could be focused by creating a document that describes one two basic scenarios that can be used to motivate the Music Notation Requirements.

109









With MDS on Audio Adaptation QOS (m1030)

Bernhard Feiten, T-Systems, presented

10340 Improvements for Audio AdaptationQoSI.WolfB.Feiten A.Graffunder

This was presented in the joint meeting and, later in the week, to the Audio Subgroup. The contribution proposed a new set of Audio Adaptation QoS descriptors for audio quality, those being “Brightness”, “Cleanness” and Wideness” which are in addition to Basic Audio Quality. T-Systems asks WG11 to send a liaison statement to EBU B/AIM group to ask that they consider extending the MUSHRA test to support these new subjective descriptors.

With Systems on timestamps and AAC normative behaviour (m10143)

Audio experts agreed to document their knowledge of the issues pertinent to this problem in N6140, Description of Audio Codec Behavior.

With Systems on MPEG-4 Advanced Audio BIFS (m10321, m10347, m10381, m10348)

Jeongil Seo, ETRI, presented

10321 Proposal of a new AdvancedAcousticScene node in MPEG-4 BIFS


This proposes a impulse-response based acoustic scene rendering. Audio experts agreed that this should be re-submitted as a Core Experiment under the Audio CE process. Juergen Schmidt, Thompson, presented


Juergen SchmidtOliver BaumJerome DanielKlaus Eilts-GrimmMario Sieck

This proposal was accepted into the WD. Jens Spille gave an oral presentation on

10351Implementation of the AudioFX PROTO solution for Small Systems with reduced overhead; Preliminary Results


Giorgio Zoia gave an oral presentation on10381 Bug fix proposal for AudioBIFS and related Levels Giorgio Zoia

Based on this presentation, two bug fixes for the AudioBIFS specification were accepted into the latest Part-11 Amendment

Task Group discussions

MPEG-2 Layer III

MP3onMP4Jens Spille, Thompson, presented

10349 Input for GNB Comments to ISO/IEC 14496-3:2001/ PDAM3 (MP3onMP4)

Ernst F. SchroederMartin Weishart

The main technical point under discussion was whether to explicitly carry the MPEG-2 Layer III backpointer value. Bernhard Grill, FhG, noted that the specification could treat the backpointer value as “informative” and the MP3onMP4 specification could set it to zero prior to sending it to an MPEG-2 Layer III decoder.The GNB proposals to ISO/IEC 14496-3:2001 /PDAM 3 (MP3onMP4) were reviewed.

110































The comments in N10349 were accepted, but the text should clearly state that the main_data_begin value should be set to zero or optionally set to the old main_data_begin value, if the bitstream was generated from an existing stream. In the case of an edited bitstream, there is no guarantee that the main_data_begin value is correct. The legacy decoder should ignore the value.The MP3onMP4 profile proposed in N10350 was rejected. Instead it was discussed to use three object IDs for MPEG-1/2 Layer 1, Layer 2 and Layer 3 to signal the type of the needed decoder. Further details for signaling the number of needed decoders still have to be discussed. The process to create the MP3onMP4 reference software and the appropriate conformance test sequences were discussed. Several ideas were proposed, like a stand-alone software solution or an integrated solution utilizing either the MPEG-4 audio reference software or the IM-1 software. Audio experts discussed the necessary conformance points. One possibility is to use the input interface to the MPEG-1/2 legacy decoder, and another is to use the waveform output of the MPEG-2 Layer III decoder(s). One of the conformance bitstreams shall be an edited bitstream to test the behavior of the decoder in this case.Layer IIIThe latest MPEG-2 Layer III Audio Reference Software was uploaded and crosschecked. The TR ISO/IEC 13818-5:1997/Amd.1:1999 has to be updated and the appropriate text for the DCOR was created (Text of ISO/IEC 13818-5:1997/Amd.1:1999/DCor.2:2004).

Two new conformance test sequences and the appropriate wave files were created and crosschecked. The conformance extension of ISO/IEC 13818-4:2004/PDAM 2 was created.

MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software

The following contributions were reviewed:10380 New proposed conformance bitstreams for MPEG-4 SA Giorgio Zoia

The proposed conformance test sequences were accepted into the Conformance WD. Test sequences will be available after the meeting on the Audio ftp site.

10364 Status on MPEG-4 Audio Conformance Ralph Sperschneider

The proposed conformance test sequences were added to the status document. The proposed but not delivered conformance test sequences to test AAC scalable in conjunction with LTP for short blocks was removed, since no those test sequences were delivered. Accordingly, this tool combination is going to be removed from the standard by means of ISO/IEC 14498-3:2001/Dcor.2, the necessary corrections are specified in the appropriate Study document (N6128).The task group prepared the output documents N6126, N6128 and N6142.

MPEG-4 Extension 1, Bandwidth Extension

Naoya Tanaka, MEI, presented

10345 Check results of the proposed SBR conformance bitstreams

Naoya TanakaChong Kok Seng

which outlines the test results from testing the conformance sequences on an independent implementation of the HE-AAC LP-SBR on a 24bit fix point platform. The document reported that the initially proposed conformance sequences were not optimal for testing the low power version of SBR. However, the revised sequences provided during the ad hoc period were more suitable for low power SBR testing, and completely avoiding the aliasing detection issues present in the originally proposed sequences. The independent implementation passed the conformance test.Kristofer Kjörling, Coding Technologies, presented

111












10370 Proposed SBR conformance test tool.


which outlines a new conformance tool for SBR. The tool addresses the problems of the conformance for the underlying AAC decoder, enabling testing of the SBR implementation without influence of the AAC. Furthermore, new conformance sequences were listed, that are more suitable to test the low power SBR. Given the new sequences and the new tool, the same conformance sequences and conformance criteria can be used for both high quality and low power SBR. The proposed tool and sequences were included in the ISO/IEC 14496-4:2001/PDAM8 document.Kristofer Kjörling, Coding Technologies, presented

10373Proposed modification of 14496-3:2001/AMD1:2003/DCor.1. (N6008) concerning SBR and DRC

Kristofer KjörlingJonas Rödén

This proposes changes to the DRC semantics for HE-AAC decoders, specifically moving the dynamic range adjustment from the AAC MDCT T/F domain to the SBR QMF filterbank domain. In addition it supports a “fast attack” mode that permits a finer time resolution that is possible with linear interpolation over an entire block time. The following output documents were prepared:A request for amendment 8 to the 2001 edition of MPEG-4 conformance was prepared. Kristofer Kjörling was designated editor. Supporting NBs are: SE, US, NL, JP, FR, DE. The text of ISO/IEC 14496-4:2001/PDAM8, conformance sequences for SBR, BIFS and structured audio was prepared, approved by the audio group and passed on to integration for final approval.The workplan for conformance testing of bandwidth extension was revised and approved.A request for amendment 5 to the 2001 edition of MPEG-2 systems was prepared. Heiko Purnhagen and Olivier Avaro were designated editors. Supporting NBs are: SE, US, NL, JP, FRThe text of ISO/IEC 13818-1:2000/PDAM5, New Audio profileandlevel Signaling was prepared, approved by the audio group and passed on to systems for final approval.The text of Study on ISO/IEC14496-3:2001/AMD1:2003/Dcor1 was prepared and approved by the audio group.

MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)

Werner Oomen, Philips, presented10374 MPEG-4 Audio Extension 2, Verification test Proposal Werner Oomen

Bert den BrinkerBernhard Grill, FhG, commented that it would be less work and more reliable if “standard” bitrates could be used for the MPEG-4 AAC coder.Audio experts agreed that the test should have the following components:

Methodologyo MUSHRAo 20 listenerso Headphones

Test itemso Preselection

Verification of encoding Test Administrator

o “double-blind” Test site

o May require payment Test analysis and report

112















The Task group agreed to generate a “Proposed Workplan for Verification Test” output document.Heiko Purnhagen, Coding Technologies, presented

10385 Combining Low Complexity Parametric Stereo with High Efficiency AAC


This proposes a stereo codec using the parametric stereo tool developed in the Amendment 2 work (Paremetric Coding). Syntax and reference software are available now.

MPEG-4 Extension 3, Lossless Coding

ALSTakehiro Moriya presented

10326 Verification Report on MPEG-4 ALS Core Experiment 2 (Support for multi-channel and 32-bit PCM) Takehiro Moriya

This contribution presented the check-phase results of the CE on multi-channel and 32-bit word format lossless coding. Based on this contribution, CE2 progresses to integration phase. The reference software is already available and the syntax is available in a contribution to this meeting.This CE is accepted by the Audio Subgroup.Jim Johnston, Microsoft, noted that there is a need for multi-channel material that is available to the entire MPEG community.Tilman Liebchen presented

a Proposed WD 2 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS) Tilman Liebchen

This contribution presented the syntax changes needed to support the functionality in CE2. Jim Johnston, Microsoft, noted that although channel pairs are appropriate for perceptual coding (i.e. to consider for binaural noise masking), for lossless coding it is more appropriate to seek inter-channel correlation wherever it may occur. He further noted that such correlation may change dynamically as the signal evolves. This may be a candidate for a future Core Experiment.SLSJim Johnston, Microsoft, presented a summary of

10283 A proposal for testing Progressive-to-Lossless Coding James D. JohnstonHe noted that there were 5 regions where evaluation of the SLS technology is possible or appropriate:

1) The subjective quality of the base layer (MPEG-4 AAC).2) The subjective quality of sub-transparent layers added to the base layer3) The subjective quality of near-transparent (through transparent) layers added to the base

layer4) The quality of “mostly-lossless” (e.g. in the case of a rate-limited channel).5) The compression rate at lossless reconstruction.

Subsequent discussion by Audio experts raised the following points concerning evaluation of each of the five operating regions:

1) The subjective quality of the base layer (MPEG-4 AAC)a. This has been done extensively by MPEG, and there is no need to repeat such

evaluations.2) The subjective quality of sub-transparent (i.e. base layer below 64 kb/s/channel) layers

added to the base layera. There is existing perceptual-coder MPEG-4 technology that operates in this

region:i. AAC/BSAC

ii. Scalable AAC113













b. SLS technology 3) The subjective quality of near-transparent (i.e. base layer at 64 kb/s/channel) through

additional enhancement layers to achieve transparent quality.a. Audio Subgroup agrees to do the evaluation, and to use one of the following

i. Multiple tandem encodings and BS.1116 evaluation methodii. Multiple tandem encodings and MUSHRA evaluation method

iii. Multiple tandem encodings and signal detection evaluation method4) Transparent through “mostly-lossless” (subsequent discussion added this category)

a. Could be evaluated in a manner similar to 5).5) The quality of “mostly-lossless” (e.g. in the case of a rate-limited channel).

a. It is desirable that the technology be able to adapt the compressed bitrate dynamically.

b. One could measure the number of different samples and maximum difference. Clearly other statistics could be measured.

6) The compression rate at lossless reconstruction.a. This is the primary performance criterion and clearly must be evaluated.

Signal DetectionJim Johnston, Microsoft, gave a presentation on signal detection. In one form, the evaluation uses a Ref/A/B test methodology in which one of A or B is a hidden reference, and the other is the SLS technology with tandem encodings. Signal detection testing is a self-training listening test that achieves accurate detection levels without extensive training. The method is very simple and is described here:

1. The method requires a way to gradually phase out the distortions or probe signals.2. The test starts with an RAB (reference, a b) presentation of the reference signal, and a

clearly audibly modified probe signal. It is presented in the usual ABC/hr method, and the subject is required to provide correct identification of reference. Typically this is run 4 times at a given level, and the subject passes if they get it right.

3. The level of the distortion or probe is reduced by some fixed amount, and the test is re-run.

4. The level of distortion is reduced every time that the subject achieves correct detection, until the subject can no longer get it right. At that time, the probe is moved one step back up, and the experiment repeated, moving up (again) if detection is not achieved, and back down, until the lowest level where the subject gets 12 (or13) of 16 correct is established.

BS.1116Ralf Geiger, FhG, proposes (in the Sunday AHG), that the SLS technology be subjected to a fixed number of tandems and that the resulting signals be evaluated using BS.1116 methodology. The figure of merit for the SLS technology would be the Impairment Scale score after a fixed number of tandems.MUSHRARalf Geiger suggested that one could use MUSHRA methodology in which the RM and CE technology are each tandemed e.g. 8, 16 and 32 times, and that these (e.g. six) systems are evaluated in a conventional MUSHRA test.Yuriy Reznik, RealNetworks, proposes that when producing tandem encodings, that each tandem use a random offset into the file to designate the encoder block boundary. Summary by the Audio ChairThe consensus of the Audio Subgroup is that the bitrate range associated with subjective quality of near-transparent (through transparent) should be evaluated in the SLS technology. There was a consensus that tandeming was the way to permit subjective assessment of the technology, but no conclusions as to whether to use BS.116, MUSHRA or Signal Detection evaluation methods.

114

Rongshan Yu, I2R, presented

10362 Verification Report for MPEG-4 SLS Core Experiment 2 (Improving Coding Efficiency)


This extends the CE proposal. I2R hopes to complete both the cross-check and integration phases of this CE by the next MPEG meeting.Rongshan Yu, I2R, presented

10361 Proposal of Bit-Stream Syntax Revision for MPEG-4 Audio Scalable Lossless Coding


which proposes changes to the bitstream syntax in the following categories:1) syntax that is no longer used 2) syntax that permits the enhancement layer to track the core layer encoder3) syntax that I2R expects to improve system performance

The consensus of the Audio Subgroup was to accept category 1) and 2) proposals and to integrate them into the WD text, but to evaluate category 3) via the Core Experiment process, as CE4.Eunmi Oh, Samsung, presented

10414 Improvement of coding efficiency in MPEG-4 audio scalable lossless coding (SLS)

Eunmi OhJung-Hoe KimMiao LeiSangWook Ki m

The contribution proposes the used of context-dependent coding of the bitplane information. Whereas the current SLS Core Experiment (intensity coding) affects coding of bits in bitplanes below the “lazy layer” the context-dependent coding affects the coding of bitplanes at and above the “lazy layer.” Mean compression performance improvement was 1.37% relative to the performance of RM1. Three cases of context were exploited: BPGC parameters, bitplane context and PCM quantized value context.The consensus of the Audio Subgroup was that this proposed CE3 has merit, but that it should be repeated based on what we anticipate will be RM2 encoder and decoder. The CE2 proponent, I2R, will make available to MPEG experts (e.g. Samsung) suitable API so that CE3 can use the best possible encoder technology.

3on4 Application Specification

There was not sufficient time for this Task Group to meet. An output document, N6289 “MPEG Music Player Application Format” was created that contained a definite schedule for progressing this specification.

MPEG-7 Extension 1 Tools, Conformance and Reference Software

The following contributions were reviewed:

10379 An Appropriate Chord Pattern Representation for Music Retrieval and Comparison

Matthias GruhneClaas DerbovenJuergen Herre

10388 SoundClassificationModelDS Proposed Draft Corragenda Michael Casey

Explorations on Spatial Coding of Audio

After much discussion, Audio experts agreed to draft two output documents on this topic: a Call for Information and a Draft Call for Proposals, with the Call for Information being a public document. In order to clearly define the relation between the existing work on parametric stereo coding within MPEG-4 Extension 2 and the new work item the following understanding was established as a consensus position of the Audio Subgroup (see also resolution 6.3.2 in N6081):

115




















It is understood and accepted that the technology created under this new work item is not subject to requirements of compatibility with or re-use of parametric stereo technology, as specified in ISO/IEC 14996-3:2001/AMD 2. Also, it is understood that all future work on stereophonic and multi-channel parametric / spatial audio techniques will be carried out under the new work item using the technology which results from the CfP and CE process.

Music Notation

Giorgio Zoia, EFPL, presented

10355 Music Notation Functionality and Interface to MPEG


This contribution presented the main requirements in terms of the interface between Music Notation and MPEG-4/MPEG-7. The required nodes and node fields in BIFS were useful to start the discussion about Music Notation application scenarios as requested during the joint meeting with Systems and Requirements (see ). A basic application was discussed, identified as “enhanced karaoke”, which illustrated the basic requirements in terms of both notation and the relationship between existing MPEG-4 tools, such as AAC, SA, BIFS, and Video, and required new functionality. The role of access units and time stamps was also considered in order to clarify some issues, but the examples resulted in a more concise and effective description of the main building blocks and interrelationships.

Meeting deliverables

Press statementThe Audio part of the press statement was prepared and reviewed.

Dispositions of CommentsAll DoC were prepared and reviewed.

Responses to Liaison and NB commentsThe responses to liaison and NB comments were presented and approved.

Recommendations for final plenaryThe Audio recommendations were presented and approved.

Establishment of Ad-hoc GroupsThe following ad-hoc groups were established by the Audio subgroup:

No. Title Mtg6152 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4 No6153 AHG on MPEG-4 Audio Conformance No6154 AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software No6155 AHG on MPEG-4 Audio Extensions 1 and 2 Yes6156 AHG on MPEG-4 Audio Lossless Coding Yes6157 AHG on MPEG-7 Audio No6158 AHG on Music Notation Application Requirements Yes6159 AHG on Timestamps and Audio Codec Behavior No6160 AHG on Audio Explorations Yes

Approval of output documentsAll output documents, shown in Annex E, were presented in Audio plenary and were approved.

116




Future activities

Schedule of future meetingsAd Hoc group meetings are indicated in Section . Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting.

Agenda for next meetingThe agenda for the next MPEG meeting is shown in Annex F.

All other businessThere was none.

Closing of the meeting The 65th Audio Subgroup meeting was adjourned at 14:10.

117

Annex A ParticipantsFirst Name Last Name Country Affiliation E-mail address

Cotarmanac’h Alexandre FR France Telecom R&D

[email protected]

Bernhard Feiten DE Deutsche Telekom

[email protected]

Ralf Geiger DE FhG IIS AEMT

[email protected]

Richard Gooch UK IFPI [email protected] Grill DE FhG IIS [email protected] Gruhne DE FhG IIS

[email protected]

Jürgen Herre DE FhG IIS [email protected] Huang SG I2R [email protected] Johnston USA Microsoft

[email protected]

Sang-Wook Kim KR Samsung [email protected] Kjörling S Coding

[email protected]

Marc Klein Middelink

NL Philips [email protected]

Tilman Liebchen DE TU Berlin [email protected] Moriya JP NTT moriya.takehiro@lab .ntt.co.jp Toshiyuki Nomura JP NEC t-nomura@ccm .cl.nec.co.jp Eunmi Oh KR Samsung sait@samsung .com Werner Oomen NL Philips werner.oomen@philips .com Pierrick Philippe FR France

Telecom R&Dpierrick.philippe@francetelecom .com

Schuyler Quackenbush USA ARL srq@audioresearchlabs .com Susanto Rahardja SG I2R [email protected] Bernard Rault FR France

Telecom R&Djeanbernard.rault@francetelecom .com

Yuriy Reznik USA RealNetworks [email protected] Seo KR ETRI seoji@etri .re.kr Ralph Sperschneider DE FhG IIS [email protected] Tanaka JP Panasonic natanaka@arl .drl.mei.co.jp Mark Vinton USA Dolby [email protected] Xiao SG I2R [email protected] Yu SG I2R [email protected] Zoia CH EPFL [email protected]

- 118 -


mailto:natanaka@arl

mailto:sperschneider@iis

mailto:seoji@etri

mailto:jeanbernard.rault@francetelecom


mailto:srq@audioresearchlabs

mailto:pierrick.philippe@francetelecom

mailto:werner.oomen@philips

mailto:sait@samsung

mailto:t-nomura@ccm

mailto:moriya.takehiro@lab


mailto:hrr@iis

mailto:rou@emt

mailto:ggr@emt

Annex B Agenda and Schedule

Annex C Agenda and Schedule for the Waikoloa MPEG Audio Meeting

Time Agenda Item MPEG-2/4

MPEG-7

Number Title Source Kohala 1 (pool)

Sunday1400-1500 AHG on MPEG-4 Parametric

Coding

10307 Listening Test Results for CE on Low Complexity Stereo module

David ViretteJean-Bernard Rault

X

10366 MPEG4-Ext2: CE on Low Complexity parametric stereo


X

10371 MPEG-4 Ext.2, subjective results on CE Low complexity stereo

Werner OomenErik Schuijers

X

10372Listening test verification of core experiment on low complexity parametric stereo.

Kristofer Kjörling

X

10376Cross-check results of MPEG-4 Audio Extension 2, Core Experiment on Low Complexity parametric stereo decoding

Juergen Herre

X

1500-1700 AHG on Lossless CodingSLS

10394 Proposed Evaluation Methods for Fine-Grain Scalability in MPEG-4 SLS

Ralf Geiger Jürgen Herre Thomas Sporer

X

Monday0900-1330 MPEG Plenary1330-1430 Lunch1430-1700 Audio Plenary

Opening of the meetingAudio Chair

Administrative mattersApproval of agendaApproval of Brisbane meeting report

X

- 119 -







































MPEG-7


Communications from the Chair- Review of Sun Chairs meeting

X

Allocation of contributions to agenda and schedule

X

Joint meetings X

Review of AhG reports X

10231 Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

Ralph SperschneiderHeiko Purnhagen

X

10230 Report of the AHG on MPEG-4 Audio Conformance

Ralph Sperschneider

X

10229 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4 Jens Spille X

10232 AHG on MPEG-4 Audio Extensions 1 and 2 T. Nomura X

10233 AHG on MPEG-4 Audio Lossless Coding Tilman Liebchen

X

10234 AHG on MPEG-7 Audio Markus Cremer

X

10235 AHG on Music Notation Requirements Paolo NesiGiorgio Zoia

X

10236 AHG on Timestamps and Audio Codec Behavior

Alexandre Cotarmanac.hSchuyler Quackenbush

X

10237 AHG on Audio Explorations Schuyler Qu ackenbush

X

Review of task groups and mandates XReceived national body

comments10277 Revised input relating to ISO/IEC 13818-1

ISO 639 language descriptorUK National Body

X

10294 FNB Position on a New Work Item on Spatial Audio

Pierrick Philippe on Behalf of the FNB

X

10338 DNB on spatial audio coding

Jean H.A. Gelissen on behalf of the DNB

X

Received liaison matters

120















mailto:??

mailto:??


mailto:??

mailto:??

mailto:??





mailto:??

mailto:??


mailto:??

mailto:??


mailto:??



















MPEG-7


Plenary discussionsExploration

10346 Proposed requirements for a CfE on Spatial Audio Encoding

Pierrick PhilippeJean-Bernard Rault

X

10378 Spatial Audio Coding: Market Context and Requirements

Juergen Herre

X

1-bit Lossless Coding

10367 Technical description of DST (lossless coding of 1 bit oversampled audio)

Werner OomenRichard Theelen

X

1830- HOD Meeting

Tuesday0830 Audio Plenary Audio Chair

Outline plan for the day

0830 ALS

10306Proposed WD 2 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS)

Tilman Liebchen

X

10326Verification Report on MPEG-4 ALS Core Experiment 2 (Support for multi-channel and 32-bit PCM)

Takehiro Moriya

X

1000 Lossless CodingSLS

10283 A proposal for testing Progressive-to-Lossless Coding

James D. Johnston

X

10361Proposal of Bit-Stream Syntax Revision for MPEG-4 Audio Scalable Lossless Coding


X

10362Verification Report for MPEG-4 SLS Core Experiment 2 (Improving Coding Efficiency)


X

10393Proposed WD1 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable Lossless Coding (SLS)

Ralf GeigerX

121






































MPEG-7


10414Improvement of coding efficiency in MPEG-4 audio scalable lossless coding (SLS)

Eunmi OhJung-Hoe KimMiao LeiSangWook Ki m

X

1200-1400 Lunch

1400-1500 Joint Meeting with Audio, Systems, Requirements

10348 Audio BIFS Ver. 3 Profile ProposalJuergen SchmidtOliver Baum

X

10350 MP3onMP4 Profile Proposal: Backwards Compatible Audio Profile

Ernst F. Schroeder

X

10357 Music Notation Technical Requirements


X

1500-1600 Music Notation

10355 Music Notation Functionality and Interface to MPEG


X

1630-1700 Joint meeting with MDS on Audio DIA (m1030) At MDS


X

1700-1800 MPEG-7

10379An Appropriate Chord Pattern Representation for Music Retrieval and Comparison

Matthias GruhneClaas DerbovenJuergen Herre

X

10388 SoundClassificationModelDS Proposed Draft Corragenda

Michael Casey

X

1800-1830 Audio PlenaryStatus for Chairs Meeting

1800-1900 Liaison Meeting1900- Chairs Meeting

122









































MPEG-7

Number Title Source Kohala 1 (pool)Wednesday0900-1100 MPEG Plenary1100-1130 Audio Plenary Audio Chair

Report on Chairs meeting and outline of plan for the day

1130 - 1200 MP3onMP4

10349 Input for GNB Comments to ISO/IEC 14496-3:2001/ PDAM3 (MP3onMP4)

Ernst F. SchroederMartin Weishart

X

10259 Summary of Voting on ISO/IEC 14496-3/PDAM 3

SC 29 Secretariat

X

1200-1400 Lunch

1400-1430 Audio DIA


X

1430-1500MPEG-4 Extension 1, Bandwidth Extension- Conformance and Corrigendum

10345 Check results of the proposed SBR conformance bitstreams

Naoya TanakaChong Kok Seng

X

10370 Proposed SBR conformance test tool.


X

10373Proposed modification of 14496-3:2001/AMD1:2003/DCor.1. (N6008) concerning SBR and DRC

Kristofer KjörlingJonas Rödén

X

1500-1600 Joint Meeting with Systems on Timestamps and Audio Codec Behavior

X

1700-1800 Joint Meeting on Audio BIFS

10321Proposal of a new AdvancedAcousticScene node in MPEG-4 BIFS


X

123
















































MPEG-7



Juergen SchmidtOliver BaumJerome DanielKlaus Eilts-GrimmMario Sieck

X

10351Implementation of the AudioFX PROTO solution for Small Systems with reduced overhead; Preliminary Results


X

10381 Bug fix proposal for AudioBIFS and related Levels Giorgio Zoia X

1800-2200 Social

Thursday

0815-0900 Audio Exploration: Spatial Coding

0900-0930 Joint meeting with Req on Req for Spatial Audio Coding

0930-1000 Audio Exploration: Spatial Coding1000-1100 Parametric Coding

10374 MPEG-4 Audio Extension 2, Verification test Proposal

Werner OomenBert den Brinker

X

10385 Combining Low Complexity Parametric Stereo with High Efficiency AAC


X

10254 Summary of Voting on ISO/IEC 14496-3:2001/FPDAM 2 [SC 29 N 5657]

SC 29 Secretariat

X

1100-1130 MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference Software

10364 Status on MPEG-4 Audio Conformance

Ralph Sperschneider

X

10380 New proposed conformance bitstreams for MPEG-4 SA Giorgio Zoia X

1130-1200 MP3onMP4

1200-1400 Lunch

124















































MPEG-7

Number Title Source Kohala 1 (pool)1400-1730 Task Group

1730-1800 Audio Plenary Audio ChairReview list of deliverablesReview list of AHGsStatus for Chairs Meeting

1800-1900 Liaison Meeting1900- Chairs Meeting

Friday0900-1300 Audio Plenary

Report on Chairs meeting and outline of plan for the day Audio Chair

Discussion of unallocated contributionsMeeting deliverables

Press statementDispositions of commentsResponses to NB commentsLiaison statementsRecommendations for final plenaryEstablishment of new Ad-hoc groupsApproval of output documents

Future activitiesAgenda for next meeting

A.O.B.Closing of the Audio meeting

1300-1400 Lunch

1400- MPEG Plenary

125

Annex D Task Groups1. MPEG-2 Layer III

Chair: Jens SpilleMandates:1.1. MP3onMP4

1.1.1. Prepare DoC on 14496-3:2001/PDAM 31.1.2. Prepare Text of 14496-3:2001/FPDAM 3

1.1.2.1. select editor1.1.3. Discuss Conformance and Reference Software

1.2. Layer III Reference Software and Conformance1.2.1. Status of any open issues1.2.2. Prepare DCOR text of Reference Software1.2.3. Prepare AMD for Conformance bitstreams1.2.4. Discuss FTP server for Layer III

2. MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4 Audio Conformance, Reference SoftwareChair: Ralph SperschneiderMandates:2.1. DCOR to remove MPEG-4 LTP / Scalable AAC / Short block conformance2.2. Prepare Study on 14496-3:2001 DCOR 22.3. Consider progressing MPEG-4 Edition 20042.4. Review and revise Status of MPEG-4 Audio Conformance

3. MPEG-4 Extension 1, Bandwidth ExtensionChair: Kristofer KjörlingMandates:3.1. Prepare “Request for AMD for Conformance”3.2. Designate editor3.3. Prepare “Request for AMD for MPEG-2 Sys Prof and Level”

3.3.1. MPEG-2 Systems audio descriptor for SBR (AMD 5)3.3.2. Designate editor

3.4. Revise Audio Contribution to MPEG-4 Conformance3.4.1. Bandwidth Extension

3.5. Prepare Status of MPEG-4 BWE Conformance3.6. Prepare Study on DCOR (DRC and SBR)3.7.

4. MPEG-4 Extension 2, Parametric Coding (FDAM 03/12)Chair Werner OomenMandates:4.1. Review status of technical work4.2. Discuss timetable for promotion to FDAM4.3. Prepare DoC on 14496-3:2001:/FPDAM 24.4. Prepare Text of 14496-3:2001:/FDAM 24.5. Revise Status of MPEG-4 Extension 2 Work

5. MPEG-4 Extension 3, Lossless CodingChair: Schuyler QuackenbushMandates:5.1. Review responses to Call for Proposals for lossless compression of 1-bit oversampled audio representations5.2. Discuss methods for evaluation scalable performance of SLS5.3. Review CE status5.4. Revise Workplan for Audio Lossless Coding 5.5. Prepare WD 2 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)5.6. Revise Workplan for Audio Scalable to Lossless Coding 5.7. Prepare WD 1 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable to Lossless Coding (SLS)5.8. Review current status of Lossless Coding signal set

5.8.1. list of required Fs/Wd5.8.2. multi-channel signals5.8.3. IEEE floating point signals

6. 3on4 Application SpecificationChair: Schuyler QuackenbushMandates:6.1. Expand and revise 3on4 Application Specification6.2. Prepare Workplan for 3on4 Editing

7. MPEG-7 Extension 1 Tools, Conformance and Reference SoftwareChair: Matthias GruhneMandates:7.1. Review CEs for V37.2. Review Status and Workplan for MPEG-7 Audio Reference Software and Conformance

7.2.1. Revise workplan to finish conformance descriptions7.3. Review and consider DCOR 1 on ISO/IEC 15938-4:2001 (see N5213)

8. Explorations

126

Chair: Schuyler QuackenbushMandates:8.1. Discuss and draft output documents

9. Music NotationChair: Giorgio ZoiaMandates:9.1. Discuss Music Notation in context of MPEG tools9.2. Prepare Music Notation example application document

127

Annex E Output DocumentsThe Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes” in column TBP (to be public).


13818-7 MPEG-2 Advanced Audio Coding6126 Study on 13818-7:2003/DCOR 1 04/01/31

14496-3 MPEG-4 Audio6127 Study on ISO/IEC 14496-3:2001/AMD1:2003/DCOR16128 Study on 14496-3:2001 DCOR 2 04/01/316129 DoC on 14496-3:2001:/FPDAM 2, Parametric Coding6130 Text of 14496-3:2001:/FDAM 2, Parametric Coding 04/02/206131 DoC on 14496-3:2001/PDAM 3, MP3onMP46132 Text of 14496-3:2001/FPDAM 3, MP3onMP4 04/01/31

6133 WD 2 of ISO/IEC 14496-3:2001 /AMD 4, Audio Lossless Coding (ALS)

6134 WD 1 of ISO/IEC 14496-3:2001 /AMD 5, Audio Scalable Lossless Coding (SLS)

6135 WD of lossless coding of 1-bit audio signals6136 Workplan for Extension 2, Parametric Coding6137 Workplan for Audio Lossless Coding (ALS)6138 Workplan for Audio Scalable Lossless Coding (SLS)6139 Work Plan for Lossless Coding of 1-bit Audio Signals6140 Description of Audio Codec Behavior6289 MPEG Music Player Application Format

14496-4 MPEG-4 Conformance

6141 Workplan for Audio contribution to MPEG-4 conformance (Bandwidth Extension)

6142 Status of MPEG-4 Audio Conformance14496-11 MPEG-4 Scene Description and Application Engine

6143 Workplan for CE on AdvancedAcousticScene Node15938-4 MPEG-7 Audio

6144 Workplan for MPEG-7 Audio Core Experiment6145 Proposed Tools for MPEG-7 AMD 26146 Proposed Draft Corrigendum for MPEG-7 Audio6147 Status of MPEG-7 Audio Contribution to XM and Conformance

21000-7 MPEG-21 Digital Item Adaptation

6148 New Subjective Sound Quality Measurement Criteria for Digital Item Adaptation ApplicationsMusic notation

6149 Application Scenarios for Music Notation integrated in MPEGExploration

6150 Call for Information on Spatial Audio Coding Yes 03/12/236151 Draft Call for Proposals on Spatial Audio Coding

128

Annex F Agenda for the 68th MPEG Audio MeetingAgenda Item1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Waikoloa meeting report2.3. Communications from the Chair2.4. Allocation of contributions2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task groups and mandates2.8. Received national body comments and liaison matters2.9. Plenary issues

3. Task group activities3.1. MPEG-2 Layer III Issues3.2. MPEG-2 AAC Text, MPEG-4 Audio Text, MPEG-4

Audio Conformance, Reference Software3.3. MPEG-4 Extension 1, Bandwidth Extension3.4. MPEG-4 Extension 2, Parametric Coding3.5. MPEG-4 Extension 3, Lossless Coding3.6. MPEG-4 BiFS Extensions3.7. MPEG Music Player Application Format3.8. MPEG-7 Extension 1 Tools, Conformance and

Reference Software3.9. Music Notation3.10. Explorations

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Responses to Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

129

Annex 10Report of SNHC meeting

Source: M. Bourges-Sévenier Title: SNHC Hawaii meeting reportAuthors: Mikaël Bourges-Sévenier (Mindego Inc.)

Opening of the Meeting

Approval of the agenda

Goals for the weekThe goals of this week are:

Review the on-going core experiments Review the status of AFX AMD1 technologies and finalize WD 3.0 Explore new directions for efficient rendering, scene representation, compression and

streaming of 3D contents Finalize ISO/IEC 14496-11/PDAMD4 XMT and MPEG-J extensions

130

Schedule

Time Monday Tuesday Wednesday Thursday Friday08

:00:30

09:00

:30

10:00

:30

11:00

:30

12:00

:30

13:00

:30

MPEG Plenary

MPEG Plenary

Lunch Break Lunch BreakLunch Break Lunch

Presentation reviewDocument number attribution

Req-Sys-SNHC10225, 10280, 10309, 10331, 10228, 10316

10311 – Shadow CE

10329 – PointTexture

10377 – MeshGrid update

Req-Sys-SNHCSeveral issues on MPEG-4

10330 – Lossless 3DMC

10324 – 3D Shape

Discussion on Graphics APIRequirements, CfP

Graphics API CfP review

131

14:00

:30

15:00

:30

16:00

:30

17:00

:30

Lunch Break

MPEG Plenary

Roll call, agenda

SNHC FAQ / Web site/ Ref sw/ conf

XMT discussion

Req-Sys-SNHC10443, 10223, 10392

10360 – Avatar preferences

10391 – BBA in IM1

10390 - MorphShape

10312 – Coding of animated scenes

10343 – 3DAV EE2 results

10344 – Multitexture CE

10339 – Framework for free-viewpoint video on 3D video fragments

Discussion on 3D animated movies requirements

Output documents review

132

18:00

:30

19:00

:30

20:00:30

21:00:30

22:00…

Chairs Meeting

Social Event

Chairs Meeting

Liaison10352 – XMT on BitWrapper10428 – MPEG-J extensions

Demos

133

Allocation of joint meetingsSub-Groups Monday Tuesday Wednesday Thursday Friday

Systems 17:00 – 18:00 (+ Requirements)

10443, 10223, 10228, 10392

Requirements 9:00 – 11:00 (+ Systems)10225, 10280, 10309, 10331,

10316MPEG-7

Video11:00 – 11:30

10324Video/3DAV 16:00 – 16:30

10339MDS 16:00-17:00

10360

Rooms allocationSNHC Queen 4Systems Kohala 3Video Kohala 4MDS Kohala 2Requirements Monarchy BallroomChairs/HoD/LiaisonsKona 1

Allocation of contributions

N° Title Schedule ActivityD1 Monday D1

MPEG Plenary D1 09h00-14h00 MPEG Gen.

Report of AhG on AFX reference software Patrick GioiaReport of AhG on AFX CE, VM, WD Marius Preda

134

N° Title Schedule ActivityReport of AhG on AFX profiles Marius PredaReport of AhG on MPEG-J extensions Mikaël Bourges-

SévenierSNHC D1 15h00-17h00 SNHC Gen.

Agenda, FAQ, Web site Mikaël 15:00AFX Reference software, integration issues Patrick 15:30AFX Profiles Marius 16:00Requirements D1 17h00-18h00 SNHC Gen.

10443 MPEG-4 Profiles under Consideration Vladimir Levantovsky10223 AhG on SNHC profiles Marius10392 Bitstream Contribution for the Animated

Character ProfileMarius PredaFrancoise Preteux

Systems D1 18:00 – 19:00+

XMT / MPEG-J

10352 The XMT-A specifications for BitWrapper node and its encoding parameters

Gyeong Ja JangJames D. K. Kim

10428 Corrections and requests for new features in MPEG-J

Mikael Bourges-SevenierVishy Swaminathan

D2 Tuesday D2Requirements D2 09h00-10h00 MPEG-J extensions

10225 AHG on MPEG-4 Scene Representation Jean-Claude Dufourd10280 French NB position on Advanced Scene

CodingAlexandre Cotarmanac'h

10309 Swiss NB position on Advanced Scene Coding

Frederic Vexo

10331 KNB comments on Simple Scene Description Format

Young-Kwon LIM

10228 AhG on MPEG-J extensions Mikaël Bourges-

135

N° Title Schedule ActivitySevenierVishy Swaminathan

10316 Requirements and Interoperability issues of Lightweight Graphics proposals

Itaru KanekoOsama K AlshaykhJunya TsutsumiMark CallowJiro KattoDaisuke Inoue

SNHC D2 10:00 – 13:00 AFX

10311 CE Shadow Algorithm Helge Drumm 10:0010329 Updates on the Description of PointTexture

Compression in Depth Image-Based Representation (DIBR)

Shinjun LeeMahnjin Han

11:00

10377 Update of flags from the MeshGrid decoder specific info

Alexandru SalomieAdrian MunteanuRudi DeklerckPeter Schelkens

12:00

SNHC D2 14:00 – 16:00 AFX

10391 BBA Implementation in IM1 Marius PredaFrancoise Preteux

14:00

10390 Scene Graph Node Design for Blending Meshes : the MorphShape Node

Marius PredaFrancoise Preteux

15:00

MDS D2 16h00 - 16h30 MDS

10360 Swiss NB Comment on the Promotion of AvatarPreferenceType

Chris JoslinThomas Di GiacomoNadia Magnenat-Thalmann

SNHC D2 17:00 – 18:00 AFX

10312 Lightweight Coding of Animated Synthetic Scene

Frederic VexoMario Gutierrez

17:00

136

N° Title Schedule ActivityD3 Wednesday D3

MPEG Plenary D3 09h00-11h00 MPEG Gen.SNHC D3 11h00-13h00 SNHC Gen.

10330 VM Contribution on Lossless 3DMC Euee S. Jang 11:00SNHC D3 14h00-18h00 SNHC Gen.

10343 Preliminary Results on EE2 Using Octree Reconstruction and View-dependent Texture Mapping

Aljoscha SmolicKarsten MuellerPhilipp Merkle

14:00

10344 Preliminary Results on Core Experiments on View-Dependent Multi-Texturing for MPEG-4 AFX

Karsten MüllerAljoscha SmolicTobias Rein

15:00

10339 A Compression Framework for Free-Viewpoint Video based on 3D Video Fragments


16:00

D4 Thursday D4Requirements D4 09h30-10h00Graphics API Requirements + CfP 9:30MPEG-7 Video D4 10h00-10h30 MPEG-7 Video

10324 Perceptual 3D Shape Descriptor results 10:00Requirements D4 11h00-12h30 MPEG-7 Video

Various MPEG-4 issues (SNHC + BIFS) 11:00SNHC D4 14h00-17h00 SNHC Gen.

Part 16/AMD1 WD 3.0 review 14:00Part 11/AMD4 CD reviewAFX CE reviewEnjoy the lagoon! 16:00

137

N° Title Schedule Activity

D5 Friday D5SNHC D5 9h30-11h00 SNHC Gen.

Document number attribution 9:30

MPEG Plenary D5 014h00-22h00 MPEG Gen.

138

General issues

Web siteThe SNHC Web site is http://www.sait.samsung.co.kr/snhc/src/index.html

ResolutionAs the web site hasn't been updated for a while, SNHC participants will add AFX Tutorial and other documents to promote AFX technologies.

AFX Reference softwareThe AFX Reference Software has been transferred to NIST and is available via CVS at

1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs3. <your password>4. Checkout "MPEG-4/Systems/IM1" module (case sensitive).

The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX.

Standards from SNHCDue to missing implementations, the AFX reference software has been delayed until this meeting.AFX conformance will reach FDIS status in March.AFX AMD1 will be CD in March.

Std

Pt Edit. Project Description CfP

WD CDPDAM

FCDFPDA

M

FDISFDAM

4 4 2003 Amd.7 AFX Conformance 02/07 02/12 03/10 04/034 5 2003 Amd.7 AFX Reference SW 02/10 02/12 03/12 04/074 11 2003 Amd.4 XMT and MPEG-J

extensions03/12 04/07 05/01

4 16 2003 AFX 03/074 16 2004 Amd.1 AFX extension 03/07 04/03 04/07 05/01

AFX activities

Conformance and reference softwareConformance data sets are available and because of issues with CVS server, SNHC participants have re-integrated the software during the week. The software is therefore ready for 14496-5/FDAM7.

M10352 - XMT-A SchemaCurrent status: XMT updated with BitWrapper and specific encodings for AFX tools.

139

http://www.sait.samsung.co.kr/snhc/src/index.html

Re-generating XMT-A schema with up to date node definition?An automated tool should be done, rules for the XMT-A Schema should be defined. Nothing has been proposed yet.

Encoding streams from BitWrapper descriptionIn XMT-A file, a BitWrapper tag encapsulates description for a specific AFX tool. The BitWrapper encoder uses this description to generate the corresponding stream, BIFS text and Mux script streams that can be used to create an mp4 file.For each node wrapped in a BitWrapper using a specific encoding method, the BitWrapper encoder would need to be updated with the corresp. specific encoding tool.

XMT2BIFSstyle sheet

XMT2MUXstyle sheet

XMT Parser(XMTRef)

XMT input file

BIFS Encoder

MP4 Encoder

.mp4 output file.mux(.scr)

Modified .scene(.txt)

.bifs / .od

XMT-Aschema

•BitWrapper node •Encodingparameters•BitWrapperEncodingHints•AFXConfig

Contain the meta description for compressed 3D graphics data

1

4

2

5BitWrapperEncoder

3

When the encoding parameters exist in BitWrapper, It should be regarded to generate encoded bitstream from the original data in it

.scene(.txt)

.mux(.scr)

Another approach is to generate the BitWrapper bitstream with 3 rd party tools and use XMT to refer to this stream; therefore no encoding is needed. It seems the first approach is more feasible.

ResolutionJames will create the BitWrapper framework and everyone responsible for a particular encoding will create their own encoding extension. A separate workspace will be created (it won't be another tool in Player3D/IM1 workspace).

All XMT extensions should be in one document, in Part 11/AMD4. So, BBA schema will be moved from Part 16/AMD1 to Part 11/AMD4.

M10311 - CE Shadow resultsThe proposed method has been implemented in Player3D.

Restriction proposed: Shadow and lights should only be under the same parent.Shadow node definition hasn't changed.In the case of multiple lights, the Shadow node has a flag for soft shadows to simulate penumbra.Transmission of shadow properties to shapes is almost all implemented.

140

It seems the solution is a simplified ray-casting solution for calculation of shadows, simplified in the sense that rays are cast to shadow-tagged objects. As such, it is believed to be pretty limited.

ResolutionThe CE show shadows calculation using physical solution. Other solutions (e.g. shadow maps) need to be explored.

CE continues until next meeting and more global solutions need to be explored. Complexity analysis must also be done.

M10329 – PointTexture updateThis proposal is a response to the last meeting resolution: describe the decoder architecture not the encoder.

ResolutionText is now appropriate for specification; it is accepted.The technology is stable and will be added AFX AMD1 WD 3.0

M10377 – MeshGrid decoder specific info updateThe MeshGrid stream is modular and each part has a tag. Some parts might not need to be present in the stream. It is proposed to add some flags indicating which parts are present.Previously we had 16 bits reserved. It is proposed to define 8 flags and keep 8 bits as reserved (this specification is in Part 16 section 5.2.2.2.1). Unfortunately, the proposal shows that it would be better to define these 8 flags in another place than the reserved bits, which breaks backward compatibility with the published AFX specication.

Also, FilterType has been defined as 0 and other filters have been defined so this value should not be 0. Removing this limitation doesn't break current streams.

MGMeshDescriptor needs to be updated as well.

ResolutionBecause multiple parts of MeshGrid stream needs to be changed and this breaks backward compatibility, a 14496-16 COR1 would be started with the proposed modifications once the full text of the modifications is available as well as the MeshGrid stream is fully checked.

Discussion - BitWrapper, buffer featureBitWrapper can refer to a stream that contains the encoded representation of a node. It can also contains a byte buffer containing the stream. The format of this buffer hasn't been specified yet.

In BitWrapper buffer version, AFX streams that require DecoderSpecificInfo (currently WSS, MeshGrid) cannot configure their respective decoders. These streams are made of tagged blocks so even if the decoder is not configured it is able to skip them. We should amend the spec to add specific info before of stream data in BitWrapper.buffer.

ResolutionThis buffer format will be added into Part 11 AMD (maybe 4?) once the text is available and supports the feature for all AFX streams and future streams using BitWrapper.

141

M10330 – Lossless 3DMC resultsThe last meeting's questions was: Q: where do we add the lossless coding flags in the existing bitstreams? A: At the end of each header (coord_, normal_, color_, texCoord_header()) in 3D_Mesh_object_Header() defined in 14496-2, the lossless flags are added. Therefore, the proposed modifications don't enable backward compatibility with existing specification and streams.

As backward compatibility is not possible, the group thinks it would be better to revise 3DMC technology and define a new 3D mesh coding codec.

It is proposed to rename Lossless 3DMC more appropriately as 3DMC HQ for "High-Quality".

ResolutionRecord the proposed syntax in AFX VM.

Due to backward compatibility broken and other features needed, we are looking for industry support to define a new 3DMC and expect proposals in future meetings.

M10391 – BBA implementation in IM1BBA has been implemented in Player3D; this is a great news since we now have FBA and BBA in the reference player .

M10390 – MorphShape nodeThe proposed MorphShape node is based on morphing algorithms as discussed at the last meeting. It is also aligned with JSR-184 specification and DCC products offering this technology.The MorphShape node refers to a Base shape and a set of Target shapes . For blending, an array of floating-point weights is defined.

In morphing, the important is to blend geometry since appearance/material information is the same as the Base shape. Geometry blending includes color, vertex coordinates, normals, texture coordinates. Connectivity and topology remains the same for the Base and Target meshes.

In the case of MeshGrid, grid points and vertices could be morphed separately. Likewise, hierarchical representations such as WaveletSubdivisionSurfaces could do morphing more specifically.

Each MorphShape has a morphID so to refer to it as it is done for BBA stream's muscleID etc. But in the case of MorphShape, DEF keyword provides the same functionality.

ResolutionAdd the proposal into the WD 3.0. For target meshes, use only SFGeometryNode and the same SFGeometryNodes for targets. Remove morphID as DEF is enough.Study how morphing can be done for hierarchical representations such as WaveletSubdivisionsurfaces and MeshGrid.

142

M10312 – Lightweight coding of animated synthetic scenesThis proposal is for semi-interactive contents: only navigation is allowed.

For the proposed applications, the constraints of the terminal are: low power consumption (no graphic cards), scalable (in terms of compression error on geometry/texture; this is on the server not

terminal), low interaction functionality (camera navigation only) hardware decoding, vertex + texture coordinate update, video sync, 2D SVG interface for menu selection, only camera management. HDTV rendering 24fps. Texture format is JPEG 2000 3D model ~250kpoly 1h30 movie should be less than 10Gb (for storage) streaming

A simple stream made of: Initialization: objectName (to identify the object), objectType (application specific, can

be ignored), vertices, coordIndex, texCoord, list of textures used at the beginning. The scene only uses diffuse maps. Camera paths are also defined at this time. Vertices are sent in absolute coordinates.

Frame data: vertex position/texCoord + transition functions (order-2 polynoms, polynom coeffs and list of vertices affected by the function). Note that for vertex animation, only deltas are sent.

Back channel usage: current camera pose (to decide which info should be sent)

To perform efficient compression of the animation stream, cluster of vertices (not necessarily belonging to the same object) can be animated using one transition function.

Notes: Lightweight in this application means simpler usage of terminal rendering resources. The vertexCluster contains identifiers based on hash code of object name + index of the

vertex coordinate in the object; this seems an implementation issue. Reference research papers (of this year Siggraph, they are based on DynaPack paper)

show the same results as the proposal and is a technique derived from image-based rendering.

What is asked is state of the art: 3D mesh compression, animation compression (?). It is claimed that current tools in MPEG-4 specification for scene representation, compression and animation are not sufficient but no evidence has been provided. However, the new tools used to support such claims are:

Graph of octrees. Inside the octree, you have the vertices + facets and pointers to textures used.

Octrees are used for fast access to vertex/facet information Cluster of vertices can be animated at once by one transition function

143

Lossless coding is required because content creators don't want loss of information (it is believed that this claim might not always be true).

CommentsVertex clustering is missing in MPEG-4. CoordinateInterpolator cannot be used because vertices may not be at the same position but animated by the same function. However, interpolator compression exploits the redundancy of CoordinateInterpolator so interpolator compression should be as efficient as the proposed representation.Authoring deformation of vertices could be exported to Position/OrientationInterpolator for rigid deformation and CoordinateInterpolator for non-rigid deformation.For efficiency, octree representation of the scene objects is used and state sorting per material/texture.

ResolutionThe proposal is about efficient representation of the scene using octrees and its animation, and usage of state of the art mesh compression based on this scene representation.

=> The envisioned applications relate to view-dependent streaming and free-viewpoint video (under exploration in 3DAV group)

Start Exploration on Model-based movies Study current tools for efficient scene representation Study current tools for efficient compression and streaming of model-based movies

Participants: Frederic Vexo EPFL, Patrick Gioia France TelecomMahnjin Han, Samsung AIT

M10344 – Multitexture CEStudy of multi-texture in VRML

Doesn't enable view-dependent texture mapping, only ADD/MODULATE blending. Therefore, artefacts from other textures not viewed from the camera position appear

Texture combination is weighted with cos interpolation results in over-lighting and has the same artefacts as above method

Unstructured lumigraph rendering (cf. reference to D. Vlasic and al. paper) avoids over-lighting at intermediate positions and the correct lighting at the correct camera position is obtained. When multiple textures are combined together some ghost artefacts might appear, but this is due to lighting of the scene when the pictures where taken; this doesn't appear with synthetic scenes/lighting.

In X3D, the MultiTexture node doesn't provide texture weights. Cf. http://www.web3d.org/specifications/ISO-IEC-19775/Part01/components/texturing.html#MultiTexture.

Calculation of the weights depending on the camera position could be done using a Script with a VisibilitySensor. But isn't it too CPU/Memory intensive?

144

http://www.web3d.org/specifications/ISO-IEC-19775/Part01/components/texturing.html#MultiTexture

http://www.web3d.org/specifications/ISO-IEC-19775/Part01/components/texturing.html#MultiTexture

ResolutionUse MultiTexture node with the texture weighting feature as proposed and refine its semantic until next meeting. In particular the node should be compact and allow X3D features as well as the new features proposed in this contribution. As such, it is understood that X3D compatibility may not be preserved.Update the node and semantic in AFX VM 3.0.If definition satisfactory for March meeting, the node will be added to AFX PDAM1.

3DAV related activities

M10343 - 3DAV EE2 resultsFrom synthetic sequences, cameras are set up at pre-defined locations and setting and video is recorded from all cameras.From all these views, segmentation is performed to generate a voxel representation. Using marching cube algorithm, a mesh is created (with surface smoothing) and texture mapping is applied on a view-dependent manner.

Very good results with this method for free-viewpoint video. A different mesh is generated at each frame from the voxel representation. Problem: changing mesh topology cannot be represented with available MPEG tools. But the animation could be analyzed before sending so to match meshes between frames and have a sequence with only one mesh animated over time. So at the moment, INTRA frame coding has been tested and they are now trying to take advantage of temporal consistency (for INTER coding).

The terminal would receive mesh + view-dependent texture. At the moment, nothing seems missing in MPEG-4 specification but 3DAV is studying how to efficiently extract the necessary information.

ResolutionPromising exploration that must continue to understand the missing tools in more details.

M10339 – Compression framework for free-viewpoint videoBased on 3D video fragments: generalize 2D video pixels towards 3D point samples. Simple and efficient spatio-temporal representation (because no problem of connectivity). Inter-frame coding with differential operators.Requirements:

Calibration data Random access in space and time Multi-attribute: position/depth, texture, normals… View-dependent coding (just what is seen)

What is multiplexed: shape, position, depth, surface normals, splat size, color/textures, metadata… from each camera. Images are compressed using EZW algorithm (similar to JPEG2000).During rendering, cameras are weighted appropriately.

Limitations of conventional video coding: cannot access data efficiently in space and time in constant time.

145

Needs: shape of the object must be lossless. Constant decoding complexity Multi-resolution representation of the texture (aka VTC, JPEG2000) Splat size = size of the point on the screen, evaluated in real time based on the distance to

the camera For geometry, they don't use meshes but points so only disparity/depth maps are

transmitted in the same manner as textures. Average coding (of textures) is important and missing in MPEG-4 specification Each point has its own attributes (there is no mesh and therefore no texture mapping)

Next work Improve framework Real world test data Evaluate better codecs.

CommentsDIBR provides a SimpleTexture which is a simple form of the point/splat rendering.From Video point of view, the issue is encoding of the texture and shape. Shape coding in MPEG-4 is enough but average texture coding is necessary. Random access to textures in space and time is also needed.

ResolutionStart a SNHC CE to define view-dependent point/splat rendering starting from DIBR SimpleTexture tool.

MPEG-7 Video

M10324 – Perceptual 3D Shape descriptorThis proposal presents new implementations and results of last meeting's contribution.A plugin to 3DSMax has been developed to help authors quickly sketch content with ellipsoids and use database matching to find corresponding models in the database. Once the model is found, it replaces the sketch.Quantization effects have been evaluated.Performance and compression results are now satisfactory.This goes in MPEG-7 Video v. 3.The demonstration of the technology is impressive.

Requirements…

SNHC profilesNo change in the proposed profiles at the last meeting.Bitstreams were proposed to support the Animated Character profile.

146

Lightweight Scene RepresentationNo activity on the reflector, some private discussions. So no report or recommendations for this meeting.However, 3 NB positions

Swiss NB: renamed Advanced Scene Coding as Lightweight Scene Coding as the goal is to design a coding as simple as possible. Swiss NB also points out to look at SVG 1.1 and SVG Mobile Profile because this representation is close to these specifications

French NB supports this activity, recommends CfP issued at this meeting and maximize compatibility with SVG/SMIL

Korea NB supports the activity and should also apply to simple 3D format.

This activity will be named "Lightweight Scene Representation" instead of Simple Scene Description.

Discussion:We should be able to do SVG/SMIL contents with this new representation as well as PDF, Flash's.MPEG believes this LSR is suitable for mobile environments.

In the 3D case, it was proposed to require support of 3D static and dynamic textured meshes. This requirement is basic and not sufficient for representing lightweight 3D scenes. SNHC cautioned that LSR was designed with 2D scenes in a mobile environment in mind. Simply extending such constraints to 3D could lead to mistakes where a compact file format isn't aligned with rendering constraints (as VRML/BIFS has been demonstrated to be at last meeting). Therefore, SNHC cautions that before defining a 3D file format, it is important to study the graphics pipeline, especially the rendering, which is one goal of the CfP on MPEG Graphics API.

Resolution:A draft CfP on lightweight scene representation will be issued. The CfP will be final in March.SNHC believes this CfP is not sufficient in the case of 3D and more analysis is needed, as indicated in the resolutions at the end of this report.

Call for Proposals on MPEG Graphics APIThe proposals are due for March 1st, 2004.The following requirements were approved:

General requirementsIntroductionThe Graphics API provides the common functionalities supported by graphic cards and suitable for composition and rendering of applications using it. It is envisioned that the industry may later need support of other features. The API is not a direct binding to graphic cards API but is structured in a compact manner to provide similar features.RequirementsThe Graphics API shall be compact. The Graphics API shall be extensible.The Graphics API shall enable optimized rendering implementationsThe Graphics API must be interoperable with MPEG-J APIs and other APIs.The Graphics API shall be designed in a platform and language independent manner.

147

Retained and immediate modesIntroductionMPEG-4 doesn't provide an access to the renderer that would enable applications to render objects as they wish without using a scene graph.RequirementsThe Graphics API must support retained and immediate mode access.The Graphics API must support mixing and matching of immediate and retained mode access.

Resource sharingIntroductionResources such as audio, images and video can be shared among multiple synthetic objects. Geometry data can also be shared by multiple synthetic objects but need intermediate scene graph representation different from rendering representation, for static and dynamic objects.RequirementsThe Graphics API must allow efficient sharing of meshes, textures, entire scene graphs, etc. The Graphics API must allow dynamic modifications of meshes, textures, entire scene graphs, etc.

Object retrievalIntroductionThe Graphics API renders synthetic objects and provides means to find objects.RequirementsThe Graphics API must provide fast object look up.The Graphics API must provide picking support.

EfficiencyIntroductionThe Graphics API is intended to be accessed by applications running in a virtual machine where object destruction cannot be guaranteed.RequirementsThe Graphics API must be structured so that garbage collection is minimized.

Profiles

MPEG-4 3D ProfilesSNHC proposes 4 new profiles, two graphics profiles and two scene graph profiles. They are built around the X3D Interactive profile proposed by Web3D Consortium.

148

Figure 1 – MPEG-4 Graphics and scene graph profiles. Simple compression and Animated Character profiles were proposed at this meeting.

Simple compression 3D profile:Provides the minimum number of tools for simple applications but enough when combined with MPEG-J for complex applications

Animated character profile:Provides more tools than the X3D Interactive profile, especially bone-based animation tools.

The scene graph profiles are defined from a complexity point of view of the compression tools available in these profiles: simple compression 3D uses 3D mesh coding and interpolator compression, animated character uses animation streams and bone-based animation. However, we need to assess the complexity of these tools to avoid definition of too many scene graph profiles.

Having 2 set of profiles enable companies to mix graphics profiles with various scene graph profiles; this provides more flexibility for various applications.

NoteThe minimal 3D toolset is not a profile but a set of tools shared by the X3D Interactive profile and the Simple compression 3D profile.

ResolutionThe 2 new graphics and 2 new scene graph profiles have been added to the profiles under consideration document during last meeting in Brisbane. At this meeting, bitstreams have been proposed to support Animated Character Profile.

149

Animated Character Profile

Animation Stream,Animation Stream,BBABBA

Animated Character Profile

SBxxxxSBxxxx

SimpleCompression3D Profile

BitWrapper,BitWrapper,IC and 3DMCIC and 3DMC

X3D Interactive Profile

Sensors,Sensors,More LightsMore Lights

X3D Interactive Profile

Geometry Geometry primitivesprimitives

GraphicsGraphics Scene GraphScene Graph

SimpleCompression3D Profile

Procedural TextureProcedural Texture

Minimal 3D toolset

Minimal 3D toolset

Resolutions of SNHC

Output documentsNo. Title TBP Available Editor

14496 MPEG-4 General6095 CfP on MPEG Graphics API Yes 03/12/12 Mikaël Bourges-

Sévenier

14496-16 MPEG-4 Animation Framework eXtension (AFX)

6096 AFX CE description No 03/12/12 Marius Preda6097 ISO/IEC 14496-16/AMD1 WD 3.0 No 03/12/26 Marius Preda6098 AFX VM 13.0 No 03/12/12 Marius Preda

ResolutionsMPEG-4Part 4

The SNHC subgroup is pleased to announce the availability of conformance data sets for AFX specification.

Part 5 The SNHC subgroup is pleased to announce the availability of the reference software

using IM1 Player3D and encourages interested parties to explore the new tools provided by AFX specification.

Explorations-relatedLightweight Scene Representation

The SNHC subgroup acknowledges an emerging discussion on lightweight scene representation for 3D and efficient representations of model-based movies.

Graphics API The SNHC subgroup welcomes the issuance of the Call for Proposals on MPEG

Graphics API.

Establishment of SNHC Ad-Hoc groupsNo. Title Meeting Chair6099 AhG on AFX document editing and Core Experiments 04/03/14 Marius Preda6106 AhG on AFX conformance 04/03/14 Mahnjin Han

N6099 Ad Hoc Group on AFX documents editing and Core ExperimentsMandates: 1. Maintain and edit WD document

2. Maintain and edit VM document.3. Maintain and edit CE descriptions.

Chairman: Marius Preda (INT)

Co-chairs: Mahnjin Han (Samsung AIT)Mikaël Bourges-Sévenier (Mindego)

Duration: Until 68th meeting Meetings Sunday before 68th meeting

150

Reflector: [email protected]: Send an email to [email protected] with the message

“subscribe” as the first line in the body.

N6106 Ad Hoc Group on AFX ConformanceMandate: 1. Review AFX conformance document

2. Coordinate bitstream exchange3. Verify reference software implementation

Chairman: Mahnjin Han (Samsung AIT)Co-chairs: Patrick Gioia (France Telecom R&D)Duration Until 68th meeting Meetings: Sunday before 68th meetingReflector: [email protected]: Send an email to [email protected] with the message

“subscribe” as the first line in the body.

Closing of the MeetingSee you in München in March.

151

Annex 11Report of Integration meeting

Source: Jean-Claude Dufourd

Opening of the Meeting

Allocation of contributionsMonday Plenary

10208Xin WangJaime DelgadoChris Barlas


10215T. ChiangYi-Shin TungChung-Neng Wang

AHG on Maintenance of MPEG-4 Visual Draft Corrigendum, Reference Software and Conformance

10221 Patrick GioiaJames D. K. Kim AHG on AFX SW Implementation

10222

Mahnjin HanAlain MignotMikael Bourges-Sevenier

AHG on AFX Conformance

10227 Dave Singer AHG on MPEG File format

10229 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4

10230 Ralph Sperschneider Report of the AHG on MPEG-4 Audio Conformance

10231 Ralph SperschneiderHeiko Purnhagen

Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software

10397Christian Timmerer Gerrard Drury Jeho Nam


Joint with Reqs, MDS and Systems, Wednesday 14:00 to 15:00

xxxx JCD reference software policyJoint with MDS, Wednesday 15:00 to 18:00

xxxx various contributors reference software workplan for DIA, DIP and REL/RDDconformance

10289



10436

Davy De SchrijverFrederik De KeukelaereRobbie De SutterRik Van de Walle


152

Integration Plenary, Thursday 14:00 to 16:00, Systems room

10251 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/PDAM 110252 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:200X/PDAM 1


10258 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 510260 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4/PDAM 610261 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5/PDAM 610267 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 410268 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 4



10351 Klaus Eilts-GrimmMario Sieck

Implementation of the AudioFX PROTO solution for Small Systems with reduced overhead; Preliminary Results

10364 Ralph Sperschneider Status on MPEG-4 Audio Conformance10365 Vladimir Levantovsky Font Compression Reference Source Code Implementation

10391 Marius PredaFrancoise Preteux BBA Implementation in IM1

10392 Marius PredaFrancoise Preteux Bitstream Contribution for the Animated Character Profile

10399 Mathias Schwark Report on the implementation of a new MPEG-4 Player10401 Mathias Schwark Proposal on the implementation of Decoders in IM1

List of standards under developmentStd

Pt

Edit.

Project

Description CfP

WD CD FCD FDIS

2 4 2004 Amd.1 IPMP Conformance Ext. 03/03 03/07 03/12 04/032 4 2004 Amd.2 Audio Conformance Ext. 03/10 03/12 04/03 04/102 5 2004 Dam1 IPMP Ref.Soft. Ext. 03/07 03/124 4 2003 Amd.4 IPMP Extension

Conformance02/07 02/12 03/07 04/03

4 4 2003 Amd.5 Error Resilience Scalable Profile Conformance

03/03 03/07 03/12

4 4 2004 Amd.6 AVC 03/07 03/12 04/034 4 2003 Amd.7 AFX Conformance 02/07 02/12 03/10 04/034 4 2004 Amd.8 SBR, ABIFS and SA 03/10 03/12 04/03 04/104 5 2003 Amd.4 IPMP Extension Reference

SW02/10 02/12 03/07 03/12

4 5 2003 Amd.5 Error Resilience Scalable Profile Reference Software

03/03 03/07 03/12

4 5 2004 Amd.6 AVC and Audio SBR 03/03 03/07 03/12 04/074 5 2003 Amd.7 AFX Reference SW 02/10 02/12 03/12 04/077 6 2001 Amd.1 Reference software

extensions01/12 03/03 03/12 04/03

7 7 2004 Amd.1 Conformance extensions 03/03 03/07 03/12 04/0321 8 200x 1st Ed. Reference software 03/03 04/03 04/07 05/0121 12 200x 1st Ed. Test Bed for MPEG-21

Resource Delivery02/12 03/12 04/07

153

21 14 200x 1st Ed. Conformance 03/10 04/03 04/07 05/01

Latest references

Project P. Standard Issue No.MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4

Conformance 2nd Ed.)02/12 Awaji N5457

MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile)

02/07 Klagenfurt

N5083

MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 01/07 Sydney N4368MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 02/03 Jeju N4711MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 02/05 Fairfax N4865MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) 01/12 Pattaya N4475MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) 02/07

KlagenfurtN4937

MPEG-2 Conformance10251 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/PDAM 1No comments.

MPEG-2 Reference Software10252 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:200X/PDAM 1No comments.

MPEG-4 Conformance (14496-4)


There is only the usual comment to fix any pending problems.

10260 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4/PDAM 6There is only the usual comment to fix any pending problems.

10267 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:2003/FPDAM 4There is only the usual comment to fix any pending problems.

MPEG-4 Reference Software (14496-5) 10258 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 5There is only the usual comment to fix any pending problems.


154

There is only the usual comment to fix any pending problems.

10268 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 4There is only the usual comment to fix any pending problems.

10365 Vladimir Levantovsky Font Compression Reference Source Code ImplementationThe contribution was presented. It is all about non-integrated software. A discussion followed, and due to lack of time the decision about a further workplan was deferred to a Systems meeting.

10399 Mathias Schwark Report on the implementation of a new MPEG-4 PlayerThis contribution presents a new 3D player based on IM1. The proponents envisage to contribute to IM1 the port of IM1 code to Linux, with makefiles.

10401 Mathias Schwark Proposal on the implementation of Decoders in IM1This contribution reports an alleged problem with the IM1 decoder API. After some discussions, it was the belief of the majority that the problem was a misunderstanding. This will be checked further on the reflector between meetings.

MPEG-21 ConformanceJoint with MDS:

10289



This contribution kickstarts the work on REL conformance.

MPEG-21 Reference SoftwareIn a joint meeting with Requirements, MDS and Systems, we discussed the requirements for MPEG-21 reference software which were started in Trondheim. Ambiguities should now be lifted. The result will be a section of the document “MPEG Reference Software Guide”.

Joint with MDS on REL software:All of the REL software contributions were presented. There is impressive progress. A revised workplan is in the works. The REL sections of the Part 8 WD will be updated.

Joint with MDS on DIA software:DIA software contributions and the work this week for integration was presented. Amazing progress has been made in the few days since the Sunday AhG meeting. There will be 9 integrated modules out of 10. It was decided to delay the Part 8 CD promotion to March.



155

The document was presented. It is ready for promotion to PDTR.

Unpublished Integration Standards

13818-4 200X Conformance testing 03/10/24 Editor To be submitted to SC 29

13818-5 200X Reference Software 03/12/12?13818-5 200X Amd.1 Reference Software

(MPEG-2 IPMP)03/12/12? DAM

14496-4 2003 2nd Ed Conformance testing ITTF To be published14496-4 2003 Amd.1 Conformance Testing

(Conformance testing for MPEG-4)

ITTF FDAM to be issued by ITTF

14496-4 2003 Amd.2 Conformance Testing (MPEG-4 Conformance extensions for XMT and media nodes)

ITTF FDAM to be issued by ITTF

14496-5 2001 Amd.2 Reference SW2nd ed. (XMT, DMIF)

02/05/10 ITTF to be published

14496-5 2001 Amd.3 Reference SW2nd ed. (Visual new level and tools)

03/03/14?

15938-6 Reference Software 01/12 ITTF Under FDIS ballot (Closing 2003-04-04-27)

15938-7 Conformance testing 02/10/25 Editor Prepare FDIS text

156

Resolutions of Integration

Resolutions1) The Integration subgroup recommends the approval of the “MPEG Reference Software Guide” (N6257). 2) In order to fill with appropriate text the Description section of the MPEG Reference Software Guide, the Integration subgroup kindly requests from all implementers a short description of their production including: language, status, functional description, input format or API, output format or API, dependencies and any other information deemed appropriate.

157

Documents

No. Title TBP Available13818-4 MPEG-2 Conformance

N6232 Text of ISO/IEC 13818-4:200X/FPDAM 1 N 03/12/12N6233 Request for Amd 2 of ISO/IEC 13818-4:200X N 03/12/12N6234 Text of ISO/IEC 13818-4:200X/PDAM2 N 03/12/12

13818-5 MPEG-2 Reference Software N6235 Text of ISO/IEC TR 13818-5:200X/DAM 1 N 04/01/30N6236 Text of ISO/IEC TR 13818-5:1997/Amd.1:1999/DCor.2:2004 N 03/12/31

No. Title TBP Available14496-4 MPEG-4 Conformance

N6237 DoC on ISO/IEC 14496-4:2003/FPDAM 5 N 03/12/12N6238 Text of ISO/IEC 14496-4:2003/FDAM 5 N 03/12/12N6239 DoC on ISO/IEC 14496-4:2003/PDAM 6 Y 04/02/06N6240 Text of ISO/IEC 14496-4:2003/FPDAM 6 Y 04/02/06N6241 Request for Amd 8 of ISO/IEC 14496-4:2003 N 03/12/12N6242 Text of ISO/IEC 14496-4:2003/PDAM 8 N 03/12/12

14496-5 MPEG-4 Reference Software N6243 DoC on ISO/IEC 14496-5:2003/FPDAM 4 N 03/12/12N6244 Text of ISO/IEC 14496-5:2003/FDAM 4 N 04/01/30N6245 DoC on ISO/IEC 14496-5:2003/FPDAM 5 N 03/12/12N6246 Text of ISO/IEC 14496-5:2003/FDAM 5 N 04/01/30N6247 DoC on ISO/IEC 14496-5:2003/PDAM 6 Y 04/02/06N6248 Text of ISO/IEC 14496-5:2003/FPDAM 6 Y 04/02/06N6249 DoC on ISO/IEC 14496-5:2003/PDAM 7 N 03/12/12N6250 Text of ISO/IEC 14496-5:2003/FPDAM 7 N 03/12/31

158

No. Title TBP Available15938-6 MPEG-7 Reference Software


N 03/12/12

15938-7 MPEG-7 Conformance N6252 DoC on ISO/IEC 15938-7:2003/PDAM1 N 03/12/12


N 04/01/16


21000-8 MPEG-21 Reference SoftwareN6254 WD4.0 of ISO/IEC 21000-8 Reference Software N 03/12/12

21000-12 MPEG-21 Test Bed for MPEG-21 Resource Delivery N6255 Text of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource

DeliveryN 03/12/31

21000-14 MPEG-21 ConformanceN6256 WD2.0 of ISO/IEC 21000-14 MPEG-21 Conformance N 03/12/31

159

AHG

N6258 AHG on MPEG Reference Software

Mandate: 4. Check and improve the MPEG Reference Software Guide 5. Produce a study before next meeting.

Chairman:

Jean-Claude Dufourd (ENST, [email protected])

Duration: Until 68th Meeting Meetings A meeting will be held on the weekend before the 68th meeting. Other

business will be conducted by E-mail or telephone conference.Reflector: [email protected] with prefix [GUIDE]Subscribe: Send email with “Subscribe mpeg-21-refsoft” to [email protected]

N6259 AHG on MPEG Multimedia Test Bed

Mandate: Create working drafts of test bed APIsDesign test environment for MPEG-21 DIA and MPEG IPMP TechnologiesWork with Scalable Video Coding AHG for testing of SVC technologiesDesign test environment for 14496-8Investigate issues in interoperability between the MPEG standards and the

QoS related Internet protocols of session, transport, and network layersChairman:

Chun-Jen Tsai (NCTU), Mihaela van der Shaar (Philips), Young-Kwon Lim (net&tv), Doug Young Suh (KHU)

Duration: Until 68th Meeting Meetings NoneReflector: [email protected]: Send an email to

[email protected] with subject ‘subscribe’

N6260 AHG on MPEG-21 Conformance

Mandate: Discuss all topics related to MPEG-21 conformanceIssue a WD2.1 of MPEG-21 Conformance for discussion at the next

meeting, improving the existing sections and creating new sections for DID and DIP conformance.

Chairman:

Thomas DeMartini (CONTENTGUARD, [email protected]), Sylvain Devillers (IMEC, [email protected]), Frederik De Keukelaere (Ghent Univ., [email protected]), Gerrard Drury (UoW, [email protected])

Duration: Until 68th Meeting Meetings NoneReflector: [email protected]: Send email with “Subscribe mpeg-21-conformance” to

[email protected] subject ‘subscribe’

160


IM1 workplan

Module Tasks Responsibility DateATG Font compression Agfa Monotype, Microsoft December

Synthesized Texture Vimatix next meetingIPMP Extensions Finalization Panasonic / Access

Ticket / Optibase / Mosesnext meeting

AFX Agreed workplan AFX next meetingElementary Stream Management

Integrate the implementation of SL-X

France Telecom / Optibase to be inserted in the CVS

161

Annex 12Report of Test meeting

Source: Vittorio Baroncini

Review Adhoc Group Reports and DocumentsAd Hoc reports

m9637 - Ad Hoc on AVC Verification Tests Presented the test results. Recommendations for the use of the test results

Work items during the week- Final version of the AVC Verification Test results document

Test results for the Multimedia applications Test results for the SDTV applications Test results for the HDTV applications General presentation of the AVC test results

- Joint meeting with video to approve the final AVC test result report.- Joint meeting with video to approve the CfP for SVC.- Test plan for the Error Resilient Functionality on the Simple Scalable Profile- Joint meeting with video for the preparation of a text to be used in the Press release of

the Waikoloa meeting.

Preparation of the report of the AVC verification tests- A continuous exchange of data and information has been carried out between the expert

in Kona and the NIST and TUB experts to improve the statistical analysis of the results of the tests and prepare a proper presentation of the results.

- The work done has been driven having in mind the only goal of making the huge amount of data (resulting from many different test sessions) as much easier understandable to people inside and outside of MPEG not deep expert in testing issues.

- This goal has been reached by means of graphs and tables that have explained individually each particular case, with the addition of a general explanation of the performance of AVC (in term of bandwidth reduction) divided for the three main cases analyzed: Multimedia, SDTV and HDTV (including D-Cinema).

Adhoc Groups

No AHG have been set up at this meeting. The video group have setup the AhG for the “SVC call for proposal”.

Output DocumentsDoc. W6231 “Report of The Formal Verification Tests on AVC (ISO/IEC 14496-10 | ITU-T Rec. H.264)”

Recommendations The test group thanks all the participants to the AVC verification testing activities and in

particular: Tobias Oelbaum (TUM), Eric Gsell (Dolby) and Tom McMahon (Dolby) for the

preparation of the test material. Charles Fenimore, John Roberts, Stefan Leigh, and Alan Heckert (NIST); Vittorio

Baroncini (FUB), Angelo Ciavardini and Giancarlo Gaudino (ISCTI); Tobias Oelbaum,

162

Florian Obermeier, Michael Pilz (TUM), and Testronic Laboratories for the subjective test conduction and results processing.

TK Tan (NTT DoCoMo), Vittorio Baroncini (FUB), Tobias Oelbaum (TUM), Walt Husak (Dolby) and Charles Fenimore (NIST) for the preparation of the report.

A particular thank to all the many companies that contributed to the success of this testing activity providing the coded bitstreams and to Tobias Oelbaum who took care of decoding all of them.

163

Annex 13Report of ISG meeting

Source: ISG ChairEditor: Marco Mattavelli (EPFL)

OverviewThe main work items of the Implementation Studies Subgroup in Waikoloa are:

1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket.

2. The planning and extensions of the integrated framework for the support to the development of MPEG-4 Part 9 with MPEG-7 part 7 and AVC (MPEG-4 Part-9) software.

3. The support to the Systems group for the selection of a “Low complexity” BIFS specification/implementation for the deployment of BIFS technology on mobile terminals.

Input contributions w.r.t. the above items are summarized according to the following table:

Contributions

M10207 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description"

Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab.

M10440 “Performance of DCT Hardware block” Tamer S. Mohamed, Wael Badawy, University of Calgary

M10439 “Hardware/software framework” Tamer S. Mohamed, Wael Badawy, University of Calgary

M10432 “MPEG-4 Part 9 virtual socket interface description”

Paul Schumacher, Robert Turney

Detailed Report

Reference hardware description for MPEG-4

The ISG activity at the Waikoloa meeting has mainly been devoted to the review of contribution on the “Virtual Socket” concept, on the planning of the releases and advances on the integrated

164

framework supporting the virtual socket idea and on the drafting of the new edition of the WD for MPEG-4 part 9. The integrated environment running the mixed software/hardware description (MPEG-4 Part 9 and Part 7) using the chosen platform (Wildcard II) has been distributed to the MPEG contributors to the development of Part 9 two weeks before the meeting. The release “0” of the integrated environment for the moment requires the input of VHDL modules, it is now planned that soon it will include co-simulation capabilities, HW debugging tools, ZBT and SDRAM support for modules requiring large memories such as motion estimation. Release 1.0 of the framework has been reviewed during the meeting, but some functionality were not working properly so its distribution has been delayed to beginning of January. The work-plan and detailed description of new releases and extensions is the following:

Release 0 (current available version): The initial release of the virtual socket connects to the LAD bus interface on the WildCard-II. The memory-map for the WildCard-II provides each hardware accelerator with four defined regions: Read-Only Registers, Write-Only Registers, Read-Only Memory and Write-Only Memory. There also exists a master interface that provides access to the hardware accelerator identification register. Each virtual socket development team will be assigned a bit that acts as presence indicators so that software may determine which hardware accelerators are present within the framework. The basic functionality of the virtual socket interface is to route the host traffic to and from the appropriate hardware accelerator. As an example of creating a hardware accelerator it has been created a block move design. The VHDL file, vs_blockmove.vhd, demonstrates how one may connect to the virtual socket top-level located in virtual_socket.vhd. This demonstrates the support for the HDL flow in Revision 0. The virtual socket interface provides four strobe signals to each HWA indicating when a read or write is occurring to its register or memory regions. The HWA then must act appropriately and in cases of reads, must provide a strobe back to the top level indicating the data it is providing is valid. Revision 0 also provides support for the Handel-C language. The virtual socket interface is functionally identical to the HDL design with the exception of imported WildCard-II LAD bus interface VHDL source. The interface to the LAD bus is provided in Handel-C code.

Release 1.0 (release on 10th January 2004) External memory interface support is

introduced in this release. There is 2MB of 133 MHz ZBT SRAM located on the WildCard-II, and in Revision 1.0, this memory will be accessible by both the host software and hardware accelerators on the virtual socket. Software may address the SRAM memory via the master unit. Since the entire address space of the SRAM is not addressable directly, the user must use a segment-offset technique that requires the writing to a 32-bit start address register mapped in the master unit’s register space. The most significant bit (31) of the start address indicates whether accesses are to the read or write only memory regions of the master: if 0, the ZBT SRAM; if 1, to the SDRAM. A ZBT controller is provided within the virtual socket top-level that allows three hardware accelerators to access the SRAM. An external block move example is provided to demonstrate the additional control signals to interface with the ZBT controller defined by the VHDL file zbt_manager.vhd. Hardware debugging support is also provided via a tool called ChipScope. Using the WildCard-II’s Left User I/O external connector, a hardware accelerator developer can debug their designs.

Release 1.1 (release on 31st January 2004) A DRAM controller will be added in Revision 1.1 to read and write to the 64MB of 266 MHz DDR SDRAM located on the WildCard-II. This complements the access to the ZBT SRAM provided in Release 1.0.

165

Release 2.0 (release on 15th February 2004) Support for co-simulation is provided in Release 2.0. A user can co-simulate their host software with their hardware code defined in either Handel-C code or HDL code.

Release 3.0 (release on 28th February 2004) Release 3.0 will provide DMA access to the virtual socket platform allowing faster access to the hardware accelerators. Support for interrupts will also be provided. The MPEG-4 Part 10/AVC code will also be integrated into the code tree.

Download Instructions for all releases:

All releases will be posted to the following ftp site:ftp://mpeg:[email protected]/pub/MPEG-ISG/Each release will be contained in a zip file named MPEG_platform_revXX.zip, where XX is the release number.

The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with the usual mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting.

Contribution to the Systems group for the selection of a Light Weight BIFS implementation During a joint meeting with the Systems group it has been discussed how to define criteria for the selection of low complexity implementations of the Systems BIFS for deployment on mobile terminals. ISG has presented the approaches developed and used in the past years for the selection of MPEG tools on a complexity basis. Information of appropriate tools has been distributed to the participants and support has been provided for the correct usage of tools. The conclusion was to use as first step to a SIMBIAN emulator for extracting the basic complexity information and reserve the usage of more sophisticated or platform independent tools as second step if necessary.

ResolutionsThe above activities have led to the following resolutions and output document approval.

MPEG-4 part 9 related resolutions:The Implementation Studies subgroup recommends to approve the following documents

14496-9 MPEG-4 Reference Hardware Description N6091 ISO/IEC 14496-9/WD of AMD 1: Information

Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description.

N 03/12/12

N6092 Integrated framework for MPEG-4 Part 7, Part 9 and Part 10.

Y 03/12/12

166

15938-7 MPEG-6 Reference Software N6094 ISO/IEC PDAM 15938-6 Information Technology -

Multimedia Content Description Interface- part 6: Reference Software Extensions

N 04/01/09

The Implementation Studies subgroup recommends establishing the following Ad Hoc group:No. Title MtgN6093 AHG on MPEG-4 Part 9: Reference

Hardware Description Phase 1 and 2Phone conferences on 8th Jan., 29th

Jan., 19th Feb, 11th Mar. at 3 p.m. GMT.

167

Annex 14Report of Liaisons meeting

Source: Niels Rump

The Liaisons Group considered the following input documents:

Input Contribution #

Title

M10250 IEC CDV 61883-4: Consumer audio/video equipment -- Digital interface -- Part 4: MPEG2-TS data transmission

M10270 ISO/IEC CD 19794-2: Information technology -- Biometric data interchange formats -- Part 2: Finger minutiae data

M10271 ISO/IEC CD 19794-4: Information technology -- Biometric data interchange formats – Part 4: Finger image data

M10272 ISO/IEC CD 19794-5: Information technology -- Biometric data interchange formats – Part 5: Face image data

M10273 ISO/IEC CD 19794-6: Information technology -- Biometric data interchange formats – Part 6: Iris image data

M10279 SMPTE VC-9 Work Item and Information Exchange Between SMPTE and WG11

M10285 UKNB Position Paper on SC 29/WG 11 Liaison ActivitiesM10302 Liaison Statement from the TV-Anytime ForumM10334 Liaison Statement from 3D Consortium

M10400 SMPTE Liaison to WG11 regarding Alpha Channel Considerations in the Professional Amendment to AVC/H.264

M10425 SMPTE ST13 Response to WG11 Liaison N6073

Next to these input documents, a liaison statement 3GPP TSG SA WG4 on the RTP Transport of Timed Text has also been received.

In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: W3C (on Lightweight Scene Representation), ITU-T SG17 (on MPEG-21 REL), EBU-B/AIM (on MUSHRA method), ITU-T SG16 Q.6 (on AVC and H.265), CRF (on M10196 from the Brisbane meeting), AVS China (on MPEG-2 IPMP), ITU-T SG16 (on conversion descriptions), 3GPP2 (on objectTypeIndication), EBU, ATSC, DVB, DVD Forum, 3GPP and 3GPP2 (on AVC Test Results), IEC TC100 (on conversion descriptions and spatial audio), and ISMA (on AVC Test Results).

Following the UK NB request, a document has been prepared that lists all documents that have been “promoted” during an MPEG meeting to all organisations WG11 has a liaison relationship with.

168







The responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed.

The following recommendations were issued:

The approval of the following documents:

Title No.List of WG11 Liaisons N6110Responses to NB Comments N6111Information on Progress of MPEG Standards N6112Liaison Statement to TV Anytime N6113Liaison Statement to 3GPP on Streaming Text N6114Liaison Statement to 3GPP2 on objectTypeIndication N6115Liaison Statement to SMPTE on Alpha Channel coding N6116Liaison Statement to SMPTE on its VC-9 work item N6117Liaison Statement to 3D Consortium N6118Liaison Statement to AVS China N6119Liaison Statement to CRF N6120Liaison Statement to ITU-T SG16 Q.6 N6121Liaison Statement to EBU-B/AIM N6122Liaison Statement to ITU-T SG17 N6123Liaison Statement to W3C N6124Liaison Statement to ISO/IEC SC37 N6125Liaison Statement to EBU on AVC Test Results N6261Liaison Statement to ITU-T SG 16 on Conversion Descriptors

N6287

Liaison Statement to IEC TC 100 on Conversion Descriptors N6288Liaison Statement to ATSC on AVC Test Results N6290Liaison Statement to DVB on AVC Test Results N6291Liaison Statement to DVD on AVC Test Results N6292Liaison Statement to 3GPP on AVC Test Results N6293Liaison Statement to 3GPP2 on AVC Test Results N6294Liaison Statement to ISMA on AVC Test Results N6297

Nomination of liaison representatives:o Brian Green to EDItEUR;o Brian Green to ISO/TC46;o Simon Watt to the Content Reference Forum; ando Chris Barlas to the International DOI Foundation.

169

1 · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF...

Documents

Transcript of 1 · Web viewORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF...