INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N10115 Busan, KR – October 2008 Source: Leonardo Chiariglione Title: Report of 86th meeting Status Report of 86th meeting .......................................................................................................................... 1 Annex A – Attendance list ................................................................................................................. 20 Annex B – Agenda ............................................................................................................................. 32 Annex C – Input contributions ........................................................................................................... 35 Annex D – Output documents ............................................................................................................ 51 Annex E – Requirements report ......................................................................................................... 59 Annex F – Systems report .................................................................................................................. 64 Annex G – Video report ..................................................................................................................... 92 Annex H – JVT report ...................................................................................................................... 106 Annex I – Audio report .................................................................................................................... 134 Annex J – 3DG report ...................................................................................................................... 158 Report of 86th meeting 1 Opening The 86th MPEG Meeting was held from 13th to 17th October 2008 at Busan, Korea. 2 Roll call of participants Annex A gives the attendance list. 3 Approval of agenda Annex B gives the approved agenda 4 Allocation of contributions Annexes C and D gives the list of input contributions and output documents 5 Communications from Convenor There were no specific communications. 1 6 Report of previous meeting This was approved (N9963) 7 Processing of NB Position Papers NB documents were presented and discussed. Where appropriate, responses were provided. 8 Work plan management 8.1 Media coding 8.1.1 MPEG-2 Main Profile Level for 1080@50/60p The following documents were approved 10135 Disposition of Comments on ISO/IEC 13818-2:2000/FPDAM 3 10136 Text of ISO/IEC 13818-2:2000/FDAM 3 Level for 1080@50/60p 8.1.2 MPEG-2 AAC miscellanea The following document was approved 10186 Study on ISO/IEC 13818-7:2006/DCOR 1, AAC CCE and 22.2 chn 8.1.3 MPEG-4 Visual Simple Studio Profile Levels 5 and 6 The following documents were approved 10139 Disposition of Comments on ISO/IEC 14496-2:2004/FPDAM5 10140 Text of ISO/IEC 14496-2:2004/FDAM5 Simple Studio Profile Levels 5 and 6 8.1.4 HD AAC Profile The following documents were approved 10187 Request for Amendment, HD-AAC Profile 10188 ISO/IEC 14496-3:2005/PDAM 10:200X HD-AAC Profile 8.1.5 New Profile for ALS The following document was approved 10193 WD on New Profile for ALS 8.1.6 960 frame length in MPEG-4 AAC The following document was approved 10194 Status, proposal and workplan regarding the 960 frame length in the MPEG-4 AAC family of profiles 2 8.1.7 Advanced Video Coding (AVC) The following documents were approved 10150 Text of ISO/IEC 14496-10:200X 5th Edition 10151 Request for ISO/IEC 14496-10:200X/Amd.1 10152 Text of ISO/IEC 14496-10:200X/PDAM 1 Constrained Baseline Profile and supplemental enhancement information 8.1.8 ISO/IEC 14496-16 3rd Edition The following document was approved 10129 WD of ISO/IEC 14496-16 3rd Edition 8.1.9 Scalable complexity 3D mesh compression The following documents were approved 10127 Text of WD3.0 of ISO/IEC 14496-16:2006/AMD4 (Scalable Complexity 3D Mesh Compression) 10128 CE on Scalable Complexity 3D Mesh Coding 8.1.10 Codec Configuration Representation The following document was approved 10168 Reconfigurable Video Coding - The Vision 10165 Study Text of ISO/IEC FCD 23001-4 Codec Configuration Representation 8.1.11 Video Tool Library The following documents were approved 10169 10170 10171 10172 Study Text of ISO/IEC FCD 23002-4 Video Tool Library WD 3 of ISO/IEC 23002-4/Amd.1 (Conformance and Reference Software) WD 3 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-4 ASP, AVC HP and SVC) RVC Work Plan and FU Development Status 8.1.12 Spatial Audio Object Coding The following documents were approved 10212 DoC on ISO/IEC CD 23003-2:200x, Spatial Audio Object Coding 10213 ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding 10214 Status and Workplan on SAOC Core Experiments 3 8.1.13 Unified Speech and Audio Coding The following documents were approved 10215 WD on Unified Speech and Audio Coding 10217 Draft Revisions to MPEG Audio CE methodology 8.1.14 3D Video Coding The following document was approved 10173 Description of Exploration Experiments in 3D Video Coding 8.1.15 Media Value Chain Ontology The following documents were approved 10265 Vision of Media Value Chain Ontology 10263 Request for ISO/IEC 21000-19 Media Value Chain Ontology 10264 ISO/IEC CD 21000-19 Media Value Chain Ontology 8.1.16 Representation of Sensory Experience The following documents were approved 10294 10295 WD 2.0 of ROSE TuC for ROSE 8.1.17 High-Performance Video Coding The following documents were approved 10174 Results of Workshop on New Directions in Video Coding 10175 Vision and Requirements for High-Performance Video Coding (HVC) 10176 Call for Test Materials for High-Performance Video Coding Standards Development 10177 Draft Call for Evidence on High-Performance Video Coding 8.2 Composition coding 8.2.1 Scene partitioning The following document was approved 10185 Text of ISO/IEC 14496-11:2005/FDAM6 (Scene Partitioning) 8.2.2 Interactive Digital Radio The following document was approved 4 10228 Requirements for a new BIFS Profile to support Interactive Digital Radio 8.2.3 LASeR Adaptation The following document was approved 10254 Study Text of ISO/EC 14496-20 LASeR/PDAM2 (Adaptation) 8.2.4 Presentation of Structured Information The following documents were approved 10255 Request for ISO/IEC 14496-20 LASeR Amd.3 (PSI) 10256 ISO/EC 14496-20 LASeR/PDAM.3 (PSI) 10259 WD 1.0 of ISO/IEC 21000-2:2005 AMD1 (PSI) 8.3 Description coding 8.3.1 Image Signature Tools The following documents were approved 10153 Disposition of Comments on ISO/IEC 15938-3:2001/FPDAM 3 10154 Text of ISO/IEC 15938-3:2001/FDAM 3 Image Signature Tools 8.3.2 Video Signature Tools The following document was approved 10155 Updated Call for Proposals on Video Signature Tools 8.3.3 Metadata driven post processing of audio signals The following document was approved 10218 Exploration on metadata driven post processing of audio signals 8.3.4 Extraction and Matching of Image Signature Tools The following documents were approved 10160 Request for ISO/IEC 15938-8:2002/Amd.5 10161 Text of ISO/IEC 15938-8:2002/PDAM 5 Extraction and Matching of Image Signature Tools 5 8.4 Transport and File formats 8.4.1 Carriage of SVC in MPEG-2 Systems The following documents were approved 10241 Request for ISO/IEC 13818-1:2007/Amd.4 10242 ISO/IEC 13818-1:2007/PDAM4 Transport of MVC 8.4.2 AVC File Format extensions for MVC The following documents were approved 10252 Request for ISO/IEC 14496-15 Amd 3 10253 ISO/IEC 14496-15:2004 PDAM 3 (MVC File Format) 8.4.3 Miscellaneous Additions to File Format The following documents were approved 10248 10249 DoC on ISO/IEC 14496-12/PDAM.1 Misc. Additions to FF ISO/IEC 14496-12/FPDAM.1 Misc. Additions to FF 8.5 Multimedia architecture 8.5.1 3D Graphics Compression Model The following documents were approved 10132 DoC on ISO/IEC FCD 14496-25 10133 Text of ISO/IEC FDIS 14496-25 8.5.2 MPEG eXtensible Middleware The following documents were approved 10167 10237 10290 10291 Proposal for MXM Public License Version 1.0 MPEG eXtensible Middleware - The Vision WD2.0 of MxM Architecture and Technologies WD2.0 of MxM APIs 8.5.3 Advanced IPTV Terminal The following document was approved 10297 Proposed joint project description for Advanced IPTV Terminal 8.5.4 Interfaces with virtual worlds The following documents were approved 6 10235 Requirements for MPEG-V Version 3 10236 MPEG-V Call for Proposals 8.5.5 Rich Media UI Framework The following documents were approved 10231 10232 10296 Rich Media UI Framework Requirements. Call for Proposal on Rich Media UI Framework Context and Objectives of Rich Media UI Framework 8.6 Application formats 8.6.1 General The following documents were approved 10233 MAF overview 10234 MAF Overview Presentation 8.6.2 Open Access Application Format The following documents were approved 10273 DoC on ISO/IEC 23000-7:2008/FPDAM 1 OA-AF Conf. and Ref. Soft 10274 ISO/IEC 23000-7:2008/FDAM 1 OA-AF Conf. and Ref. Soft 8.6.3 Digital Multimedia Broadcasting Application Format The following documents were approved 10275 Study of ISO/IEC 23000-9/PDAM1 DMB AF Conf. And Ref. Soft. 10276 Workplan for ISO/IEC 23000-9 DMB AF Conf. And Ref. Soft. WD 1.0 of ISO/IEC 23000-9/AMD2 DMB AF (Storage of MPEG-2 TS in ISO file 10277 format) 8.6.4 Video Surveillance Application Format The following documents were approved 10278 DoC of ISO/IEC FCD 23000-10 (Video Surveillance Application Format) 10279 Text of ISO/IEC FDIS 23000-10 (Video Surveillance Application Format) 10281 Future work on Surveillance AF’s collection of requirement 8.6.5 Stereoscopic Video Application Format The following documents were approved 7 10282 DoC Text on ISO/IEC FCD 23000-11 (Stereoscopic Video Application Format) 10283 ISO/IEC FDIS 23000-11 (Stereoscopic Video Application Format) 10284 Referencing Explanatory Report on AMR and EVRC 8.6.6 Interactive Music Application Format The following documents were approved 10285 Request for 23000-12 (Interactive Music Application Format) 10286 WD 1.0 of ISO/IEC 23000-12 (Interactive Music Application Format) 10287 Mini experiment on the constraints representation 8.7 Protocols 8.7.1 MXM Protocols The following document was approved 10293 WD1.0 of 2nd edition of ISO/IEC 29116-1 (MXM Protocols) 8.8 Reference implementation 8.8.1 AAC-ELD Reference Software The following documents were approved 10196 DoC on ISO/IEC 14496-5:2001/PDAM 24, MPEG-4 AAC ELD 10197 ISO/IEC 14496-5:2001/FPDAM 24, MPEG-4 AAC ELD 8.8.2 SVC Reference Software The following documents were approved 10166 Disposition of Comments on ISO/IEC 14496-5:2001/FPDAM 19 10146 Text of ISO/IEC 14496-5:2001/FDAM 19 Reference Software for Scalable Video Coding 8.8.3 MVC Reference Software The following document was approved 10147 Study Text of ISO/IEC 14496-5:2001/PDAM 15 Reference Software for Multiview Video Coding 8.8.4 Scene Partitioning Reference Software The following document was approved 10125 Text ISO/IEC 14496-5:2001/PDAM 25 (Scene Partitioning Reference Software) 8 8.8.5 Frame-based Animated Mesh Compression Reference Software The following documents were approved 10123 DOCR on ISO/IEC 14496-5:2001/FPDAM 21 (FAMC Reference Software) 10124 Text of ISO/IEC 14496-5:2001/FDAM 21 (FAMC Reference Software) 8.8.6 Open Font Format Reference Software The following documents were approved 10245 DoC on ISO/IEC 14496-5/FPDAM.14 Open Font Format Reference Software 10246 ISO/IEC 14496-5/FDAM.14 Open Font Format Reference Software 8.8.7 Image Signature Tools Reference Software The following documents were approved 10156 Request for ISO/IEC 15938-6:2003/Amd.3 10157 Text of ISO/IEC 15938-6:2003/PDAM 3 Reference Software for Image Signature Tools 8.8.8 MPEG Query Format Reference Software The following document was approved 10257 WD1.0 of MPEG Query Format Conf. and Ref. Soft 8.8.9 MPEG-21 DIS Reference Software The following documents were approved 10261 DoC on ISO/IEC 21000-8/FPDAM.1 Extra reference software for MPEG-21 10262 ISO/IEC 21000-8/FDAM1 Extra reference software for MPEG-21 8.8.10 Photo Player AF Reference Software The following documents were approved 10162 Disposition of Comments on ISO/IEC 23000-3/FPDAM1 Reference Software for Photo Player MAF 10163 Text of ISO/IEC 23000-3/FDAM1 Reference Software for Photo Player MAF 8.8.11 Musical Slide Show MAF Reference Software The following documents were approved 10266 DoC on ISO/IEC 23000-4/FPDAM.1 MSSAF Conf. & Soft 9 10267 ISO/IEC 23000-4/FDAM.1 MSSAF Conf. & Soft 10268 ISO/IEC 23000-4/FPDAM.2 Prot. MSSAF Conf. & Soft 8.8.12 Professional Archival MAF Reference Software The following documents were approved 10269 ISO/IEC 23000-6 PA-AF/FDIS Professional Archival Application Format Request for ISO/IEC 23000-6 PA-AF/AMD 1 Conformance and Reference 10270 Software 10271 ISO/IEC 23000-6 PA-AF/PDAM 1 Conformance and Reference Software 10272 Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference Software 8.8.13 Video Surveillance Reference Software The following document was approved 10280 Study of ISO/IEC 23000-10 PDAM1 (Video Surveillance Application Format) Conf. & Ref. SW. 8.8.14 M3W Reference Software The following documents were approved 10288 DoC on ISO/IEC 23004-8/FCD Reference Software and Conformance 10289 ISO/IEC FDIS 23004-8 Reference Software and Conformance 8.8.15 MXM Reference Software The following document was approved 10292 WD1.0 of MxM Ref. SW. and Conf. 8.9 Conformance 8.9.1 MPEG-2 Main Profile Level for 1080@50/60p Conformance The following documents were approved 10137 Disposition of Comments on ISO/IEC 13818-4:2004/FPDAM 3 10138 Text of ISO/IEC 13818-4:2004/FDAM 3 Level for 1080@50/60p Conformance Testing 8.9.2 MPEG-4 Visual Simple Profile Level 6 Conformance The following documents were approved 10141 Disposition of Comments on ISO/IEC 14496-4:2004/FPDAM35 10142 Text of ISO/IEC 14496-4:2004/FDAM35 Simple Studio Profile Levels 5 and 6 10 Conformance Testing 8.9.3 Multiview Video Coding Conformance The following documents were approved 10144 Request for ISO/IEC 14496-4:2004/Amd.38 10145 Text of ISO/IEC 14496-4:2004/PDAM38 Multiview Video Coding Conformance Testing 8.9.4 MPEG-4 Audio Conformance The following document was approved 10199 WD of ISO/IEC 14496-26:200x, Audio Conformance 8.9.5 File Format Conformance improvements The following documents were approved 10243 10244 Request for ISO/IEC 14496-4 AMD 37 File Format Conformance Improvements ISO/IEC 14496-4 PDAM 37 File Format Conformance Improvements 8.9.6 Scene Partitioning Conformance The following document was approved 10122 Text of ISO/IEC 14496-4:2004/PDAM 39 (Scene Partitioning Conformance) 8.9.7 Frame-based Animated Mesh Compression Conformance The following document was approved 10121 Text of ISO/IEC 14496-4:2004/FDAM 32 (FAMC Conformance) 8.9.8 Image Signature Tools Conformance The following documents were approved 10158 Request for ISO/IEC 15938-7:2003/Amd.5 10159 Text of ISO/IEC 15938-7:2003/PDAM 5 Conformance Testing for Image Signature Tools 8.9.9 MPEG Query Format Conformance The following document was approved 10257 WD1.0 of MPEG Query Format Conf. and Ref. Soft 11 8.9.10 M3W Conformance The following documents were approved 10288 DoC on ISO/IEC 23004-8/FCD Reference Software and Conformance 10289 ISO/IEC FDIS 23004-8 Reference Software and Conformance 8.9.11 Photo Player MAF Conformance The following document was approved 10164 Working Draft 2 of ISO/IEC 23000-3/Amd.2 Conformance Testing for Photo Player MAF 8.9.12 Musical Slide Show MAF Conformance The following documents were approved 10266 DoC on ISO/IEC 23000-4/FPDAM.1 MSSAF Conf. & Soft 10267 ISO/IEC 23000-4/FDAM.1 MSSAF Conf. & Soft 10268 ISO/IEC 23000-4/FPDAM.2 Prot. MSSAF Conf. & Soft 8.9.13 Professional Archival MAF Conformance The following documents were approved 10269 ISO/IEC 23000-6 PA-AF/FDIS Professional Archival Application Format Request for ISO/IEC 23000-6 PA-AF/AMD 1 Conformance and Reference 10270 Software 10271 ISO/IEC 23000-6 PA-AF/PDAM 1 Conformance and Reference Software 10272 Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference Software 8.9.14 Video Surveillance Conformance Reference Software The following document was approved 10280 Study of ISO/IEC 23000-10 PDAM1 (Video Surveillance Application Format) Conf. & Ref. SW. 8.9.15 MXM Conformance The following document was approved 10292 WD1.0 of MxM Ref. SW. and Conf. 8.10 Maintenance 8.10.1 Systems coding standards The following documents were approved 12 10240 ISO/IEC 13818-1:2007/Cor.2 10250 ISO/IEC 14496-12/COR.1 Corrigendum on Flute support 10251 ISO/IEC 14496-12/DCOR.2 Usage of brands and box order in sample entry 8.10.2 Video coding standards The following documents were approved 10143 Defect report on ISO/IEC 14496-4:2004 (three visual conformance streams) 10148 Disposition of Comments on ISO/IEC 14496-10:2008/DCOR 1 10149 Text of ISO/IEC 14496-10:2008/COR 1 8.10.3 Audio coding standards The following documents were approved 10189 Study on ISO/IEC 14496-3:2005/DCOR 6, CCE Study on ISO/IEC 14496-3:2005/AMD 2:2006/DCOR 4, HE-AAC V2 Profile and 10190 ALS 10191 Study on ISO/IEC 14496-3:2005/AMD 3:2006/DCOR 2, SLS 10192 Study on ISO/IEC 14496-3:2005/AMD 9:2008/DCOR 1, AAC-ELD 10195 Defect Report on Audio Conformance 10198 ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 3, ALS and SLS 8.10.4 3DG coding standards The following document was approved 10120 DOCR on ISO/IEC 14496-4:2004/FPDAM 32 (FAMC Conformance) 10126 Text of ISO/IEC 14496-16:2006/AMD1:2007/COR2 8.10.5 Visual description coding standards The following document was approved 10258 Text of ISO/IEC 15938-12/DCOR.1 8.10.6 MPEG-21 standards The following document was approved 10260 ISO/IEC 21000-7/Cor.1 8.11 Time line The following documents were approved 10201 MPEG Standards 13 10202 Table of unpublished FDISs 10203 Work plan and time line 9 Organisation of this meeting 9.1 Tasks for subgroups The following tasks were assigned Requirements Std 4 A V Systems Std 2 Pt Amd X Y 12 Pt Amd 1 4 Cor 4 4 7 4 26 37 5 14 23 11 6 12 1 Cor.2 15 3 20 2 3 X 22 2nd Ed 5 6 12 Cor1 Laser-BIFS integration User Interface framework Interactive music AF Responses to CfR for Interfaces with virtual worlds Responses to CfP on MPEG eXtensible Middleware Loudness metadata Advanced IPTV Terminal Contribution to press release MPEG-V CfP New standard areas Video Audio Gaming Carriage of MVC Carriage of AVC RA Open Font Format Conformance FF conformance Open Font Format Reference Software Synthetised texture RS SVC FF RS Scene partitioning Miscellanea Usage of brands etc. MVC File Format Adaptation technologies for Laser Presentation of Structured Information Laser-BIFS integration Open Font Format MPEG query format RS MPEG query format Conformance 21 7 Cor 1 8 1 19 Amendment on query format capability Minor enhancement MVCO 14 A B E M 4 1 2 5 2nd Ed 6 1 7 1 9 Cor 1 9 1 10 1 11 1 12 2 1 8 1 2 3 V Musical Slide Show MAF RS & C Protected Musical Slide Show MAF RS & C Media Streaming MAF Professional Archival AF Professional Archival AF RS & C Open Access AF Reference Software and Conformance DMB MAF DMB MAF RS & C Video Surveillance AF Video Surveillance AF RS & C Stereoscopic video AF Stereoscopic video AF RS & C Interactive music AF Fragment Request Unit RS & C M3W RS & C MXM Architecture API RS & C Information exchange with virtual worlds Representation of sensory effects information Advanced IPTV Terminal Update MPEG technology web page MAFs Contribution to press release UI framework CfP Digital radio CfP MVC FF, MVCO, PSI reaching CD MAFs becoming FDIS Video 2 4 7 A B C 2 4 2 4 3 3 6 7 8 3 3 3 5 35 3 4 1 2 4 4 4 1 2 1080P/60 level 1080P/60 level conformance Simple Studio Profile level 5 and 6 Simple Studio Profile level 5 and 6 conformance Image Signature Tools Video Signature Tools Image Signature Tools Image Signature Tools Image Signature Tools Photo Player Reference Software Photo Player Conformance Codec Configuration Description Video Tool Library Video Tool Library Conformance & RS Video Tool Library extensions 3DV/FTV Future video Update MPEG technology web page 15 JVT 4 4 38 5 19 15 10 Cor 1 2 Audio 4 3 D 4 36 5 24 26 2 3 Contribution to press release Future video workshop, plan for CfE, Cf test seqs Image signature tools MPEG-4 Studio Profile Amd RVC? MVC Conformance Scalable Video Coding Reference SW MVC RS Miscellanea AVC Constrained Baseline Profile Contribution to press release Emmy Description of work items ALS profile SLS profile AAC-ELD conformance AAC-ELD Reference Software Conformance Spatial Audio Object Coding USAC New audio issues Contribution to press release Audio loudness metadata 3DG 4 4 32 33 34 5 21 22 11 6 16 3rd Ed 4 25 FAMC (Frame based Animated Mesh Compress.) Conformance Multiresolution profile conformance 3D Graphics Compression model Conformance FAMC (Frame based Animated Mesh Compress.) Reference software 3D Graphics Compression model Reference Software Space partitioning Frame-based animated mesh compression extension Scalable complexity 3DMC 3D Graphics Compression model Information exchange with virtual worlds Contribution to press release 3D Graphics Compression model 9.2 Joint meetings The following joint meetings were held Groups What S, V MXM-RVC S, 3 MXM-3DG Day Time Where Mon 16:00-16:30 Sys Mon 16:30-17:00 Sys 16 S, R, 3 S, A, R S, A J, V, R V, R S, R S, R, V S, R S, V MPEG-V IMAF Audio BIFS AVC Future video Adv. IPTV Ter. MAF Overview UI Framework MXM-RVC Wed Wed Wed Wed Wed Wed Thu Thu Thu 1100-1200 14:00-15:00 15:00-15:30 15:00-16:00 16:00-17:30 17:30-19:00 10:00-11:30 11:30-12:30 ?-? Req Sys Sys Jvt Vid Sys Req Req ? 10 WG management 10.1 Terms of reference 10200 Terms of reference 10.2 Editors 10204 Editors of MPEG standards 10.3 Liaisons The following liaisons were issued 10230 Liaison to WorldDMB on requirements to support Interactive Digital Radio 10308 Liaison statement to ETSI on requirements to support Interactive Digital Radio 10309 Liaison statement to TC 100 on requirements to support Interactive Digital Radio 10310 Liaison statement to TTA on requirements to support Interactive Digital Radio 10229 Liaison to GRN on requirements to support Interactive Digital Radio 10298 Liaison statement to ITU-T SG16 on IPTV 10300 Liaison statement to ISO/TC156/SC4/WG9 10301 Liaison statement to WG1 on PA AF 10307 Liaison statement to IEC TC100 TA4 on Interactive Music Application Format 10178 Liaison Statement to SC 34 10179 Liaison Statement to IEC TC 100 10219 Liaison response to AES (m15788) 10220 Liaison response to ITU-T SG 16 (15920) 10221 Liaison statement to IEC on IEC 100/1309/NP 10130 Liaison statement to TC 184/SC 4 10131 Liaison statement to Mobile Convergence Solution Forum (MCSF) 10011 List of Organisations with which MPEG entertains liaisons 17 10.4 Work item assignment 10.5 Ad hoc groups 10303 10302 10183 10134 10306 10304 10226 10184 10239 10180 10182 10223 10181 10227 10305 Ad Hoc Group on MPEG File Formats Ad Hoc Group on Scene Representation AHG on 3D Video and FTV Coding AHG on 3DGC documents, software maintenance and core experiments AHG on advanced IPTV AHG on Application Format AHG on Audio Standards Maintenance AHG on High-Performance Video Coding AHG on Information Exchange with Virtual Worlds AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance AHG on MPEG-7 Visual AHG on MxM AHG on Reconfigurable Video Coding AHG on SAOC, USAC AHG on the RoSE Framework 10.6 Asset management The following documents were approved 10205 10206 10207 10208 10209 Schema assets updates Software assets Conformance assets Content assets URI assets and MIME Types 10.7 IPR management 10210 Standards under development for which a call for patent statements is issued 11 Work plan 11.1 Responses to National Bodies The following documents were approved 10222 Response to Chinese, Finnish and French NBs 10225 Response to USNB (m15794) 11.2 Schedule of future MPEG meetings The following meeting schedule was approved 18 # 86 87 88 89 90 91 92 93 94 City Busan Lausanne Maui, HI London Xian Kyoto ? ? ? Country KR CH US UK CN JP AU IT ? 11.3 Promotional activities 10117 Busan press release 12 Resolutions of this meeting These were approved 13 A.O.B There was no other business 14 Closing The meeting closed at 2008/10/17T19:45 19 yy 08 09 09 09 09 10 10 10 10 mm 10 02 04 06-07 10 01 04 07 10 dd-dd 13-17 02-06 20-24 29-03 26-30 18-22 12-16 19-23 Annex A – Attendance list FIRST NAME LAST NAME COMPANY/ORGANIZATION COUNTRY Mohamad Raad RaadTech Consulting Australia Christian Timmerer Klagenfurt University Austria Kenneth Vermeirsch IBBT - UGent - MMLab Belgium Marcelo Moreno ABNT - Associação Brasileira de Normas Tecnicas Brazil Philippe Gournay VoiceAge Corporation Canada Redwan Salami VoiceAge Corporation Canada Zhijie Yang Broadcom China QING ZHANG Huawei Technologies China JIANHUA ZHENG Huawei Technologies Co. Ltd, China Lianhuan Xiong Huawei Technologies Co., Ltd. China weizhong CHEN Huawei technologies CO.,LTD China Wen Gao Peking University China Tiejun Huang Peking University China Siwei Ma Peking University China Yilin Chang Xidian University China Haitao Yang Xidian University China Yin Zhao Zhejiang University China Mejdi Trimeche Nokia Research Center Finland Ying Chen Tampere University of Technology Finland Mickaël Raulet IETR/INSA of Rennes France Owen Lagadec iKlax Media France Laurent Primaux iKlax Media France Olivier DEFORGES INSA Rennes France Mickaël RAULET INSA Rennes France marius preda Insitut TELECOM France 20 Sebastien Brangoulo Joost Technologies France Stephane Pateux Orange France Pierrick Philippe Orange Labs France Marc GUEZ VUCHER SCPP France CONCOLATO CYRIL TELECOM PARISTECH France LE FEUVRE JEAN TELECOM PARISTECH France Vincent Bottreau Thomson France Patrick LOPEZ Thomson France Chaker Larabi University of Poitiers France Andreas Schneider Dolby Germany Germany Sebastian Gerke Fraunhofer HHI Germany Karsten Grueneberg Fraunhofer HHI Germany Philipp MERKLE Fraunhofer HHI Germany Stefan Doehla Fraunhofer IIS Germany Ralf Geiger Fraunhofer IIS Germany Oliver Hellmuth Fraunhofer IIS Germany Juergen Herre Fraunhofer IIS Germany Markus Multrus Fraunhofer IIS Germany Max Neuendorf Fraunhofer IIS Germany Sperschneider Ralph Fraunhofer IIS Germany Stephan Schreiner Fraunhofer IIS Germany Leonid Terentiev Fraunhofer IIS Germany Bernhard Grill Fraunhofer Institut für Integrierte Schaltungen Germany Herve Taddei Huawei Germany Joern Ostermann Leibniz University Hannover Germany Tilman Liebchen LG Electronics Germany Steffen Wittmann Panasonic Germany Jens-Rainer Ohm RWTH Aachen University Germany Gero Baese Siemens Germany Johannes Boehm Thomson Germany Oliver Wuebbolt THOMSON Germany 21 Mario Doeller University Passau Germany Carmen Cheng ASTRI, HK Hong Kong Leonardo Chiariglione CEDEO.net Italy Filippo Chiariglione CEDEO.net Italy Marzia Corvaglia CNIT Italy Giovanni Cordara Telecom Italia Lab Italy Keiji Mitaubuchi Digital Holywood Graduate School Japan Shinya Hasegawa Fujitsu Laboratories Ltd. Japan Takashi Ito Fujitsu Laboratories Ltd. Japan Katsuyuki Nakamura Hitachi Ltd. Japan Yukiko Ogura IPSJ/ITSCJ Japan Shigeru Fukushima JVC Japan Takuyo Kogure Matsushita Electric Industrial Co. Ltd Japan Kohtaro Asai Mitsubishi Electric Corporation Japan Tokumichi Murakami Mitsubishi Electric Corporation Japan Shun-ichi Sekiguchi Mitsubishi Electric Corporation Japan Kazuo Sugimoto Mitsubishi Electric Corporation Japan Kazuyoshi Suzuki Nagoya University Japan Masayuki Tanimoto Nagoya University Japan Toshiyuki Nomura NEC Corporation Japan Keiichi Chono NEC Corporation Japan Kota Iwamoto NEC Corporation Japan Ryoma Oami NEC Corporation Japan Yasushige Nakayama NHK Japan Takanori Senoh NICT Japan Noboru Harada NTT Corporation Japan Takehiro Moriya NTT Corporation Japan Shinya Shimizu NTT Corporation Japan Hideaki Kimata NTT Corporation Japan Kei Kikuiri NTT DOCOMO, Inc. Japan 22 Yoshinori Suzuki NTT DoCoMo, Inc. Japan Thiow Keng Tan NTT DoCoMo, Inc. Japan Takahiro Nishi Panasonic Japan Takeshi Norimatsu Panasonic Japan Tomoyuki Yamamoto Sharp Japan Yasuaki Tokumo Sharp Corporation Japan Jun Matsumoto Sony Corporation Japan Teruhiko Suzuki Sony Corporation Japan Motomasa Futagami Sony Corporation Japan Yasuhiro Toguri Sony Corporation Japan Toshiaki Fujii Tokyo Institute of Technology Japan Takeshi Chujoh Toshiba Corporation Japan Satoshi Ito Toshiba corporation Japan YURIKA OGAWA TOSHIBA Corporation Japan TOMOO YAMAKAGE TOSHIBA Corporation Japan Satoru Sakazume Victor Company of Japan, Limited Japan Kevin S.C HALM AUDIZEN Korea Soon Young Kwon DGIST Korea Sang Heon Lee DGIST Korea Hogab Kang DRM inside Korea Taehyun Kim DRM inside Korea Sung-Moon Chun ECT Inc., Korea Kugjin ahn ETRI Korea Gun Bang ETRI Korea Seungkwon Beack ETRI Korea Ji Hun Cha ETRI Korea Hanjin Cho ETRI Korea Maeng-Sub Cho ETRI Korea Yongju Cho ETRI Korea bum suk choi ETRI Korea Haechul Choi ETRI Korea 23 Miran Choi ETRI Korea Hyon-Gon Choo ETRI Korea Jin Woo Hong ETRI Korea Seung-ku Hwang ETRI Korea Inseon Jang ETRI Korea Seyoon Jeong ETRI Korea Sanghyun Joo ETRI Korea Soon-heung Jung ETRI Korea Jung Won Kang ETRI Korea Kyeongok KANG ETRI Korea Hui Yong KIM ETRI Korea Hyun Woo Kim ETRI Korea Jin-Seo Kim ETRI Korea Jinwoong Kim ETRI Korea Minje Kim ETRI Korea Wonjong Kim ETRI Korea HAN KYU LEE ETRI Korea Jeong-Woo Lee ETRI Korea Jungsoo Lee ETRI Korea Miyoung Lee ETRI Korea Sang Kwang Lee ETRI Korea Seung Wook Lee ETRI Korea Taejin Lee ETRI Korea Yong Ju LEE ETRI Korea Sung-Chang Lim ETRI Korea Weon Geun OH ETRI Korea Jihyun Park ETRI Korea Seungsoon Park ETRI Korea Jeongil Seo ETRI Korea Jinwuk Seok ETRI Korea Il Hong Shin ETRI Korea 24 Truong Cong Thang ETRI Korea Gi-Mun Um ETRI Korea Won-Keun Yang ETRI Korea Jae-hyoun Yoo ETRI Korea JEONG-JU YOO ETRI Korea Cheon Lee GIST Korea YO-SUNG HO GWANGJU INSTITUTE OF SCIENCE Korea AND TECHNOLOGY Sin Wook Lee Hanyang Univ. Korea Kiho Choi Hanyang University Korea Euee S Jang Hanyang University Korea Jechang Jeong Hanyang University Korea Daiyong Kim Hanyang University Korea Hyungyu Kim Hanyang University Korea Kyoung Soo Son Hanyang University Korea EUNKYUNG KWAK HUMAX Korea Alex Lee HUMAX co., Ltd. Korea Min Sung Kim HUMAX/IPR Korea Jihoon Park ICU/SaIL Korea Minsoo Hahn Kwangki Kim Munchurl Kim Muhammad Syah Houari Sabirin Hendry Tan Sangil Na Inha Univ. Korea AYOUNG CHO INHA UNIVERSITY Korea Dong-Seok Jeong Inha University Korea Ju Kyong Jin Inha University Korea Junwoo Lee Inha university Korea choong sang cho KETI Korea Information and Communications Univ. Information and Communications Univ. Information and Communications University Information and Communications University Information and Communications University 25 Korea Korea Korea Korea Korea Byeongho Choi KETI Korea Taebeom Lim KETI Korea HWASEON SHIN KETI Korea Saim Shin KETI Korea JOOYOUNG YI KETI Korea Seung Woo Kum Jong-Jin Jung Hyuntae Cho Konkuk University Korea Min-Uk Kim Konkuk University Korea Kyoungro Yoon Konkuk University Korea Ho-Seok Chang Kookmin University Korea Dong Wook Kang Kookmin University Korea Jin-Young Lim Kookmin University Korea Jong-Min Lim Kookmin University Korea Jae-Gon Kim Korea Aerospace University Korea Sanghoon Sull Korea Univ. Korea Sangjin Hahm Korean Broadcasting system Korea ChangSeob Park Korean Broadcasting System Korea Sangmi Lee KORPA Korea Chang-Beom Ahn Kwangwoon University Korea Gwang-shin Cho Kwangwoon University Korea SuYeol Jeon Kwangwoon university Korea Jung-Hak Nam Kwangwoon University Korea Seoung-Jun Oh Kwangwoon University Korea Dong-Gyu Sim Kwangwoon University Korea SEUNG RYONG KOOK Kyung Hee University Korea YOON JIN LEE Kyung Hee University Korea Byung Chul Kim KyungHee Univ. Korea Kyuheon Kim KyungHee Univ. Korea Jangwon Lee Kyunghee Univ. Korea KETI (Korea Electronics Korea Technology Institute) KETI / B&C Convergence Research Korea Center 26 Heungsik Park KyungHee Univ. Korea HAN GUN JANG Kyunghee University Korea JIN KYU JEONG Kyunghee University Korea CHUL KEUN KIM Kyunghee University Korea KYUNG YONG KIM Kyunghee University Korea YONG HUN LEE Kyunghee University Korea Gwang Hoon Park Kyunghee University Korea DOUG YOUNG SUH Kyunghee University Korea Younghee Choi LG Electronics Korea Yong-Joon Jeon LG Electronics Korea Yang-Won Jung LG Electronics Korea Dong Soo Kim LG Electronics Korea Hyunkook Lee LG electronics Korea Jaehyun Lim LG Electronics Korea Jung Eun Lim LG Electronics Korea Henney Oh LG Electronics Korea Seung-Kyun Oh LG Electronics Korea Jong-Yeul Suh LG Electronics Korea Jaewon Sung LG Electronics Korea Jeong-Hyu Yang LG Electronics Korea Sungyong Yoon LG Electronics Korea YuKyoung Song LGE Korea SANG GYOU LEE MBC Korea Sang-Kyun Kim Myongji University Korea Jongyoun Kim net&tv Korea Sung uk Baik Oniontech Korea Seong won Kim Oniontech Korea Seung Chul Kang PAVONINE KOREA Korea Sang Jun Lee PAVONINE KOREA Korea Jae-Seob SHIN PIXTREE, INC. Korea WOONG IL CHOI SAMSUNG Korea 27 Yejin Moon Samsung Korea Kyong-Sok Seo Samsung Elec. Korea Jeong-Hwan Ahn SAMSUNG ELECTRONICS Korea Elena Alshina Samsung Electronics Korea Dae Sung Cho Samsung Electronics Korea Woo-Jin Han Samsung Electronics Korea Hyun Mun KIm Samsung Electronics Korea JungHoe Kim Samsung Electronics Korea Yongje Kim Samsung Electronics Korea Jaechool Lee Samsung Electronics Korea Jaejoon Lee Samsung Electronics Korea Seungsin Lee Samsung Electronics Korea Hangil Moon Samsung Electronics Korea Eunmi Oh Samsung Electronics Korea Young Wook Sohn Samsung Electronics Korea Jaeyeon Song Samsung electronics Korea Yongtae Z Samsung Electronics Korea Seungji Yang Samsung Electronics / DM Research Center Korea Seo-Young Hwang Samsung Electronics Co. Ltd Korea Kyohyuk Lee Samsung Electronics Co., Ltd. Korea Sang Rae Lee Samsung Electronics Co., Ltd. Korea JeongHoon Park Samsung Electronics Co., Ltd. Korea JUNG SUK SUH Samsung Electronics Co., Ltd. Korea JUNGWAN KO SAMSUNG ELECTRONICS CO.,LTD. Korea Tammy Lee Samsung Electronics. Korea Jie JIA Sejong University Korea Hye-Min Jun Sejong University Korea Hae Kwang KIM Sejong University Korea Ki-Baek Kim Sejong University Korea kioh kim sejong university Korea MinJae Kim Sejong University Korea 28 Jeongbeom LEE Sejong university Korea Yung-Lyul Lee Sejong University Korea Hee-Suk Pang Sejong University Korea Daeil Yoon Sejong University Korea Tae Meon Bae SK Telecom Korea Hayoon Kim SK Telecom Korea Jeongyeon Lim SK Telecom Korea Byeungwoo Jeon Sungkyunkwan University Korea Jaehwan Joo Univ. Yonsei Korea RInchul Kim University of Seoul Korea Yong Han Kim University of Seoul Korea Seonghoon Kim VaroVision Korea Sejun Park VaroVison Korea Donghyun Kim Yonsei Univ. Korea Yoonsik Choe Yonsei University Korea Jangwon Choi Yonsei university Korea Jungdong Seo Yonsei University Korea Jong-Seol, James Lee KETI Korea Gun-hee Lee KyungHee Univ. Korea Sanghyun Park Kyunghee University Korea Young-Kwon LIM net&tv Inc. Korea KYUNGMO PARK SAMSUNG ELECTRONICS CO., LTD. Korea Woochul Jung Samsung Electronics. Korea Fons Bruls Philips Wiebe de Haan Philips Lincoln Sampaio Lobo Philips Werner Oomen Philips Applied Technologies Jean H.A. Gelissen Philips Research Olgierd Stankiewicz Poznan University of Technology 29 Netherlands, The Netherlands, The Netherlands, The Netherlands, The Netherlands, The Poland Lukasz Pikula Telekomunikacja Polska S.A. Poland Tuan Kiang Chiew Institute for Infocomm Research Singapore Haibin Huang Institute for Infocomm Research Singapore Wei Yao Institute for Infocomm Research Singapore Yongwei Zhu Institute for Infocomm Research Singapore Ti Eu Chan Te Li Chong Soon Lim Huan Zhou Haishan Zhong Jaime Delgado DMAG-UPC Spain Marc Gauvin sDae Spain Francisco Morán Burgos Universidad Politécnica de Madrid Spain VICTOR RODRIGUEZ DONCEL UPC Spain Kristofer Kjoerling Dolby Sweden Sweden Heiko Purnhagen Dolby Sweden Sweden Per Fröjdh Ericsson Sweden Ivana Radulovic Ericsson Sweden Manuel BRIAND ERICSSON AB Sweden Christophe Lucarz EPFL Switzerland Marco Mattavelli EPFL Switzerland Chun-Chi Chen ITRI International/NCTU China Yi-Shin Tung MStar Semiconductor, Inc China Gwo Giun (Chris) Lee National Cheng Kung University China Miroslaw Bober Mitsubishi Electrc ITE UK Paul Brasnett Mitsubishi Electric ITE UK Leszek Cieplinski Mitsubishi Electric ITE-VIL UK Kate Grant Nine Tiles UK Panos Kudumakis Queen Mary University of London, Centre for Digital Music UK Institute For Infocomm Research (A*STAR) Institute for Infocomm Research, A*STAR Panasonic Singapore Singapore Singapore Singapore Panasonic Singapore Laboratories Singapore Pte Ltd Panasonic Singapore Laboratories Singapore Pte Ltd (PSL) 30 David Singer Apple USA Schuyler Quackenbush Audio Research Labs USA Xin Wang ContentGuard, Inc. USA Alexandros Tourapis Dolby Laboratories USA Pankaj Topiwala FastVDO USA Haoping Yu Huawei Technologies (USA) USA MINJIE XIE Huawei Technologies Ltd. USA Yi-Jen Chiu Intel Corp. USA Suman Sharma Intel Corporation USA Gary Sullivan Microsoft USA Andrew Tescher Microsoft USA Anthony Vetro Mitsubishi Elec Res Labs USA Huifang Sun Mitsubishi Electric Research Labs USA Sehoon Yea Mitsubishi Electric Research Labs USA Vladimir Levantovsky Monotype Imaging Inc. USA Faisal Ishtiad Motorola USA Ajay Luthra Motorola USA Mandayam Narasimhan Motorola USA Shih-Ta Hsiang Motorola, Inc. USA Justin Ridge Nokia, Inc. USA Lulin Chen Omneon, Inc. USA Giovanni Motaa Qualcomm USA Geert Van der Auwera Samsung Information Systems America USA Mohamed Mansour Texas Instruments Inc. USA Dong Tian Thomson Inc USA Xiaofan Lin Vobile Inc. USA 31 Annex B – Agenda 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 Opening Roll call of participants Approval of agenda Allocation of contributions Communications from Convenor Report of previous meeting Processing of NB Position Papers Work plan management Media coding 1 MPEG-2 Main Profile Level for 1080@50/60p 2 MPEG-4 Visual Simple Studio Profile Levels 5 and 6 3 Advanced Video Coding (AVC) 4 Multiview Video Coding (MVC) 5 Frame-based Animated Mesh Compression 6 Multiresolution profile 7 Low-complexity 3D mesh compression 8 Open Font Format extensions 9 Codec Configuration Representation 10 Video Tool Library 11 Spatial Audio Object Coding 12 3D Video Coding 13 Unified Speech and Audio Coding 14 Media Value Chain Ontology 15 Representation of Sensory Experience 16 New Video Coding 17 New Audio Coding Composition coding 1 Joint use of Laser and BIFS 2 Presentation of Structured Information 3 User Interface framework Description coding 1 Image Signature Tools 2 Video Signature Tools 3 MPEG-7 Query Format Systems support IPMP Digital Item 1 Schema files for MPEG-21 standards 2 Security in Event Reporting Transport and File formats 32 8 9 10 11 1 Carriage of SVC in MPEG-2 Systems 2 AVC File Format extensions for MVC Multimedia architecture 1 3D Graphics Compression Model 2 Interfaces between virtual and real worlds 3 MPEG eXtensible Middleware Application formats 1 Protected Musical Slide Show Application Format 2 Professional Archival MAF 3 Open Access Application Format 4 Portable Video Player Application Format 5 Video Surveillance Application Format 6 Video Stereoscopic Application Format Reference implementation 1 MPEG-1 and -2 on MPEG-4 Reference Software 2 BSAC Extensions Reference Software 3 AAC-ELD Reference Software 4 New Profiles for Professional Applications Reference Software 5 SVC Reference Software 6 File Format Reference Software 7 Geometry and Shadow Reference Software 8 Frame-based Animated Mesh Compression Reference Software 9 3D Graphics Compression Model Reference Software 10 Open Font Format Reference Software 11 MPEG-7 Systems Reference Software 12 MPEG-21 REL Reference Software 13 Photo Player MAF Reference Software 14 Musical Slide Show MAF Reference Software 15 Binary MPEG format for XML Reference Software 16 MPEG Surround Reference Software 17 M3W Reference Software Conformance 1 MPEG-2 Main Profile Level for 1080@50/60p Conformance 2 MPEG-4 Visual Simple Profile Level 6 Conformance 3 New Profiles for Professional Applications Conformance 4 Scalable Video Coding Conformance 5 AAC-ELD, OAFI and additional AAC Conformance 6 MPEG-1 and -2 Audio in MPEG-4 Conformance 7 BSAC Conformance 8 File Format Conformance 9 Geometry & Shadow Conformance 10 Frame-based Animated Mesh Compression Conformance 11 MultiResolution Profile Conformance 12 3D Graphics Compression Model Conformance 13 Synthesized Texture Conformance 33 14 Laser Conformance 15 Open Font Format Conformance 16 Improvements to Geographic Descriptor Conformance 17 MPEG Surround Conformance 18 M3W Conformance 19 Video Tool Library Conformance 12 Maintenance 1 Systems coding standards 2 Video coding standards 3 Audio coding standards 4 3DG coding standards 5 Visual description coding standards 6 Audio description coding standards 7 MPEG-21 standards 8 MPEG-A standards 13 Time line 9 Organisation of this meeting 1 Tasks for subgroups 2 Joint meetings 10 WG management 1 Terms of reference 2 Officers 3 Editors 4 Liaisons 5 Work item assignment 6 Ad hoc groups 7 Asset management 7.1 Reference software 7.2 Conformance 7.3 Test material 7.4 URI 8 IPR management 9 Work plan 11 Administrative matters 1 Responses to National Bodies 2 Schedule of future MPEG meetings 3 Promotional activities 12 Resolutions of this meeting 13 A.O.B 14 Closing 34 Annex C – Input contributions Number Source Title m15721 Webmaster Busan document register m15722 Jean Gelissen, Marius Preda Ad Hoc Group on Information Exchange with Virtual Worlds m15723 Filippo Chiariglione, Marius Preda Ad Hoc Group on MxM m15724 Yi-Shin Tung, Teruhiko Suzuki Ad Hoc Group on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance m15725 Euee S. Jang, Marco Mattavelli, Yoshihisa Yamada Ad Hoc Group on Reconfigurable Video Coding m15726 Miroslaw Bober, Ryoma Oami m15727 Ad Hoc Group on MPEG-7 Visual Hideaki Kimata, Aljoscha Smolic, Karsten Müller Ad Hoc Group on 3D Video and FTV Coding Jens-Rainer Ohm, Jörn Ostermann, Ajay Ad Hoc Group on New Challenges in m15728 Luthra, Jason Suh, T.K. Tan, Lazar Video Coding Standardization Bivolarski m15729 Ralph Sperschneider Ad Hoc Group on Audio Standards Maintenance Schuyler Quackenbush, Eunmi Oh, m15730 Jürgen Schmidt Ad Hoc Group on SAOC, USAC, and Support for new Loudspeaker Configurations m15731 Patrick Gioia, Francisco Morán Burgos Ad Hoc Group on 3DGC documents, software maintenance and core experiments m15732 Young-Kwon Lim, Jaeyeon Song, Cyril Ad Hoc Group on Scene Representation Concolato m15733 David Singer m15734 Ad Hoc Group on MPEG File Formats Kyuheon Kim, Hui Yong Kim, Jean Cha, Noboru Harada, Hendry m15735 Marc Gauvin, Miran Choi m15736 Ad Hoc Group on Application Format Ad Hoc Group on MVCO WD Editing Sanghyun Joo, Jean Gelissen, Christian Timmerer Ad Hoc Group on the RoSE Framework m15737 Vladimir Levantovsky Ad Hoc Group on Font Format Representation m15738 SC 29 Secretariat Summary of Voting on ISO/IEC 1449610:200X/DCOR 1 [SC 29 N 9679] 35 m15739 SC 29 Secretariat Summary of Voting on ISO/IEC 138181:2007/DCOR 2 [SC 29 N 9680] m15740 SC 29 Secretariat Summary of Voting on ISO/IEC 144964:2004/PDAM 36 [SC 29 N 9681] m15741 SC 29 Secretariat Summary of Voting on ISO/IEC 144965:2001/PDAM 23 [SC 29 N 9683] m15742 SC 29 Secretariat Summary of Voting on ISO/IEC 1449612:200X/DCOR 1 [SC 29 N 9685] m15743 SC 29 Secretariat Summary of Voting on ISO/IEC 1449612:200X/PDAM 1 [SC 29 N 9687] m15744 SC 29 Secretariat Summary of Voting on ISO/IEC 1449616:2006/Amd.1:2007/DCOR 2 [SC 29 N 9688] m15745 SC 29 Secretariat Summary of Voting on ISO/IEC TR 15938-8:2002/PDAM 4 [SC 29 N 9691] m15746 SC 29 Secretariat Summary of Voting on ISO/IEC 210007:2007/DCOR 1 [SC 29 N 9692] m15747 SC 29 Secretariat Summary of Voting on ISO/IEC 230004:200X/PDAM 2 [SC 29 N 9694] m15748 SC 37 via SC 29 Secretariat ISO/IEC 19794-5/FPDAM 2 [SC 29 N 9702] m15749 SC 37 via SC 29 Secretariat ISO/IEC CD 29109-4 [SC 29 N 9703] m15750 SC 37 via SC 29 Secretariat ISO/IEC CD 19794-5 [SC 29 N 9712] m15751 SC 37 via SC 29 Secretariat ISO/IEC PDTR 29794-5.2 [SC 29 N 9713] m15752 SC 37 via SC 29 Secretariat ISO/IEC CD 19794-4 [SC 29 N 9714] m15753 SC 29 Secretariat Summary of Voting on ISO/IEC CD 23003-2 [SC 29 N 9720] m15754 SC 29 Secretariat Summary of Voting on ISO/IEC 144965:2001/FPDAM 19 m15755 SC 29 Secretariat Summary of Voting on ISO/IEC 230003:2007/FPDAM 1 m15756 SC 29 Secretariat Summary of Voting on ISO/IEC 138182:2000/FPDAM 3 m15757 SC 29 Secretariat Summary of Voting on ISO/IEC 138184:2004/FPDAM 3 m15758 SC 29 Secretariat Summary of Voting on ISO/IEC 144962:2004/FPDAM 5 m15759 SC 29 Secretariat Summary of Voting on ISO/IEC 1449636 4:2004/FPDAM 32 m15760 SC 29 Secretariat Summary of Voting on ISO/IEC 144965:2001/FPDAM 14 m15761 SC 29 Secretariat Summary of Voting on ISO/IEC 144965:2001/FPDAM 21 m15762 SC 29 Secretariat Summary of Voting on ISO/IEC 1449611:2005/FPDAM 6 m15763 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 14496-25 m15764 SC 29 Secretariat Summary of Voting on ISO/IEC 210008:2008/FPDAM 1 m15765 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23004-8 m15766 SC 29 Secretariat Summary of Voting on ISO/IEC 159383:2002/FPDAM 3 m15767 SC 29 Secretariat Summary of Voting on ISO/IEC 230004:200X/FPDAM 1 m15768 SC 29 Secretariat Summary of Voting on ISO/IEC 144965:2001/PDAM 24 m15769 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 1449616:2006/FDAM 3 m15770 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 144964:2004/FDAM 26 m15771 ITTF via SC29 Secretariat Table of Replies on ISO/IEC 144964:2004/FDAM 27 m15772 ITTF via SC29 Secretariat Table of Replies on ISO/IEC 210009:2005/FDAM 1 m15773 ITTF via SC29 Secretariat Table of Replies on ISO/IEC 2100015:2006/FDAM 1 m15774 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 23001-3 m15775 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 14496-9 [3rd Edition] m15776 SC 29 Secretariat Summary of Vpting on ISO/IEC FCD 23000-6 m15777 SC 29 Secretariat Summary of Voting on ISO/IEC 230007:200X/FPDAM 1 m15778 SC 29 Secretariat Summary of Voting on ISO/IEC 144964:2004/FPDAM 35 37 m15779 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 23000-4 [2nd Edition] m15780 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23000-11 m15781 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23001-4 m15782 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 23002-4 Christian Timmerer Markus Waltl Yasuaki Tokumo Bumsuk Choi m15783 Seungsoon Park Sanghyun Joo Mark Verberkt Sang-Kyun Kim Report of Core Experiment on the Representation of Sensory Effects m15784 SC 37 via SC 29 Secretariat ISO/IEC CD 29109-5 m15785 ITU-T SG 16 SC 29 Secretariat Liaison Statement from ITU-T SG 16 m15786 Per Ekstrand Markus Schnell Proposed Draft Corrigendum on AACELD m15787 IEC TC 100 via SC 29 Secretariat IEC CDV 62514 [SC 29 N 9755] m15788 AES via SC 29 Secretariat Liaison Statement from AES m15789 DVB via SC 29 Secretariat Liaison Statement from DVB Injae Lee Jihun Cha m15790 Young-kwon Lim Han-Kyu Lee Jinwoo Hong New Extensions for PSI m15791 Cyril Concolato Jean Le Feuvre Comments and Proposal for LASeR PDAM2 m15792 Cyril Concolato Jean Le Feuvre Comments on LASeR AMD3 (PSI) Cyril Concolato m15793 Jean Le Feuvre Kyungmo Park Comments on the Architecture of the MPEG Rich Media UI Framework m15794 A. G. Tescher for USNB Suggested profile name for ALS Haitao Yang Yilin Chang m15795 Xiaoxian Liu Shan Gao Sixin Lin Adaptive Non-uniform Quantization in Depth Format Conversion 38 Lianhuan Xiong Haoping Yu Jiantong Zhou m15796 Qingpeng Xie Lianhuan Xiong m15797 Video Coding in Wired and Wireless IP Network Applications Yasuaki Tokumo Shin-ya Hasegawa Report of Core Experiment on RoSE Philipp Merkle Aljoscha Smolic m15798 Yongzhe Wang Karsten Müller Results of Exploration Experiments in 3D Video Coding for Dog Data Set Jin-Seo Maeng-Sub Cho m15799 Sang-Kyun Kim Yong Soo Joo Bon-Ki Koo A Core Experiment Report on RoSE Gwo Giun (Chris) Lee He-Yuan Lin m15800 Yuan-Long Cheng Bo-Han Chen Ming-Jiun Wang Multiple reference picture management FU for AVC inter-prediction m15801 Christian Timmerer Study of WD1.0 of RoSE m15802 [email protected] [email protected] 3DV EE3 results on lovebird1 and leavinglaptop sequences Soonyoung Kwon Hyungyu Kim Sinwook Lee Hwa Seon Shin m15803 Sang-heon Lee Byeongho Choi Chungku Yie Euee S. Jang Study on FUID definition (CE 1.3) Hyungyu Kim Sinwook Lee Hwa Seon Shin Soonyoung Kwon m15804 Sang-heon Lee Byeongho Choi Chungku Yie Euee S. Jang BSDL Parser Description and Generation Using ECMAscript Sinwook Lee Hwa Seon Shin m15805 Hyungyu Kim Soonyoung Kwon Modified Token Description for the Consideration of Token Precedence 39 Sang-heon Lee Byeongho Choi Chungku Yie Euee S. Jang Hwa Seon Shin Hyungyu Kim Sinwook Lee Soonyoung Kwon m15806 Sang-heon Lee Byeongho Choi Chungku Yie Euee S. Jang Proposed Token Pool for ISO/IEC 23002-4 VTL and Its Application in Evaluating FU Network m15807 Yasushige Nakayama Issues of AudioBIFS to applying to an Advancement of Satellite Digital Broadcasting in Japan m15808 Leonardo Chiariglione Proposal for MXM Public License Version 1.0 Filippo Chiariglione m15809 Marc Gauvin Tiejun Huang Reference software implementing the MXM submissions Filippo Chiariglione Marc Gauvin m15810 Tiejun Huang Denis Oliver Kropp Martin Springer Response to Call for Proposals on Additional MXM Technologies m15811 Filippo Chiariglione Christian Timmerer Further ideas on MXM architecture m15812 David Singer Editor's draft of the Part12 file format amendment Heiko Purnhagen Oliver Hellmuth m15813 Leonid Terentiev Werner Oomen Comments on IMAF draft CfP and MAF Overview m15814 Motomasa Futagami Teruhiko Suzuki Proposal to clarify the scope of the brands "isom" and "iso2" m15815 Motomasa Futagami Teruhiko Suzuki Comment on the change of the 'ctts' box Noboru Harada Hendry m15816 Takehiro Moriya Yutaka Kamamoto m15817 Proposed update on MAFs Ovierview for PA-AF Taka Senoh Kemji Yamamoto 3DV/FTV EE report on Champagne Tower 40 Ryutaro Oi Tomoyuki Mishina Makoto Okui Shun-ichi Sekiguchi Shuichi Yamagishi Yoshihisa Yamada m15818 Yoshiaki Kato Kohtaro Asai Tokumichi Murakami Comments on test conditions for highquality coding experiments Ye-Kui Wang m15819 Miska Hannuksela Ying Chen An extension to ISO base media file format m15820 Shinya Shimizu Hideaki Kimata Results of EEs in 3DV/FTV for Doorflowers m15821 Christian Timmerer Contribution to MXM Reference Software Ivica Arsov m15822 Marius Preda Françoise Preteux MXM Software Implementation for 3D Graphics Blagica Jovanova m15823 Marius Preda Françoise Preteux Software Implementation for MPEG-4 Part 25 Benoit Le Bonhomme m15824 Marius Preda Françoise Preteux Benchmarking results for Scalable Complexity Mesh Compression Khaled Mamou Titus Zaharia m15825 Marius Preda Francoise Prêteux TFAN stream description Johannes Hilpert Maria Luis Valero Markus Schnell Oliver Hellmuth m15826 Leonid Terentiev Jonas Engdegård Heiko Purnhagen Erik Schuijers Core Experiment on Low Delay MPEG SAOC system Jonas Engdegård Leonid Terentiev m15827 Oliver Hellmuth Erik Schuijers Core Experiment on Low Power MPEG SAOC system Oliver Hellmuth m15828 Johannes Hilpert Harald Mundt Proposal for adoption of stereo-tobinaural scenario for the MPEG SAOC system 41 Leonid Terentiev Cornelia Falch Heiko Purnhagen Jonas Engdegård Jeroen Koppens Leonid Terentiev Cornelia Falch m15829 Oliver Hellmuth Johannes Hilpert Proposal for the integration of the enhanced Karaoke/Solo processing into the decoding modes of the MPEG SAOC system Leonid Terentiev Cornelia Falch Oliver Hellmuth m15830 Johannes Hilpert Heiko Purnhagen Jonas Engdegård Jeroen Koppens Report on corrections for the MPEG SAOC CD text and RM software m15831 Kota Iwamoto Ryoma Oami Issues on Call for Proposals on Video Signature Tools m15832 Krzysztof WEGNER Olgierd STANKIEWICZ 3DV/FTV EE1 and EE2 results on Alt Moabit sequence R.O'Callaghan [email protected] m15833 [email protected] [email protected] m15834 Editors Input to ISO/IEC 159383:2001/FPDAM 3 Lu Yu Yin Zhao 3D Video Exploration Experiment on LDV of Champagne Tower sequence Saar De Zutter m15835 Kenneth vermeirsch Florian Schreiner Editors' input to ISO/IEC 210008:2008/FDAM 1 Extra reference software Masayuki Tanimoto m15836 Toshiaki Fujii Kazuyoshi Suzuki Reference Software of Depth Estimation and View Synthesis for FTV/3DV Masayuki Tanimoto m15837 Toshiaki Fujii Kazuyoshi Suzuki Depth Estimation to improve boundary clarification Hendry Houari Sabirin m15838 Noboru Harada Munchurl Kim Editors' update to WD 1.0 of ISO/IEC 23000-6/Amd.1 PA-AF Conformance & Reference Software m15839 Yang-Won Jung Henney Oh Comments on parameter estimation in SAOC m15840 Yang-Won Jung Henney Oh Proposed modification on parameter estimation in SAOC 42 m15841 Zhuangfei Wu Per Fröjdh Enhancements to the MVC File Format m15842 Daniel Catrein Per Fröjdh Improved file format support for SRTP reception m15843 Ryoma Oami Proposed text for ISO/IEC 23000-3 PDAM 2 Ryoma Oami m15844 Kota Iwamoto Foreground video clips prepared by NEC with video contents gathered from web sites m15845 Paul Brasnett Miroslaw Bober Experimental Data from the National Film and Television School, UK m15846 Kevin SeungChul Ham Marketing & Business status of Interactive Music Service Yun-Suk Kang m15847 Cheon Lee Yo-Sung Ho EE1: Results on 'Pantomime? Sequence using Nagoya SW JungHoe Kim Ralph Geiger m15848 Ti-Eu Chan Eunmi Oh Proposed Corrigendum on MPEG-4 SLS m15849 deleted deleted Jae-Il Jung m15850 Cheon Lee Yo-Sung Ho EE2: View Synthesis Results on 'Pantomime' Sequence using Thomson SW m15851 Cheon Lee Yo-Sung Ho View Synthesis Tools for 3D Video m15852 Sang-Beom Lee Yo-Sung Ho Results of Experiment on Temporal Enhancement for Depth Estimation [email protected] m15853 [email protected] [email protected] Scene Representation in PSI Taeyoung Na Munchurl Kim m15854 Jeongyeon Lim Youngho Joo Kimun Kim A Proposed New Profile and Level on MPEG-4 Part 10 AVC|H.264 for Video Telephony Applications Gun Bang Gi Mun Um m15855 Jaeho Lee Namho Hur Jin Woong Kim 3DV/FTV EE1/EE2 results on Lovebird1 and EE3 result on Leaving Laptop sequence 43 m15856 Schuyler Quackenbush Thoughts on Unified Speech and Audio Coding Reference Software and the Core Experiment Process m15857 Schuyler Quackenbush 85th MPEG Audio Report Marc Gauvin Jaime Delgado m15858 Víctor Rodríguez Doncel Miran Choi Editor´s proposal for Media Value Chain Ontology CD text m15859 Ivana Radulovic Per Fröjdh 3DTV Exploration Experiments on Pantomime sequence Noboru Harada Tilman Liebchen m15860 Takehiro Moriya Yutaka Kamamoto Proposed Corrigenda on MPEG-4 ALS Noboru Harada Tilman Liebchen m15861 Takehiro Moriya Yutaka Kamamoto Information related to the proposed ALS profile Miska M. Hannuksela m15862 Ye-Kui Wang Ying Chen On MVC file format m15863 Paul Brasnett Miroslaw Bober Comments & Results on MPEG-7 Image Signature Vision and Requirements for HighPerformance Video Coding (HVC) Codec m15864 T.K. Tan m15865 Ralf Geiger Virgilio Bacigalupo Further information on the complexity of the HD-AAC profile Juegren Schmidt m15866 Mario Sieck Report on flexible signaling of audio channels to loudspeaker mapping using MPEG-4 BIFS Max Neuendorf Stefan Bayer Jérémie Lecomte Guillaume Fuchs Philippe Gournay m15867 Julien Robilliard Nikolaus Rettelbach Frederik Nagel Ralf Geiger Redwan Salami Markus Multrus Detailed Technical Description of Reference Model 0 of the CfP on Unified Speech and Audio Coding (USAC) m15868 Markus Multrus Reference Software for Reference Model 44 Max Neuendorf Jérémie Lecomte Guillaume Fuchs Philippe Gournay Julien Robilliard Nikolaus Rettelbach Frederik Nagel 0 of the CfP on Unified Speech and Audio Coding (USAC) Thomas Schierl m15869 Karsten Grüneberg Proposal for the Amendment to ISO/IEC 13818-1:2007 - "Transport of MVC in MPEG-2 Systems" Matthieu Wipliez m15870 Mickael Raulet Jonathan Piat Editing a RVC FU network using a GUI called Graphiti m15871 Mario Doeller Felix Fischer -1 Reference Software: MPQF Parser Framework Mario Doeller Heiko Studt - 1 Ruben Tous m15872 Jaime Delgado Miran Choi Tae-Beom Lim Reference Software: MPQF Validator Florian Décologne m15873 Mickael Raulet Médéric Blestel FU Networks for luminances of MPEG4 AVC BP decoder m15874 Karsten Grüneberg Thomas Schierl On MVC File Format Stephan Schreiner m15875 Wolfgang Fiesel Matthias Neusinger A proposal for requirements for a audio metadata system within MPEG m15876 Andreas Schneider Proposed study on coupling channel fixes Andreas Schneider m15877 Kristofer Kjörling proposed new restriction for the AAC family of profiles and proposed new profile m15878 Laurent PRIMAUX Owen LAGADEC iKlax - IM AF Business & market status m15879 Mauri Väänänen on behalf of Finnish National Body Comment on the Unified Speech and Audio Coding Activity m15880 Sehoon Yea Anthony Vetro Results of Exploration Experiments in 3D Video for Lovebird2 m15881 Dong Tian Joan Llach 3DV EE1 & EE2 on Leaving_Laptop m15882 Fons Bruls 3DV EE1 & EE2 results on Arrive Book 45 Lincoln Lobo Dong Tian Joan Llach m15883 Fons Bruls Meng Zhao Improvements on View Synthesis and LDV extraction Based on Disparity (ViSBD 2.0) Fons Bruls m15884 Lincoln Lobo Meng Zhao 3DV EE3 LDV results on Arrive Book, Alt-Moa, Newspaper & Lovebird2. m15885 SC 34/WG 2 via SC29 Secretariat Liaison Statement from SC 34/WG 2 m15886 SC 29 Secretariat Late comments on ISO/IEC FCD 2300011 m15887 Jung Eun Lim Jaewon Sung EE results on Newspaper Jaewon Sung m15888 Yong-Joon Jeon Byeong-Moon Jeon Improved view synthesis algorithm Seo-Young Hwang Jaeyeon Song m15889 Cyril Concolato Jean Le Feuvre Young-Kwon Lim Study Text for CD of 14496-20 AMD2 Seo-Young Hwang Jaeyeon Song m15890 Cyril Concolato Jean Le Feuvre Young-Kwon Lim Study Text for AdaptiveSceneIndicator of CD on 14496-20 AMD2 Seo-Young Hwang m15891 Jaeyeon Song Young-Kwon Lim Study Text for display size related adaptation on 14496-20 AMD2 Kyungmo Park Jaeyeon Song m15892 Cyril Concolato Jean Le Feuvre Architecture for the MPEG UI Framework Jeongil Seo Seungkwon Beack m15893 Kyeongok Kang Kwangki Kim Minsoo Hahn CE Report on Support for a Mastering Downmix Ju-Kyong Jin m15894 Jun-Woo Lee Dong-Seok Jeong Suggestion to solve the problem of delayed trimmed position in modification for VCE-7 m15895 Weon-Geun Oh Ju-Kyong Jin Automatic extraction of start frame from 'capture and Record video clips' for 46 Dong-Seok Jeong VCE-7 modification Hui Yong Kim HanKyu Lee m15896 Hyunsoon Kim Daebok Kwon Conformance files contribution for ISO/IEC 23000-9 (DMB-AF) Hui Yong Kim HanKyu Lee Houari Sabirin m15897 Munchurl Kim Jung Soo Lee Yong Han Kim Updated text and reference SW for ISO/IEC 23000-9 (DMB-AF) Hui Yong Kim Myung Seok Ki m15898 HanKyu Lee Yong Han Kim Alignment of MPEG-2 TS storage for DMB-AF to ISO file format Elena Alshina Kyohyuk Lee m15899 Woo-Jin Han Jeonghoon Park Technical considerations on New Challenges in Video Coding Standardization Sang-il Na Weon-Geun Oh m15900 Ayoung Cho Dong-Seok Jeong Proposal on the change of success condition in direct matching Inseon Jang Jeongil Seo m15901 Kyeongok Kang Hui Yong Kim Kevin SeungChul Ham Comments on MAF overview m15902 Jean H.A. Gelissen Additional Requirements for MPEG-V Seungwook Lee Bonki Koo m15903 Kyoungsoo Son Euee S. Jang CE Report Version 2 on the SC3DMC Seungwook Lee Bonki Koo m15904 Daiyong Kim Euee S. Jang Algorithm Desctiption on the CE of SVA m15905 GRN via SC 29 Secretariat Liaison Statement from GRN Bumsuk Choi Seungsoon Park m15906 Sanghyun Joo Kyungro Yoon Report of Core Experiment on RoSE m15907 Bumsuk Choi Contribution to RoSE CE M.1 47 Seungsoon Park Sanghyun Joo m15908 Digital Radio Mondiale Consortium via Liaison Statement from the Digital Radio SC 29 Secretariat Mondiale Consortium Bumsuk Choi m15909 Seungsoon Park Sanghyun Joo Contribution to RoSE CE M.2 Gwo Giun (Chris) Lee m15910 He-Yuan Lin Ming-Jiun Wang ID assignment for RVC (CE 1.3) m15911 Wen Gao on behalf of the Chinese NB Comment on the Unified Speech and Audio Coding Exploration Activity m15912 Mario Doeller Philipp Wendler Proposal for MPEG Query Format Corrigendum m15913 Next generation Broadcasting Forum (Korea) Proposed text of ISO/IEC 23000-11 FDIS Stereoscopic Video Application Format m15914 Pierrick Philippe on behalf of the French National Body Comment on the Unified Speech and Audio Coding Activity m15915 Giovanni Cordara Diego Gibellino On MPEG Rich-Media UI Framework Data Source "ETSI/EBU/CENELEC JTC on m15916 Broadcast via SC 29 Secretariat Liaison Statement from "ETSI/EBU/CENELEC JTC on Broadcast" m15917 Jean H.A. Gelissen Additional Requirements for MPEG-V II Weon-Geun Oh m15918 Won-Keun Yang Jun-Woo Lee A proposal for additional condition on matching complexity of video signature m15919 WorldDMB Forum via SC 29 Secretariat Liaison Statement from WorldDMB Forum m15920 ITU-T SG 16 via SC 29 Secretariat Liaison Statement from ITU-T SG 16 m15921 deleted deleted m15922 ISO TC 184/SC 4 via SC 29 Secretariat Liaison Statement from ISO TC 184/SC 4 Hwa Seon Shin Hyungyu Kim Sang-heon Lee m15923 Byeongho Choi Chungku Yie Euee S. Jang Technical and editorial suggestions on RVC 48 m15924 deleted m15925 deleted Guido Franceschini Giovanni Cordara ISOFF compatibility issue Hwa Seon Shin Hyungyu Kim Byeongho Choi m15926 Sangheon Lee Chungku Yie Euee S. Jang Modified Token Description for the Different Characteristics of FU Inputs m15927 Yi-Shin Tung Tse-Tsung Shih Update of MPEG-4 video reference software for short header bug fix m15928 Yi-Shin Tung Tse-Tsung Shih fix of 3 MPEG-4 video conformance bitstreams Weon-Geun Oh Won-Keun Yang m15929 Ayoung Cho Sang-Il Na Dong-Seok Jeong Fast Image Signature for All Modifications m15930 IEC TC 100 via SC29 Secretariat Liaison Statement from IEC TC 100 Seo-Young Hwang m15931 Jaeyeon Song Young-Kwon Lim Study Text for memory related adaptation on 14496-20 AMD2 m15932 Francisco Morán Burgos Report on the Ad Hoc Group on 3DGC documents and software maintenance m15933 Xin Wang Outline of a possible joint project between MPEG and ITU-T Q.13/16 on Advanced IPTV Terminals m15934 Xin Wang Report on Joint IPTV meeting between MPEG and ITU-T Q.13/16 m15935 DMP via SC 29 Secretariat Liaison Statement from DMP m15936 Maria Teresa Andrade Contribution to the MXM reference software - the "DI access and edit" library Sinwook Lee m15937 Jeonghwan Ahn Euee S. Jang Source code for Interpolation Compression for MPEP-4 part 25 Alexandru Salomie Dan Cernea m15938 Adrian Munteanu Peter Schelkens Current status of MeshGrid compression software m15939 Florian Schreiner GNB comment on ISO/IEC23000-7 49 FPDAM1 m15940 Leonardo Chiariglione The vision for Reconfigurable Video Coding m15941 Leonardo Chiariglione The vision for the MPEG eXtensible Middleware m15942 Jens-Rainer Ohm GNB comment on ISO/IEC 144965 :2001/FPDAM 19 m15943 The Editors Editors' input on 23000-7 FPDAM1 50 Annex D – Output documents Number Source Title w10112 Convener List of Documents from the 86th Meeting in Busan, Rep. of Korea w10113 Convener Resolutions of the 86th Meeting in Busan, Rep. of Korea w10114 Convener List of AHGs Established at the 86th Meeting in Busan, Rep. of Korea w10115 Convener Report of the 86th Meeting in Busan, Rep. of Korea w10116 Convener Guidelines for Electronic Distribution of MPEG M and N Documents w10117 Convener Press Release of the 86th Meeting in Busan, Rep. of Korea w10118 Convener Meeting Notice of the 87th Meeting in Lausanne, Switzerland w10119 Convener Guide for WG 11 Meeting Hosts w10120 3DGC DOCR on ISO/IEC 14496-4:2004/FPDAM 32 (FAMC conformance) w10121 3DGC Text of ISO/IEC 14496-4:2004/FDAM 32 (FAMC Conformance) w10122 3DGC Text of ISO/IEC 14496-4:2004/PDAM 39 (Scene Partitioning Conformance) w10123 3DGC DOC on ISO/IEC 14496-5:2001/FPDAM 21 (FAMC Ref Soft) w10124 3DGC Text of ISO/IEC 14496-5:2001/FDAM 21 (FAMC Ref Soft) w10125 3DGC Text ISO/IEC 14496-5:2001/PDAM25 (Scene Partitioning Reference Software) w10126 3DGC Text of ISO/IEC 14496-16:2006/AMD1:2007/COR2 w10127 3DGC Text of WD3.0 of ISO/IEC 14496-16:2006/AMD4 (Scalable Complexity 3D Mesh Compression) w10128 3DGC CE on Scalable Complexity 3D Mesh Coding w10129 3DGC WD of AFX 3rd Edition w10130 Convener Liaison Statement to ISO TC 184/SC 4 w10131 Convener Liaison Statement to Mobile Convergence Solution Forum w10132 3DGC DoC on ISO/IEC FCD 14496-25 w10133 3DGC Text of ISO/IEC 14496-25 FDIS w10134 Convener AHG on 3DGC documents, software maintenance and core experiments w10135 Video Disposition of Comments on ISO/IEC 13818-2:2000/FPDAM 3 51 w10136 Video Text of ISO/IEC 13818-2:2000/FDAM 3 Level for 1080@50/60p w10137 Video Disposition of Comments on ISO/IEC 13818-4:2004/FPDAM 3 w10138 Video Text of ISO/IEC 13818-4:2004/FDAM 3 Level for 1080@50/60p Conformance Testing w10139 Video Disposition of Comments on ISO/IEC 14496-2:2004/FPDAM5 w10140 Video Text of ISO/IEC 14496-2:2004/FDAM5 Simple Studio Profile Levels 5 and 6 w10141 Video Disposition of Comments on ISO/IEC 14496-4:2004/FPDAM35 w10142 Video Text of ISO/IEC 14496-4:2004/FDAM35 Simple Studio Profile Levels 5 and 6 Conformance Testing w10143 Video Defect report on ISO/IEC 14496-4:2004 (three visual conformance streams) w10144 Video Request for ISO/IEC 14496-4:2004/Amd.38 w10145 Video Text of ISO/IEC 14496-4:2004/PDAM38 Multiview Video Coding Conformance Testing w10146 Video Text of ISO/IEC 14496-5:2001/FDAM 19 Reference Software for Scalable Video Coding w10147 Video Study Text of ISO/IEC 14496-5:2001/PDAM 15 Reference Software for Multiview Video Coding w10148 Video Disposition of Comments on ISO/IEC 14496-10:2008/DCOR 1 w10149 Video Text of ISO/IEC 14496-10:2008/COR 1 w10150 Video Text of ISO/IEC 14496-10:200X 5th Edition w10151 Video Request for ISO/IEC 14496-10:200X/Amd.1 w10152 Video Text of ISO/IEC 14496-10:2008/PDAM 1 Constrained Baseline Profile and supplemental enhancement information w10153 Video Disposition of Comments on ISO/IEC 15938-3:2001/FPDAM 3 w10154 Video Text of ISO/IEC 15938-3:2001/FDAM 3 Image Signature Tools w10155 Video Updated Call for Proposals on Video Signature Tools w10156 Video Request for ISO/IEC 15938-6:2003/Amd.3 w10157 Video Text of ISO/IEC 15938-6:2003/PDAM 3 Reference Software for Image Signature Tools w10158 Video Request for ISO/IEC 15938-7:2003/Amd.5 w10159 Video Text of ISO/IEC 15938-7:2003/PDAM 5 Conformance Testing for Image Signature Tools w10160 Video Request for ISO/IEC 15938-8:2002/Amd.5 w10161 Video Text of ISO/IEC 15938-8:2002/PDAM 5 Extraction and Matching 52 of Image Signature Tools w10162 Video Disposition of Comments on ISO/IEC 23000-3/FPDAM1 Reference Software for Photo Player MAF w10163 Video Text of ISO/IEC 23000-3/FDAM1 Reference Software for Photo Player MAF w10164 Video Working Draft 2 of ISO/IEC 23000-3/Amd.2 Conformance Testing for Photo Player MAF w10165 Video Study Text of ISO/IEC FCD 23001-4 Codec Configuration Representation w10166 Video Disposition of Comments on ISO/IEC 14496-5:2001/FPDAM 19 w10167 Convener Proposal for MXM Public License Version 1.0 w10168 Video Reconfigurable Video Coding - The Vision w10169 Video Study Text of ISO/IEC FCD 23002-4 Video Tool Library w10170 Video WD 3 of ISO/IEC 23002-4/Amd.1 (Conformance and Reference Software) w10171 Video WD 3 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-4 ASP, AVC HP and SVC) w10172 Video RVC Work Plan and FU Development Status w10173 Video Description of Exploration Experiments in 3D Video Coding w10174 Video Results of Workshop on New Directions in Video Coding w10175 Video Vision and Requirements for High-Performance Video Coding (HVC) w10176 Video Call for Test Materials for High-Performance Video Coding Standards Development w10177 Video Draft Call for Evidence on High-Performance Video Coding w10178 Convener Liaison Statement to SC 34 w10179 Convener Liaison Statement to IEC TC 100 on encoding guidelines w10180 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance w10181 Convener AHG on Reconfigurable Video Coding w10182 Convener AHG on MPEG-7 Visual w10183 Convener AHG on 3D Video and FTV Coding w10184 Convener AHG on High-Performance Video Coding w10185 3DGC Text of ISO/IEC 14496-11:2005/FDAM6 (Scene partitioning) w10186 Audio Study on ISO/IEC 13818-7:2006/DCOR 1, AAC CCE and 22.2 chn 53 w10187 Audio Request for Amendment, HD-AAC Profile w10188 Audio ISO/IEC 14496-3:2005/PDAM X:200X HD-AAC Profile w10189 Audio Study on ISO/IEC 14496-3:2005/DCOR 6, CCE w10190 Audio Study on ISO/IEC 14496-3:2005/AMD 2:2006/DCOR 4, HE-AAC V2 Profile and ALS w10191 Audio Study on ISO/IEC 14496-3:2005/AMD 3:2006/DCOR 2, SLS w10192 Audio Study on ISO/IEC 14496-3:2005/AMD 9:2008/DCOR 1, AACELD w10193 Audio WD on New Profile for ALS w10194 Audio Status, proposal and workplan regarding the 960 frame length in the MPEG-4 AAC family of profiles w10195 Audio Defect Report on Audio Conformance w10196 Audio DoC on ISO/IEC 14496-5:2001/PDAM 24, MPEG-4 AAC ELD w10197 Audio ISO/IEC 14496-5:2001/FPDAM 24, MPEG-4 AAC ELD w10198 Audio ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 3, ALS and SLS w10199 Audio WD of ISO/IEC 14496-26:200x, Audio Conformance w10200 Convener Terms of reference w10201 Convener MPEG Standards w10202 Convener Table of unpublished FDISs w10203 Convener Work plan and time line w10204 Convener Editors of MPEG standards w10205 Convener Schema assets updates w10206 Convener Software assets w10207 Convener Conformance assets w10208 Convener Content assets w10209 Convener URI assets w10210 Convener Standards under development for which a call for patent statements is issued w10211 Convener List of organisation with which MPEG is in liaison w10212 Audio DoC on ISO/IEC CD 23003-2:200x, Spatial Audio Object Coding w10213 Audio ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding w10214 Audio Status and Workplan on SAOC Core Experiments w10215 Audio WD on Unified Speech and Audio Coding w10217 Audio Draft Revisions to MPEG Audio CE methodology 54 w10218 Audio Exploration on metadata driven post processing of audio signals w10219 Convener Liaison response to AES (m15788) w10220 Convener Liaison response to ITU-T SG 16 (15920) w10221 Convener Liaison statement to IEC on IEC 100/1309/NP w10222 Convener Response to Chinese, Finnish and French NB (m15879) w10223 Convener AHG on MxM w10225 Convener Response to USNB (m15794) w10226 Convener AHG on Audio Standards Maintenance w10227 Convener AHG on SAOC, USAC w10228 Requirements Requirements for a new BIFS profile to support Interactive Digital Radio w10229 Convener Liaison to GRN on requirements to support the Interactive Digital Radio w10230 Convener Liaison to WorldDMB on requirements to support the Interactive Digital Radio w10231 Requirements Rich Media UI Framework Requirements w10232 Requirements Call for Proposal on Rich Media UI Framework w10233 Requirements MAF Overview w10234 Requirements MAF Overview Presentation w10235 Requirements Requirements for MPEG-V Version 3 w10236 Requirements MPEG-V Call for Proposals w10237 Requirements MPEG eXtensible Middleware - The Vision w10239 Convener AHG on Information Exchange with Virtual Worlds w10240 Systems ISO/IEC 13818-1:2007/Cor.2 w10241 Systems Request for ISO/IEC 13818-1:2007/Amd.4 w10242 Systems ISO/IEC 13818-1:2007/PDAM4 Transport of MVC w10243 Systems Request for ISO/IEC 14496-4 AMD 37 File Format Conformance Improvements w10244 Systems ISO/IEC 14496-4 PDAM 37 File Format Conformance Improvements w10245 Systems DoC on ISO/IEC 14496-5/FPDAM.14 Open Font Format Reference Software w10246 Systems ISO/IEC 14496-5/FDAM.14 Open Font Format Reference Software w10247 Systems ISO/IEC 14496-11/FDAM.6 Scene Partitioning 55 w10248 Systems DoC on ISO/IEC 14496-12/PDAM.1 Misc. Additions to FF w10249 Systems ISO/IEC 14496-12/FPDAM.1 Misc. Additions to FF w10250 Systems ISO/IEC 14496-12/COR.1 Corrigendum on Flute support w10251 Systems ISO/IEC 14496-12/DCOR.2 Usage of brands and box order in sample entry w10252 Systems Request for ISO/IEC 14496-15:2004 Amd 3 w10253 Systems ISO/IEC 14496-15:2004 PDAM 3 (MVC File Format) w10254 Systems Study Text of ISO/EC 14496-20 LASeR/PDAM2 (Adaptation) w10255 Systems Request for ISO/IEC 14496-20 LASeR Amd.3 (PSI) w10256 Systems ISO/EC 14496-20 LASeR/PDAM.3 (PSI) w10257 Systems WD1.0 of MPEG Query Format Conf. and Ref. Soft w10258 Systems Text of ISO/IEC 15938-12/DCOR.1 w10259 Systems WD 1.0 of ISO/IEC 21000-2:2005 AMD1 (PSI) w10260 Systems ISO/IEC 21000-7/Cor.1 w10261 Systems DoC on ISO/IEC 21000-8/FPDAM.1 Extra reference software for MPEG-21 w10262 Systems ISO/IEC 21000-8/FDAM1 Extra reference software for MPEG-21 w10263 Systems Request for ISO/IEC 21000-19 Media Value Chain Ontology w10264 Systems ISO/IEC CD 21000-19 Media Value Chain Ontology w10265 Systems Vision of Media Value Chain Ontology w10266 Systems DoC on ISO/IEC 23000-4/FPDAM.1 MSSAF Conf. & Soft w10267 Systems ISO/IEC 23000-4/FDAM.1 MSSAF Conf. & Soft w10268 Systems ISO/IEC 23000-4/FPDAM.2 Prot. MSSAF Conf. & Soft w10269 Systems ISO/IEC 23000-6 PA-AF/FDIS Professional Archival Application Format w10270 Systems Request for ISO/IEC 23000-6 PA-AF/AMD 1 Conformance and Reference Software w10271 Systems ISO/IEC 23000-6 PA-AF/PDAM 1 Conformance and Reference Software w10272 Systems Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference Software w10273 Systems DoC on ISO/IEC 23000-7:2008/FPDAM 1 OA-AF Conf. and Ref. Soft w10274 Systems ISO/IEC 23000-7:2008/FDAM 1 OA-AF Conf. and Ref. Soft w10275 Systems Study of ISO/IEC 23000-9/PDAM1 DMB AF Conf. And Ref. Soft. 56 w10276 Systems Workplan for ISO/IEC 23000-9 DMB AF Conf. And Ref. Soft. w10277 Systems WD 1.0 of ISO/IEC 23000-9/AMD2 DMB AF (Storage of MPEG-2 TS in ISO file format) w10278 Systems DoC of ISO/IEC FCD 23000-10 (Video Surveillance Application Format) w10279 Systems Text of ISO/IEC FDIS 23000-10 (Video Surveillance Application Format) w10280 Systems Study of ISO/IEC 23000-10 PDAM1 (Video Surveillance Application Format) Cof. & Ref. SW. w10281 Systems Future work on Surveillance AF's collection of requirement w10282 Systems DoC Text on ISO/IEC FCD 23000-11 (Stereoscopic Video Application Format) w10283 Systems ISO/IEC FDIS 23000-11 (Stereoscopic Video Application Format) w10284 Systems Referencing Explanatory Report on AMR and EVRC w10285 Systems Request for 23000-12 (Interactive Music Application Format) w10286 Systems WD 1.0 of ISO/IEC FDIS 23000-12 (Interactive Music Application Format) w10287 Systems Workplan for mini experiment on the constraints representation w10288 Systems DoC on ISO/IEC 23004-8/FCD Reference Software and Conformance w10289 Systems ISO/IEC FDIS 23004-8 Reference Software and Conformance w10290 Systems WD2.0 of MxM Architecture and Technologies w10291 Systems WD2.0 of MxM APIs w10292 Systems WD1.0 of MxM Ref. SW. and Conf. w10293 Systems WD1.0 of 2nd edition of ISO/IEC 29116-1 (MXM Protocols) w10294 Systems WD 2.0 of ROSE w10295 Systems TuC of ROSE w10296 Systems Context and Objectives of Rich Media UI Framework w10297 Convener Proposed joint project description for advanced IPTV Terminal w10298 Convener Liaison statement to ITU-T SG16 on IPTV w10300 Convener Liaison statement to Haptic ISO/TC159/SC4/WG9 w10301 Convener Liaison statement to WG1 on PA AF w10302 Convener Ad Hoc Group on Scene Representation w10303 Convener Ad Hoc Group on MPEG File Formats w10304 Convener AHG on Application Format 57 w10305 Convener AHG on the RoSE Framework w10306 Convener AHG on advanced IPTV w10307 Convener Liaison Letter to IEC TC 100 TA 4 on Interactive Music Player Application Format w10308 Convener Liaison statement to ETSI on requirements to support Interactive Digital Radio w10309 Convener Liaison statement to TC 100 on requirements to support Interactive Digital Radio w10310 Convener Liaison statement to TTA on requirements to support Interactive Digital Radio 58 Annex E – Requirements report Source: Jörn Ostermann (Leibniz Universität Hannover) 1 Requirements documents approved at this meeting No. 10167 10228 10229 10230 10231 10232 10233 10234 10235 10236 10237 10238 10239 10155 10296 2 Title Proposal for MXM Public License Version 1.0 Requirements for a new BIFS profile to support Interactive Digital Radio Liaison to GRN on new BIFS profile Liaison to WorldDMB on new BIFS profile Rich Media UI Framework Requirements Call for Proposal on Rich Media UI Framework MAF Overview MAF Overview Presentation Requirements for MPEG-V Version 3 MPEG-V Call for Proposals MPEG eXtensible Middleware - The Vision Reconfigurable Video Coding - The Vision AHG on Information Exchange with Virtual Worlds Updated Call for Proposals on Video Signature Tools Context and Objectives of Rich Media UI Framework MPEG-V: Information exchange with virtual worlds The following responses to the Extended Call for requirements N10105 have been received as contributions to the 86th MPEG meeting: m15902 Additional Requirements for MPEG-V m15917 Additional Requirements for MPEG-V II These contribution extend and clarify the requirements as well as extend the requirements in the area of Audio. The architecture for MPEG-V has been further developed ( Figure 1). It appears that MPEG-V as well as Rose can fit into one architecture ( Figure 2). A new version of the requirements document (N10235) and a call for proposals (N10236) was issued. An adhoc group (N10239) prepares the evaluation. At the moment, we foresee four parts for MPEG-V. Architecture, Data Representations between Virtual Worlds and the Real World, Data Representations between Virtual Worlds, and Real World Data Representation. Rose is currently working on data representations between virtual worlds and the real world. 59 MPEG-V Architecture Standardisation Area 2: Data representations between virtual worlds Digital Content Provider (Virtual World, (serious) game, simulator, DVD, …) Virtu al Worl d Data Repr esen tatio nR Us er Int er act ion Enriched content Virtual World N Adaptation RV/VR Adaptation RV Adaptation VR S S forAMPEG-V A Figure 1 Architecture Device Commands Real Real World World Digital Content Provider Dev2 Dev1 Real World Dev3 (Virtual World, (serious) game, simulator, DVD, …) Standardisation Area 1: Data representations between virtual worlds and the real world Adaptation RV Standardisation Area 3: Real World Data Representation Areas 1, 2 & 3 are targets of MPEGV standardisation Adaptation VR Senso Actuato rReal World r Device N User Sensory Preferences Sensory Effect Metadata RoS E SE Adaptation VR/RV Virtual World Data Representation V 2 Provider 1 RoSE Engine Consumer Device(s) 3 4 SE RoSE Engine (i.e. Adaptation) SDC & USP SDC Consumer 1 Sensory Effect Delivery Format 2 User Preferences Delivery Format 3 Sensory Device Capability Delivery Format 4 Sensory Device Command Delivery Format Figure 2 Mapping of Rose onto the MPEG-V Architecture Device(s) 3 Sensory Device Commands Sensory Device Capabilities Scope of standarization (Normative) Not in the scope of standarization (Informative) MAF 3.1 Interactive Music Application Format MAF (IM AF) A MAF supporting playback of multiple audio streams was requested at the 84th meeting. Compared to the music player MAF, additional streams have to play synchronously. A document reviewing the requirements and 2 documents on the business model of interactive music players were proposed. 60 m15846 Marketing & Business status of Interactive Music Service m15878 iKlax - IM AF Business & market status m15813 Comments on IMAF draft CfP and MAF Overview m15901 Comments on MAF overview It has been confirmed that no new coding technology has to be developed in order to fulfil the available requirements. Therefore, no call for proposals will be issued. A WD is to be developed. The MAF Overview document (N10233/N10234) has been updated with the requirements for this MAF. This includes an extended list of supported audio coding technologies. 3.2 m15816 Professional Archival Appilcation Format (PA AF) Proposed update on MAFs Ovierview for PA-AF The section on PA AF is updated in the MAF Overview (N10233/N10234) and moved to the sections on MAF already specified. 3.3 Miscellaneous The MAF under consideration section is now empty due to lack of input to Advanced Surveillance AF and Cross Media Interactive Presentation AF. The Stereoskopic Video AF is made extensible. 4 MPEG eXtensible Middleware (MXM) In response to the CfP (N10107) for MXM and associated Requirements (N10106), one proposal supported by several companies has been received. Furthermore, a proposal for an Open Source License for MXM was submitted: m15810 Systems Response to Call for Proposals on Additional MXM Technologies m15808 Proposal for MXM Public License Version 1.0 As a result of the evaluation of the responses to the call of this meeting and of last meeting, MPEG has now technology suitable to satisfy all requirements for MxM. 61 Figure 3 Scope of MxM standardization Since MxM shall be made an open source project, a license is required. The proposal for an Public License (m15808) is sent as an output document N10167 to National Bodies for comments. Document N10237 explains the vision of MxM and its goals. The need for the second call delayed the MxM project which is now 3 months behind schedule. 5 Reconfigurable Video Coding The vision is presented in N10238. 6 Video Signature Tools An Updated Call for Proposals on Video Signature Tools (N10155) with clarified performance measures was issued. 7 Lossless Audio Coding Several requests for standardizing a profile for lossless audio coding were made by different industries at the 85th meeting. Work on the profile for ALS which was requested by ARIB (Association of Radio Industries and Business) was put on hold due to lack of industrial support. MPEG-4 / AVC A Proposed New Profile and Level on MPEG-4 Part 10 AVC|H.264 for Video Telephony Applications m15854 M15854 evaluates the coding efficiency of different tools within the base line profile of AVC. No need for a new profile was identified. 8 Explorations 8.1 Exploration on MPEG User Interface Framework As user interfaces (UI) become more divers and more plentiful, MPEG would like to explore currently available UI technology and investigate what is still missing in order to make MPEG technology more usable in modern user interfaces considering requirements like description language for UI specification, personalization, UI exchange between devices and UI aggregation. This exploration was described in N9895 at the 85th meeting. Additional requirements were received at this meeting: m15915 On MPEG Rich-Media UI Framework Data Source The requirements document was updated and published as N10231. Since the requirements and architecture are now in a mature stage, a call for proposals was issued (N10232). Context and Objectives are documented in N10296. 8.2 Interactive Radio Requirements for Interactive Radio as captured in N10228 are supported by several liaison letters received by MPEG. The current plan includes issuing a Call for Proposals at the 87th 62 meeting with responses to be received by the 88th meeting. Liaison letters to WorldDMB (N10230) and GRN (N10229) were prepared. 8.3 High Performance Video Coding The workshop on "New Challenges in Video Coding Standardization" draw a large audience. One contribution showed gains in coding efficiency of about 30% for HDTV video. m15864 Vision and Requirements for High-Performance Video Coding (HVC) Codec Within the workshop, M15864 was presented. As a conclusion of the workshop and further discussion, MPEG is planning to start a new standardization project in case the current evidence for coding efficiency gains gets further support. As a first step, a call for high quality test material (N10176) and a draft call for evidence on high performance video coding (N10177) were issued. Draft requirements are captured in Vision and Requirements for HighPerformance Video Coding (HVC) (N10175). 63 Annex F – Systems report Source: Title: Status: Editor: Systems Chair and Break-out group Chairs Systems Meeting Report Draft Olivier Avaro (Streamezzo) Contributors: David Singer (Apple), Young-Kwon Lim (Net&TV), Gero Baese (Siemens), Jaieme Delgado (UPC), Christian Timmerer (University of Klagenfurt) 1 Overview The main outputs of the meeting from the Systems Sub-group perspective are: No. X 10240 10241 10242 X 10243 10244 X 10245 10246 X 10247 X 10248 10249 10250 10251 X 10252 10253 X 10254 10255 10256 X 10257 X 10258 X 10259 X 10260 X 10261 10262 X 10263 10264 10265 X 10266 10267 10268 X 10269 10270 Title 13818-1 MPEG-2 Systems ISO/IEC 13818-1:2007/Cor.2 Request for ISO/IEC 13818-1:2007/Amd.4 ISO/IEC 13818-1:2007/PDAM4 Transport of MVC 14496-4 Conformance Request for ISO/IEC 14496-4 AMD 37 File Format Conformance Improvements ISO/IEC 14496-4 PDAM 37 File Format Conformance Improvements 14496-5 Reference Software DoC on ISO/IEC 14496-5/FPDAM.14 Open Font Format Reference Software ISO/IEC 14496-5/FDAM.14 Open Font Format Reference Software 14496-11 Scene Description and Application Engine ISO/IEC 14496-11/FDAM.6 Scene Partitioning 14496-12 ISO File Format DoC on ISO/IEC 14496-12/PDAM.1 Misc. Addition to FF ISO/IEC 14496-12/FPDAM.1 Misc. Addition to FF ISO/IEC 14496-12/COR.1 Corrigendum on Flute support ISO/IEC 14496-12/DCOR.2 Usage of brands and box order in sample entry 14496-15 AVC File Format Request for ISO/IEC 14496-15:2004 Amd 3 ISO/IEC 14496-15:2004 PDAM 3 (MVC File Format) 14496-20 LASeR Study Text of ISO/EC 14496-20 LASeR/PDAM2 (Adaptation) Request for ISO/IEC 14496-20 LASeR Amd.3 (PSI) ISO/EC 14496-20 LASeR/PDAM.3 (PSI) 15938-7 Conformance WD1.0 of MPEG Query Format Conf. and Ref. Soft 15938-12 MPEG Query Format Text of ISO/IEC 15938-12/DCOR.1 21000-2 Digital Item Declaration WD 1.0 of ISO/IEC 21000-2:2005 AMD1 (PSI) 21000-7 Digital Item Adaptation ISO/IEC 21000-7/Cor.1 21000-8 Reference Software DoC on ISO/IEC 21000-8/FPDAM.1 Extra reference software for MPEG-21 ISO/IEC 21000-8/FDAM1 Extra reference software for MPEG-21 21000-19 Media Value Chain Ontology Request for ISO/IEC 21000-19 Media Value Chain Ontology CD 1.0 of ISO/IEC 21000-19 Media Value Chain Ontology Vision of Media Value Chain Ontology 23000-4 Protected MSS Application Format DoC on ISO/IEC 23000-4/FPDAM.1 MSSAF Conf. & Soft ISO/IEC 23000-4/FDAM.1 MSSAF Conf. & Soft ISO/IEC 23000-4/FPDAM.2 Prot. MSSAF Conf. & Soft 23000-6 Professional Archival Application Format ISO/IEC 23000-6 PA-AF/FDIS Professional Archival Application Format Request for ISO/IEC 23000-6 PA-AF/AMD 1 Conformance and Reference Software 64 TBP Available No No No 08/10/17 08/10/17 08/10/17 No No 08/10/17 08/10/17 No No 08/10/17 08/10/17 No 08/10/17 No No No No 08/10/17 08/10/31 08/10/17 08/10/31 No No 08/10/17 08/10/17 No No No 08/10/31 08/10/17 08/10/31 No 08/10/17 No 08/10/17 No 08/10/31 No 08/10/17 No No 08/10/17 08/10/17 No No No 08/10/17 08/10/17 08/10/17 No No No 08/10/17 08/11/14 08/10/17 Yes No 08/10/17 08/10/17 10271 10272 X 10273 10274 X 10275 10276 10277 X 10278 10279 10280 10281 X 10282 10283 10284 X 10285 10286 10287 X 10288 10289 X 10290 10291 10292 X 10293 X 10294 10295 X 10296 10297 X 10205 10209 X 10298 10299 10300 10301 10307 2 ISO/IEC 23000-6 PA-AF/PDAM 1 Conformance and Reference Software Workplan for ISO/IEC 23000-6 PA-AF Conformance and Reference Software 23000-7 Open Access Application Format DoC on ISO/IEC 23000-7 OA-AF/FPDAM OA-AF Conf. And Ref. Soft ISO/IEC 23000-7 OA-AF/FDAM OA-AF Conf. And Ref. Soft 23000-9 Digital Multimedia Broadcasting Application Format Study of ISO/IEC 23000-9/PDAM1 DMB AF Conf. And Ref. Soft. Workplan for ISO/IEC 23000-9 DMB AF Conf. And Ref. Soft. WD 1.0 of ISO/IEC 23000-9/AMD2 DMB AF (Storage of MPEG-2 TS in ISO file format) 23000-10 Video Surveillance Application Format DoC of ISO/IEC FCD 23000-10 (Video Surveillance Application Format) Text of ISO/IEC FDIS 23000-10 (Video Surveillance Application Format) Study of ISO/IEC 23000-10 PDAM1 (Video Surveillance Application Format) Cof. & Ref. SW. Future work on Surveillance AF’s collection of requirement 23000-11 Stereoscopic Video Application Format DoC Text on ISO/IEC FCD 23000-11 (Stereoscopic Video Application Format) ISO/IEC FDIS 23000-11 (Stereoscopic Video Application Format) Referencing Explanatory Report on AMR and EVRC 23000-12 Interactive Music Application Format Request for 23000-12 (Interactive Music Application Format) WD 1.0 of ISO/IEC FDIS 23000-12 (Interactive Music Application Format) Workplan for mini experiment on the constraints representation 23004-8 M3W Reference Software DoC on ISO/IEC 23004-8/FCD Reference Software and Conformance ISO/IEC FDIS 23004-8 Reference Software and Conformance MPEG-M – MPEG extensible Middleware WD2.0 of MxM Architecture and Technologies WD2.0 of MxM APIs WD1.0 of MxM Ref. SW. and Conf. Supplemental Media Technologies WD1.0 of 2nd edition of ISO/IEC 29116-1 (MXM Protocols) Project Started – Representation of Sensory Experience WD 2.0 of ROSE TuC of ROSE Exploration Context and Objectives of Rich Media UI Framework Proposed joint project description for advanced IPTV Terminal Assets and Standing Documents MPEG Schema Assets Updates MPEG URIs and MIME Types Liaison Liaison statement to ITU-T SG16 on IPTV Liaison statement to SGSN Liaison statement to Haptic Liaison statement to WG1 on PA AF Liaison statement to TC100 Yes Yes 08/10/17 08/10/17 No No 08/10/17 08/10/17 No No No 08/10/17 08/10/17 08/10/17 No No No 08/10/31 08/10/31 08/10/17 No 08/10/17 No No No 08/10/17 08/10/31 08/10/31 No No No 08/10/17 08/10/17 08/10/17 No No 08/10/17 08/10/17 No No No 08/10/24 08/10/31 08/10/17 No 08/10/24 Yes Yes 08/10/17 08/10/17 No No 08/10/17 08/10/17 No No 08/10/17 08/10/17 No No No No No 08/10/17 08/10/17 08/10/17 08/10/17 08/10/17 General issues 2.1 General The meeting report from Antalya has been approved. The following demonstrations have been made: None. 2.2 List of standards under development Pr Pt Edit. Project Description 2 1 2006 Cor.2 Transport of AVC 2 1 2006 Amd.4 Transport of MVC 4 1 200x Amd.4 Registration Authority 65 CfP WD CD 08/04 08/10 07/10 FCD 09/04 09/01 FDIS 08/10 09/10 09/07 4 4 4 5 4 5 4 5 4 5 4 4 4 4 4 4 4 21 21 11 12 12 15 20 20 22 12 12 7 8 21 19 A 4 A 4 A A 5 6 A 7 A 8 A 9 A 10 A 10 A 11 A 11 B 2 E 8 X - 7 7 2008 Amd.37 File Format Conf. 2007 Amd.14 Open Font Format Ref. Soft 2007 Amd.xx AVC File Format Ref. Soft 2007 Amd.xx SVC File Format Ref. Soft 2007 Amd.23 Synth. Texture Ref. Soft 2005 Amd.6 Scene Partitioning 200x Amd.1 Misc. Addition to FF 200x Cor.1 Cor. On Flute 200x Amd.3 MVC File Format 2008 Amd.2 Scene Adaptation 2008 Amd.3 PSI 2008 2nd Ed. Open Font Format 200x Cor.1 MPQF Corrigendum 200x Amd.1 MPQF Ref. Soft 200x Cor.1 DIA Cor. 200x Amd.1 Minor Enhance. Ref. Soft 200x 1st Ed. Media Value Chain Onto. 200x Amd.1 MSS AF Conf. and Soft 200x Amd.2 Prot. MSSAF Conf. & Soft 200x 2nd Ed. MS AF 200x 1st Ed. Professional Archival AF 200x Amd.1 OA AF Ref. Soft and Conf. 200x Amd.1 PVP AF Soft. And Conf. 200x Amd.1 DMB AF Soft. And Conf. 200x 1st Ed. Video Surveillance AF 200x Amd.1 Video Surveillance AF 200x 1st Ed. Stereoscopic Video AF 200x 1st Ed. SVAF Ref. Soft. And Conf. 200x Amd.1 FRU Ref. Soft. And Conf. 200x 1st Ed. Ref. Soft. and Conformance Rep. of Sens. Exp. 66 08/04 08/10 07/10 07/10 09/02 08/04 09/07 08/10 08/04 09/01 09/07 08/01 08/04 08/04 08/04 08/10 08/07 08/07 08/10 08/01 08/10 08/10 09/01 08/04 07/10 08/04 08/10 08/04 08/10 09/04 08/10 09/07 09/07 09/07 09/01 09/10 09/10 08/10 08/10 08/07 08/10 09/02 09/07 07/07 07/10 08/04 08/10 08/04 08/10 09/04 08/01 08/10 07/10 08/01 09/02 08/04 09/07 08/10 08/01 08/04 08/10 08/07 09/01 09/07 07/04 07/07 08/01 08/10 07/04 08/01 08/04 08/10 08/07 08/10 09/04 09/07 07/01 07/07 08/04 08/10 08/07 08/10 08/02 09/07 TBS TBS 09/02 09/01 09/02 08/07 09/04 09/04 X - 2.3 - - MxM 08/07 08/10 08/02 09/07 Standing Documents Pr Pt Documents 1 1 MPEG-1 White Paper – Multiplex Format 1 1 MPEG-1 White Paper – Terminal Architecture 1 1 MPEG-1 White Paper – Multiplexing and Synchronization 2 1 MPEG-2 White Paper – Multiplex Format 2 1 MPEG-2 White Paper – Terminal Architecture 2 1 MPEG-2 White Paper – Multiplexing and Synchronization 2 11 MPEG-2 White Paper – MPEG-2 IPMP 4 1 MPEG-4 White Paper – MPEG-4 Systems 4 1 MPEG-4 White Paper – Terminal Architecture No. Meeting N7675 05/07 Nice N7676 05/07 Nice N7677 05/07 Nice N7678 05/07 Nice N7679 05/07 Nice N7680 05/07 Nice 05/07 Poznan 05/07 Poznan 05/10 Nice 1 1 6 11 12 14 15 MPEG-4 White Paper – M4MuX MPEG-4 White Paper – OCI MPEG-4 White Paper – DMIF MPEG-4 White Paper – BIFS MPEG-4 White Paper – ISO File Format MPEG-4 White Paper – MP4 File Format MPEG-4 White Paper – AVC FF N7503 N7504 N7610 N7921 N8148 N8149 N7608 N8150 N7923 N7924 13 13 17 18 20 White Paper on MPEG-4 IPMP MPEG IPMP Extensions Overview White Paper on Streaming Text White Paper on Font Compression and Streaming Presentation Material on LASER N7505 N6338 N7515 N7508 N6969 20 22 1 1 White Paper on LASeR White Paper on Open Font Format MPEG-7 White Paper - MPEG-7 Systems MPEG-7 White Paper – Terminal Architecture N7507 N7519 N7509 N8151 05/07 Poznan 04/03 München 05/07 Poznan 05/07 Poznan 05/01 HongKong 05/07 Poznan 05/07 Poznan 05/07 Poznan 06/04 Montreux E 9 X X X X X N7925 N9421 N9840 N9841 N7922 N6335 06/01 Bangkok 07/10 Shenzhen 08/04 Archamps 08/04 Archamps 06/01 Bangkok 04/03 München E X MPEG-21 White Paper – MPEG-21 File Format MPEG Application Format Overview MAF Overview Document MAF Overview Presentation MPEG-B White Paper – BinXML MPEG Multimedia Middleware Context and Objectives 1rst M3W White paper 4 4 4 4 4 4 4 4 4 4 4 4 4 4 7 7 21 A A A B 67 06/01 Bangkok 06/04 Montreux 06/04 Montreux 05/10 Nice 06/04 Montreux 06/01 Bangkok 06/01 Bangkok N7510 05/07 Poznan E X 2nd M3W White Paper : Architecture E X X Tutorial on M3W M3W White Paper : Multimedia Middleware Architecture M3W White Paper : Multimedia API M3W White Paper : Component Model M3W White Paper : Resource and Quality Management M3W White Paper : Component Download M3W White Paper : Fault Management M3W White Paper : System Integrity Management E E E E E E E 2.4 Topic General Systems List BiM File Format LASeR X X X X X X N8152 06/04 Montreux N8153 06/04 Monreux N8687 06/10 Hanzhou N8688 06/10 Hanzhou N8689 06/10 Hanzhou N8690 06/10 Hanzhou N8691 06/10 Hanzhou N8692 06/10 Hanzhou N8693 06/10 Hanzhou Mailing Lists Reminder Information Liste Reflector : [email protected] List-Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/gen-sys mailto:[email protected]?subject=subscribe List-Archive: http://lists.uni-klu.ac.at/pipermail/gen-sys List-Help: mailto:[email protected]?subject=help Liste Reflector : [email protected] List-Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mpeg7-sys mailto:[email protected]?subject=subscribe List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg7-sys List-Help: mailto:[email protected]?subject=help Liste Reflector : [email protected] List-Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mp4-sys mailto:[email protected]?subject=subscribe List-Archive: http://lists.uni-klu.ac.at/pipermail/mp4-sys List-Help: mailto:[email protected]?subject=help Liste Reflector : [email protected] List-Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/mpeg-laser mailto:[email protected]?subject=subscribe List-Archive: http://lists.uni-klu.ac.at/pipermail/mpeg-laser 68 Kindly Managed by University of Klagenfurt University of Klagenfurt University of Klagenfurt University of Klagenfurt List-Help: mailto:[email protected]?subject=help Liste Reflector : [email protected] List-Subscribe: http://lists.uni-klu.ac.at/mailman/listinfo/maf-sys mailto:[email protected]?subject=subscribe MAF List-Archive: http://lists.uni-klu.ac.at/pipermail/maf-sys List-Help: mailto:[email protected]?subject=help #1: Please subscribe via http://lists.uniklu.ac.at/mailman/listinfo/isoff-transport. Please use only that email address for posting messages with which you're MPEG-2 subscribed. Otherwise the email won't be delivered. #2: The email address for posting messages is: isoffon File Format [email protected] #3: The archive is accessible via http://lists.uniklu.ac.at/mailman/private/isoff-transport/ for list members only. University of Klagenfurt University of Klagenfurt 2.5 FAQ The FAQ were updated as needed. 2.6 AOB None. 3 MPEG-2 Systems (13818-1) 3.1 General 3.2 13818-1:2007 DCOR.2 3.2.1 Topics 1. Corrigendum on the carriage of AVC 3.2.2 Contributions M15739 There was no comments for NBs but editors found some typos. Cor. will be produced with correction of typos. 3.3 13818-1:2007 AMD4 3.3.1 Topics 1. Carriage of MVC 69 3.3.2 Contributions M15869 Proposal for the carriage of MVC based on the architecture of carriage of SVC. Questions raised from the floor are: This contribution requires changes of definitions of SVC extensions and it might cause confusion to the readers. It is questioned wether this proposal allows the use of same base layer for both SVC and MVC enhancement layers. 4 4.1 MPEG-4 Conformance (14496-4) 14496-4 Amd.37 File Format Conformance 4.1.1 Topics 1. File Format Conformance None. Technical Work in Progress. 5 5.1 MPEG-4 Reference Software (14496-5) 14496-5 Amd.14 5.1.1 Topics 1. Open Font Format Reference Software 5.1.2 Contributions M15760 Ballot results. Dispositions are documented in N10245 Technical Work In Progress. 5.2 14496-5 Amd.23 5.2.1 Topics 1. Synthesized Texture Reference Software 5.2.2 None. Contributions Technical Work In Progress. 70 6 6.1 MPEG-4 Scene Presentation (14496-11) 14496-11/Amd.6 6.1.1 Topics 1. Scene Partitionning 6.1.2 Contributions M15762 Ballot results. No comments are received. Technical Work In Progress. 7 7.1 MPEG-4 ISO Base File Format (14496-12) 14496-12 AMD1, Cor1 & Cor2 7.1.1 Topics 1. 2. Corrigendum Items Miscellaneous Addtions 7.1.2 Contributions m15742 Summary of Voting on ISO/IEC 14496-12:200X/DCOR 1 [SC 29 N 9685] All approved, thank you. m15743 Summary of Voting on ISO/IEC 14496-12:200X/PDAM 1 [SC 29 N 9687] thank you. some of these comments were supported by contributions (below). m15814 Proposal to clarify the scope of the brands "isom" and "iso2" Yes, you are right. Brands isom, iso2, avc1, and mp71 are effectively defined in 6.3 and Annex E. We should move the definitions in 6.3 into Annex E, with a forward pointer. We should also remove the text “this amended version” as it is (at best) ambiguous. Editors to include in a new DCOR. m15815 Comment on the change of the 'ctts' box It’s true that using signed offsets would break compatibility (hence the change to version number). We should make it clear that you should use signed offsets (version 1) only if absolutely needed, for maximum compatibility, and use unsigned offsets and edit lists if possible. It should also be clear that the new ctts box is only under the scope of a new iso4 (?) brand, so that readers get advance warning. There should also be text in the annex on using the file format, discussing this question. m15819 An extension to ISO base media file format This is a nice problem, thank you. We could use track references, of course, perhaps one way (‘pick a track as the root for one source’) or bi-directional. Bi-directional becomes unmanageable, of course, if there are many tracks per source. We would need a crisp definition of ‘the same source’ no matter what we do. Or perhaps not (the writing application can choose, it can be application specific). 71 We are going to try ‘csrc’ (common source) track references, and say that tracks coming from a common source should have at least a single track reference from each track except one, to a ‘root’ track for each source, and that there may be more track references (e.g. to create a full mesh). m15842 Improved file format support for SRTP reception Thank you for the detailed edits. These changes are worth incorporating. Perhaps even if CSRC, SSRC etc. are not always needed ‘at the root of the definitions’, it makes the specification text cleaner. m15925 ISOFF compatibility issue You are right. We should say that the extension boxes (pasp, clap etc.) defined in part 12 should FOLLOW any boxes required by derived specs, not precede them. We should also suggest that readers cope with any box order. This and 15814 should be clarified in a new DCOR. m15812 Editor's draft of the Part12 file format amendment Thank you. We agree with the suggestions. Many comments have already been addressed, or are addressed by contributions to this meeting. Technical Work In Progress. 8 8.1 MPEG-4 AVC Base File Format (14496-15) 14496-15:2004/AMD.3 MVC FF 8.1.1 Topics 1. MVC File Format Extensions 8.1.2 Contributions m15841 Enhancements to the MVC File Format There are a number of proposals here. The content view priority could be useful as long as it is seen as (in some sense) a sub-priority of the view priority (as one cannot thin views in an order that doesn’t respect dependency). The usual anxieties about placing material in the movie box come up for the global information (but see below). On content view priority: this seems useful as long as the relationship to decoding view priority is made clear (as above). On local, global view information: this seems useful and we accept it. The global information should probably be in the multi-view group box (which may be moving from the movie level). On the optimization of the multiview relationships: There is a gain here (space saving), but also a pain (having to follow the reference when reading). Is it worth it? Do we need to set this up more like sample groups, where there is a bag of ‘definitions’ which the views can then refer to (rather than referring to each other)? (We are not going to design this during the meeting). We insert an editor’s note pointing out the issue and asking for further comment. 72 m15862 On MVC file format These seem like a distinct improvement, and trying the minf box will surely elicit comments on the PDAM if there are problems. m15874 On MVC File Format The contribution expresses concern that some simple descriptions may involve a lot of structure (sample groups, and so on). However, it does seem to overlap with existing solutions, and we are not totally happy about that. It’s also not clear what a file author should write if he has no particular display in mind: what constitutes an ‘associated view’? Perhaps if we are indicating suitable stereo views (only) to have a view information box that details which views make suitable stereo pairs? Do we need view disparity for non-adjacent views? We agree on adding the view_ids to the camera parameter boxes. In general, we should inspect the PDAM to see: are simple things simple, and complicated things possible? There are almost certainly some simple things that are complicated to do at the moment, so the thrust of this proposal (that there should be simple ways to do simple things) is exactly correct. We put the view association box into the multiview group container box for now, but fully expect comments on the PDAM on the overlap in functionality. Technical Work in Progress. 9 9.1 MPEG-7 15938-12 MPEG Query Format 9.1.1 Topics 1. 2. Corrigendum Conformance and Reference Software 9.1.2 Contributions M15192 This contribution describes several errors need to be fixed with proposed solutions. This contribution will be used as a base document for DCOR. M15872 Reference Software for MPEG Query Format Validator M15871 Reference Software for MPEG Query Format Parser Framework 10 LASeR (14496-20) 10.1 14496-20/Amd.2 10.1.1 Topics 1. Adaptation technologies 73 10.1.2 Contributions M15791 has been reviewed during the Torino AHG meeting (m15732). Results are accommodated in the Study of CD (N10254) M15889 and M15890 proposed answers to the open questions in the CD. Results are accommodated in the Study of CD (N10254) M15931 and M15891 proposed additional technologies for the adaptation. Results are accommodated in the Study of CD (N10254) 10.2 14496-20/Amd.3 10.2.1 Topics 1. PSI 10.2.2 Contributions M15792 has been reviewed during the Torino AHG meeting (m15732). Results are accommodated in the CD (N10256) M15790 proposed additional technologies for PSI. Results are accommodated in the CD (n10256) M15853 proposed technology for MPEG-21 DI can embed richmedia presentation. Decided to initiate new amendment to MPEG-21 DI. (WD) Technical Work in Progress. 11 Open Font Format (14496-22) 11.1 14496-22/Amd.1 11.1.1 Topics 1. Open Font Format Extension 11.1.2 None. Contributions Technical Work in Progress. 12 12.1 21000 MPEG-21 21000-7 DIA 12.1.1 Topics 1. Corrigendum 12.1.2 M15746 Ballot results. No comments received. 74 Contributions Technical Work In Progress. 12.2 21000-8 Reference Software 12.2.1 Topics 1. MPEG-21 Reference Software 12.2.2 Contributions M15764 Ballot results. Dispositions are contained in the output document N10261. M15835 Proposed modifications are incorporated in the output document N10262. Technical Work In Progress. 12.3 21000-19 Media Value Chain Ontology 12.3.1 Topics 1. Media Value Chain Ontology 12.3.2 Contributions M15858 Proposed modifications are incorporated in the CD. Technical Work In Progress. 13 MPEG-A MAF (23000) 13.1 23000-4 Musical Slide Show AF 13.1.1 Topics 1. Media Streaming MAF 13.1.2 Contributions m15747: Summary of Voting on ISO/IEC 23000-4:200X/PDAM 2 [SC 29 N9694] m15767: Summary of Voting on ISO/IEC 23000-4:200X/FPDAM 1 Technical Work in Progress. 13.2 23000-5 Media Streaming MA 13.2.1 Topics 2. Media Streaming MAF 13.2.2 None. Contributions Technical Work in Progress. 75 13.3 23000-6 Professional Archival AF 13.3.1 Topics 1. Professional AF 13.3.2 Contributions M15776: Summary of Voting on ISO/IEC FCD 23000-6 M15838: Editors' update to WD 1.0 of ISO/IEC 23000-6/Amd.1 PA-AF Conformance & Reference Software Technical Work in Progress. 13.4 23000-7 Open Access Application Format 13.4.1 Topics 1. Open Access Application Format 13.4.2 Contributions m15777: Summary of Voting on ISO/IEC 23000-7:200X/FPDAM 1 Technical Work in Progress. 13.5 23000-9 DMB Application Format 13.5.1 Topics 1. DMB Application Format 13.5.2 Contributions M15896: Conformance files contribution for ISO/IEC 23000-9 (DMB-AF) M15897: Updated text and reference SW for ISO/IEC 23000-9 (DMB-AF) m15898: New amendment proposal for alignment to MPEG-2 TS storage in ISO base media file format. M1589 Technical Work in Progress. 13.6 23000-10 Video Surveillance MAF 13.6.1 Topics 1. Video Surveillance MAF 1st Edition 13.6.2 None. Contributions Technical Work in Progress. 76 13.7 23000-11 Stereoscopic Video AF 13.7.1 Topics 1. Stereoscopic Video AF 13.7.2 Contributions m15780: Summary of Voting on ISO/IEC FCD 23000-11, which shows one disapproval with comments from USNB. The comments tell the editorial issues. m15913: Proposed text of ISO/IEC 23000-11 FDIS Stereoscopic Video Application Format Technical Work in Progress. 13.8 23000-12 Interactive Music AF 13.8.1 Topics 1. Interactive Music AF 13.8.2 Contributions M15878 This contribution claims that there is strong market needs to have this AF quickly. Special attention on the “control” of interactive playback because it may result undesirable user experience. The contributor understands that the current requirements already capture this properly. M15846 This contribution presents current business cases in Korea. M15901 This contribution proposes to add additional audio coding technologies such as MP3, SAOC, and WAV. M15813 Comments to current Issues of “mixing”. Do we need to develop new technology for this? Normal mixing process is multiplying gain to each track and add up them all. So, we only need a description format to represent “constraints.” 14 MPEG-E Multimedia Middleware (23004) 14.1 Multimedia Middleware 14.1.1 Topics 1. Reference Software 14.1.2 Contributions M15765 Summary of Voting on FCD. Comments on small errors, which are all accepted. Technical Work in Progress. 77 15 Project Started 15.1 Representation of Sensory Effects 15.1.1 Topics 1. Representation of Sensory Effects 15.1.2 Contributions Disposition about the core experiment results (m15906, m15797, m15783, m15907, m15909) are as follows: Participant Evaluation results provided Demonstration Result of Working Draft *) planed 2.0 during AhG meeting ETRI The proposal has been evaluated ‘Declaration and using simple simulation software. reference’ structure is As quantitative evaluation result, agreed to be part of they proposed expressiveness and WD2.0 of SEM. compactness. Expressiveness is Some attributes proposed measured as percentage of by ETRI are agreed to be successful description in M.3 part of WD2.0 such as over the given effect in M.2. Alternate effect URI, Compactness is the size of adaptation information instance and the size per effect. and priority. As qualitative evaluation result, they provided description efficiency, delivery complexity, and processing complexity. Myongji/ETR The proposal has been evaluated Parameter for preparing I using evaluation system using color correction is agreed simulation software. They to be part of WD2.0. provided compactness as evaluation result but the result was different from UNIKLU. They proposed some clear definition on ‘activation’ and ‘duration’. Philips/amB N/A ☐ X Sharp The proposal has been evaluated Adaptation attributes using evaluation system including group is agreed to be part software and lighting devices. of WD2.0. They provided evaluation result on the color temperature. UNIKLU The proposal has been evaluated The basic building block using evaluation system including including light, fan, vibration, scent, etc. GroupOfEffects and They provided quantitative SingleEffect in WD1.0 evaluation result on the was modified to include compactness represented as size declaration, parameter, 78 of description. They also provide qualitative result in the aspect of authoring complexity, delivery complexity and processing complexity. and reference. The element name ‘SingleEffect’ is changed to ‘Effect’. M15801 Study text is incorporated in the new WD. Technical Work in Progress. 15.2 MPEG eXtensible Middleware 15.2.1 Topics 1. 2. 3. 4. MPEG eXtensible Middleware Architecture and Technology MPEG eXtensible Middleware APIs MPEG eXtensible Middleware Conformance and Reference Software MPEG eXtensible Middleware Protocols 15.2.2 Contributions 15723 This contribution provided the foundation of the work during the week 15810 The technologies in the response to the CfP have been integrated into N10293 (WD1.0 of 2nd edition of ISO/IEC 29116-1 (MXM Protocols) and the APIs into N10291 (WD2.0 of MxM APIs) 15811 This contribution provided the foundation for the work that led to producing 10291 (WD2.0 of MxM APIs) 15808 This document was discussed and submitted to MPEG delegates for consideration 15809 This contribution was integrated into 10292 (MPEG eXtensible Middleware Conformance and Reference Software) Tiejun Huang 15821 This contribution was integrated into 10292 (MPEG eXtensible Middleware Conformance and Reference Software) 15822 This contribution was integrated into 10292 (MPEG eXtensible Middleware Conformance and Reference Software) Technical Work in Progress. 16 Requirements and Exploration 16.1 MPEG Richmedia UI Framework M15915, m15973, m15892 have been reviewed during the Torino AHG meeting. Please refer Report of AHG on Scene Representation (m15732) Results are accommodated in the Context and Objectives document (N10296) 16.2 Standing Documents None. 16.3 New Proposals None. 79 17 Liaison Cf. Liaison output. 80 18 Latest References and Publication Status Reference on the ISO Web Site : http://www.itscj.ipsj.or.jp/sc29/open/29view/29n9270c.htm Pr Pt 2 1 2 Standard No. Issue ISO/IEC 13818-1/Amd.7 2nd 00/12 1 1 1 1 ISO/IEC 13818-1:2000 (MPEG-2 Systems 1 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) 1 1 ISO/IEC 13818-1:2000/Amd.4 (Metadata Application CP) 1 1 1 ISO/IEC 13818-1:2000/COR3 (Correction for Field Picture) ISO/IEC 13818-1:2006 (MPEG-2 Systems 3rd Edition) 2 1 1 ISO/IEC 13818-1:2006/Amd.1 (Transport of Streaming text) N8369 2 1 ISO/IEC 13818-1:2006/Amd.2 (Carriage of Auxialiry Video Data) N8798 2 2 2 2 2 2 2 2 2 2 2 Edition) ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) ISO/IEC 13818-1:2000/COR2 (FlexMuxTiming_ descriptor) ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) & COR1 on Amd.1 ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) ISO/IEC 13818-1:2000/COR4 (M4MUX Code Point) ISO/IEC 13818-1:2000/COR5 (Corrections related to 3rd Ed.) N3844 N4404 N5867 N5604 N5771 N6847 N6585 N6845 N7469 N7895 01/01 Pisa 01/12 Pattaya 03/07 Trondheim 03/03 Pattaya 03/07 Trondheim 04/10 Palma 04/07 Redmond 04/10 Palma 05/07 Poznan 06/01 Bangkok 06/xx 81 06/07 Klagenfurt 07/01 Marrakech Status Doc. With Purpose Published 2000/12 ISO Award Done Published Published Published Published 2000/12 2002/03 2002/12 2003/12 Proposed N/A N/A Proposed Published Published 2004/03 XXXX N/A Proposed FDAM FDAM ITTF ITTF to be published to be published N/A N/A COR COR COR ITTF ITTF ITTF to be published to be published to be published N/A N/A N/A Published FDAM ITTF ITTF to be published TBP TBP FDAM ITTF to be published TBP 2 1 ISO/IEC 13818-1:2006/Cor.1.2 (Reference to AVC Specification) N9365 2 1 ISO/IEC 13818-1:2006/Amd.3 (SVC in MPEG-2 Systems) 2 4 11 1 1 ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) N1005 8 N5607 N2501 N3054 4 1 ISO/IEC 14496-1/Cor.1 N3278 4 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) N3850 4 1 1 1 1 1 ISO/IEC 14496-1:2001/Cor.3 N4264 N5275 N6587 4 1 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) N4698 4 1 ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) N5282 4 ISO/IEC 14496-1:2001/Amd.4 (SL Extension) 4 1 1 ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5471 N5976 4 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) N6202 01/07 Sydney 02/10 Shangai 04/07 Redmond 02/03 Jeju Island 02/10 Shanghai 02/12 Awaji 03/10 Brisbanne 03/12 Hawaii 4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 4 ISO/IEC 14496-1:200x/Cor4 (Node Coding Table) 4 1 1 Ed.) N7473 N5277 4 1 ISO/IEC 14496-1:200x/Amd.1 (Text Profile Descriptors) N7229 4 4 4 4 ISO/IEC 13818-1:2003 (IPMP on 2) st ISO/IEC 14496-1 (MPEG-4 Systems 1 Ed.) 07/10 Shenzhen 08/07 Hannover 03/03 Pattaya 98/10 Atl. City 99/12 Hawaii FDAM ITTF to be published TBP FDAM ITTF to be published TBP Published Published Published 2003/12 1999/12 2001/11 Proposed Done Done Published 2001/11 N/A Published Published COR COR COR 2001/11 2002/10 ITTF ITTF ITTF N/A Done N/A N/A N/A AMD ITTF N/A Published 2004-05 N/A Published Published 2003/12 2004-08 N/A N/A AMD ITTF to be published N/A 05/04 Busan PDAM ITTF N/A 05/07 Poznan 02/10 Shanghai 05/04 Busan PDAM IS ITTF ITTF Final Text Editing to be published to be published N/A Proposed PDAM ITTF Final Text N/A 00/03 Noordwijk. 01/01 Pisa ISO/IEC 14496-1:2001/Amd.1 (Flextime) ISO/IEC 14496-1:2001/Cor.1 ISO/IEC 14496-1:2001/Cor.2 ISO/IEC 14496-1 (MPEG-4 Systems 3rd 82 4 1 ISO/IEC 14496-1:200x/Cor.1 (Clarif. On audio codec behavior) N8117 4 1 ISO/IEC 14496-1:200x/Amd.2 (3D Profile Descriptor Extensions) N8372 4 1 ISO/IEC 14496-1:200x/Cor.2 (OD Dependencies) N8646 4 1 ISO/IEC 14496-1:200x/Amd.3 (JPEG 2000 support in Systems) N8860 4 4 ISO/IEC 14496-1:200x/Amd.17 (ATG Conformance) N8861 4 4 ISO/IEC 14496-1:200x/Amd.22 (AudioBIFS v3 conformance) N9295 4 4 ISO/IEC 14496-1:200x/Amd.23 (Synthesized Texture conformance) N9369 4 4 ISO/IEC 14496-1:200x/Amd.24 (File Format Conformance) N9370 4 4 ISO/IEC 14496-1:200x/Amd.25 (LASeR V1 Conformance) N9372 4 4 ISO/IEC 14496-1:200x/Amd.26 (Open Font Format Conf.) N9815 4 4 ISO/IEC 14496-1:200x/Amd.27 (LASeR Amd.1 Conformance) N9816 4 5 5 ISO/IEC 14496-1:200x/Amd.12 (File Format) ISO/IEC 14496-1:200x/Amd.16 (SMR Ref. Soft) N9020 N9672 06/04 Montreux 06/07 Klagenfurt 06/10 Hangzhou 07/01 Marrakech 07/01 Marrakech 07/07 Lausanne 07/10 Shenzhen 07/10 Shenzhen 07/10 Shenzhen 08/04 Archamps 08/04 Archamps 07/04 San Jose 08/01 Antalya ISO/IEC 14496-1:200x/Amd.17 (LASeR Ref. Soft) N9674 08/01 Antalya N4712 N6960 02/03 Jeju 05/01 HongKong 4 4 4 4 4 5 6 8 11 ISO/IEC 14496-6:2000 ISO/IEC 14496-8 (MPEG-4 on IP Framework) ISO/IEC 14496-11 (MPEG-4 Scene Description 3rd Edition) 83 COR ITTF PDAM ITTF Editing Final Text Editing to be published COR ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM ITTF to be published N/A PDAM PDAM ITTF ITTF to be published to be published N/A N/A PDAM Published Published FDIS ITTF 2000/12 2004-05 SC29 to be published N/A N/A Proposed Proposed Final Text Editing N/A N/A Integration in 1st Ed. Integration in 1st Ed. 4 11 ISO/IEC 14496-11/Amd.1 (AFX) N5480 02/12 Awaji FDAM ITTF 4 11 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) N6205 03/12 Hawaii FDAM ITTF 4 ISO/IEC 14496-11/Cor.1 4 11 11 N6203 ISO/IEC 14496-11/Cor.3 Valuator/AFX related correction N6594 COR COR SC29 ITTF 4 11 ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 FDAM ITTF 4 11 ISO/IEC 14496-11/Amd.4 XMT and MPEG-J Extensions N6959 FDAM ITTF 4 11 ISO/IEC 14496-11/Cor.3 (Audio BIFS Integrated in 3rd Edition) N7230 03/12 Hawaii 04/07 Redmond 04/07 Redmond 05/01 HongKong 05/04 Busan COR ITTF 4 11 ISO/IEC 14496-11/Cor.5 (Misc Corrigendum) N8383 COR SC29 N/A 4 11 ISO/IEC 14496-11/Amd.5 Symbolic Music Representation N8657 FDAM ITTF TBP 4 ISO/IEC 14496-11/Cor.6 (AudioFx Correction) 4 11 12 ISO/IEC 14496-12 (ISO Base Media File Format) N9021 N5295 COR Published SC29 2004-02 N/A Proposed 4 12 ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 FDAM ITTF FDAM 04/11/30 N/A 4 12 N7232 COR ITTF 12 Final Text Editing Final Text Editing N/A 4 ISO/IEC 14496-12/Cor.1 (Correction on File Type Box) ISO/IEC 14496-12/Cor.2 (Miscellanea) 4 12 N8659 4 12 ISO/IEC 14496-12/Amd.1 (Description of timed metadata) ISO/IEC 14496-12/Cor.3 (Miscellanea) 4 12 ISO/IEC 14496-12/Amd.2 (Flute Hint Track) 06/07 Klagenfurt 06/10 Hangzhou 07/04 San Jose 02/10 Shanghai 04/07 Redmond 05/04 Busan COR ITTF FDAM ITTF N9024 06/01 Bangkok 06/10 Hangzhou 07/04 San Jose COR ITTF N9023 07/04 San Jose FDAM ITTF N7901 84 st Integration in 1 Ed. Integration in 1st Ed. Integration in 1st Ed. Final Text Editing N/A N/A N/A N/A Proposed N/A N/A N/A N/A Final Text Editing N/A N/A 4 13 ISO/IEC 14496-13 (IPMP-X) N5284 4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 4 14 ISO/IEC 14496-14/Cor.1 (Audio P&L Indication) N7903 4 15 ISO/IEC 14496-15 (AVC File Format) N5780 4 15 ISO/IEC 14496-15/Amd.1 (Support for FREXT) N7585 4 4 15 15 ISO/IEC 14496-15/Cor.1 ISO/IEC 14496-15/Cor.2 (NAL Unit Restriction) N7575 N8387 4 15 4 17 ISO/IEC 14496-15/Amd.2 (SVC File Format Extension) ISO/IEC 14496-17 (Streaming Text) 4 18 18 Published 2003-11 COR ITTF Published 2004-04 FDAM ITTF to be published Proposed Proposed Final Text Editing N/A Proposed Final Text Editing N/A ITTF ITTF N/A N/A N9682 FDAM ITTF N/A N7479 05/07 Poznan FDAM ITTF TBP N6215 N8664 03/12 Hawaii 06/10 Hangzhou 03/12 Hawaii 05/10 Nice 06/10 Hangzhou 07/04 San Jose Published COR 2004-07 ITTF Proposed N/A Published FDAM COR 2004-07 Editor ITTF Proposed TBP N/A FDAM ITTF N/A FDAM ITTF N/A FDAM ITTF N/A FDAM Editor 4 4 20 4 20 ISO/IEC 14496-20/Cor.2 (Profile Removal) N9381 4 20 ISO/IEC 14496-20/Amd.2 (SVGT1.2 Support) N9384 4 22 ISO/IEC 14496-22 (Open Font Format) N8395 4 ITTF COR COR 19 20 20 4 IS 05/10 Nice 06/07 Klagenfurt 08/01 Antalya ISO/IEC 14496-18 (Font Compression and Streaming) ISO/IEC 14496-18/Cor.1 (Misc. corrigenda and clarification) ISO/IEC 14496-19 (Synthesized Texture Stream) ISO/IEC 14496-20 (LASeR) ISO/IEC 14496-20/Cor.1 (Misc. corrigenda and clarification) ISO/IEC 14496-20/Amd.1 (LASeR Extension) 4 02/10 Shanghai 02/10 Shanghai 06/01 Bangkok 03/07 Trondheim 05/10 Nice N6217 N7588 N8666 N9029 85 07/10 Shenzhen 07/10 Shenzhen 06/07 Klagenfurt Final Text Editing TBP 7 ISO/IEC 15938-1 (MPEG-7 Systems) 7 1 1 1 1 1 2 ISO/IEC 15938-2 (MPEG-7 DDL) N4285 N6326 N6328 N7490 N7532 N4288 01/07 Sydney 04/03 Munich 04/03 Munich 05/07 Poznan 05/10 Nice 01/07 Sydney Published FDAM COR COR FDAM Published 2002/07 ITTF Editor ITTF ITTF 2002/02 7 7 ISO/IEC 15938-7/Amd.2 (Fast Access Ext. Conformance) N8672 FDAM ITTF N/A ISO/IEC 15938-12 MPEG Query Format N9830 FDAM ITTF N/A 9 ISO/IEC 21000-9 (MPEG-21 File Format) N6975 FDIS ITTF 21 9 ISO/IEC 21000-9/Amd.1 (MPEG-21 Mime Type) N9837 FDAM ITTF Done 21 15 ISO/IEC 21000-15 (Security in Event Reporting) N9839 FDIS ITTF TBP 21 16 5 4 4 ISO/IEC 21000-16 (MPEG-21 Binary Format) ISO/IEC 21000-5 (Open Release Content Profile) ISO/IEC 23000-4 (Musical Slide Show MAF) ISO/IEC 23000-4 (Musical Slide Show MAF 2nd Ed.) N7247 N9687 N9037 N9843 FDIS FDAM FDIS FDIS ITTF ITTF ITTF ITTF A 7 8 ISO/IEC 23000-7 (Open Access MAF) ISO/IEC 23000-8 (Portabe Video AF) N9698 N9853 FDIS FDIS ITTF ITTF TBP TBP A 9 ISO/IEC 23000-9 (Digital Multi. Broadcasting MAF) N9397 FDIS ITTF TBP A 9 N9854 COR ITTF TBP B 1 ISO/IEC 23000-9/Cor.1 (Digital Multi. Broadcasting MAF) ISO/IEC 23001-1 (XML Binary Format) 06/10 Hangzhou 08/04 Archamps 05/01 HongKong 08/04 Archamps 08/04 Archamps 05/04 Busan 08/01 Antalya 07/04 San Jose 08/04 Archamps 08/01 Antalya 08/04 Archamps 07/10 Shenzhen 08/04 Archamps 05/10 Nice 7 12 21 FDIS ITTF TBP 7 7 7 7 21 A A A ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigendum) ISO/IEC 15938-1/Cor.2 (MPEG-7 Systems Corrigendum) ISO/IEC 15938-1/Amd.2 (BiM extension) N7597 86 FDAM 04/11/28 FDIS 05/01/21 FDIS 05/04/22 Done N/A N/A N/A N/A Done Done TBP TBP TBP TBP B 1 B 1 B 1 B 1 B ISO/IEC 23001-1/Cor.1 (Misc. Editorial and technical clar.) ISO/IEC 23001-1/Cor.2 (Misc. Editorial and technical clar.) ISO/IEC 23001-1/Amd.1 (Reference Soft. & Conf.) N8680 N9296 E 2 3 1 ISO/IEC 23001-1/Amd.1 (Exten. On encoding of wild cards) ISO/IEC 23001-2 (Fragment Request Unit) ISO/IEC 23001-3 (IPMP XML Messages) ISO/IEC 23008-1 Architecture E 2 ISO/IEC 23008-2 Multimedia API N8893 E 3 ISO/IEC 23008-3 Component Model N8894 E 4 ISO/IEC 23008-4 Ressource & Quality Management N8895 E 5 6 7 1 ISO/IEC 23008-5 Component Download ISO/IEC 23008-6 Fault Management ISO/IEC 23008-7 System Integrity Management ISO/IEC 29116 Media Streaming MAF Protocols N9053 N9054 N9055 N9420 B E E 29116 N9049 N8886 N9051 N9416 N8892 87 06/10 Hangzhou 07/04 San Jose COR ITTF N/A COR ITTF N/A 07/01 Marrakech 07/07 Lausanne 07/04 San Jose 07/04 San Jose 07/01 Marrakech 07/01 Marrakech 07/01 Marrakech 07/01 Marrakech 07/04 San Jose 07/04 San Jose 07/04 San Jose 07/10 Shenzhen FDAM ITTF N/A PDAM ITTF FDIS FDIS FDAM ITTF ITTF ITTF TBP TBP N/A FDAM ITTF N/A FDAM ITTF N/A FDAM ITTF N/A FDAM FDAM FDAM FDAM ITTF ITTF ITTF ITTF N/A N/A N/A N/A to be published N/A 19 Resolutions of Systems Cf. WG11 resolution. 20 Contributions Reviewed by the Systems Subgroup N° 15723 15733 15734 Title Ad Hoc Group on MxM Ad Hoc Group on MPEG File Formats Ad Hoc Group on Application Format 15735 15736 Ad Hoc Group on MVCO WD Editing Ad Hoc Group on the RoSE Framework 15737 15739 Ad Hoc Group on Font Format Representation Summary of Voting on ISO/IEC 138181:2007/DCOR 2 [SC 29 N 9680] Summary of Voting on ISO/IEC 1449612:200X/DCOR 1 [SC 29 N 9685] Summary of Voting on ISO/IEC 1449612:200X/PDAM 1 [SC 29 N 9687] Summary of Voting on ISO/IEC 210007:2007/DCOR 1 [SC 29 N 9692] Summary of Voting on ISO/IEC 230004:200X/PDAM 2 [SC 29 N 9694] Summary of Voting on ISO/IEC 144965:2001/FPDAM 14 Summary of Voting on ISO/IEC 1449611:2005/FPDAM 6 Summary of Voting on ISO/IEC 210008:2008/FPDAM 1 Summary of Voting on ISO/IEC FCD 23004-8 Summary of Voting on ISO/IEC 230004:200X/FPDAM 1 Summary of Voting on ISO/IEC FCD 23000-6 Summary of Voting on ISO/IEC 230007:200X/FPDAM 1 Summary of Voting on ISO/IEC FCD 23000-11 Report of Core Experiment on the Representation of Sensory Effects 15742 15743 15746 15747 15760 15762 15764 15765 15767 15776 15777 15780 15783 88 Authors Filippo Chiariglione, Marius Preda David Singer Kyuheon Kim, Hui Yong Kim, Jean Cha, Noboru Harada, Hendry Marc Gauvin, Miran Choi Sanghyun Joo, Jean Gelissen, Christian Timmerer Vladimir Levantovsky SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat Christian Timmerer Markus Waltl Yasuaki Tokumo Bumsuk Choi Seungsoon Park Sanghyun Joo Mark Verberkt Sang-Kyun Kim N° 15785 15789 15790 Title Liaison Statement from ITU-T SG 16 Liaison Statement from DVB New Extensions for PSI 15791 Comments and Proposal for LASeR PDAM2 15792 Comments on LASeR AMD3 (PSI) 15793 Comments on the Architecture of the MPEG Rich Media UI Framework 15797 Report of Core Experiment on RoSE 15799 A Core Experiment Report on RoSE 15801 15807 Study of WD1.0 of RoSE Issues of AudioBIFS to applying to an Advancement of Satellite Digital Broadcasting in Japan Proposal for MXM Public License Version 1.0 Reference software implementing the MXM submissions 15808 15809 15810 Response to Call for Proposals on Additional MXM Technologies 15811 Further ideas on MXM architecture 15812 15813 15815 Editor's draft of the Part12 file format amendment Comments on IMAF draft CfP and MAF Overview Proposal to clarify the scope of the brands "isom" and "iso2" Comment on the change of the 'ctts' box 15819 An extension to ISO base media file format 15821 15822 Contribution to MXM Reference Software MXM Software Implementation for 3D Graphics 15814 89 Authors ITU-T SG 16 SC 29 Secretariat DVB via SC 29 Secretariat Injae Lee Jihun Cha Young-kwon Lim Han-Kyu Lee Jinwoo Hong Cyril Concolato Jean Le Feuvre Cyril Concolato Jean Le Feuvre Cyril Concolato Jean Le Feuvre Kyungmo Park Yasuaki Tokumo Shin-ya Hasegawa Jin-Seo Maeng-Sub Cho Sang-Kyun Kim Yong Soo Joo Bon-Ki Koo Christian Timmerer Yasushige Nakayama Leonardo Chiariglione Filippo Chiariglione Marc Gauvin Tiejun Huang Filippo Chiariglione Marc Gauvin Tiejun Huang Denis Oliver Kropp Martin Springer Filippo Chiariglione Christian Timmerer David Singer Heiko Purnhagen and al. Motomasa Futagami Teruhiko Suzuki Motomasa Futagami Teruhiko Suzuki Ye-Kui Wang Miska Hannuksela Ying Chen Christian Timmerer Ivica Arsov Marius Preda N° Title 15835 Editors' input to ISO/IEC 21000-8:2008/FDAM 1 Extra reference software 15838 Editors' update to WD 1.0 of ISO/IEC 230006/Amd.1 PA-AF Conformance & Reference Software 15841 Enhancements to the MVC File Format 15842 Improved file format support for SRTP reception 15846 Marketing & Business status of Interactive Music Service Scene Representation in PSI 15853 15858 Editor´s proposal for Media Value Chain Ontology CD text 15862 On MVC file format 15866 15871 Report on flexible signaling of audio channels to loudspeaker mapping using MPEG-4 BIFS Proposal for the Amendment to ISO/IEC 138181:2007 - "Transport of MVC in MPEG-2 Systems" Reference Software: MPQF Parser Framework 15872 Reference Software: MPQF Validator 15874 On MVC File Format 15878 iKlax - IM AF Business & market status 15889 15890 Study Text for CD of 14496-20 AMD2 Study Text for AdaptiveSceneIndicator of CD on 14496-20 AMD2 Study Text for display size related adaptation on 14496-20 AMD2 Architecture for the MPEG UI Framework Conformance files contribution for ISO/IEC 23000-9 (DMB-AF) 15869 15891 15892 15896 90 Authors Françoise Preteux Saar De Zutter Kenneth vermeirsch Florian Schreiner Hendry Houari Sabirin Noboru Harada Munchurl Kim Zhuangfei Wu Per Fröjdh Daniel Catrein Per Fröjdh Kevin SeungChul Ham [email protected] [email protected] [email protected] Marc Gauvin Jaime Delgado Víctor Rodríguez Doncel Miran Choi Miska M. Hannuksela Ye-Kui Wang Ying Chen Juegren Schmidt Mario Sieck Thomas Schierl Karsten Grüneberg Mario Doeller Felix Fischer -1 Mario Doeller Heiko Studt - 1 Ruben Tous Jaime Delgado Miran Choi Tae-Beom Lim Karsten Grüneberg Thomas Schierl Laurent PRIMAUX Owen LAGADEC Seo-Young Hwang Seo-Young Hwang Seo-Young Hwang and al. Seo-Young Hwang Hui Yong Kim HanKyu Lee N° Title 15897 Updated text and reference SW for ISO/IEC 23000-9 (DMB-AF) 15898 Alignment of MPEG-2 TS storage for DMB-AF to ISO file format 15901 15905 15906 Comments on MAF overview Liaison Statement from GRN Report of Core Experiment on RoSE 15907 Contribution to RoSE CE M.1 15909 Contribution to RoSE CE M.2 15912 Proposal for MPEG Query Format Corrigendum 15913 Proposed text of ISO/IEC 23000-11 FDIS Stereoscopic Video Application Format On MPEG Rich-Media UI Framework Data Source ISOFF compatibility issue 15915 15925 15931 Study Text for memory related adaptation on 14496-20 AMD2 91 Authors Hyunsoon Kim Daebok Kwon Benoît Pellan Alain David Hui Yong Kim HanKyu Lee Houari Sabirin Munchurl Kim Jung Soo Lee Yong Han Kim Hui Yong Kim Myung Seok Ki HanKyu Lee Yong Han Kim Inseon Jang and al. GRN via SC 29 Secretariat Bumsuk Choi Seungsoon Park Sanghyun Joo Kyungro Yoon Bumsuk Choi Seungsoon Park Sanghyun Joo Bumsuk Choi Seungsoon Park Sanghyun Joo Mario Doeller Philipp Wendler Next generation Broadcasting Forum (Korea) Giovanni Cordara Diego Gibellino Guido Franceschini Giovanni Cordara Seo-Young Hwang and al. Annex G – Video report Source: Gary J. Sullivan, Jens-Rainer Ohm 1 MPEG-2 Support for 1080/50p/60p Amendment 3 for MPEG-2 video (enabling a new level for 1080p 50 and 60 fps formats in main profile), as well as the associated conformance testing specifications were progressed to FDAM. Except editorial updates, no changes were made as compared to FPDAM. Documents reviewed: m15756 m15757 Summary of Voting on ISO/IEC 13818-2:2000/FPDAM 3 Summary of Voting on ISO/IEC 13818-4:2004/FPDAM 3 Documents approved: No. Title 10135 Disposition of Comments on ISO/IEC 13818-2:2000/FPDAM 3 10136 Text of ISO/IEC 13818-2:2000/FDAM 3 Level for 1080@50/60p 10137 Disposition of Comments on ISO/IEC 13818-4:2004/FPDAM 3 10138 Text of ISO/IEC 13818-4:2004/FDAM 3 Level for 1080@50/60p Conformance Testing 2 SC 29 Secretariat SC 29 Secretariat TBP N N N N Available 08/10/17 08/10/17 08/10/17 08/10/17 MPEG-4 Simple Studio Profile Levels 5 & 6 The amendment work to support larger formats (beyond 1920x1080) with MPEG-4 simple studio profile, as well as the associated conformance testing specifications, were progressed for FDAM. Except editorial updates, no changes were made as compared to FPDAM. Documents reviewed: m15758 m15778 Summary of Voting on ISO/IEC 14496-2:2004/FPDAM 5 Summary of Voting on ISO/IEC 14496-4:2004/FPDAM 35 Documents approved: No. Title 10139 Disposition of Comments on ISO/IEC 14496-2:2004/FPDAM5 10140 Text of ISO/IEC 14496-2:2004/FDAM5 Simple Studio Profile Levels 5 and 6 10141 Disposition of Comments on ISO/IEC 14496-4:2004/FPDAM35 10142 Text of ISO/IEC 14496-4:2004/FDAM35 Simple Studio Profile Levels 5 and 6 Conformance Testing 3 MPEG-4 Visual Software and Conformance Maintenance 92 SC 29 Secretariat SC 29 Secretariat TBP Available N 08/10/17 N 08/10/17 N N 08/10/17 08/10/17 In the course of the work of the AHG on maintenance of MPEG-4 Visual, another bug fix of software is reported in M15927. It was decided to make this available in the reference software package on the MPEG SVN repository. Problems with another three streams in the visual conformance testing suite were reported as well (minor issue with timing syntax in one frame). It was decided to issue a defect report on this. Corrigenda and/or new editions of visual software and conformance will be issued by an appropriate time. For conformance streams, it is necessary to identify an appropriate facility (SVN preferable) for exchange and downloads. Documents reviewed: m15927 Update of MPEG-4 video reference software for short header bug fix Yi-Shin Tung, TseTsung Shih m15928 Fix of 3 MPEG-4 video conformance bitstreams Yi-Shin Tung, TseTsung Shih Documents approved: No. Title 10143 Defect report on ISO/IEC 14496-4:2004 (three visual conformance streams) TBP Available N 08/10/24 4 Development of AVC The video subgroup jointly approved the ISO standard related output documents that were produced during the 29th JVT meeting which was held in parallel. Important work items in this context were – Final work on reference software for SVC (Study of FPDAM) – Work on MVC software (Study of PDAM) and conformance (PDAM) – Further work on the Cor.1 (Study of DCOR) – Work for new edition, which will include the 2008 edition, Cor.1 and Amd.1 (MVC) – Work for a new amendment (Amd.1 of the new edition), defining the previously discussed Constrained Baseline Profile and a new SEI message defining usage of a checkerboard (quincunx) pattern for interlacing left/right stereo views. On the new SEI message proposal, it is understood that the proposed checkerboard pattern extends over the existing stereo SEI, giving support for another specific type of display. Better understanding will be sought during the development of the amendment about the impact on compression performance, as well as looking for more complete support of stereo interlacing methods that are currently used or expected to be used. Another profile proposal (brought in M15854) was discussed jointly with the Requirements subgroup. At this moment, the proposals appears to be not sufficiently clear in terms of its technical maturity, as well as its place relative to other AVC profiles, where typically the baseline profile is used for video telephony applications currently. Documents reviewed: m15738 m15754 m15854 Summary of Voting on ISO/IEC 14496-10:200X/DCOR 1 [SC 29 N 9679] Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 19 A Proposed New Profile and Level on MPEG-4 Part 10 AVC|H.264 for Video Telephony Applications Documents approved: No. Title SC 29 Secretariat SC 29 Secretariat Taeyoung Na, Munchurl Kim, Jeongyeon Lim, Youngho Joo, Kimun Kim TBP Available 93 10144 10145 10166 10146 10147 10148 10149 10150 10151 10152 Request for ISO/IEC 14496-4:2004/Amd.38 Text of ISO/IEC 14496-4:2004/PDAM38 Multiview Video Coding Conformance Testing Disposition of Comments on ISO/IEC 14496-5:2001/FPDAM 19 Text of ISO/IEC 14496-5:2001/FDAM 19 Reference Software for Scalable Video Coding Study Text of ISO/IEC 14496-5:2001/PDAM 15 Reference Software for Multiview Video Coding Disposition of Comments on ISO/IEC 14496-10:2008/DCOR 1 Text of ISO/IEC 14496-10:2008/COR 1 Text of ISO/IEC FDIS 14496-10:200X 5th Edition Request for ISO/IEC 14496-10:200X/Amd.1 Text of ISO/IEC 14496-10:200X/PDAM 1 Constrained Baseline Profile and supplemental enhancement information N N 08/10/17 08/10/24 N N 08/10/17 09/01/15 08/11/14 N N N N N 08/10/17 08/11/28 08/11/28 08/10/17 08/10/24 5 MPEG-7 Visual and Photo Player MAF 5.1 MPEG-7 Visual related work in Busan The MPEG-7 breakout group was active during the whole week. Input documents related to the Visual part in 15938-3 and Photo Player MAF 23003-3 are listed in the table below. m15755 m15766 m15831 m15833 Summary of Voting on ISO/IEC 23000-3:2007/FPDAM 1 Summary of Voting on ISO/IEC 15938-3:2002/FPDAM 3 Issues on Call for Proposals on Video Signature Tools Editors Input to ISO/IEC 15938-3:2001/FPDAM 3 m15843 m15844 m15900 Proposed text for ISO/IEC 23000-3 PDAM 2 Foreground video clips prepared by NEC with video contents gathered from web sites Experimental Data from the National Film and Television School, UK Comments & Results on MPEG-7 Image Signature Suggestion to solve the problem of delayed trimmed point in modification for VCE-7 Automatic extract start frame program from Capture and Record video clips for VCE-7 modification Proposal on the change of success condition in direct matching m15918 New measurement of video signature matching complexity m15929 Fast Image Signature for All Modifications Note: This is a late document which was reviewed only for information, without any impact on the development of the image signature descriptor amendment. m15845 m15863 m15894 m15895 SC 29 Secretariat SC 29 Secretariat Kota Iwamoto, Ryoma Oami R.O'Callaghan, Miroslaw Bober, Ryoma Oami, Paul Brasnett Ryoma Oami Ryoma Oami, Kota Iwamoto Paul Brasnett, Miroslaw Bober Paul Brasnett, Miroslaw Bober Ju-Kyong Jin, Jun-Woo Lee, Dong-Seok Jeong Won-Geun Oh, Ju-Kyong Jin, Dong-Seok Jeong Weon-Geun Oh, Sang-il Na, AYoung Cho, Dong-Seok Jeong Weon-Geun Oh, Won-Keun Yang, Jun-Woo Lee Weon-Geun Oh, Won-Keun Yang, Ayoung Cho, Sang-Il Na, Dong-Seok Jeong The text of ISO/IEC 15938-3:2001/FDAM 3 Image Signature Tools was issued. Except for a large number of editorial improvements, as requested by NBs, this is technically unchanged as compared to the previous Study of FPDAM. After finalization of the standard text, the associated PDAMs on software, conformance and non-normative extraction/matching parts (the latter containing fast matching procedures as previously in XM) were issued. For Photo Player MAF, the reference software was finally released (FDAM), and conformance testing amendment was further prepared (WD2). 94 The main activity during the week was the preparation of the Call for Proposals on Video Signature Tools, for which an update was issued. Now, more than 140 hours of content are available, where newly arrived donations were extensively reviewed and selected during the meeting. For the Call, seven pre-registrations have been received in the meantime, responses are due by the next meeting. 5.2 Output documents related to MPEG-7 Visual No. 10153 10154 10155 10156 10157 10158 10159 10160 10161 10162 10163 10164 Title 15938-3 Visual Disposition of Comments on ISO/IEC 15938-3:2001/FPDAM 3 Text of ISO/IEC 15938-3:2001/FDAM 3 Image Signature Tools Updated Call for Proposals on Video Signature Tools Request for ISO/IEC 15938-6:2003/Amd.3 Text of ISO/IEC 15938-6:2003/PDAM 3 Reference Software for Image Signature Tools Request for ISO/IEC 15938-7:2003/Amd.5 Text of ISO/IEC 15938-7:2003/PDAM 5 Conformance Testing for Image Signature Tools Request for ISO/IEC 15938-8:2002/Amd.5 Text of ISO/IEC 15938-8:2002/PDAM 5 Extraction and Matching of Image Signature Tools 23000-3 Photo Player Application Format Disposition of Comments on ISO/IEC 23000-3/FPDAM1 Reference Software for Photo Player MAF Text of ISO/IEC 23000-3/FDAM1 Reference Software for Photo Player MAF Working Draft 2 of ISO/IEC 23000-3/Amd.2 Conformance Testing for Photo Player MAF TBP Available N N Y N N 08/10/17 08/10/31 08/10/17 08/10/17 09/01/11 N N 08/10/17 09/01/11 N N 08/10/17 09/01/11 N 08/10/17 N 08/10/17 N 08/10/17 6 23002 MPEG-C Video Technologies 6.1 23001-4 and 23002-4 Reconfigurable Video Coding (RVC) 6.1.1 General status of work The two parts related to RVC (ISO/IEC 23001-4 Codec Configuration Representation in MPEGB and ISO/IEC FCD 23002-4 Video Tool Library in MPEG-C) were progressed into FCD status in April with editorial period, and delivered in time for the ballots, which was closing before the October meeting (where it was originally planned to promote both parts for FDIS). Unfortunately, the Study documents that were started during the Hannover meeting were not delivered in time before the ballots closed. This was partially caused due to data losses of the editing work from Hannover shortly after the meeting, and due to difficulties to find sufficiently qualified MPEG-2 experts for reviewing the tool descriptions. While excellent progress was made in implementing RVC and proving comcepts (in particular for AVC baseline profile, which is now operational with CAVLC), two issues popped up from the input documents that were brought for Busan: 95 – For the more advanced entropy coding schemes (namely CAVLC and CABAC), a more elegant solution (compared to the envisioned implementation by dedicated FUs) seems to be the usage of the BSD Java interface. This will be further implemented an checked until the next meeting; – It has now become common understanding of all RVC experts that the CAL reference implementation of FUs must be made normative, and this is the only means (unlike the textual description) to uniquely describe FU behaviour in terms of timing and dataflow. Therefore, one more round of careful checking is needed, also to resolve some known divergences between the textual description and the CAL reference. As a consequence of the situation described above, as well as the deficiencies in editorial maturity, which were criticized by NBs in the ballot votes, it was decided to delay the FDIS of both 23001-4 and 23002-4 by one meeting. At the same time, Amd.1 (software and conformance) will be speeded up, most likely with PDAM for 09/02 (WD 3 currently). Regarding the view of normative elements and their conformance testing, the following statements were discussed as being the cuurent view: - Current/first version of RVC only supports 100% MPEG pieces; if non-MPEG toolboxes are written by same formalism as MPEG, it will most probably also work, but at own risk. - If not 100% MPEG, conformance is only provided for the level of decoder description decoding (primitive parsing check) and for input/output of used MPEG FUs. For MPEG, conformance testing for complete solutions will be provided. - In the future, extensions may be considered that provide e.g. Java interfaces at the abstract decoder model that could support plugging in C++ libraries While the first edition will give full support for MPEG-2 main profile, MPEG-4 simple profile and MPEG-4 AVC baseline profile, further tools for MPEG-4 advanced simple profile, AVC high profile and SVC will be supported in Amd.2, for which the third version of WD was issued. 6.1.2 Assignment of editors Documents Study of FDIS of 23001-4 (MPEG-B CCR) Study of FDIS of 23002-4 (MPEG-C VTL) Workplan Conformance & RSM WD Extension to VTL RVC Vision Editors Gwo Giun, TK, Hyungyu, Christophe Yishin, TK, Hwa Seon Hwa Seon Gwo Giun, Christophe Mikael Euee 6.1.3 Allocation of input contributions MPEG-B Related Doc. Title No. m15803 Study on FUID definition (CE 1.3) A four-byte field for FUID was proposed. m15804 BSDL Parser Description and Generation Using ECMAscript M15910 ID assignment for RVC (CE 1.3) 96 FU ID M15804 UMID (a SMPTE standard) was analysed. Recommendation Will support one tool library Will keep the current FUID system (both numeric and textual) Will incorporate M15803 into RVC vision document To adopt the examples in CCR and VTL (Hyungyu Editors) To reflect conformance testing rules in conformance WD (Hyungyu Chris) MPEG-C related Doc. Title No. m15800 Multiple reference picture management FU for AVC inter-prediction FU definition: input/output/internal algorithm Will integrate into VTL data management FU description (NCKU Yishin) m15805 Modified Token Description for the Consideration of Token Precedence Conclusion is not made until FDIS preparation is done. m15806 Proposed Token Pool for ISO/IEC 23002-4 VTL and Its Application in Evaluating FU Network Conclusion is not made until FDIS preparation is done. M15870 Editing a RVC FU network using a GUI called Graphiti Include the tool in RSM as RVC supporting tools (Yishin) M15873 FU Networks for luminances of MPEG4 AVC BP decoder Include in VTL & RSM m15926 Modified Token Description for the Different Characteristics of FU Inputs Conclusion is not made until FDIS preparation is done FDIS preparation Doc. Title No. M15781 Summary of Voting on ISO/IEC FCD 23001-4 m15782 Summary of Voting on ISO/IEC FCD 23002-4 m15923 Technical and editorial suggestions on RVC Study of FCD (from Hannover) - Points to be clarified: 1. Bitstream syntax and parsing description (BSPD) - Thorough comparison between BSDL-schema and RVC-BSDL schema is needed. Core Experiment - What is added on top of BSDL-schema (i.e., port connections to FUs) needs a precise description. Core Experiment - The current concept of RVC does not allow the on-the-fly generation of new FUs with an exception of parser FU. Study of FCD (in introduction) 97 - Example BSDL schema of one example decoder configuration (e.g., MPEG-4 SP) in Annex (informative) pointer to MPEG-C for other examples. 2. FU network description (FUND) - (XML) Description of top-level decoder network of FUs for one example decoder configuration in Annex (informative): pointer to MPEG-C for other examples. 3. FUs in VTL - Separation of normative and nonnormative FUs in VTL - Diagram of top-level decoder network of FUs for decoder configuration for the currently supported profiles and levels - Clear description of interfaces of FU - (XML) Descriptions of top-level decoder network of FUs for the supported decoder configurations as example in Annex (informative) - Example BSDL schema of example decoder configuration of the currently supported profiles and levels in Annex (informative) 6.1.4 RVC-related schedule of the 86th meeting Day Monday Topic Video Plenary (planning of this week) Joint meeting with systems on RVC and MXM Review of MPEG-B contributions Review of MPEG-C Contributions Tuesday Study of FCD preparation Workshop Wednesday Study of FCD preparation Thursday Study of FCD preparation AhG mandates Workplan Friday Video Plenary Room C.B.2 Systems Time 1230 – 13 16 - 1630 Status DONE DONE Bellevue 1630 - 22 DONE Bellevue C.B.2 Bellevue Bellevue Bellevue Bellevue C.B.2 All day All day 11 – 19 All day done done done done Output Documents: No. 10165 10168 10169 10170 10171 Title 23001-4 Codec Configuration Representation Study Text of ISO/IEC FCD 23001-4 Codec Configuration Representation RVC Vision 23002-4 Video Tool Library Study Text of ISO/IEC FCD 23002-4 Video Tool Library WD 3 of ISO/IEC 23002-4/Amd.1 (Conformance and Reference Software) WD 3 of ISO/IEC 23002-4/Amd.2 (Tools for MPEG-4 ASP, AVC HP and SVC) 98 TBP Available N 08/12/31 Y 08/12/31 N N 08/12/31 08/12/31 N 08/11/14 10172 RVC Work Plan and FU Development Status N 08/10/17 7 Explorations – 3D Video The goal of 3D video, as a first step towards a broader range of free-viewpoint (FTV) applications, is to generate interpolated views from available videos of multiview camera configurations. The target application is mostly seen for upcoming generations of (auto-) stereoscopic displays, for which only a low number (1) of video sequences shall be transmitted, but rendering of additional views shall be enabled by associated depth information. To make a next step towards development of such a system, a set of exploration experiments had been set up in Archamps, during which the available test sequences were used with the two available depth estimators and associated view interpolation methods. Various cases of sparseness (baseline distances between cameras to be taken from the dense set) were investigated. A first round of experts viewing using stereoscopic displays was performed in Hannover. Since the results were not satisfactory even for the lightest case of small baseline interpolation, further collaborative experiments were performed to improve the quality by better depth estimation (EE1) and improved view synthesis (EE2). In addition, an alternative method (layered depth video, which is as such an appropriate representation for a specific type of autostereoscopic displays, but could in principle be used for arbitrary view generation) was investigated in EE3. The results gained by the effort of the group and judged by another round of experts viewing in Busan were as follows: • • EE1 & EE2: – Sub-pel for depth estimation gives good improvement, temporal consistency produces artifacts – some sequences are (almost) acceptable – Seems possible to continue with coding experiments EE3 (alternative method layered-depth video): – More sequences acceptable than for EE1 & EE2, but results more divergent for various types of sequences The main conclusion is that for some sequences the quality by “uncompressed” processing is largely acceptable. For those sequences, a first of experiments compressing both video and depth maps will be performed until the next meeting. Therefore, the new round of experiments was designed as follows: • • • • EE1: Improvement of depth estimation – in particular resolve the problem of temporal consistency EE2: Improvement of view interpolation – in particular, appropriate hole-filling and boundary processing methods EE3: Investigation of alternative method for representation: Layered depth video (LDV) – for this, full source code for a view rendering method will be provided to the participants EE4: Coding of Video/Depth data for part of the sequences – set QP values for texture approx. 20…32, explore QP requirement for depth data A general consensus was reached that this EE process targets (only) developing anchors for a possible upcoming CfP, for which the software (source) must be openly available. It may therefore be that either EE1/EE2 or EE1/EE3 combination is used as anchor, depending on better quality and/or compression performance (once the results of EE4 are available). In this context, it 99 is also envisioned that minimum quality expectations are to be imposed for the renderer (e.g. projection of pixels, hole-filling approach, boundary processing). Whereas it is open whether this is relevant for standardization (most likely, most parts of renderers will never be normative), one purpose of the EEs is also to find out which such minimum operational/quality requirements according to the current state of the art could be expected. A better understanding is still needed about the common target – the "vision" shall be discussed under AHG mandates, and accordingly a vision document is expected for the next meeting. As the first set of coding experiments necessary to produce anchors for a possible CfP will be run between October and January, the shortest possible tentative timeline from the current perspective could be as follows: • • • • • Until 09/02: Perform first experiments to decide about bit rates for the MVC-based videoplus-depth anchors, selection of sequences 09/02: Experts viewing again, draft CfP Until 09/04: Further coding experiments, first set of test conditions 09/04: Draft CfP, refinement of test conditions 09/07: Final CfP Documents reviewed m15795 Adaptive Non-uniform Quantization in Depth Format Conversion m15798 m15802 m15817 Results of Exploration Experiments in 3D Video Coding for Dog Data Set 3DV EE3 results on lovebird1 and leavinglaptop sequences 3DV/FTV EE report on Champagne Tower m15820 m15832 Results of EEs in 3DV/FTV for Doorflowers 3DV/FTV EE1 and EE2 results on Alt Moabit sequence m15834 m15837 3D Video Exploration Experiment on LDV of Champagne Tower sequence Reference Software of Depth Estimation and View Synthesis for FTV/3DV Depth Estimation to improve boundary clarification m15847 EE1: Results on 'Pantomime? Sequence using Nagoya SW m15850 EE2: View Synthesis Results on 'Pantomime' Sequence using Thomson SW View Synthesis Tools for 3D Video Results of Experiment on Temporal Enhancement for Depth Estimation 3DV/FTV EE1/EE2 results on Lovebird1 and EE3 result on Leaving Laptop sequence 3DTV Exploration Experiments on Pantomime sequence Results of Exploration Experiments in 3D Video for Lovebird2 3DV EE1 & EE2 on Leaving_Laptop 3DV EE1 & EE2 results on Arrive Book Improvements on View Synthesis and LDV extraction Based on Disparity (ViSBD 2.0) 3DV EE3 LDV results on Arrive Book, Alt-Moa, Newspaper & Lovebird2. Improved View Synthesis Based on Disparity (ViSBD 2.0.beta) EE results on Newspaper Improved view synthesis algorithm m15836 m15851 m15852 m15855 m15859 m15880 m15881 m15882 m15883 m15884 m15886 m15887 m15888 100 Haitao Yang, Yilin Chang, Xiaoxian Liu, Shan Gao, Sixin Lin, Lianhuan Xiong Philipp Merkle, Aljoscha Smolic, Yongzhe Wang, Karsten Müller Patrick Lopez, Guillaume Boisson Taka Senoh, Kemji Yamamoto, Ryutaro Oi, Tomoyuki Mishina, Makoto Okui Shinya Shimizu, Hideaki Kimata Krzysztof WEGNER, Olgierd STANKIEWICZ Lu Yu, Yin Zhao Masayuki Tanimoto, Toshiaki Fujii, Kazuyoshi Suzuki Masayuki Tanimoto, Toshiaki Fujii, Kazuyoshi Suzuki Yun-Suk Kang, Cheon Lee, Yo-Sung Ho Jae-Il Jung, Cheon Lee, Yo-Sung Ho Cheon Lee, Yo-Sung Ho Sang-Beom Lee, Yo-Sung Ho Gun Bang, Gi Mun Um, Jaeho Lee, Namho Hur, Jin Woong Kim Ivana Radulovic, Per Fröjdh Sehoon Yea, Anthony Vetro Dong Tian, Joan Llach Fons Bruls, Lincoln Lobo Dong Tian, Joan Llach, Fons Bruls, Meng Zhao Fons Bruls, Lincoln Lobo, Meng Zhao Dong Tian, Joan Llach Jung Eun Lim, Jaewon Sung Yong-Joon Jeon Output documents: No. Title 10173 Description of Exploration Experiments in 3D Video Coding TBP Available N 08/10/17 8 Explorations – High-Performance Video Coding To face the challenges that emerging applications impose on the requirements of video coding standardization, ISO/IEC WG11 (MPEG) has held a full-day workshop on 14 October 2008. The key intention of the workshop was to acquire solid information about the context in which video coding will be operating in the future, to enable MPEG draw conclusions for the needs and chances in video coding standardization during the next years. For this purpose speakers had been invited on key topics for the morning sessions, and in addition regular proposed contributions were accepted for the noon and afternoon sessions. The following presentations were given (see N10174): Morning Invited Session 1: Video Coding and Next-Generation Networks 1-1 Tomonori Aoyama (Keio University): Direction of digital media and content evolution and a new generation network to support it 1-2 Jeongyeon Lim (SK Telecom), Simon Ji (LG Electronics), Taesung Park and Daesung Cho (Samsung Electronics), Jae-Seob Shin (Pixtree) : Experiences and forecasts on mobile video services by manufacturers and operators 1-3 Doug Y. Suh (KHU), Won Ryu and Jeong Joo Yoo (ETRI): MPEG-64 (MPEG over IPv6 and 4G networks) Invited Session 2: Video Coding for Future Applications and Devices 2-1 Seonki Kim (Samsung): Advanced Technology in LCD Display – New Driving Scheme and Advanced Super PVA Technology 2-2 Jonghwa Kim (Samsung): Flash Memory for Packaged Media : What it can do and where it fits Regular Session 1: Technology Context of Future Video Coding 3-1 Sinwook Lee, Hyungyu Kim, Hwaseon Shin and Euee S. Jang (Hanyang University): Reconfigurable Video Coding – A Building Block for Future MPEG Coding Standards 101 3-2 Kim Kyunghoon, Kim Nacwoo, Kim Sangkyune, Son Seungchul and Lee Byungtak (ETRI): The necessity of a New MPEG Standard Supporting Real-time Distributed IPTV Environment 102 Afternoon Regular Session 2: Compression Technology 4-1 Geert Van der Auwera and Yeong Taeg Kim (Samsung Information Systems): Triangular Sub-Macroblock Partitioning for Motion Compensated Prediction 4-2 Munchurl Kim (ICU), Changseob Park (KBS): Beyond Macroblock based Predictive Coding 4-3 Kyohyuk Lee, Elena Alshina, Jeonghoon Park, Woojin Han and Junghye Min (Samsung): Technical considerations on new challenges in video coding standardization 4-4 Johannes Ballé, Steffen Kamp, Aleksandar Stojanovic, Mathias Wien and Jens-Rainer Ohm (RWTH Aachen University): Tools for Improving Texture and Motion Compression Conclusions from Workshop (including high-level summary from various presentations): a) Next-generation Networks Fixed: Open where the limits per user are … but consumption is expected to increase by a factor of 1.7 per year Mobile: Limited data rate per user (bitrate achieved in practical services far below theoretical maximum), cost per bit transmitted will always be issue. Complexity issue in battery operated devices b) Devices: Displays: 4K x 2K will happen (2012?). Human/display relationship should be further investigated (will the viewing distance always be 3H or will it become closer?) Color, frame rate, bit-depth also increase. Cameras: No presentation given, but 4Kx2K cameras exist. In general, quality of cameras (low noise) has largely increased recently. Storage: Flash memory – further development no problem; compression is an issue a) because data transfer is slow b) because it has to compete in terms of capacity e.g. against optical storage. Packaged media is relevant application for FM. c) Network Protocol aspects: Impact of network QoS? d) Compression technology: Improvement over the gains reported in Hannover. Main conclusion: Compression as much as possible is needed. The main result of the workshop is that the digital video services over networks are expected to steadily grow over time in terms of resolution, quality and volume (amount of consumption). As a consequence, the overall 103 amount of video data rate that is to be transferred will grow at a very fast pace. Networks are already finding it difficult to carry HDTV resolution and data rates economically to the end user. Further increase in the resolution and the data rates will put further pressure on the networks. For example: High-definition (HD) devices (displays and cameras) are affordable for consumer usage today, while the currently available internet and broadcast network capacity is not sufficient to transfer large amount of HD content economically. While this situation may change slowly over time, the next generation of ultra-HD (UHD) contents and devices, such as 4Kx2K displays for home cinema applications and digital cameras, are already appearing on the horizon. For mobile terminals, video quality using resolutions such as QCIF at low frame rates and low bit rates today is largely unacceptable. While the overall data rate will increase with the evolution of 3D/LTE and 4G networks, also the number of users increases simultaneously with their quality demand. Anticipating that lightweight HD resolutions such as 720p or even beyond will be introduced in the mobile sector to provide similar perceptual quality as for the home applications, lack of sufficient data rates as well as the prices to be paid for transmission will remain a problem for the long term. Analyzing this situation, video bitrate (when current compression technology is used) will go up faster than the network infrastructure will be able to carry economically, both for wireless and wired networks. MPEG has therefore concluded that next generation of video compression technology is needed that has clearly higher compression capability than the existing AVC standard in its best configuration, the High Profile. As a consequence, a study has been started on the feasibility of High-Performance Video Coding (HVC), which is mainly intended for high quality applications, in particular expecting Performance improvements at higher resolution, Applicability to entertainment-quality services such as HD mobile, home cinema and UHD TV. The first steps towards HVC were made by producing the following three documents: – Vision and Requirements of HVC, starting from a document that had previously been presented on the AHG reflector – Call for test materials, which is urgently needed both for further evaluation of evidence of existing technical solutions, as well as for possible standards development (note: Currently available material is often captured with outdated generations of cameras; good test material for ultra-high resolutions does not exist). First responses are expected to the next meeting – Draft Call for Evidence with tentative timeline (depending on availability of test materials) for Call in February, responses by April. Documents reviewed m15796 Video coding in wired and wireless network applications Note: This document was presented immediately after the workshop session, and some of the conclusions stated about have been drawn from it, as far as it could seen as supplementing the workshop presentations. Video over IP with large market potential. Wired and wireless will converge in IP. In China, 94% of IP usage in 2010 will be video. Wired network access 1 Gb/s, next Gen 10 Gb/s. All-IP wireless download will be around 100 Mb/s. Current rates (necess. comp. ratios) EDGE 60 kbps(49 for QCIF), 3G 128 kbps(70 for QVGA), DSL 1.5 Mbbs(78). 3G still too expensive for users. QVGA still needs to be improved.DSL video is not yet competitive with DTV. 104 Haoping Yu, Lianhuan Xiong m15818 m15864 Investigation on mobile display sizes: Could go from 480x320 up to 960x540 (QHD). For home, “theatrical presentation”, necessary view angle should go up to 90 degrees, which would result in 5400x2700 pixels to make pixels invisible. Error resilience is not sufficient in current video coding for IPTV applications. 4G: 960x540Q30p 1 Mbit/s VDSL2: 1920x1080@60p 8 Mbps. Low complexity for mobile is also important Comments on test conditions for high-quality coding experiments Propose QP from 20 … 32 (omit bad quality) Propose to use 4:4:4 mixed PSNR Offer 4Kx2K @ 30 “traffic” sequence and1080p @ 24 “cosme” Vision and Requirements for High-Performance Video Coding (HVC) Codec Shun-ichi Sekiguchi, Shuichi Yamagishi, Yoshihisa Yamada, Yoshiaki Kato, Kohtaro Asai, Tokumichi Murakami T.K. Tan This document was discussed in the joint video and requirements meetings on HVC, and was used as a starting point in drafting N10175. m15899 Technical considerations on New Challenges in Video Coding Standardization Note: This was presented in the workshop. Elena Alshina, Kyohyuk Lee, Woo-Jin Han, Jeonghoon Park, Tammy Lee Use adaptive interpolation and after-loop filters, larger block sizes, improved intra prediction (more directions). Also use initial implementation of decoderside motion vector derivation by template matching. Total gain of 37 % on average for HD 1080p (50% for rolling tomatoes), approx. 25% for 720p for hierarchical B structure. Similar for IPPP structure with 1 reference frame. Output documents: No. Title 10174 Results of Workshop on New Directions in Video Coding 10175 Vision and Requirements for High-Performance Video Coding (HVC) 10176 Call for Test Materials for High-Performance Video Coding Standards Development 10177 Draft Call for Evidence on High-Performance Video Coding 105 TBP Available Y 08/10/20 N 08/10/17 Y 08/10/17 N 08/10/17 Annex H – JVT report Source: Jens Ohm and Gary Sullivan, Chairs Abstract The Joint Video Team (JVT) of ITU-T Q.6/16 and ISO/IEC JTC 1/SC 29/WG 11 held its 29th meeting during 13-17 Oct., 2008 at the Busan Lotte Hotel in Busan, Korea. The JVT meeting was held under the chairmanship of Dr. Gary Sullivan (Microsoft/USA) and Dr. Jens-Rainer Ohm (RWTH Aachen/Germany), and under the associate chairmanship of Dr. Thomas Wiegand (Fraunhofer HHI/Germany) and Dr. Ajay Luthra (Motorola/USA). The JVT meetings opened at approximately 4:30 p.m. on Monday 13 October 2008 and closed at approximately 11:00 a.m. on Friday 17 Oct. 2008. Approximately 78 people attended the JVT meetings and approximately 10 input documents were discussed. The meetings took place in a co-located fashion with a meeting of ISO/IEC JTC 1/SC 29/WG 11 (MPEG) – one of the two parent bodies of the JVT. The subject matter of the JVT meeting activities consisted of work on video coding. 106 Contents Abstract 106 Contents 107 1. Documents of the JVT meeting 109 1.1. Input documents 109 1.1.1 Administrative input contributions ......................................................................... 109 1.1.2 Input liaison statements and parent-body inputs ..................................................... 109 1.1.3 Non-administrative input contributions .................................................................. 109 1.2. Major output documents 109 JVT-AC200 Meeting report of the 29th JVT meeting (this document) ......................................................... 109 JVT-AC203-M (WG 11 N 10146) Draft reference software for SVC (H. Schwarz) [2009-01-15] .............. 109 JVT-AC204-M (WG 11 N 10152) Draft AVC amendment text to specify Constrained Baseline profile and supplemental enhancement information (G. Sullivan and A. Tourapis) [2008-10-24] .................................. 110 JVT-AC205-M (WG 11 N 10149 and WG 11 N 10150) ITU-T Rec. H.264 | ISO/IEC 14496-10 Advanced video coding defect report (G. Sullivan, H. Schwarz) [2008-11-28] ............................................................. 110 JVT-AC206 (WG 11 N 10145) Draft conformance testing for MVC (A. Vetro et al.) [2008-10-24] ........... 110 JVT-AC207-M (WG 11 N 10147) Draft reference software for MVC (A. Vetro et al.) [2008-11-14] ......... 110 1.3. Output documents produced pursuant to WG 11 parent body procedures 110 WG 11 N 10144 Request to create new amendment ISO/IEC 14496-4:2004 / Amd.38 ............................... 110 WG 11 N 10148 Disposition of WG 11 National Body comments on ISO/IEC 14496-4:2008 / DCOR 1 ... 110 WG 11 N 10151 Request to create new amendment ISO/IEC 14496-10:200X/Amd.1 ................................ 110 WG 11 N 10166 Disposition of WG 11 National Body comments on ISO/IEC 14496-5:2001 / FPDAM 19 ....................................................................................................................................................................... 110 2. 2.1. 2.2. 2.3. 2.4. 2.5. JVT administrative and liaison topics 110 IPR policy reminder and update 110 Meeting opening and remarks by the chairmen JVT communication practices113 Scheduling and logistics notes 113 Administrative documents and subjects 114 112 JVT-AC000 List of documents of Hannover meeting .................................................................................. 114 JVT-AC001 (AhG) [G. J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] AHG Report: Proj mgmt and errata ....................................................................................................................................................................... 114 JVT-AC002 (AhG) [T. Wiegand, K. Suehring, A. Tourapis, T. Suzuki, G. J. Sullivan] AHG Report: JM text, ref soft, bitstream, conf .................................................................................................................................. 114 JVT-AC003 (AhG) [H. Schwarz, J. Vieron, T. Wiegand, M. Wien, A. Eleftheriadis, V. Bottreau] AHG Report: JSVM text, S/W, conf ....................................................................................................................... 116 JVT-AC004 (AhG) [A. Segall, T. Wiegand, Y.-J. Chiu] AHG Report: SVC bit depth, color gamut, and chroma format ................................................................................................................................................ 118 JVT-AC005 (Ahg) [H. Kimata, A. Smolic, P. Pandit, A. Vetro, Y. Chen] AHG Report: MVC JD & JMVM text & software .............................................................................................................................................. 118 JVT-AC006 (AhG) [G. J. Sullivan, A. Rodriguez, S. Narasimhan] AHG Report: Splicing operation ......... 119 2.6. Closing session notes 120 2.7. JVT liaison communications and parent-body communications 3. AVC base specification, errata, and related topics 120 120 JVT-AC007 [Editors] Editors' draft corrigendum to AVC (in integrated form) ............................................ 121 4. Scalable video coding (SVC) 123 4.1. SVC reference software 123 5. Multi-view coding (MVC) 123 5.1. MVC profiles (including interlace coding tools issue) 5.2. MVC conformance testing 124 6. Future enhancements of AVC 124 6.1. Constrained Baseline Profile specification 124 6.2. Checkerboard multiplexed video data SEI message 125 107 123 JVT-AC010 (Prop 2.0/3.1) [A. M. Tourapis, W. Husak (Dolby)] SEI message for checkerboard multiplexed video data ....................................................................................................................................................... 125 JVT-AC011 / WG 11 M 15854 (Prop Profile) [T. Na, M. Kim (ICU), J. Lim, Y. Joo, K. Kim, J. Byun (SK Telecom)] A Proposed New Profile and Level on MPEG-4 Part 10 AVC | H.264 for Video Telephony Applications ................................................................................................................................................... 127 7. 8. 8.1. 8.2. 8.3. 8.4. 8.5. 8.6. 9. 10. 11. JVT internal operating rules 127 List of AHGs established 129 JVT project management and errata reporting 129 JM Text, reference software, bitstream exchange and conformance 129 SVC JSVM text and software 129 SVC bit depth, color gamut, and chroma format scalability 130 MVC reference software and conformance 130 Splicing operation 130 Future meeting plans 130 Resolutions conveyed to the WG 11 parent body 130 Attendance 131 108 1 Documents of the JVT meeting 1.1 Input documents 1.1.1 Administrative input contributions The following topics of an administrative nature were discussed: JVT-AC000 List of documents of Busan meeting JVT-AC001 (AhG) [G. J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] AHG Report: Proj mgmt and errata JVT-AC002 (AhG) [T. Wiegand, K. Suehring, A. Tourapis, T. Suzuki, G. J. Sullivan] AHG Report: JM text, ref soft, bitstream, conf JVT-AC003 (AhG) [H. Schwarz, J. Vieron, T. Wiegand, M. Wien, A. Eleftheriadis, V. Bottreau] AHG Report: JSVM text, S/W, conf JVT-AC004 (AhG) [A. Segall, T. Wiegand] AHG Report: SVC bit depth and chroma format JVT-AC005 (Ahg) [H. Kimata, A. Smolic, P. Pandit, A. Vetro, Y. Chen] AHG Report: MVC JD & JMVM text, software, conformance JVT-AC006 (AhG) [G. J. Sullivan, A. Rodriguez, S. Narasimhan] AHG Report: Splicing operation JVT-AC007 [Editors] Editors' draft corrigendum to AVC (in integrated form) 1.1.2 Input liaison statements and parent-body inputs The following ITU-T Q.6/16 and WG 11 parent-body input contributions were considered: WG 11 M 15738 [SC 29 Secretariat] Summary of Voting on ISO/IEC 14496-10:200X/DCOR 1 [SC 29 N 9679] WG 11 M 15942 [German NB to WG 11] GNB comment on ISO/IEC 14496-5:2001/FPDAM 19 1.1.3 Non-administrative input contributions The following non-administrative input contributions were considered: JVT-AC010 (Prop 2.0/3.1) [A. M. Tourapis, W. Husak (Dolby)] SEI message for checkerboard multiplexed video data JVT-AC011 / WG 11 M 15854 (Prop Profile) [T. Na, M. Kim (ICU), J. Lim, Y. Joo, K. Kim, J. Byun (SK Telecom)] A Proposed New Profile and Level on MPEG-4 Part 10 AVC | H.264 for Video Telephony Applications 1.2 Major output documents Major output documents submitted to parent-body review included the following. (Dates listed are planned dates of availability.) 1.2.1.1.1 JVT-AC200 Meeting report of the 29th JVT meeting (this document) 1.2.1.1.2 JVT-AC203-M (WG 11 N 10146) Draft reference software for SVC (H. Schwarz) [2009-01-15] 109 (Conveyed to WG 11 as "Text of ISO/IEC 14496-5:2001/FDAM 19 Reference Software for Scalable Video Coding".) 1.2.1.1.3 JVT-AC204-M (WG 11 N 10152) Draft AVC amendment text to specify Constrained Baseline profile and supplemental enhancement information (G. Sullivan and A. Tourapis) [2008-10-24] (Conveyed to WG 11 as " Text of ISO/IEC 14496-10:200X/PDAM 1 Constrained Baseline Profile and supplemental enhancement information ".) 1.2.1.1.4 JVT-AC205-M (WG 11 N 10149 and WG 11 N 10150) ITU-T Rec. H.264 | ISO/IEC 14496-10 Advanced video coding defect report (G. Sullivan, H. Schwarz) [2008-11-28] (Conveyed to WG 11 in integrated form as "Text of ISO/IEC 14496-10:2008/COR 1" and "Text of ISO/IEC 14496-10:200X 5th Edition".) 1.2.1.1.5 JVT-AC206 (WG 11 N 10145) Draft conformance testing for MVC (A. Vetro et al.) [2008-10-24] (Conveyed to WG 11 as "Text of ISO/IEC 14496-4:2004/PDAM38 Multiview Video Coding Conformance Testing".) 1.2.1.1.6 JVT-AC207-M (WG 11 N 10147) Draft reference software for MVC (A. Vetro et al.) [2008-11-14] (Conveyed to WG 11 as "Study Text of ISO/IEC 14496-5:2001/PDAM 15 Reference Software for Multiview Video Coding".) 1.3 Output documents produced pursuant to WG 11 parent body procedures 1.3.1.1.1 WG 11 N 10144 Request to create new amendment ISO/IEC 14496-4:2004 / Amd.38 1.3.1.1.2 WG 11 N 10148 Disposition of WG 11 National Body comments on ISO/IEC 14496-4:2008 / DCOR 1 1.3.1.1.3 WG 11 N 10151 Request to create new amendment ISO/IEC 1449610:200X/Amd.1 1.3.1.1.4 WG 11 N 10166 Disposition of WG 11 National Body comments on ISO/IEC 14496-5:2001 / FPDAM 19 2 JVT administrative and liaison topics 2.1 IPR policy reminder and update Participants were reminded of the IPR policy established by the parent organizations of the JVT and were referred to the parent body web sites for further information. The IPR policy was summarized for the participants. Participants were particularly reminded of the need to supply a completed JVT IPR status reporting form in all technical proposals for normative standardization. Participants were also 110 reminded of the need to formally report patent rights to the top-level parent bodies (using the common reporting form found on the database listed below) and to make verbal and/or document IPR reports within the JVT as necessary in the event that they are aware of unreported patents that are essential to implementation of a standard or of a draft standard under development. The JVT chair noted that the top-level parent bodies have agreed upon a common patent policy among ITU-T, ITU-R, ISO, and IEC. Some relevant links for organizational and IPR policy information are provided below: – http://www.itu.int/ITU-T/ipr/index.html (common patent policy for ITU-T, ITU-R, ISO, IEC and guidelines and forms for formal reporting to the parent bodies) – http://ftp3.itu.int/av-arch/jvt-site (JVT contribution template for each meeting) – http://www.itu.int/ITU-T/studygroups/com16/jvt/index.html (JVT founding charter) – http://www.itu.int/ITU-T/dbase/patent/index.html (ITU-T IPR database) – http://www.itscj.ipsj.or.jp/sc29/29w7proc.htm (SC29 Procedures) The JVT chair noted that the ITU TSB director's AHG on IPR had issued a clarification of the IPR reporting process for ITU-T standards, as follows (and as previously sent to the JVT email reflector), per SG 16 TD 327 (GEN/16): “TSB has reported to the TSB Director’s IPR Ad Hoc Group that they are receiving Patent Statement and Licensing Declaration forms regarding technology submitted in Contributions that may not yet be incorporated in a draft new or revised Recommendation. The IPR Ad Hoc Group observes that, while disclosure of patent information is strongly encouraged as early as possible, the premature submission of Patent Statement and Licensing Declaration forms is not an appropriate tool for such purpose. In cases where a contributor wishes to disclose patents related to technology in Contributions, this can be done in the Contributions themselves, or informed verbally or otherwise in written form to the technical group (e.g. a Rapporteur’s group), disclosure which should then be duly noted in the meeting report for future reference and record keeping. It should be noted that the TSB may not be able to meaningfully classify Patent Statement and Licensing Declaration forms for technology in Contributions, since sometimes there are no means to identify the exact work item to which the disclosure applies, or there is no way to ascertain whether the proposal in a Contribution would be adopted into a draft Recommendation. Therefore, patent holders should submit the Patent Statement and Licensing Declaration form at the time the patent holder believes that the patent is essential to the implementation of a draft or approved Recommendation.” The JVT chair noted (as also previously remarked on the JVT email reflector) that since we are at the completion of the MVC amendment project, it was suggested that if anyone needs to report IPR on that topic and has not yet done so, now would be a good time to file formal notices to the parent bodies for any patent rights that are believed to be essential to the implementation of the MVC extensions (not to mention any notices not previously filed relating to the new SVC profiles, AVC professional profiles, or other previous projects). It is suggested that, to enable proper interpretation of such formal notices, the MVC amendment should be clearly identified in such formal notices. For example, as “ITU-T Rec. H.264 and ISO/IEC 14496-10 Advanced video coding (2007 Ed.) Amendment 1 (2008): Multiview video 111 coding”. Notices pertaining to other efforts should be made with a similar degree of clarity of identification of the specific standardization work item to which the declaration pertains. The chair invited participants to make any necessary verbal reports of previously-unreported IPR in draft standards under preparation and opened the floor for such reports: No such verbal reports were made. 2.2 Meeting opening and remarks by the chairmen The meeting was opened at approximately 4:30 p.m. on Monday 13 Oct. 2008. It was agreed that the JVT meeting would end by lunchtime on Friday 17 October 2008 at latest. Our goal for this meeting was to finish all major JVT business by noon on Thursday 16 October 2008, leaving only perhaps some minor "tidying up" work after that, with the final closing of the meeting by lunchtime on Friday 17 October 2008. Document handling and other working practices were reviewed for the participants. A document template was attached to various email announcements and could also be found at http://ftp3.itu.int/av-arch/jvt-site/JVT-ACxxx.dot. It contained important instructions and policy information. Participants had been instructed to read it and use it as the basis of their contributions. Documents were made available for download at http://ftp3.itu.int/av-arch/jvtsite/2008_10_Busan. Due to the relatively light workload for this meeting, our usual practice regarding late documents was not followed as strictly as usual. Only one non-administrative contribution (JVT-AC010) arrived originally as a JVT document. It was registered and made available on 10 October 2008 (the Friday before the meeting). This would have ordinarily been past our typical advance-upload deadline for the meeting, but there were no objections to relaxing the ordinary procedures regarding treatment of this late-registered contribution for this meeting. Another nonadministrative contribution (JVT-AC011 / WG 11 M 15854) arrived originally as a WG 11 contribution and was subsequently re-registered as a JVT contribution during the meeting. At the opening session of the meeting, the JVT chairs reminded participants of the relevant IPR policy as described above, and reviewed the status and plans for the work under way in the JVT. The largest area of activity consisted of corrigendum work and multi-view video coding (MVC) software/conformance extensions for the ITU-T Rec. H.264 | ISO/IEC 14496-10 Advanced video coding (AVC) standard. Agenda topics previously approved for consideration at the meeting included the following: – – – – – – – – Progression of work on enhancement of AVC for 3 D / multi-view video coding (MVC). Consideration of proposals for supplemental enhancement information for use with AVC. Consideration of proposals for new enhancements of AVC and its associated conformance and reference software specifications. Maintenance of AVC and its associated conformance and reference software specifications, including resolution of ITU-T Last Call and ISO/IEC ballot comments. Collection of non-normative content to aid in the study and implementation of AVC. Study and coordination relating to use of AVC in systems. Review, planning and coordination for work of JVT. Coordination and communication with other organizations on topics relating to the work of the JVT. 112 – Other business as necessary for JVT consideration. Our work at this meeting was announced in advance by email to be anticipated to consist primarily of review of progress on ad hoc group activities, liaison and coordination issues, maintenance issues, planning, and review of status and progress of work on the following subjects: – Reference software for SVC [WG 11 14496-5 FPDAM 19 ballot completed 29 Aug, with Ballot results in WG 11 M 15754 (summarized as 17 in favor, 0 opposed, and 6 abstaining). – Reference software for MVC [WG 11 14496-5 PDAM 15 ballot to be completed 2 Dec] – Conformance specification for MVC [Currently at WG 11 14496-4 WDAMD 38 status] – Corrigendum to AVC [WG 11 14496-10 DCOR 1 ballot completed 5 Aug, with Comments from Germany, Japan, and US as reflected in WG 11 M 15738]. Further work and additional needs on the development, standardization, and maintenance of the base specification and the recently-completed SVC and professional profiles, and of associated reference software and conformance specifications was noted. An interesting and important item of news was noted at the meeting: The JVT had just recently been given a Prime-Time Emmy Engineering award by the Academy of Television Arts and Sciences. The award ceremony had been on August 23 2008, and was attended by three members of the JVT management team (Gary Sullivan, Thomas Wiegand, and Ajay Luthra) and also by the ISO/IEC JTC 1 chairman (Scott Jameson) and the head of the ITU telecommunication standardization bureau (Malcolm Johnson). 2.3 JVT communication practices JVT documents were available at http://ftp3.itu.int/av-arch/jvt-site. These can also be accessed via ftp with the site name ftp3.itu.int, user ID avguest and password Avguest. Upon login, documents will then be found in the directory "jvt-site". Uploading of contributions is done by upload via ftp protocol to the "jvt-site/dropbox" directory using this account ID and password. JVT email lists are managed through the site http://mailman.rwth-aachen.de/mailman/options/jvtxyz, and to send email to one of these reflectors, the email address is "[email protected]", where "xyz" corresponds to – "experts" for general experts group discussions – "bitstream" for bitstream exchange activities – "svc" for SVC work – "mvc" for MVC work 2.4 Scheduling and logistics notes Information about the meeting, including participation registration information, had been made available at http://sc29busan.org/main/main.php. Participants had been reminded of the need to be properly qualified to attend. Interested parties had been instructed to contact the JVT management team if they sought clarification of what proper qualification entails or if they needed help learning how to obtain such qualification. JVT document registration and contribution archiving followed ordinary JVT practices. Requests to register documents were handled by email to Gary Sullivan ([email protected] or [email protected]). 113 The JVT work was suspended during plenary sessions of the ISO/IEC JTC 1/SC 29/WG 11 (MPEG) parent body. The first JVT meeting session for this meeting was held at approximately 4:30 p.m. on Monday October 13, 2008. Further meetings were held on Wednesday October 15 and Thursday October 16. Some of the discussions on Wednesday October 15 were held jointly with the WG 11 parent body. The primary business was concluded in the afternoon of Thursday October 16. Formal approval of resolutions and available output documents was conducted jointly with the video part of the WG 11 parent body on the morning of Friday October 17. 2.5 Administrative documents and subjects Administrative & AHG report topics 2.5.1.1.1 JVT-AC000 List of documents of Hannover meeting As listed herein. 2.5.1.1.2 JVT-AC001 (AhG) [G. J. Sullivan, J.-R. Ohm, A. Luthra, T. Wiegand] AHG Report: Proj mgmt and errata The overall status of work in the JVT was reported verbally and by email in advance of the meeting as recorded in section 2.2 below. The status of corrigendum drafting finalization activity was provided by the editors' submission of JVT-AC007. 2.5.1.1.3 JVT-AC002 (AhG) [T. Wiegand, K. Suehring, A. Tourapis, T. Suzuki, G. J. Sullivan] AHG Report: JM text, ref soft, bitstream, conf This document described the activities of the JM text, reference software and bitstream conformance Adhoc-Group since the last JVT meeting. There was no activity to report on the JM reference text. JM 14.1 software was released in June 2008 and submitted to the WG 11 parent body as replacement for all previous reference software versions in ISO/IEC14496-5:2001. This release included support of new distortion metrics beyond PSNR, bi-predictive motion estimation for partitions smaller than 16x16, improved motion compensation precision using weighted prediction methods, proper SP decoding support, and generic bug fixes and cleanups among others. JM 14.2 had been released in September and was a bug fix release. A new JM release (JM 14.3) was reported to be scheduled for after this JVT meeting, which is expected to contain improved level constraint support (motion vector size) and more bug fixes. The most important issues for which volunteers are needed were identified as follows: 1) As the official H.264/AVC reference software, the JM should be a correct source for checking implementations. This means the decoder should be able to decode all valid H.264/AVC bitstreams and the encoder should never create invalid bitstreams. This is currently not the case. 2) Depending on the configuration the JM encoder can create invalid bitstreams: Some Level constraints are not properly checked The 16-bit transform requirement is not checked 114 The software coordinators encouraged all JVT experts to volunteer for fixing these issues. A web based bug tracking system has been set up for keeping track of known issues and missing features. The system is publicly accessible but requires registration for entering bug reports. The system is located at http://ipbt.hhi.de. This internet site contains also some usage instructions. Please note that the bug tracking system is using encrypted/secure http (https) for protecting the user’s login. The used certificate is self signed and has to be imported into the user’s web browser. The SHA-1 fingerprint of the certificate is 69:21:86:d9:3e:72:da:3f:e8:30:df:a8:dd:fa:a5:4c:ed:85:b5:09. A list of known issues and their state can be found at: https://ipbt.hhi.de/mantis/view_all_bug_page.php. A list of current bugs was provided as an annex of the AHG report document. It was requested that certain rules should be followed before reporting any new bugs: – The database should be searched on whether the same issue was previously reported. If the problem was reported before, but there is additional information, then this information should be added to the original report. – It should be specified if the problem is related to the encoder, decoder or both. – The version of the software used should be specified. – Description of the problem should be as precise as possible. – The necessary steps to reproduce the problem should be described in detail. – If available, the configuration files or/and command line syntax used to run the software should be provided. – The language terminology used in the standard should be used when referencing the text description. – After filing the report, the user should check if he/she is requested to provide additional or other information relating to this issue. Communications related to bitstream exchange activity have taken place on the bitstream exchange reflector (“[email protected]”). However AHG was not so active since the last JVT meeting. The FTP area for downloading bitstream files is on the main JVT Experts FTP site: ftp://ftp3.itu.int/jvt-site/bitstream_exchange/ The bitstreams can also be accessed from the following http site. http://ftp3.itu.int/av-arch/jvt-site/bitstream_exchange/ To volunteer a bitstream for testing, experts were instructed to please include it in a zip archive along with related files (trace files, configuration, reconstructed frames) and upload it to the dropbox: ftp://ftp3.itu.int/jvt-site/dropbox using user ID "avguest" and password "Avguest". In general, the following naming convention is being followed for the bitstreams in the exchange: FeatureCode_Source_VersionLetter Please refer to the spreadsheet and files on the FTP site for examples. 115 Once a bitstream has been uploaded to the dropbox, send an e-mail to [email protected], and/or the bitstream exchange reflector and it will be made available in the bitstream_exchange directory. To sign up for the bitstream exchange reflector, use the web address given below. Over the web: < http://mailman.rwth-aachen.de/mailman/listinfo/jvt-bitstream > No new bitstreams for non-"professional" profiles were reported to have been exchanged since the last meeting. There had been no conformance related activities since the last JVT meeting. 2.5.1.1.4 JVT-AC003 (AhG) [H. Schwarz, J. Vieron, T. Wiegand, M. Wien, A. Eleftheriadis, V. Bottreau] AHG Report: JSVM text, S/W, conf This document presented the report of the AhG on JSVM text, JSVM software, and conformance. The text of the Joint Scalable Video Model was reportedly not modified relative to JVT-X202 (JSVM-11). The JSVM software had reportedly been improved relative to JVT-AB203 (JSVM_9_14). Known bugs have been fixed. Adoptions of the last JVT meeting and some new features (which were missing) have implemented into the software. The latest version of the JSVM software is JSVM 9.15 (CVS tag: JSVM_9_15). Changes relative to JVT-AB203 (CVS tag: JSVM_9_14): – correction of temporal Id in packet trace files – correction of padding before intra upsampling for Mbaff frames (near top & bottom border) – correction of residual prediction (residual of intra MBs is not used for residual prediction) – correction of derivation of SpatialResolutionChangeFlag and RestrictedSpatialResolutionChangeFlag – correction of typo in motion vector scaling (when cropping parameters change) – correction of derivation of sub-macroblock modes in inter-layer motion prediction – correction of chroma location calculation for the inter-intra combination process – correction of transform coefficient scaling in AVC rewriting mode – correction of derivation of maximum slice size (encoder only) – additional encoder checks for not supported combinations of parameters – correction of encoder control for InterLayerPred equal to 1 – temporally disabling the writing of parameters in scalable info SEI that causes encoder crashes (this will be re-enabled in the future when a bug fix has been implemented, see below) Known bugs: – bug in calculation of m_aadMaxBitrate[][] - fix will be provided by Nokia (argument of setPriorityLayerInfoPresentFlag() should be changed from false to true after the bug fix) – incorrect setting of dpb_output_delay – correction of SNR scalability with Mbaff frames (currently this is considered as spatial scalability in the software) Missing features: – support of field pictures in scalable configurations in encoder (currently only correctly supported in single-layer coding) 116 – – – adding of remaining profile/level constraints in encoder (add checks in decoder?) decoder support for AVC rewrite mode in connection with incomplete layer representations (as adopted at the Geneva meeting in April 2008) error detection & concealment (without the restriction to two layers and fixed prediction structures that was found in the previously implemented version) Further desirable improvements: – general improvement of encoder structure, including using same functions for P and B pictures ("key" and "non-key" pictures) using same functions for "slice mode" using same functions for "IROI" – combine "motion estimation", "motion compensation", and "residual encoding" – support of more flexible encoder configurations, including – GOP structures with non-dyadic prediction structures – combination of MGS and CGS coding – higher flexibility of "MGS vector mode" – if feasible, support of slice data partitioning In order to keep track of the changes in software development and to always provide an up-todate version of the JSVM software, a CVS server for the JSVM software has been set up at the Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen. The CVS server can be accessed using TortoiseCVS, WinCVS, or any other CVS client. The server is configured to allow read access only using the parameters specified below. Write access to the JSVM software server is restricted to the JSVM software coordinators group. authentication: pserver host address: garcon.ient.rwth-aachen.de path: /cvs/jvt user name: jvtuser password: jvt.Amd.2 module name: jsvm or jsvm_red Example 1 shows how the JSVM software can be accessed by using a command line CVS client. Example 1: Accessing the JSVM software with a command line CVS client cvs –d :pserver:jvtuser:[email protected]:/cvs/jvt login cvs –d :pserver:[email protected]:/cvs/jvt checkout jsvm In Example 2, it is shown how a specific JSVM software version – specified by a tag (JSVM_9_8 in Example 2) – can be obtained using a command line CVS client. Note that co represents an abbreviation for the command checkout, which was used in Example 1. Example 2: Accessing the JSVM software version with the tag JSVM_9_8 with a command line CVS client cvs –d :pserver:jvtuser:[email protected]:/cvs/jvt login cvs –d :pserver:[email protected]:/cvs/jvt co –r JSVM_9_8 jsvm It is possible to checkout only a reduced JSVM software package by using the module name jsvm_red instead of jsvm. In this case, the directories JSVM0-config-sample and MVC-Configs are ommitted in the checkout, see Example 3. Example 3: Accessing the JSVM software without the JSVM0 and MVC directories. cvs –d :pserver:jvtuser:[email protected]:/cvs/jvt login cvs –d :pserver:[email protected]:/cvs/jvt co jsvm_red The CVS repository includes a JSVM software manual, which provides further information on the JSVM software. 117 The text of the conformance document "Draft conformance testing for SVC" was submitted as JVT-AB205, which corresponds to “Text of ISO/IEC 14496-4:2004/FDAM 31 Conformance Testing for Scalable Video Coding” [WG 11 N9971” as delivered to ISO Secretary on October 1st 2008. Discussions: – Is the software status good enough to go for standardization approval of a new version soon? We should approve a new version as soon as we have sufficient stability. – There were no NB comments, so is it appropriate to proceed with the Study doc of Hannover meeting? Most probably yes, because bug fixing in software is desirable. 2.5.1.1.5 JVT-AC004 (AhG) [A. Segall, T. Wiegand, Y.-J. Chiu] AHG Report: SVC bit depth, color gamut, and chroma format The AhG had been established to study bit-depth, color gamut and chroma format scalability. The mandates of the AhG were: – Identify applications – Work out suggestions for detailed needs – Find/create test material – Study bit-depth reduction techniques, e.g., tone-mapping tools – Study color space and/or gamma conversion requirements – Study combined spatial and bit depth scalability – Define experiments and test conditions – Investigate software and text modification needs – Identify complexity issues However, there was no activity on the reflector. Despite the apparent lack of progress, the AhG recommended to continue the AhG in hope that future progress would be made. 2.5.1.1.6 JVT-AC005 (Ahg) [H. Kimata, A. Smolic, P. Pandit, A. Vetro, Y. Chen] AHG Report: MVC JD & JMVM text & software At the Hannover meeting, the JVT established the AhG on MVC JD and JMVM text, software, and conformance with the following mandates: 1) Collect comments on draft, perform necessary editing and delivery. 2) Maintain JMVM and JD document and collect comments on the text. 3) Coordinate JD/JMVM software integration 4) Coordinate bug-fixing process for the JD/JMVM software 5) Maintain JD/JMVM software manual 6) Plan, edit, and collect bitstreams for MVC conformance specification The status of work in this AHG was reported as follows: Regarding Specification Text: The JD8 was submitted to JVT as JVT-AB204 on October 1, 2008. This was reported to be the final draft of the amendment text. There were a number of significant changes to all parts of the specification, including signaling of profile and levels, NAL unit semantics, syntax and semantics of sequence parameter set extension, MVC decoding process, sub-bitstream extraction process, level definitions and SEI messages. Relevant errata have also been accounted for in the final editing. 118 Regarding Conformance: A first draft of MVC conformance testing was produced and uploaded as JVT-AB206 on August 28, 2008. The draft included descriptions for 18 bitstreams for the Multiview High profile covering four major categories: multiview dependency structure, number of views, memory management and control, and subset SPS. No bitstreams had reportedly been collected yet, but contributions are expected after this first draft has been reviewed by the JVT. Regarding Reference Software: The JD software (JMVC 2.0) was delivered to the group on August 30, 2008 as JVT-AB207. This release contained some software improvements and bug fixes. We need to evaluate the capability of this software to produce conformance streams and update the workplan for software integration accordingly. The AhG recommended the following: 1) Discuss WD on MVC conformance and capabilities of reference software 2) Plan for collection of MVC conformance bitstreams; recommend WG11 progress the conformace testing specification to PDAM stage 3) Consider any errata reports and possible future ammendments based on needs from outside organizations (e.g., enabling interlaced coding tools in MVC, requirements for higher color sampling and/or pixel bit depth) For the meeting discussions on these topics, see section 5 of this report. 2.5.1.1.7 JVT-AC006 (AhG) [G. J. Sullivan, A. Rodriguez, S. Narasimhan] AHG Report: Splicing operation Most of the activity of the AHG members was in the continuing support for standards work in SCTE and DVB related to splicing based on the pending AVC corrigendum. The content of this AHG report was based on the personal knowledge of the AHG chairs (primarily Sam Narasimhan), rather than on discussions held on the JVT experts reflector. It should thus be regarded as input information for consideration rather than as a group consensus report. This report includes some of the inputs from JVT-AB007. SCTE 128 specification for carriage of AVC in cable networks specified a constraint on MaxDpbSize for broadcast applications in order to achieve ‘seamless’ behavior in receivers when there is a transition in horizontal resolution only (no change to vertical resolution, frame rate, profile/level). The text in the standard appeared to violate AVC semantics for both MaxDpbSize and max_dec_frame_buffering and a suggestion from the last JVT meeting to maintain conformance was adopted into an amendment document. Following excerpts a part of the adopted text: <quote> The value of "MaxFrameBuffers" is specified in Table 9 below. For each of the resolutions in Table 9, the coded video sequence shall not require the units of frame buffers in the DPB (Decoded Picture Buffer) to be greater than MaxFrameBuffers to enable the output of the decoded pictures at the specified output times. The syntax element num_ref_frames in the AVC Sequence Parameter Set shall be set to a value less than or equal to the value MaxFrameBuffers. If the syntax element max_dec_frame_buffering is present in the VUI parameters syntax structure of the sequence parameter set, its value shall be set equal to MaxFrameBuffers. If the syntax element max_dec_frame_buffering is not present in the VUI parameters syntax structure of the sequence parameter set, the bitstream shall still obey the same constraints as if the 119 syntax element max_dec_frame_buffering had been present and equal to MaxFrameBuffers. </quote> Based on the corrigendum items clarifying the inference of no_output_of_prior_pics_flag and usage of end_of_stream NAL unit in concatenated bitstreams, SCTE is currently completing specification DVS 714 (stream conditioning to enable splicing) and associated receiver standards. DVS 714 uses the end_of_stream NAL unit to signal splice points (for example at both start of an ad-insertion and end of insertion) with an IDR picture following the end_of_stream NAL unit. Under the constraint of changes to horizontal size of coded pictures only, DVS 714 and associated receiver specifications mandate the correct processing of no_output_of_prior_pics_flag – I.E;, if set to ‘0’ receiver must output all pictures from the DPB correctly and if set to ‘1’ flush the DPB. Across a splice point (signaled using end_of_stream NAL unit), no gaps are allowed in access unit removal time (DTS). However, gaps are allowed in DPB output time (PTS) and receivers are mandated to repeat the last decoded picture till the next picture is available for output (a behavior currently specified by MPEG-2 for low delay and still picture modes). As one may differ in inferring that AVC allows an end_of_stream NAL unit to follow an end_of_sequence NAL unit, this is precluded in DVS 714 as it may cause confusion to receiving equipment. DVB has completed the requirements for “Codec and Format Transitions” and this will be used together with the output of this AHG to develop associated specifications in the near future. We also expect the work in SG 9 of ITU-T to harmonize with these efforts. 2.6 Closing session notes The closing sessions of the meeting were held in a split fashion, with overall status review and output planning conducted on the afternoon of Thursday October 16, and final review of meeting resolutions and available output documents conducted jointly with the video part of the WG 11 parent body on the morning of Friday October 17. In the closing sessions there were no requests to reopen discussions of preceding agenda topics and side activities recorded elsewhere in this report. The JVT thanked its ISO/IEC JTC 1/SC 29/WG 11 (MPEG) parent body and the meeting organizers for hosting the 29th JVT meeting. The JVT meeting was closed at approximately 11:00 a.m. on Friday 17 October 2008. 2.7 JVT liaison communications and parent-body communications The JVT did not receive or send formal liaison communications at this meeting. 3 AVC base specification, errata, and related topics The latest prior errata reporting status had been provided in JVT-Z210 and the previous meeting report (JVT-AB200). 120 3.1.1.1.1 JVT-AC007 [Editors] Editors' draft corrigendum to AVC (in integrated form) The editors provided the current state of the corrigendum drafting work as JVT-AC007 for review. Several details of the corrections were reviewed by the group, with some editing of tentative results conducted in real time. Some discussed topics included: – Inference of low_delay_hrd_flag when it is not present. – Potentially adding informative advice advising against locking the value of PicOrderCnt to output timing when output timing differs from sampling timing. – Informative references to documents/specifications. – The statement in subclause 8.2.5 saying "For a complementary reference field pair, the pair is marked the same as both of its fields." – Clarification of the number of bits used to represent cpb_removal_delay in regard to which SPS is used for its parsing, and other aspects of the parsing of picture timing SEI messages in relation to SPS activation, which may require storing the picture timing SEI message prior to being able to parse it. – The upper limit of max_dec_frame_buffering syntax element in relation to a tautological constraint identified in Annex A. – The wording of informative text relating to the end of stream NAL unit. – The meaning of the term "sequence" in the semantics of the subsequence layer characteristics SEI message. – The semantics of the picture timing SEI message (e.g., examples of usage and num_units_in_tick) – Aspects of the marking and buffering of complementary field pairs (e.g., subclause 7.4.3.3, and the meaning of the phrase "complementary field of"). – The definition of the fR variable in Annexes A and G. WG 11 National body comments were provided as WG 11 M 15738, and these comments along with their disposition is provided below. This disposition was recorded for WG 11 purposes in the output document WG 11 N 10148. Germany NB Comment #1: The Study text WG 11 N 9976 should be considered. Disposition: The referenced study text was used as the basis of the COR as requested. Germany NB Comment #2: The formulation in A.2.1.1 does not clearly express whether "constrained baseline" is meant as a new conformance point of AVC. Clarification is requested. Disposition: WG 11 has issued a new PDAM in which the "constrained baseline" bitstreams and decoders are specified as a new conformance point. When approved, this new conformance point specification will replace the non-normative terminology definition. The new profile will be defined to be technically identical to the "constrained baseline" terminology. Japan NB Comment #1: General comment: JNB requests to reflect "Study Text of ISO/IEC 14496-10:200X/DCOR1 (WG 11 N 9976)". Disposition: The referenced study text was used as the basis of the COR as requested. 121 Japan NB Comment #2: Comment on level limits: As section 3.4.4 of the resolutions of 85th WG 11 meeting (WG 11 N 9961) indicates, there still remains open issues regarding level limits that were raised by the JNB comment (WG 11 M 15558). The deletions of level limits described in "Text of ISO/IEC 14496-10:200X/DCOR 1 (WG 11 N 9574)" may cause troubles to the existing decoder products. Therefore, JNB requests restoring the deleted paragraphs (A.3.3.a, G.10.2.2.a, A.3.1.c, A.3.3.i and G.10.2.2.i in the original text (WG 11 N 9198) to the original state or the equivalent constraint condition as described in WG 11 M 15558 before promoting DCOR 1 to the final stage. If the issues are not solved, JNB requests to cancel the deletion of the related paragraphs in DCOR 1, and to continue the discussion as a further corrigendum item. Disposition: In consultation with key members of the Japan NB, modified expressions of the level limits have been developed. These level limits have not been removed. Japan NB Comment #3: JNB requests to include a statement that prohibits an encoder from generating a bitstream that would put a decoder into an undefined output state that persists beyond recovery_frame_cnt. Inclusion of such statement for resolving POC type1 problem was agreed at the 28th JVT meeting. Disposition: This issue has been resolved as requested with appropriate clarification text. US NB Comment #1: To the extent feasible, the finalization of the corrigendum should be coordinated closely with the corresponding corrigendum approval process under way in ITU-T. Disposition: The work has been coordinated and we believe that the result is maximally aligned with that of the corresponding approval process in ITU-T (to the extent that this is feasible without undue delay). US NB Comment #2: The text should be checked carefully to ensure that all valid identified (prior and newly-identified) problems for which it is feasible to provide a mature fix have been adequately addressed. This particularly includes all issues noted in document JVT-Y210 and recent JVT meeting reports. A number of topics identified in JVT-Y210 have yet to be fully resolved. These include correction/clarification of the following aspects: a. parsing and ordering issues relating to the transition boundary between different coded video sequences, including issues relating to the relative ordering of buffering period SEI, picture timing SEI, picture parameter sets and sequence parameter sets -for example, the determination of the size of the syntax element cpb_removal_delay. b. the definition of MaxFPS with respect to frames versus fields interpretation, c. the meaning of "the clock frequency of a video signal", d. the semantics of memory_management_control_operation command equal to 3 in relation to a "short-term complementary reference field pair". Disposition: Substantial work has been conducted to ensure that the corrigendum text corrects all valid identified issues for which it is feasible to provide a mature correction or clarification. The four specific identified issues, in particular, have been fully addressed. The editors were given discretion to finalize the corrigendum draft in a manner consistent with the above and provide the result as JVT-AC205 / WG 11 N 10149. It was agreed that the draft should be made available to the JVT with some opportunity for review by the members prior to final processing by the parent bodies. For parent body publication purposes, it was agreed that the JVT preference is for the corrigendum work to be embodied in a new edition of the standard rather than published as a separate list of corrections. 122 4 Scalable video coding (SVC) 4.1 SVC reference software The work on developing reference software for SVC was considered sufficiently mature for progression to FDAM (final) status in WG 11. The German national body of WG 11 had submitted a late comment document M15942 requesting that the software should be checked such that all known bugs were fixed and integrated, and that the Study of FPDAM should be considered. The JVT issued the WG 11 N 10166 disposition of comments document embracing this comment. 5 Multi-view coding (MVC) 5.1 MVC profiles (including interlace coding tools issue) A potential need for MVC to support "interlaced coding tools" (frame_mbs_only_flag equal to 0) was reported in the AHG report JVT-AC005. The report suggested that there may be applications that, for example, require encoding of interlace-captured stereoscopic content (each view being captured with an interlaced camera). Some participants suggested that it would be desirable to change the definition of the recentlydrafted MVC High profile to include support for interlaced coding tools, presumably as a corrigendum action. The justification for doing this would be both the potential need for this capability to be supported in applications and also the fact that we anticipate that many (perhaps most or nearly all) implementations of the MVC High profile would be based on existing (or developing) implementations of the AVC High profile. Since the AVC High profile already includes support for these coding tools, it was suggested that there should not be a significant burden imposed on implementers to require such support in MVC usage as well. In terms of drafting effort, it appeared that it would probably not be difficult to specify this feature in the text. The text drafting work would seem to mostly consist of just removing the requirement for frame_mbs_only_flag to be equal to 1. Some participants expressed a desire to see more investigation of the use of interlace in the application, as there is no interlace usage in the current JMVM derived software and there have been no demonstrations of the user experience with such usage that have been shown to the JVT. There also did not appear to be much of a clear message from the market in terms of evidence that the capability is definitely needed for the application. Some participants suggested that not all implementations of MVC may be based on AVC High profile, and, in such a case, supporting interlaced coding tools in such implementations could become a burden. It was noted that the final text for the MVC specification had just been produced, and it clearly did not include support of the interlaced coding tools. There was some suggestion that we should 123 consider it to be too late to change that status. Some participants suggested that if a profile is needed that includes such features; this should be done by specifying a separate, additional profile. However, it was noted that having different profiles that differ only in regard to whether they support interlaced coding tools or not may also not be desirable in terms of confusion, market fragmentation, limitation of interoperability scope, etc. It appeared that further information would be needed before any action could be taken on this issue. JVT disposition: The JVT agreed to produce a meeting resolution to request further input on the topic. 5.2 MVC conformance testing There was a discussion of whether the work on MVC conformance testing was sufficiently mature to merit giving it PDAM status in the WG 11 parent body. Remark: Must at least have the specifications of streams and the names of companies who generate them. Post-meeting note: A start code emulation correction and some minor editorial modifications were made soon after the Busan meeting, which resulted in issuing a new version of JVT-AB204. After judging its work on MVC conformance test development to have reached sufficient maturity, the JVT agreed to issue a formal request to WG 11 (WG 11 N 10144) to amend the ISO/IEC 14496-4 specification and to recommend progression to PDAM status in WG 11. Shinya Shimizu, Anthony Vetro, , and Chen Ying were appointed as editors of the specification. WG 11 milestone target dates were listed as PDAM 2008-10, FPDAM 2009-02, and FDAM 2009-07. The following WG 11 NBs were listed as supporting the effort: Japan, US, Germany, Finland, and Korea. The JVT agreed to provide the current state of its drafting work on this topic for consideration by the parent bodies as JVT-AC206 / WG 11 N 10145. 6 Future enhancements of AVC 6.1 Constrained Baseline Profile specification The prior issue of whether to define a formal "Constrained Baseline Profile" (profile_idc equal to 66 with constraint_set1_flag equal to 1) had been left open from the preceding meeting cycle, and a need to address the issue had been noted in resolution 3.4.5 of the July meeting of the WG 11 parent body. It had been agreed at the preceding JVT meeting that defining such a profile would be further considered in consultation with the parent bodies, and incoming liaison statements on the subject had been received at the preceding meeting. A comment on the DCOR ballot for the 124 corrigendum to AVC in the WG 11 parent body on the topic had been submitted by the WG 11 national body of Germany as noted above. This configuration of the AVC standard has been selected by WG 11 for its video surveillance MAF specification work, and previous study has also shown that various industry groups are also specifying it. In consultation with WG 11, the JVT reached the conclusion that to finally resolve the issue of the conformance and interoperability in view of this usage; it was desirable to define the Constrained Baseline configuration as a formal profile. Accordingly, a new amendment to the AVC specification was agreed to be produced that would include this specification. However, it was agreed that it was important to make it clear in the new amendment that there is no change to the bitstream signaling and no necessity to change any specification of current usage of profile_idc equal to 66 with constraint_set1_flag equal to 1 that is caused by the specification of this profile. This specification of the Constrained Baseline profile is technically identical to specification of the use of the Baseline profile with constraint_set1_flag equal to 1. Thus, any existing specifications (in other documents that reference this Recommendation | International Standard) that have referred to the use of the Baseline profile with constraint_set1_flag equal to 1 should thus be interpreted as continuing in force as being technically identical to referring to the use of the Constrained Baseline profile (without any need for revision of these existing specifications to instead refer explicitly to the use of the Constrained Baseline profile). The draft was agreed to be produced as JVT-AC204. Editorship is discussed in the next section of this report. A formal request to create the new amendment was issued for WG 11 as WG 11 N 10151. Supporting WG 11 national bodies included France, Italy, Netherlands, Spain, Switzerland, and the US. The terminology definition for the ongoing corrigendum drafting work was allowed to proceed forward, as it has no direct impact on the formal definition of Constrained Baseline as a profile, and may serve the purpose of providing a "preview" of the specification of this as a profile. 6.2 Checkerboard multiplexed video data SEI message 6.2.1.1.1 JVT-AC010 (Prop 2.0/3.1) [A. M. Tourapis, W. Husak (Dolby)] SEI message for checkerboard multiplexed video data This contribution proposed interleaving left and right image views each as quincunx sampling structured images, such that the sampling pattern of a given view corresponds to the squares of a given color on a checkerboard. This checkerboard sampling structure is reportedly supported by some types of stereo displays. It was claimed that the disadvantage in terms of compression (relative to coding the views as different pictures) is not large. The main asserted advantage was that conventional AVC decoders could directly be used for this specific type of stereo displays (with post-processing of the decoded pictures to separate the views). The ability (without specific presented results) of enabling 1080p Blu-ray encoding at 20 Mbit/s was suggested as an application scenario. 125 Question: How to allocate chroma samples? Chroma planes would have the same quincunx style sampling structure as luma planes – half of the samples belong to each view. There was some concern expressed about potential chroma issues. Question: Would the SEI be persistent? No clear view on this, most probably yes, in some form. It was claimed that further postprocessing techniques would not need to be specified. The contribution included a proposal to include some extra “checkerboard_info_entry” data to be carried which appeared to be, in principle, private "user data" without any specification of what it means. Some JVT members expressed concern over the desirability of this "user data" feature and whether its inclusion meant that there needed to be some extra data proprietary sent in order for the SEI message to be useful. The proponent indicated that this data was not necessary and had only been proposed as a way to provide maximal flexibility. It was remarked that since SEI message supplemental data can, in principle, alternatively be sent in an entirely proprietary fashion by use of "user data", we should generally welcome proposals for SEI messages, provided they are well documented and provided we can ensure that they have been demonstrated to be useful. This is especially so when the amount of necessary associated specification text for an SEI message is relatively small. The threshold for acceptance of SEI messages should generally thus be lower than for such things as normative content of profiles. It seemed clear that if we had been aware of this type of display interleaving, we likely would have included support for it in the scope of the prior stereo video SEI message definition, but there does not appear to be a way to extent its definition at this point. Only another new SEI message will suffice. Some concern was expressed over the increasingly diverse set of various ways that we have standardized to support stereo video and whether approving this would cause market confusion. However, it was generally felt that the various alternative approaches do already exist, and not standardizing this SEI message here in the JVT would likely not really help that situation. Considering that support for this scheme is built into some displays, having a small SEI message that enables indicating that this scheme is being used seems desirable. JVT decision: Adopt into new draft amendment being created at this meeting, subject to refinements & caveats as follows: – Improve editorial quality (including 4:2:0 sampling structure clarification as necessary). – Remove "checkerboard_info_entry" undocumented extra data payload. – Refine persistence aspects of design in a manner reasonably consistent with persistence aspects of other SEI message designs. – Use somewhat generalized terms to try to allow alternative future uses (e.g., other forms of spatially interleaved pictures), and otherwise generally provide some extensibility and flexibility in the SEI message design. – A "showcase" demonstration of usefulness needs to be shown at a meeting by April (preferably by January). Gary Sullivan was appointed as editor with proponent Alexis Tourapis as co-editor to help prepare the draft specification. The editors were asked to produce the draft amendment as output document JVT-AC204. 126 6.2.1.1.2 JVT-AC011 / WG 11 M 15854 (Prop Profile) [T. Na, M. Kim (ICU), J. Lim, Y. Joo, K. Kim, J. Byun (SK Telecom)] A Proposed New Profile and Level on MPEG-4 Part 10 AVC | H.264 for Video Telephony Applications This contribution discusses the coding efficiency of various aspects: CABAC vs. CAVLC, B pictures, number of reference pictures. A new profile design was suggested for real-time conversational applications. Remark: Is picture reordering delay at low frame rate acceptable? Summary of proposal is: Baseline + CABAC + B. Picture resolution? Relatively low (QCIF). Remark: Isn't this the same thing as Main profile? Reply: No, FMO type II (rectangular slices) support is desired. Alternative expression of proposal: Main + FMO type II. Various other restrictions were suggested in the proposal (limit on number of reference pictures, limit on B picture usage, prohibition of CAVLC, turning off intra prediction in P and B pictures, sub-MB partitioning disabled in B pictures, deblocking disabled for chroma). Remark: It is unclear whether the compression gain is appropriate for the added latency, and whether the restrictions are justified by the complexity rationale (when considering the widespread existence of implementations). Remark: ROI fidelity adjustment capability can be achieve using QP control rather than by FMO type II. Remark: Ordinary slice structured coding may also be able to provide much of the desired properties. Remark: QCIF is very a very small picture size, such that it seems unclear whether the benefits of FMO would be meaningful in such small pictures. Contribution noted. 7 JVT internal operating rules JVT decision: The following clarifications/adjustments of JVT operating rules have been adopted. The JVT decided that participants shall to refrain from long (=more than 4 Minutes) presentations of their proposal, if they are proposing coding efficiency improvements and the results of their coding efficiency experiments have provided less than 2% bit-rate on average (or equivalently 0.1 dB gain on average). Presentations should also not use "cherry picking" of results for summary reporting in abstracts and presentations. Summary reports must be true summaries – not highlights of best results while ignoring worst results. 127 Regarding late contributions: Due to our difficulties with a large quantity of late-submitted contributions at some previous meetings, the JVT has agreed that no late-uploaded (non-AHGreport, non-liaison, non-verification) contributions will be presented without having a minimum of 4 JVT participants (working for separate organizations other than that of the primary contribution author) recorded by name as supporting the allowance of such a presentation, in addition to a consensus of the general JVT membership to allow the presentation. Such support to allow a presentation is to be understood to not necessarily imply support of the adoption of the content of the late contribution, but only as a positive expression that the document should be allowed to be presented. Additionally, the provider of such a presented late contribution shall send an email apology to the JVT email reflector. This rule does not apply to material requested by the JVT at the meeting (e.g., reports of JVT-authorized "break out group" side activities). However, this rule was somewhat relaxed for purposes of this meeting as noted above. For all contributions that have presentation material that is used to present them to the group (e.g., PowerPoint presentations), the presentation material should be provided along with the written contribution (within the same zip container file). PDF is preferred over PPT for presentations when the PPT filesize is large and there is no need for the slide deck to be editable by others. All submissions must be made in JVT-ACxxx.zip format with the Word docs, Excel sheets and other information being inside the zip container. The document must contain an abstract and be accompanied with an e-mail notification containing title, authors and abstract (identical to the one in the doc) which is no longer than 200 words and no shorter than 25 words and is written in 3rd person language in a manner that does not express endorsement of the content of the document. Regarding filenames inside of .zip containers – use a filename so that if someone takes the files out of the zip container, they would still know what contribution they came from. Thus, every file (or directory) in the .zip container for document JVT-ACxxx should start with JVT-ACxxx. Example: JVT-ACxxx.doc (main document), JVT-ACxxx_presentation.pdf, JVTACxxx_results1.xls, etc. When providing additional or revised files, do not include copies of files that were already included in the prior .zip archive for the same contribution and do not re-use the same filenames without adding revision numbers (_r1, _r2, etc.) – this saves us needing to worry about whether the files someone obtains with the same filenames are the same or different. Independent verification (necessary for adoption of a normative technical proposal) is provided either through a) independent implementation by 1 or more organizations different than that of the proponent based on the textual description (after adoption, both decoder source code versions must be made publicly available along with one encoder version), or b) providing source code to all CE participants prior to the meeting (CEs can only be joined at the meeting, when the CE is created. CEs are created at each meeting and last until the next meeting.) Simply running binary executables provided by a proponent is not ordinarily considered independent verification. Source code should be provided and used, and the verifying party should invest a proper degree of effort to ensure that the “verification” they perform is a meaningful and professional study with significant depth rather than just a perfunctory procedural formality. For every SEI message and every syntax element that are currently in the SVC/MVC draft, a "showcase" must be provided in order to retain it in the JSVM/JMVM/JD. If such a showcase is 128 not provided at the next meeting for an SEI message or parts of it, the SEI message or the respective parts will be removed from the JSVM/JMVM/JD. The source code and executables for the showcase must be made available. When Core Experiments (CEs) are to be established, a first CE description should be available at the last day of the meeting (or at least within a few days). Changes of the CE description are only allowed until 3 weeks prior to the next meeting. These changes must be of evolutionary characteristic relative to the input documents on which the CE is based and must be agreed by those who contributed the respective input document(s) or be added as an option. Contributions that are proposals of new technology that was not what was described as being tested in a CE (even if related to the tested technology) should not indicate that they are CE documents in their title and abstract. 8 List of AHGs established The following JVT “ad hoc groups” (AHGs) were established to progress work on identified topics until the next meeting of the JVT. 8.1 JVT project management and errata reporting Discussion: [email protected] Chair: Gary Sullivan, Jens Rainer Ohm, Ajay Luthra, and Thomas Wiegand Mandates: – Collect errata reports on standards under management of JVT – Coordinate overall interim JVT progress – Prepare status information for JVT status reporting 8.2 JM Text, reference software, bitstream exchange and conformance Discussion: [email protected] Chair: Thomas Wiegand, Karsten Sühring, Alexis Tourapis, Teruhiko Suzuki, Gary Sullivan Mandates: – Maintain and update JM algorithm description text – Maintain and update JM reference software and its usage manual – Facilitate exchange of test bitstreams to aid interoperability testing – Collect bitstreams for inclusion in (non-SVC, non-MVC) Conformance specifications – Identify and correct problems in Conformance specifications and associated bitstreams 8.3 SVC JSVM text and software Discussion: [email protected] Chair: Heiko Schwarz, Jérome Vieron, Thomas Wiegand, Mathias Wien, Alex Eleftheriadis, Vincent Bottreau Mandates: – Edit and deliver improved JSVM text – Coordinate JSVM software integration – Coordinate bug-fixing process for the JSVM software – Maintain JSVM software manual 129 8.4 SVC bit depth, color gamut, and chroma format scalability Discussion: [email protected] Chair: Andrew Segall, Thomas Wiegand, Yi-Jen Chiu Mandates: – Identify applications – Work out suggestions for detailed needs – Find/create test material – Study bit-depth reduction techniques, e.g., tone-mapping tools – Study color space and/or gamma conversion requirements – Define experiments and test conditions – Investigate software and text modification needs – Identify complexity issues 8.5 MVC reference software and conformance Discussion: [email protected] Chair: Shinya Shimizu, Anthony Vetro, Ying Chen Mandates: – Coordinate MVC reference software development and bug fixing – Maintain software manual – Plan, edit, and collect bitstreams for MVC conformance specification 8.6 Splicing operation Discussion: [email protected] Chair: Gary Sullivan, Arturo Rodriguez, Sam Narasimhan Mandates: – Study the use of bitstream splicing in applications – Investigate potential needs for SEI data to aid in splicing operations, including consideration of JVT-Z040, JVT-Z041, and JVT-Z042 and the issues raised in their discussion – Study the implications of ITU-T Rec. J.181 and the draft new ITU-T Rec. J.h-dpi – Gather information about activities of other relevant organizations regarding the development of specifications relating to bitstream splicing 9 Future meeting plans The JVT chairmen proposed to hold the 30th JVT meeting during 29 January – 3 February 2009 under ITU-T SG 16 auspices in Geneva, CH. 10 Resolutions conveyed to the WG 11 parent body JVT meeting resolutions were conveyed to the WG 11 parent body as described below: – Requesting approval of output drafts (JVT-AC206 / WG 11 N 10145, JVT-AC203 / WG 11 N 10146, JVT-AC207 / WG 11 N 10147, JVT-AC205 / WG 11 N 10149, JVT-AC205 / WG 11 N 10150, JVT-AC204 / WG 11 N 10152) and disposition descriptions for WG 11 national body comments (WG 11 N 10166, WG 11 N 10148). – A formal request (WG 11 N 10144) to amend the ISO/IEC 14496-4 MPEG-4 conformance specification to include MVC conformance as reflected in a draft amendment (JVT-AC206 / WG 11 N 10145). 130 – A formal request (WG 11 N 10151) to approve creation of a draft amendment (JVT-AC204 / WG 11 N 10152) to the ISO/IEC 14496-10 MPEG-4 AVC specification to add specification of a Constrained Baseline Profile and SEI message. – A request to publish a 5th edition integrated text (JVT-AC205 / WG 11 N 10150) of the ISO/IEC 14496-10 MPEG-4 AVC specification upon completion of the ballot for ISO/IEC 14496-10:2008/FDAM 1. The 5th Edition will include ISO/IEC 14496-10:2008/FDAM 1 and ISO/IEC 14496-10:2008/COR 1. The following persons were named as Editors for the 5th edition: Heiko Schwarz, Gary Sullivan and Thomas Wiegand. – Requesting WG 11 national bodies to study output drafts. – Thanks to WG 11 national bodies for their valuable comments on ballots. – Thanks to MERL, Nokia, NTT and Thomson for their commitment to provide conformance streams for MVC Conformance Testing (H.264.1 and ISO/IEC 14496-4:2004/Amd.38). – A request to WG 11 NBs to submit information and comments about the desirability of defining Multiview Video Coding Profile(s) with frame_mbs_only_flag = 0. – A proposal to hold the 30th JVT meeting during 29 January – 3 February 2009 under ITU-T SG 16 auspices in Geneva, CH as described above. – Information regarding the ad hoc group activities planned by the JVT as described above. – A remark of celebration of that on 23 August 2008, the JVT was awarded a 2008 Primetime Emmy Engineering award by the Academy of Television Arts and Sciences. This remark noted that the Academy has acclaimed the development of the High Profile of ITU-T H.264 | ISO/IEC 14496-10 Advanced Video Coding as being among the "developments in engineering that are either so extensive an improvement on existing methods or so innovative in nature that they materially affect the transmission, recording or reception of television". 11 Attendance Persons attending the meeting, as recorded by a sign-in sheet circulated during the meeting, included the following (78 listed participants): 1. Asai, Kohtaro (Mitsubishi Electric) 2. Bae, Tae Meon (SK Telecom) 3. Bäse, Gero (Siemens AG) 4. Bottreau, Vincent (Thomson R&D France) 5. Chang, Yilin (Xidian Univ.) 6. Chen, Lulin (Omneon Video Networks) 7. Chen, Ying (Tampere Univ. Tech.) 8. Chiu, Yi-Jen (Intel) 9. Cho, Hanjin (ETRI) 10. Choi, Younghee (LG Electronics) 11. Chono, Keiichi (NEC) 12. Chujoh, Takeshi (Toshiba) 13. Fukushima, Shigeru (JVC) 14. Futagami, Motomasa (Sony) 15. Hsiang, Shih-Ta (Motorola) 16. Husak, Walt (Dolby Labs) 17. Ishtiaq, Faisal (Motorola) 18. Itoh, Takashi (Fujitsu Labs) 19. Jeon, Su Yeal (Kwangwoon Univ.) 20. Jeon, Yong-Joon (LG Electronics) 131 21. 22. 23. 24. 25. 26. 27. 28. 29. 30. 31. 32. 33. 34. 35. 36. 37. 38. 39. 40. 41. 42. 43. 44. 45. 46. 47. 48. 49. 50. 51. 52. 53. 54. 55. 56. 57. 58. 59. 60. 61. 62. 63. 64. 65. 66. 67. 68. 69. 70. 71. 72. 73. Jeong, Jin Kyu (Kyunghee Univ.) Jeong, Seyoon (ETRI) Jia, Jie (Sejong Univ.) Jun, Hye-Min (Sejong Univ.) Jung, Soon-Heung (ETRI) Kang, Jung Won (ETRI) Kim, Hyun-il (Onion Tech.) Kim, Ki Oh (Sejong Univ.) Kim, Ki-Baek (Sejong Univ.) Kim, Kyung-Yong (Kyunghee Univ.) Kim, Min Jae (Sejong Univ.) Kim, Seonghoon (Varovision) Kim, Wonjong (ETRI) Kook, Seung Ryong (Kyunghee Univ.) Lee, Jaejoon (Samsung Electronics) Lee, Jeong-Beom (Sejong Univ.) Lee, Miyoung (ETRI) Lee, Sang Gyou (MBC) Lee, Yoon-Jim (Kyunghee Univ.) Lee, Yung-Lyul (Sejong Univ.) Lim, Chong Soon (Panasonic) Lim, Sung Chang (Sejong Univ. --> ETRI) Luthra, Ajay (Motorola) Ma, Siwei (Peking Univ.) Motta, Giovanni (Qualcomm) Nakamura, Katsuyuki (Hitachi) Nam, Jung-Hak (Kwangwoon Univ.) Narasimhan, Sam (Motorola) Nishi, Takahiro (Panasonic) Ogawa, Yurika (Toshiba) Oh, Chi-Young (Onion Tech.) Ohm, Jens-Rainer (RWTH Aachen Univ.) Pateux, Stephane (Orange - France Telecom) Sakazume, Satoru (JVC) Sekiguchi, Shun-ichi (Mitsubishi Electric) Shih, Il Hong (ETRI) Shimizu, Shinya (NTT) Sullivan, Gary (Microsoft Corp.) Sun, Huifang (Mitsubishi Electric) Suzuki, Teruhiko (Sony) Suzuki, Yoshinori (NTT DoCoMo) Tan, Thiow Keng (NTT DoCoMo) Topiwala, Pankaj (FastVDO) Tourapis, Alexandros (Dolby Labs) Trimedee, Mejoh (Nokia) Van der Auwera, Geert (Samsung Info. Sys.) Vermeirsch, Kenneth (Ghent Univ.) Vetro, Anthony (Mitsubishi Electric) Wittmann, Steffen (Panasonic) Yamakage, Tomoo (Toshiba) Yamamoto, Tomoyuki (Sharp) Yang, Haitao (Xidian Univ.) Yang, Jeong-Hyu (LG Electronics) 132 74. 75. 76. 77. 78. Yang, Zhijie (Broadcom) Yao, Wei (I2R) Yea, Sehoon (MERL) Yi, Joo Young (KETZ) Zheng, Jianhua (Huawei) 133 Annex I – Audio report Source: Schuyler Quackenbush, Chair, Audio Subgroup 1 2 Opening of the meeting ......................................................................................................... 135 Administrative matters .......................................................................................................... 135 2.1 Communications from the Chair 135 2.2 Approval of agenda and allocation of contributions 135 2.3 Creation of Task Groups 135 2.4 Approval of previous meeting report 135 2.5 Review of AHG reports 135 2.6 Joint meetings 135 2.7 Received National Body Comments and Liaison matters 135 3 Record of AhG meetings ....................................................................................................... 136 3.1 AhG Meeting on SAOC Sunday 1200-1700 136 4 Plenary presentations ............................................................................................................. 138 5 Task group activities ............................................................................................................. 138 5.1 Joint meetings and documents from other groups 138 5.1.1 Interactive Music Application Format ........................................................................ 138 5.1.2 Audio Channel to Loudspeaker Mapping ................................................................... 139 5.2 Task Group discussions 139 5.2.1 MPEG-2 and MPEG-4 audio, conformance, reference software ................................ 139 5.2.2 MPEG-D SAOC .......................................................................................................... 142 5.2.3 MPEG-D Unified Speech and Audio .......................................................................... 142 5.2.4 Exploration .................................................................................................................. 146 6 MPEG closing plenary discussions ....................................................................................... 147 7 Meeting deliverables ............................................................................................................. 147 8 Responses to Liaison and NB comments .............................................................................. 147 8.1 Recommendations for final plenary 147 8.2 Establishment of Ad-hoc Groups 147 8.3 Approval of output documents 148 8.4 Press statement 148 9 Future activities ..................................................................................................................... 148 9.1 Schedule of future meetings 148 9.2 Agenda for next meeting 148 9.3 All other business 148 9.4 Closing of the meeting 148 Annex A Participants ............................................................................................................... 149 Annex B Audio Contributions and Schedule .......................................................................... 151 Annex C Task Groups ............................................................................................................. 155 Annex D Output Documents ................................................................................................... 155 Annex E Agenda for the 87th MPEG Audio Meeting ............................................................. 157 134 1 Opening of the meeting The MPEG Audio Subgroup meeting was held during the 86th 12-17, Busan, KR. The list of participants is given in Annex A. 2 meeting of WG11, October Administrative matters 2.1 Communications from the Chair The Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary. 2.2 Approval of agenda and allocation of contributions The agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B. 2.3 Creation of Task Groups Task groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below. 2.4 Approval of previous meeting report th The 85 approved. 2.5 Audio Subgroup meeting report was registered as a contribution, and was Review of AHG reports There were no requests to review any of the AHG reports. 2.6 Joint meetings The joint meetings with Audio for the week are shown below: Groups What Where m15846, Marketing & Business status of Systems, Systems Interactive Music Service Requirements, m15878 iKlax - IM AF Business & market status m15901 Comments on MAF overview Audio Systems, Audio 2.7 m15813 Comments on IMAF draft CfP and MAF Overview m15807 Issues of AudioBIFS to applying to an Advancement of Satellite Digital Broadcasting in Japan m15866 Report on flexible signaling of audio channels to loudspeaker mapping using MPEG-4 BIFS Systems Day Wed Time 1400-1500 Wed 1500-1530 Received National Body Comments and Liaison matters The NB Comments and Liaison documents for the meeting that require a response are as shown below. No. Title Topic Response by m15908 Liaison Statement from the Digital Radio Mondiale Consortium to WG 11 m15916 Liaison Statement from "ETSI/EBU/CENELEC JTC on Broadcast" Audio Liaison Statement from WorldDMB Forum via SC 29 Secretariat m15919 m15788 Liaison Statement from AES Proposal to remove 960 transform from the AAC, HE AAC and HE AAC v2 profiles on 960 frame length in the MPEG-4 AAC family of profiles on Proposal to remove 960 transform from the AAC, HE AAC and HE AAC v2 profiles AES Standards Liaison Report 2008 135 S. Quackenbush S. Quackenbush S. Quackenbush S. Quackenbush m15920 Liaison Statement from ITU-T SG 16 m15879 Comment on the Unified Speech and Audio Coding Activity General/All Comment on the Unified Speech and Audio Coding Exploration Activity Comment on the Unified Speech and Audio Coding Activity FRNB comment on the Unified Speech and Audio Coding Exploration Activity m15911 m15914 m15551 3 3.1 Enhanced low delay AAC and media coding summary database Mauri Väänänen on behalf of Finnish National Body Wen Gao on behalf of the Chinese NB Marcus Schnell Pierrick Philippe on behalf of the French National Body Pierrick Philippe on behalf of the FRNB S. Quackenbush S. Quackenbush S. Quackenbush S. Quackenbush Record of AhG meetings AhG Meeting on SAOC Sunday 1200-1700 Jeongil Seo, ETRI, presented m15893 CE Report on Support for a Mastering Downmix Jeongil Seo Seungkwon Beack Kyeongok Kang Kwangki Kim Minsoo Hahn The CE proposes two new elements Mastering Downmix Gain Modified quantization scheme The proposed means to support Mastering dowmix gain is the same as is used in MPEG Surround (Artistic Downmix Gain). However, since mastering downmix MDCT coefficients are biased slightly positive with respect to the mixing downmix, and new quantization scheme is proposed. This effect was observed for many tens of released CDs. The contribution presented the results of a listening test from ETRI and also listening test results from LG. For both labs, the proposed system is significantly better (at the 95% level of significance) than using SAOC with unaltered mastering downmix signal. There will be a break-out group (Jeongil Seo, Werner Oomen, Heiko Purnhagen) to discuss other means to accomplish this goal, which will report during the week. Oliver Hellmuth, FhG, presented m15828 Proposal for adoption of stereo-to-binaural scenario for the Oliver Hellmuth MPEG SAOC system Johannes Hilpert Harald Mundt Leonid Terentiev Cornelia Falch Heiko Purnhagen Jonas Engdegård Jeroen Koppens This presented evidence on the operation of a “missing mode” in SAOC, the mode being stereo downmix to binaural presentation. Evidence of performance, as a listening test, was presented. Stereo to binaural performed similarly to mono to binaural. It was the consensus of the AhG to recommend that the Audio Subgroup accept this technology into the SAOC FCD. Oliver Hellmuth, FhG, presented m15826 Core Experiment on Low Delay MPEG SAOC system Johannes Hilpert Maria Luis Valero Markus Schnell Oliver Hellmuth Leonid Terentiev Jonas Engdegård Heiko Purnhagen Erik Schuijers This proposes a new core experiment which has the objective of reducing the one-way latency of the SAOC system thus making it better for teleconferencing applications. The reduction of latency is accomplished by replacing the SAOC QMF filterbank with a Complex Low Delay Filterbank (CLDFB) which has an analysis-synthesis latency of only 1.3 ms. This is particularly 136 advantageous if the core coder uses the same filterbank, for example AAC-ELD. Example latencies are shown in the following table from m15826: Core coder type Core coder delay (in ms) Delay of core coder and SAOC RM (in ms) Delay of core coder and LD-SAOC (in ms) AAC LD AAC ELD AAC ELD with SBR 21.3 16.0 33.7 41.3 41.3 62.7 22.7 17.3 33.8 This CE proposal needs more technical details and a cross-check listening test. Pierrick Philippe noted that France Telecom R&D would be willing to perform the listening cross-check. Heiko Purnhagen, Dolby, presented m15827 Core Experiment on Low Power MPEG SAOC system Jonas Engdegård Leonid Terentiev Oliver Hellmuth Erik Schuijers This contribution proposes a core experiment on a “low power” real-valued filterbank for SAOC. This filterbank is similar to what is used in MPEG Surround. The new filterbank has no effect on the bitstream syntax, such that one bitstream can be decoded either by the current filterbank or by the “low power” filterbank. The changes include: Real-value filterbank with antialiasing tool Real-value decorrelators. This is a not a complete proposal, and still requires the following information: Complete technical specification Performance information (optionally with cross-check) It was noted that these changes are only for mono or stereo outputs in SAOC. Multichannel output continues to used MPEG Surround, for which the low-power, real-valued processing is already available. The scope of the CE is currently envisioned to cover the “regular” filterbank and not the low delay filterbank. ETRI, LG and France Telecom R&D offered to participate in a listening test to verify the performance of the low power filterbank. Leonid Terentiev, FhG, presented m15829 Proposal for the integration of the enhanced Karaoke/Solo Leonid Terentiev processing into the decoding modes of the MPEG SAOC Cornelia Falch system Oliver Hellmuth Johannes Hilpert This contribution proposes to revise the descriptive text and figures, but does not propose any technical changes. The AhG recommends to the Audio Subgroup check the candidate text for the SAOC FCD. Leonid Terentiev, FhG, presented m15830 Report on corrections for the MPEG SAOC CD text and RM software Leonid Terentiev Cornelia Falch Oliver Hellmuth Johannes Hilpert Heiko Purnhagen Jonas Engdegård Jeroen Koppens This contribution proposes editorial and technical changes to the SAOC text and reference software. The AhG recommends to the Audio Subgroup that they be incorporated into the SAOC FCD text. The Chair requested that the SAOC FCD text be available for review by interested parties no later than Thursday morning. Yang-Won Jung, LG, presented 137 m15839 Comments on parameter estimation in SAOC Yang-Won Jung Henney Oh The contribution discusses a problem with object energy parameters associated with several signals, the problem being that the parameters appear to saturate the energy quantizatizer table. Leonid Terentiev, FhG, noted that the hypothesized energy parameter values would correspond to input signals of unrealistically high level, and that perhaps the LG calculations are not quite correct. The Chair proposed a break-out discussion to clarify this issue, and if the LG calculations were not correct then perhaps the SAOC encoder informative text requires clarification or expansion. Yang-Won Jung, LG, presented m15840 Proposed modification on parameter estimation in SAOC Yang-Won Jung Henney Oh The contribution presents a means to reduce side information bitrate. As a byproduct, it notes an issue concerning quantization errors in OLD, DMG and DCLD parameters. The AhG recommended that there be a break-out group to discuss these issues which will report to the Audio Subgroup during the week. 4 Plenary presentations The HODs of the various National Bodies presented M15911 General/All Comment on the Unified Speech and Audio Coding Exploration Activity Wen Gao on behalf of the Chinese NB m15879 Comment on the Unified Speech and Audio Coding Activity Mauri Väänänen on behalf of Finnish National Body m15914 Comment on the Unified Speech and Audio Coding Activity Pierrick Philippe on behalf of the French National Body Prof. Huang, the Chinese HOD, noted that their comment raises two broad issues In the Core Experiment process, testing all 9 operating points may be too burdensome. Core Experiments should be conducted on a single source code base for encoder and decoder. Chair noted that if the encoder source is mandated for CEs, then in his opinion this runs counter to the Audio CE methodology in force at the time of the Call. Ralf Geiger, FhG, noted that there might be a danger in using sub-optimal source code to select CE technology that might not be needed relative to a more optimized code base. Justin Ridge, Finish HOD, noted that a CE is credible if both the encoder and decoder source code are available, and the successful CEs should provide their new coding tool as optimal source code. Pierrick Philippe, France Telecom R&D, proposed that RM0 be made available as an object module which CE proponents can use as a toolbox for their CE proposal. Prof. Huang, the Chinese HOD, reiterated its position that a source code framework for CEs would facilitate the widest collaboration. 5 Task group activities 5.1 Joint meetings and documents from other groups 5.1.1 Interactive Music Application Format The following document were presented in the joint meeting: m15878 m15846 m15901 m15813 iKlax - IM AF Business & market status Marketing & Business status of Interactive Music Service Comments on MAF overview Comments on IMAF draft CfP and MAF Overview The first document’s presenter noted that there is considerable business demand and market opportunity for interactive music. For example, there may be several instrumental arrangements and several vocal tracks, and the options on mixing combinations must be constrained. The second document’s presenter noted that his company, Audizen, focuses on the Korean and Asian 138 markets. They have over 100 CDs and an on-line music store using their current technology. Overall, the two contributions indicate a strong demand for interactive music. The third document noted that currently in IM AF, MPEG-4 AAC profile is the audio coding format. It suggested the following recommended that the following coded audio formats be supported in IM AF: MP3 MPEG-D SAOC WAV Heiko Purnhagen, Dolby, presented the last document. This gave a number of editorial and technical corrections and suggestions concerning the IMAF Mixing means gain applied to the set of tracks, possibly including a restriction on the permitted gains. The Systems chair and Requirements Chair noted that there is really no need for a Call if there is not new technology needed for the MAF. Additional discussion noted that the constraint solver must be normative if a user experience is to be enforced. 5.1.2 Audio Channel to Loudspeaker Mapping Yasushige Nakayama, NHK, presented m15807 Issues of AudioBIFS to applying to an Advancement of This noted that AudioBIFS has two difficulties for the ARIB system. First, it has not yet been reviewed, and to be fully reviewed would delay the system deployment, and second, it has a complexity that is too high for the consumer marketplace. At the last MPEG meeting, NHK presented syntax and semantics for a way to signal the 22.2 program. Discussion amongst audio experts at this meeting resulted in an even simpler means to signal the 22.2. program using implicit channel signalling and an Annex describing the ARIB 22.2 loudspeaker layout. The simpler means was agreed to by NHK experts, and it was the consensus of the Audio Subgroup to incorporate this into the existing 13818-7:2006/Dcor1. Johannes Boehm, Thomson, presented m15866 Report on flexible signaling of audio channels to loudspeaker mapping using MPEG-4 BIFS This presentation reported on the technical details of using MPEG-4 BIFS to describe the proposed ARIB 22.2 channel program. Systems Chair noted that 5.2 Task Group discussions 5.2.1 MPEG-2 and MPEG-4 audio, conformance, reference software Heiko Purnhagen, Dolby, presented m15786 Proposed Draft Corrigendum on AAC-ELD Per Ekstrand Markus Schnell Backward compatible signalling of SBR in AAC-ELD is not allowed. The contribution proposes that this restriction should be more prominent in the specification. Furthermore, it notes an error in aliasing cancelling tool for Low Power mode (i.e. real-valued filterbanks) and gives the correct phase factor that should be used. It was the consensus of the Audio Subgroup to incorportate the proposed Part 3 changes in the current DCOR under ballot and the Part 5 changes in the PDAM to be produced at this meeting. Takehiro Moriya, NTT, presented m15861 Information related to the proposed ALS profile Noboru Harada Tilman Liebchen Takehiro Moriya Yutaka Kamamoto This noted that the principal customer for the proposed ALS profile has withdrawn its support, and hence recommends that this profile remain at WD status. Schuyler Quackenbush, Audio Research Labs, presented m15794 Suggested profile name for ALS A. G. Tescher for USNB 139 This contribution suggested a new name for the proposed ALS profile. The Audio Subgroup agreed that since this profile will not progress to CD status, discussions on profile naming can be postponed until such progression occurs. Takehiro Moriya, NTT, presented m15860 Proposed Corrigenda on MPEG-4 ALS Noboru Harada Tilman Liebchen Takehiro Moriya Yutaka Kamamoto This contribution presented a number of technical corrections required in the ALS specification, as either the textual specification or the reference software. It was the consensus of the Audio Subgroup to incorporate the proposed changes into AMD 2/DCOR 4 of the ALS specification and into a new Dcor to ALS conformance and reference software. The Chair noted that it would be best to issue the conformance Dcor at the next meeting against MPEG-4 Part 26, the new part that will contain all MPEG-4 Audio conformance. Andreas Schneider, Dolby, presented m15876 Proposed study on coupling channel fixes Andreas Schneider Based on the information in the contribution, it was the consensus of the Audio Subgroup to issue a Study on 13818-7 Dcor1 and Study on 14496-3 Dcor 6. Yasushige Nakayama, NHK, presented m15807 Issues of AudioBIFS to applying to an Advancement of Satellite Digital Broadcasting in Japan Yasushige Nakayama The presenter reviewed NHK’s original proposal. This extends MPEG-2 AAC’s original implicit channel mapping for the horizontal plane by proposing similar syntax in the AAC fill element for a “top” plane and a “bottom” plane. In addition, NHK requests that there be an additional entry in the MPEG-4 AAC channel configuration table for the 22.2 loudspeaker case. Johannes Boehm, Thomson, presented m15866 Report on flexible signaling of audio channels to loudspeaker mapping using MPEG-4 BIFS Juegren Schmidt Mario Sieck The contribution reported on how BIFS could be used to map the individual AAC decoded channel signals to the associated loudspeakers. It reported that the data rate and computational complexity are moderate in the context of the Hi-Vision system data rate. It was agreed to conduct an AhG activity in which the following standards bodies are contacted to determine if they have specified means to map coded audio channels to loudspeakers: AES TC100 Ralph Sperschneider, FhG, noted that a 22.2 channel MPEG-2 AAC program in which the PCE signals only 10 channels (the “mid” plane of the 22.2 program), legacy decoders might crash due to input buffer overflow. It was agreed to study the MPEG-2 changes requested by ARIB in a break-out to meet at 1200 today. Participants are at least Ralph Sperschneider, S. Quackenbush, Yasushige Nakayama. Break-out Currently proposal maps channel pairs to horizontal speaker pairs. It is conceivable that mapping to vertical speaker pairs might work better. It was agreed to draft a workplan to investigate the coding of 22.2 program items and also investigate downmix from 22.2 to 5.1 and stereo. The workplan might designate that: NHK provide 22.2 material FhG implement 22.2 encoder and decoder Designated audio experts will informally contact AES and TC100 to inquire about mapping of coded audio channels to loudspeakers. JungHoe Kim, Samsung, presented m15848 Proposed Corrigendum on MPEG-4 SLS JungHoe Kim Ralph Geiger Ti-Eu Chan Eunmi Oh 140 This contribution reports a number of corrections for SLS: It was the consensus of the Audio Subgroup to incorporate the suggested changes as follows: Part 3 – Specification Study on 14496-3:AMD3/DCOR2 Part 4 – Conformance 14496-26/Dcor x (Audio Conformance), to issue at the next meeting Part 5 – Reference 14496-5:AMD10/Dcor 3, to issue at this meeting software Ralf Geiger, FhG, presented m15865 Further information on the complexity of the HD-AAC profile Ralf Geiger Virgilio Bacigalupo This contribution reported on computation complexity and compression performance of the CBAC tool in MPEG-4 SLS. As an overall average, it reports that CBAC tool delivers an additional 0.2% of compression performance and requires an additional computational complexity of 10%. It concludes that in considering compression / complexity trade-off for selecting tools to put in the HD-AAC profile, it recommends that the CBAC tool not be included in the profile. It was the consensus of the Audio Subgroup to split the current working draft on ALS and SLS profile in two, leave the ALS profile at WD and promote the SLS profile to CD at this meeting. The tools in the SLS profile will remain unchanged, specifically the CBAC tool is not included in the HD-AAC profile. Kristofer Kjörling, Dolby, presented m15877 proposed new restriction for the AAC family of profiles and Andreas Schneider proposed new profile Kristofer Kjörling The contribution notes that the vast majority of AAC, HE-AAC and HE-AAC V2 profile implementations only support 1024 block length. The systems that mandate a 960 block length in the bitstreams are DAB+ (HE-AAC V2 restricted to 960 block length) and DRM (Scalable AAC with ER syntax and a 960 block length in combination with SBR and two different versions of parametric stereo). In this respect, only DAB+ has the realistic possibility of interoperating with HE-AAC V2 profile decoders. Concerning the block length issue, the contribution recommends to Create a new HE-AAC V2 profile that is restricted to 960 block length Change the current family of AAC profiles to restricted them to 1024 block length In addition, it recommends moving the non baseline PS to level 5 in the HE-AAC V2 profile. It was the consensus of the Audio subgroup to incorporate PS issue into the Study on AMD 2/COR 4 HE-AAC V2 Profile. The Chair presented the following Liaison statements m15908 Liaison Statement from the Digital Radio Mondiale Consortium to WG 11 Proposal to remove 960 transform from the AAC, HE AAC and HE AAC v2 profiles m15916 Liaison Statement from "ETSI/EBU/CENELEC JTC on Broadcast" on 960 frame length in the MPEG-4 AAC family of profiles m15919 Audio Liaison Statement from WorldDMB Forum WorldDMB Forum via SC 29 Secretariat on Proposal to remove 960 transform from the AAC, HE AAC and HE AAC v2 profiles All contributions raise the legitimate concern that MPEG should not remove support for the 960 block length for the AAC family of profiles. Discussion David Singer, Apple, noted that we might publicize these issues by drafting a public WG11 document that might be provided to Via Licensing. Bernhard Grill, FhG, noted that changing profiles may adversely impact licensing programs. It was the consensus of the Audio subgroup to Prepare an output document summarizing the current view of possible resolutions to the 1024/960 problem. This would 141 o State that WG11 is not removing support for 960 o Encourage players to implement both profiles (block lengths) so as to promote interoperability. However interoperability does not exist today. WG11 would encourages the various DAB systems to take steps so as to have associated bitstreams enter the marketplace in a way that maintains interoperability. Prepare Liaison statements to the various DAB standards bodies affirming MPEG’s support for 960 and attaching the above output document. The Chair presented a draft response to m15920 Liaison Statement from ITU-T SG 16 Enhanced low delay AAC and media coding summary database This was edited and approved. 5.2.2 MPEG-D SAOC Break-out group reports Mastering downmix - It was the consensus of the Audio Subgroup that this technology is accepted into the SAOC FCD, but to use the MPEG Surround ADG mechanism, but rename it since ADG is already used in another part of SAOC. Energy estimation parameter - It was the consensus of the ASG to add informative text to the SAOC specification to clarify this issue. Optional usage of downmix gains – the group requests more information, e.g. including a listening test. Karaoke/Solo - It was the consensus of the Audio Subgroup that this technology is accepted into the SAOC FCD, but to add additional clarifying text concerning MBO handling. Proposed corrections – there were no comments, so this is accepted as it into the SAOC FCD. 5.2.3 MPEG-D Unified Speech and Audio Max Neuendorf, FhG, presented m15867 Detailed Technical Description of Reference Model 0 of the CfP on Unified Speech and Audio Coding (USAC) Max Neuendorf Stefan Bayer Jérémie Lecomte Guillaume Fuchs Philippe Gournay Julien Robilliard Nikolaus Rettelbach Frederik Nagel Ralf Geiger Redwan Salami Markus Multrus This contribution describes the technology selected as RM in the Unified Speech and Audio coding Call for Proposals. The presentation reviewed overall architecture and the various tools used. Subsequent to the presentation, there was a discussion to clarify various issues. Markus Multrus, FhG, presented m15868 Reference Software for Reference Model 0 of the CfP on Unified Speech and Audio Coding (USAC) Markus Multrus Max Neuendorf Jérémie Lecomte Guillaume Fuchs Philippe Gournay Julien Robilliard Nikolaus Rettelbach Frederik Nagel The USAC reference software is included in the zip archive of this document. It was noted that the supplied code has fixed a number of bugs, although a #define can cause the code to be configured to behave exactly as in the CfP submission. The Chair requested that the USAC reference software be checked into the MPEG SVN server. USAC and the CE process The discussion from Monday Audio plenary (see Section 4) was continued on Tuesday afternoon. The Chair summarized the major issues from the discussion as follows: 142 5.2.3.1 Signing an NDA can be a barrier to participation in CEs. On the other hand, an NDA protects the RM proponent’s Reference Quality encoder library code. For each CE, an API into the Reference Quality encoder code is made available on a CEby-CE basis. Furthermore, the Reference Quality encoder code could be made available with a “block diagram” API. The API is defined by header files that support linking with the Reference Quality encoder library. A Reference Quality encoder could be made available via two mechanisms: o The RM proponent links an object module provided by the CE proponent (that implements the tool under test) into the Reference Quality encoder library and provides bitstreams to the CE proponent. o The RM proponent provides to the CE proponent the Reference Quality encoder library and the CE proponent links the library, runs the CE experiment and obtains the bitstreams. This may require executing an NDA. Plan for developing MPEG Reference Encoder for use in Core Experiments Initially, this is the code base provided by the RM proponent. It is envisioned that this process can result in another Reference Quality encoder. The Audio Subgroup maintains a workplan whose elements are Define an encoder Block Diagram (e.g. from the WD text) Define APIs for each block Designate companies that commit to create source or object code conforming to these APIs Define a process to check and debug the entire encoder Additional contributions are welcome Process for conducting CEs The CE process of Proposal, Cross-check, Integration are followed. One scenario is that o CE proponent shows the merit of the tool (i.e. listening test results) using the MPEG Reference Encoder o The cross-check shows the merit of the tool (i.e. listening test results) using the RM proponent Reference Quality encoder. For the CE winner, the proponent is obligated to o Submit informative, but perhaps sub-optimal code for the MPEG Reference Encoder no later than the time of the next MPEG meeting. In addition, this added code must demonstrate an improvement in the performance in the MPEG Reference Encoder (maybe lower performance increment target). However, if the exact code as used in the CE is submitted, the listening test to verify improvement has already been done (as the CE evidence), but a cross-check by other parties on the bitsream generation should be done. The Chair moved the text in this section to a draft output document for further editing and discussion. 5.2.3.2 Revision of CE methodology document The Chair brought up a revised version of N7140, Revised core experiment methodology for MPEG audio. The following captures the discussion of the open issues in that revised document. The CE methodology document should document the following means of statistical analysis and indicate the appropriate context for their use. Two-sided 95% confidence interval on the mean based on the assumption of Gaussian PDF. Appropriate for large sample sized and multiple systems under test. Two-sided 95% confidence interval on the mean based on a small sample set (i.e. t-test analysis). Appropriate for small sample sized and multiple systems under test. 143 Single-sided 95% confidence interval on the difference between means based on the assumption of Gaussian PDF. Appropriate for large sample sized and two systems under test Single-sided 95% confidence interval on the difference between means based a small sample set (i.e. t-test analysis). Appropriate for small sample sized and two systems under test The CE methodology document should document the following means of subjective quality assessment and indicate the appropriate context for their use. BS-1116 triple-stimulus hidden reference. Appropriate for assessment for neartransparent systems. MUSHRA. Appropriate for assessment for intermediate quality systems A/B Comparative test. Appropriate for two systems under test where maximum sensitivity is needed but there is no need for an assessment of the absolute level of subjective quality. The subjective quality assessment method and the statistical analysis method should be selected by the consensus of the Audio Subgroup as appropriate for each work item but may be changed for a particular Core Experiment. The subjective performance data from test sites should be examined for consistency. The data from a majority of test sites should show an increase in performance for the CE technology. Test items – The 12 CfP test items should be used in the CE process. If the CE technology or circumstances warrant, different test items can be used, but this should be decided on a CE by CE basis. Operating points – The CE proponent must show improvement at least one of the nine operating points and no degradation at the remaining operating points. WD and Reference Software for USAC Eunmi Oh, Samsung, reported that all the CfP bitstreams were successfully decoded to the CfP waveforms, and are a bit-exact match. She also reported that not all modes (e.g. bitrates) of the encoder are operational. Markus Multrus, FhG, reported that the software attached to the USAC WD output document has already been edited to address all of the reported encoder bugs. Eunmi Oh further noted that currently the USAC encoder and decoder are part of the MPEG-4 VM, and expressed the preference that it be developed as a separate code base. There was some discussion of this matter, and the Chair suggested that this be discussed further in the AhG activity. Takehiro Moriya, NTT, suggested that the CfP bistreams and decoded waveforms for the USAC RM be made available to the group. It was agreed to post the bistreams and decoded waveforms on the USAC ftp site. The following text captures discussions during the week concerning MPEG Reference Encoder and the core experiment process: Process for developing an MPEG Reference Encoder for use in Core Experiments It is envisioned that this process can result in another Reference Quality encoder for use in the CE process. The Audio Subgroup shall maintain a workplan whose elements are to Define an encoder Block Diagram (e.g. from a figure in the WD text) 144 Define APIs for each block in that diagram Designate companies that commit to create source or object code conforming to these APIs. Note that initially, the MPEG Reference Encoder code base is the code base provided by the RM proponent. Define a process to check and debug the entire encoder Additional contributions beyond what is specifically designated in the workplan, and which progress the work, are welcome. Process for conducting CEs The CE process of Proposal, Cross-check and Integration are followed. The following picture illustrates the listening test results required for a successful Core Experiment. Note that the Alternate Encoder (AE) could be the MPEG Reference Encoder. The process is summarized as follows: Proposal and Cross-Check The CE proponent shows the merit of the tool (i.e. listening test results) in which AE+CE shown an improvement over AE at the 95% level of significance AE is not different from RQx at the 95% level of significance Or AE+CE shown an improvement over AE at the 95% level of significance AE+CE shown an improvement over RQx at the 95% level of significance The company doing the cross-check shows the merit of the tool (i.e. listening test results) in which AE+CE shown an improvement over AE at the 95% level of significance AE is not different from RQx at the 95% level of significance Or AE+CE shown an improvement over AE at the 95% level of significance AE+CE shown an improvement over RQx at the 95% level of significance This listening test evidence is necessary for the CE to be successful. All evidence is considered when judging the overall outcome of a CE. The first alternative for evidence is illustrated in the following diagram. 145 RQx AE CE Reference Quality Encoder Alternate Encoder Core Experiment Core Experiment Acceptance Proponent AE+CE RQx AE Cross-check PASS AE+CE RQx AE Integration If the CE shows merit and is therefore to be accepted, the proponent is obligated to integrate, prior to the next MPEG meeting, informative but perhaps sub-optimal code into the MPEG Reference Encoder. The addition of this code must result in an improvement in the performance of the MPEG Reference Encoder. Process for determining Reference Quality bitstreams (RQx) At any time, if evidence is presented (i.e. listening test results) that show that an Alternate Encoder (AE) shows an improvement over RQx at the 95% level of significance, then AE becomes the new Reference Quality Encoder (RQx+1). New Reference Quality Encoder AE RQx+1 = AE RQx 5.2.4 Exploration Stephan Schreiner, FhG, presented 146 m15875 A proposal for requirements for a audio metadata system within MPEG Stephan Schreiner Wolfgang Fiesel Matthias Neusinger The contribution notes that HE-AAC is getting widespread adoption in the video broadcast marketplace. However, relative to some competing audio coding systems, HE-AAC has limited support for metadata and which in turn might limit market adoption. The metadata of greatest interest is information to control the following three factors (the three "classical" D's): dialog normalization dynamic range control downmix Such Audio metadata helps the receiver to manipulate the received audio signal based on the adjustments performed by the listener. For example, this metadata might can be used for three major applications: Midnight Mode – reduced dynamics Downmix – to derive stereo or mono from a multichannel program Clean Audio – boost dialog and suppress ambiance for e.g. hearing impaired listeners The contribution reviewed the limitations of the metadata currently supported by AAC (and hence available to HE-AAC) and proposes a potential requirements for a potential metadata activity: Backward compatibility – reuse parameters from existing production infrastructure Computational complexity – reuse existing coding tools to facilitate user control (e.g. filterbank) Bitstream overhead – metadata should impose low overhead User interface – should be simple to use Embedding in coded representation (bitstream) – retain backward compatibility There was considerable discussion on this topic. An issue was raised as to whether the metadata is agnostic to and independent of the coded representation. Another comment was whether metadata is even needed to provide the user control functionality. 6 MPEG closing plenary discussions During the Audio presentation in closing plenary, there was discussion on the objective of the MPEG reference encoder (i.e. source code encoder). The convenor remarked that the objective of the project should be To create a platform for CE collaboration that is open and based on reference encoder source code And that a by-product of the product might be That this source code base becomes a “Reference Quality” encoder The Audio Chair noted that if the MPEG reference encoder is not “Reference Quality” then the CE results might be subject to question by some audio experts, hence having it be “Reference Quality” is highly desirable. 7 Meeting deliverables 8 Responses to Liaison and NB comments The responses to Liaison and NB comments were prepared and approved. 8.1 Recommendations for final plenary The Audio recommendations were presented and approved. 8.2 Establishment of Ad-hoc Groups The following ad-hoc groups were established by the Audio subgroup: 147 No. 10226 10227 8.3 Title AHG on Audio Standards Maintenance AHG on Unified Speech and Audio Coding and SAOC Mtg No Yes Approval of output documents All output documents, shown in Annex D, were presented in Audio plenary and were approved. 8.4 Press statement There was no Audio contribution to the press statement. 9 9.1 Future activities Schedule of future meetings Ad Hoc group meetings are indicated in Section 8.2. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting. 9.2 Agenda for next meeting The agenda for the next MPEG meeting is shown in 0. 9.3 All other business There was none. 9.4 The 86th Closing of the meeting Audio Subgroup meeting was adjourned Friday at 13:00. 148 Annex A Participants First Name Manuel Jihoon Oliver Hai Shan Seungkwon Johannes Ti Eu Ralf Philippe Bernhard Minsoo Oliver Jürgen Haibin Yang-Won Kyeong Ok Kei Dong Soo Junghoe Kwangki Kristofer Marc Kelvin Taejin Terentiev Te Tilman Jaehyun Mohamed Han Gil Takehiro Markus Yasushige Max Toshiyuki Takeshi Eunmi Henney Werner Hee-Suk Pierrick Heiko Schuyler Mohamad Redwan Andreas Stephan Jeongil Ralph Herve Yasuhiro Oliver Sungyong Last Name Briand Park Wuebbolt Zhong Beack Boehm Chan Geiger Gournay Grill Hahn Hellmuth Herre Huang Jung Kang Kikuiri Kim Kim Kim Kjörling Klein Middelink Lee Lee Leonid Li Liebchen Lim Mansour Moon Moriya Multrus Nakayama Neuendorf Nomura Norimatsu Oh Oh Oomen Pang Philippe Purnhagen Quackenbush Raad Salami Schneider Schreiner Seo Sperschneider Taddei Toguri Wuebbolt Yoon Country Sweden Korea Germany Singapore KR DE SG DE Canada DE KR DE DE SG KR Korea JP KR KR KR SE NL SG KR DE SG DE KR USA KR JP DE JP Germany JP JP KR KR NL KR FR SE USA Australia Canada DE Germany KR DE DE JP DE KR Affiliation Ericsson AB Information and Communications Univ. Thomson Panasonic Singapore Laboratories ETRI Thomson I2R Fraunhofer IIS VoiceAge Corp. / Univ. of Sherbrooke Fraunhofer IIS Information and Communications Univ. Fraunhofer IIS Fraunhofer IIS I2R LG Electronics ETRI NTT DOCOMO LG Electronics Samsung AIT Information and Communications Univ. Dolby Philips I2R ETRI Fraunhofer IIS I2R LG Electronics LG Electronics Teas Instruments Samsung Electronics NTT Fraunhofer IIS NHK Fraunhofer IIS NEC Panasonic Samsung LG Electronics Philips Applied Technologies Sejong University France Telecom R&D Dolby ARL RaadTech Consulting VoiceAge Corporation Dolby Fraunhofer IIS ETRI Fraunhofer IIS Huawei Technologies Sony Thomson LG Electronics 149 Yongwei Zhu Singapore Institute for Infcomm Resarch 150 Annex B Audio Contributions and Schedule Day / Time Task Group Sunday 1400-1700 AhG: Spatial Audio Object Coding m15893 CE Report on Support for a Mastering Downmix Jeongil Seo Seungkwon Beack Kyeongok Kang Kwangki Kim Minsoo Hahn X m15828 Proposal for adoption of stereo-to-binaural scenario for the MPEG SAOC system Oliver Hellmuth Johannes Hilpert Harald Mundt Leonid Terentiev Cornelia Falch Heiko Purnhagen Jonas Engdegård Jeroen Koppens X m15826 Core Experiment on Low Delay MPEG SAOC system Johannes Hilpert Maria Luis Valero Markus Schnell Oliver Hellmuth Leonid Terentiev Jonas Engdegård Heiko Purnhagen Erik Schuijers X m15827 Core Experiment on Low Power MPEG SAOC system Jonas Engdegård Leonid Terentiev Oliver Hellmuth Erik Schuijers X m15829 Proposal for the integration of the enhanced Karaoke/Solo processing into the decoding modes of the MPEG SAOC system Leonid Terentiev Cornelia Falch Oliver Hellmuth Johannes Hilpert X m15830 Report on corrections for the MPEG SAOC CD text and Leonid Terentiev RM software Cornelia Falch Oliver Hellmuth Johannes Hilpert Heiko Purnhagen Jonas Engdegård Jeroen Koppens X m15839 Comments on parameter estimation in SAOC Yang-Won Jung Henney Oh X m15840 Proposed modification on parameter estimation in SAOC Yang-Won Jung Henney Oh X Schuyler Quackenbush, Eunmi Oh, Jürgen Schmidt X Review of AhG Report m15730 Report of AHG on SAOC, USAC, and Support for new Loudspeaker Configurations 1800- Chairs Meeting Monday 0900-1230 MPEG Plenary 1300-1400 Lunch 1400-1430 Audio Plenary Welcome Report on Sunday Chairs meeting Review main tasks for the week 151 General documents m15730 Ad Hoc Group on SAOC, USAC, and Support for new Loudspeaker Configurations Schuyler Quackenbush, Eunmi Oh, Jürgen Schmidt X m15729 Ad Hoc Group on Audio Standards Maintenance Ralph Sperschneider X m15857 85th MPEG Audio Report Schuyler Quackenbush X Mauri Väänänen on behalf of Finnish National Body X 1430-1600 NB Comments m15879 Comment on the Unified Speech and Audio Coding Activity M15911 General/All Comment on the Unified Speech and Audio Wen Gao on behalf of the Chinese Coding Exploration Activity NB X m15914 Comment on the Unified Speech and Audio Coding Activity Pierrick Philippe on behalf of the French National Body X m15551 (Hannover) FRNB comment on the Unified Speech and Audio Coding Exploration Activity Pierrick Philippe on behalf of the FRNB 1600-1800 MPEG-2 and MPEG-4 m15786 Proposed Draft Corrigendum on AAC-ELD Per Ekstrand Markus Schnell X m15861 Information related to the proposed ALS profile Noboru Harada Tilman Liebchen Takehiro Moriya Yutaka Kamamoto X m15794 Suggested profile name for ALS A. G. Tescher for USNB X m15860 Proposed Corrigenda on MPEG-4 ALS Noboru Harada Tilman Liebchen Takehiro Moriya Yutaka Kamamoto X m15876 Proposed study on coupling channel fixes Andreas Schneider X 1800- HoD Meeting Tuesday 0900-1300 MPEG-2 and MPEG-4 m15807 Issues of AudioBIFS to applying to an Advancement of Satellite Digital Broadcasting in Japan Yasushige Nakayama X m15866 Report on flexible signaling of audio channels to loudspeaker mapping using MPEG-4 BIFS Juegren Schmidt Mario Sieck X m15848 Proposed Corrigendum on MPEG-4 SLS JungHoe Kim Ralph Geiger Ti-Eu Chan Eunmi Oh X m15865 Further information on the complexity of the HD-AAC profile Ralf Geiger Virgilio Bacigalupo X m15877 proposed new restriction for the AAC family of profiles and proposed new profile Andreas Schneider Kristofer Kjörling X m15908 Liaison Statement from the Digital Radio Mondiale Consortium to WG 11 Proposal to remove 960 transform from the AAC, HE AAC and HE AAC v2 profiles X m15916 Liaison Statement from "ETSI/EBU/CENELEC JTC on Broadcast" on 960 frame length in the MPEG-4 AAC family of profiles X m15919 Audio Liaison Statement from WorldDMB Forum WorldDMB Forum via SC 29 Secretariat on Proposal to remove 960 transform from the AAC, HE AAC and HE AAC v2 profiles X 1300-1400 Lunch 152 1400-1700 USAC m15867 Detailed Technical Description of Reference Model 0 of Max Neuendorf the CfP on Unified Speech and Audio Coding (USAC) Stefan Bayer Jérémie Lecomte Guillaume Fuchs Philippe Gournay Julien Robilliard Nikolaus Rettelbach Frederik Nagel Ralf Geiger Redwan Salami Markus Multrus X m15868 Reference Software for Reference Model 0 of the CfP on Unified Speech and Audio Coding (USAC) Markus Multrus Max Neuendorf Jérémie Lecomte Guillaume Fuchs Philippe Gournay Julien Robilliard Nikolaus Rettelbach Frederik Nagel X m15856 Thoughts on Unified Speech and Audio Coding Reference Software and the Core Experiment Process Schuyler Quackenbush X 1800- Chairs Meeting Wednesda y 0900-1100 MPEG Plenary 1130-1300 Exploration: Metadata m15875 A proposal for requirements for a audio metadata system within MPEG Stephan Schreiner Wolfgang Fiesel Matthias Neusinger x 1300-1400 Lunch 1400-1500 Joint with Requirements on IMAF 1500-1530 Joint with Systems on Loudspeaker Mapping USAC At Sys – Saphire (LLF) X At Sys – Saphire (LLF) X Encoders and the CE process 1900 - X Social Thursday X 0900-0930 Status of open issues Review of resolutions m15920 Liaison Statement from ITU-T SG 16 Enhanced low delay AAC and media coding summary database X m15551 (Hannover) FRNB comment on the Unified Speech and Audio Coding Exploration Activity Pierrick Philippe on behalf of the FRNB X 0930-1300 Review and revision of Audio CE methodology X 1300-1400 Lunch X 1400-1500 USAC CE process 153 1700-1800 Audio Plenary for early document approval 1800- Chairs Meeting Friday 0730-1300 Audio plenary USAC discussions Remarks on Thursday Chairs meeting Recommendations for final plenary Establishment of new Ad-hoc groups AhG Mandates Get document numbers 1000 1030 Approve Responses to NB comments and Liaison Approval of output documents Review of Audio presentation to MPEG plenary Agenda for next meeting A.O.B. Closing of the Audio meeting 1300-1400 Lunch 1400- MPEG Plenary 154 X Annex C Task Groups 1. 2. 3. 4. MPEG-2 and MPEG-4 audio, conformance, reference software MPEG-D SAOC MPEG-D Unified Speech and Audio Coding Exploration Annex D Output Documents No. 10186 No. 10187 10188 10189 10190 10191 10192 10193 10194 No. 10195 No. 10196 10197 10198 No. 10199 No. 10212 10213 10214 No. 10215 10217 No. 10218 Title 13818-7 Advanced Audio Coding Study on ISO/IEC 13818-7:2006/DCOR 1, AAC CCE and 22.2 chn Title 14496-3 Audio Request for Amendment, HD-AAC Profile ISO/IEC 14496-3:2005/PDAM 10:200X HD-AAC Profile Study on ISO/IEC 14496-3:2005/DCOR 6, CCE Study on ISO/IEC 14496-3:2005/AMD 2:2006/DCOR 4, HE-AAC V2 Profile and ALS Study on ISO/IEC 14496-3:2005/AMD 3:2006/DCOR 2, SLS Study on ISO/IEC 14496-3:2005/AMD 9:2008/DCOR 1, AACELD WD on New Profile for ALS Status, proposal and workplan regarding the 960 frame length in the MPEG-4 AAC family of profiles Title 14496-4 Conformance testing Defect Report on Audio Conformance Title 14496-5 Reference Software DoC on ISO/IEC 14496-5:2001/PDAM 24, MPEG-4 AAC ELD ISO/IEC 14496-5:2001/FPDAM 24, MPEG-4 AAC ELD ISO/IEC 14496-5:2001/AMD 10:2007/DCOR 3, ALS and SLS Title 14496-26 Audio Conformance WD of ISO/IEC 14496-26:200x, Audio Conformance Title 23003-2 SAOC DoC on ISO/IEC CD 23003-2:200x, Spatial Audio Object Coding ISO/IEC FCD 23003-2:200x, Spatial Audio Object Coding Status and Workplan on SAOC Core Experiments Title 23003-3 Unified Speech and Audio Coding WD on Unified Speech and Audio Coding Draft Revisions to MPEG Audio CE methodology Title Exploration – Metadata-driven post processing of audio signals Exploration on metadata driven post processing of audio signals 155 TBP Available No 08/10/17 TBP Available No No No No 08/10/17 08/10/17 08/10/17 08/10/17 No No 08/10/17 08/10/17 No No 08/10/17 08/10/17 TBP Available No 08/10/17 TBP Available No No No TBP 08/12/05 08/10/17 08/10/31 Available No 08/10/17 TBP Available No 08/10/17 No 08/11/14 No 08/10/17 TBP Available No 08/10/17 No 08/10/17 TBP Available No 08/10/17 No. 10219 10220 10221 No. 10225 Title Liaison Statements Liaison response to AES (m15788) Liaison response to ITU-T SG 16 (15920) Liaison statement to IEC on IEC 100/1309/NP Title Responses to National Bodies Response to USNB (m15794) 156 TBP Available No No No TBP 08/10/17 08/10/17 08/10/17 Available No 08/10/17 Annex E Agenda for the 87th MPEG Audio Meeting Agenda Item 1. Opening of the meeting 2. Administrative matters 2.1. Communications from the Chair 2.2. Approval of agenda and allocation of contributions 2.3. Review of task groups and mandates 2.4. Approval of previous meeting report 2.5. Review of AhG reports 2.6. Joint meetings 2.7. Received national body comments and liaison matters 3. Plenary issues 4. Task group activities 4.1. MPEG Maintenance, including MPEG-1, MPEG-2, MPEG-4, SMR and MPEG Surround issues 4.2. Spatial Audio Object Coding 4.3. Unified Speech and Audio Coding 4.4. Exploration 5. Discussion of unallocated contributions 6. Meeting deliverables 6.1. Responses to Liaison and NB comments 6.2. Recommendations for final plenary 6.3. Establishment of new Ad-hoc groups 6.4. Approval of output documents 6.5. Press statement 7. Future activities 8. Agenda for next meeting 9. A.O.B 10. Closing of the meeting 157 Annex J – 3DG report Source: MPEG 3D Graphics Compression Title: 3D Graphics Compression report from the 86th MPEG meeting @ Busan Authors: Marius Preda (Institut TELECOM) 1 Opening of the meeting 1.1 Approval of the agenda The agenda is approved. 1.2 Goals for the week The goals of this week are: Review SC-3DMC contributions and issue the associated CD and CE Discuss the software status for SC-3DMC Review the votes Discuss FAMC, Scene Partitioning RefSoftware and Conformance Implementation of IC in MP25 Compile and test reference software Check the validity and re-generate when necessary conformance data for 3DGC Investigate future developments of MPEG 3D Graphics Compression Review Liaisons 1.3 Standards from 3DGC 4 4 4 11 4 4 2005 Amd.6 2004 Amd.32 2004 Amd.33 4 4 2004 Amd.34 4 4 2004 Amd.39 4 5 2001 Amd.21 4 5 2001 Amd.22 4 5 2001 Amd.25 4 4 16 16 2006 Amd.1/Cor.2 2006 Amd.4 4 16 200x 3rd Ed. Scene partitioning FAMC conformance Multiresolution profile conformance 3DGC Model Conformance Scene partitioning conformance FAMC reference software 3DG Compr. Model RefSof scene partitioning RefSof 3DMC ext. corr. Scalable complexity 3D mesh coding AFX 158 08/01 07/10 07/10 08/04 08/04 08/07 08/10 08/10 09/02 S 3 3 08/01 08/07 09/02 3 08/10 09/02 09/07 3 07/04 07/10 08/04 08/10 3 06/07 08/01 08/07 09/02 3 08/10 09/02 09/07 3 08/04 08/10 09/02 08/10 09/07 3 3 08/10 09/02 3 07/04 07/04 08/01 07/10 Delayed to include the current COR 4 25 200x 1st Ed. 1.4 07/04 Peacock Title Schedule D1 D1 09:00~11:30 D1 13:00~14:00 D1 14:00~15:30 Monday MPEG Plenary Lunch Break 3DG Plenary Roll call, Agenda, Goals, FAQ, etc., m15731 Report of AHG on 3DGC documents, experiments and software maintenance MXM and impact on group activities m15822 Implementation of 3DGraphics MXM Marius Preda Patrick Gioia, Francisco Moran Marius Preda Ivica Arsov, Marius Preda Francoise Prêteux 15:30~16:00 Coffee Break Joint with System on MXM-RVC Joint with System on MXM-Graphics Filippo Filippo 17:00 – 18:00 3DG Plenary Validation session for the RefSoft and test data set Validation session for the conformance data set Results of voting Liaison MPEG-V and impact on group activities D2 08/04 Allocation of contributions N° D1 16:00 16:30 07/10 Room allocation 3DGC: 1.5 3D Graphics Compression model Francisco Moran Marius Preda Marius Preda Francisco Moran Marius Preda D2 D2 09:00~12:00 Tuesday Scalable Complexity 3D Mesh Encoding (SC-3DMC) m15903 CE Report Version 2 on the SC3DMC 159 Seungwook Lee Bonki Koo 09:00-09:30 08/10 3 m15824 Kyoungsoo Son Euee S. Jang Benoit le Bonhomme 9:30-10:00 Marius Preda Francoise Prêteux 10:00 – 12:00 12:00~14:00 Benchmarking results for Scalable Complexity Mesh Compression Liaison meeting with Mobile Convergence Solution Forum Lunch Break Scalable Complexity 3D Mesh Encoding (SC-3DMC) 14:00~18:00 Seungwook Lee Bonki Koo 14:00-15:00 Daiyong Kim Euee S. Jang Khaled Mamou Titus Zaharia 15:00-16:00 Marius Preda Francoise Prêteux Algorithm Description on the CE of m15904 SVA m15825 TFAN stream description Coffee Break 16:00~16:30 Marius Preda, Seungwook Lee SC-3DMC editing D3 Wednesday MPEG Plenary Jean Gelisen (Req room) MPEG-V Lunch Break Part 25 m15823 m15937 Software Implementation for MPEG4 Part 25 Source code for Interpolation Compression for MPEP-4 part 25 Blagica Jovanova Marius Preda Françoise Preteux Sinwook Lee Coffee Break Liaison with ISO TC 184/SC4 AFX Amd.4 SC-3DMC Editing 16:30-18:00 D3 09:00~11: 00 11:00~12: 00 13:00~14:0 0 14:00~15: 00 14:00~14: 50 14:50~15: 30 15:30~16:0 0 16:00 – 16:30 16:30 – 17:00 Seungwook Lee 17:00~18:0 0 MPEG-V Clarification on the interchange format between the virtual worlds Jean Gelissen 160 D4 Thursday P16 Cor ISO/IEC 14496-16 2nd Ed. Amd.1 Cor.2 AFX Reference Software Results on checking reference encoders Review the 3DG related votes D4 Seungwook 9:00 – 9: 30 09:30~10:00 Daiyong Kim Marius Preda RefSoft and Conformance Plan for the conformance data Test the RefSoft on the test data (BreakOut) P11 SP ISO/IEC 14496-11 AMD6 Amd.3 MRZ MRZ Conformance Amd.4 SC-3DMC Edit of the CE 09:30~10:00 10:00~10:30 Seungwook Francisco Moran Patrick Gioia 11:00 - 11:30 Patrick Gioia 11:30 - 12:00 Seungwook 14:00~16:00 Amd.4 SC-3DMC Edit the WD Seungwook 14:00~17:30 Amd.2 FAMC Marius Preda 17:30– 17:40 Marius Preda 17:40– 17:50 Marius Preda 17:50– 18:00 all D5 09:00~12:00 Lunch Break Conf and RefSoft P25 3DGCM Conformance Editing 3DGCM RefSoft Editing P16 3rd Edition D5 1.6 Friday 3DG output documents preparation Scene Partitioning documents Liaison statements review AhGs and resolutions Lunch Break MPEG Plenary 12:00~14:00 14:00~ Attendance list Name Marius Preda Francisco Morán Burgos Seung Wook Lee Euee S. Jang Byoungjun Kim Country France Spain Korea Korea Korea Company Institut TELECOM UPM ETRI Hanyang Univ. Hanyang Univ. 161 Mingxiao Chen Jeong-Hwan Ahn Korea Korea 2 General issues 2.1 General discussion Hanyang Univ. Samsung 2.1.1 Reference Software It is recalled that the source code of both decoder AND encoder should be provided as part of the Reference Software for all technologies to be adopted in MPEG standards. Moreover, not providing the complete software for a published technology shall conduct to the removal of the corresponding technical specification from the standard. Currently almost all the AFX tools published in the second edition are supported by both encoder and decoder implementation. Only exception is the MeshGrid tool; however commitment was provided by VUB (see m15938) 2.1.2 Web site OrangeLabs proposed a new version of the web site, now available at www.mpeg-3dgc.com. The goal of the web site is to disseminate the group activities (documents, software and demonstration), to maintain the FAQ and to be active in providing answers through the use of the Forum. 3DGC contributors are kindly asked to check the web-site and provide comments. 3 AFX (14496-16) related activities 3.1 AhG on AFX activities Report of AHG on 3DGC documents, experiments and software maintenance Title Authors Patrick Gioia, Francisco Moran Summary See M15731 - use the reflector for exchanges on technology development - Ivica Arsov is responsible for maintaining the 3DG reference software Resolution - Seungwook Lee is responsible for regenerating conformance and maintaining it. 3.2 Scalable Complexity 3D Mesh Compression (14496-16 Amd.4) CE Report Version 2 on the SC3DMC Seungwook Lee, Bonki Koo, Kyoungsoo Son, Euee S. Jang New binarisation is proposed that increases the compression performances Summary with 5%. Some problems on implementing the MMW library are reported Resolution Resolution: accepted. Title Authors 162 Action: double check the documentation on how to implement MMMW libraries and if necessary organize a physical meeting in Paris for MMW programming tutorial. Benchmarking results for Scalable Complexity Mesh Compression Benoit le Bonhomme, Marius Preda, Francoise Prêteux Several new filters are proposed for better benchmarking local and global Summary compression results. ZIP compression is introduces for reference. New results for 3DMC, TFAN and TG are presented. Resolution Accepted. Title Authors Title Authors Summary Resolution TFAN stream description Khaled Mamou, Titus Zaharia, Marius Preda, Françoise Prêteux A syntax is proposed for TFAN compression. Accepted and updated as specified in the WD (output document) Title Authors Summary Resolution Algorithm Description on the CE of SVA Seungwook Lee, Bonki Koo, Daiyong Kim, Euee S. Jang A syntax is proposed for TFAN compression. Accepted and updated as specified in the WD (output document) 3.2.1 Scene partitioning (14496-11 Amd.6) SP is followed as a joint activity between Systems and 3DGC. The technology is integrated in Part 11. There was no joint meeting with Systems on this topic during this meeting. SP activity on conformance and reference software continued. 3.3 Maintenance 3.3.1 FAMC Conformance and Reference Software FNB reports on a problem related to FAMC reference software, namely the usage of little Indian convention when writing the bitstream. This conducts to errors in parsing the FAMC bitstream when encapsulated in MP4. Resolution: issue a corrigendum on FAMC ref soft and conformance and ask the contributors to update the software and regenerate the bitstreams. AFX 3rd Edition 3.3.2 The document was updated during the week. The final publication is delayed for February 2009 in order to include current corrigendums. 3.4 Dataset and benchmarking For Scalable Complexity 3D Mesh Coding, the www.MyMultimediaWorld.com will be used for benchmarking. 163 3.5 Software Title Authors Current status of MeshGrid compression software Alexandru Salomie, Dan Cernea, Adrian Munteanu, Peter Schelkens The contribution reports a delay in providing the MeshGrid encoder but Summary maintain the commitment. Resolution - accepted, look forward to receive the software for February 2009. Title Authors Results on checking reference encoders 3DMC Daiyong Kim All the available software (standalone encoders) was validated and committed Summary on the SVN A new organization of the software is proposed Resolution Accepted 3.6 Promotions Title Authors Summary Resolution Special Session on 3D Graphics Compression in ICIP08 Karsten Muller, Marius Preda A special session on 3D graphics compression is organized in ICIP 2008. - 3.6.1 Title Authors Web Site Status of www.mpeg-3dgc.com Patrick Gioia The web site is in beta version but no improvement was done since the last Summary meeting Action Point: Resolution Patrick Gioia will ask more actively contributions for demos from individual parties. 3.7 Future 3.7.1 Virtual Worlds (formally Metaverse) MPEG-V - Information Exchange with Title Authors MPEG-V and impact on group activities Marius Preda Informal discussion on possible impact of MPEG-V activities on technologies Summary developed by 3DG group Action Point: Resolution Actively monitor and participate in setting the current documents for this standard (currently in a Requirements phase) 3.7.2 Title MXM MXM and impact on group activities 164 Marius Preda Informal discussion on possible impact of MXM activities on technologies Summary developed by 3DG group Action Point: Resolution Actively participate in proposing a complete API for accessing 3D graphics tools. Authors Title Authors Implementation of 3DGraphics MXM Ivica Arsov, Marius Preda , Francoise Prêteux Introduction of the 5 API related to 3D graphics and of the software Summary implementing them Accepted by the 3DG group. To be discussed and validated in joint meeting Resolution with Systems. 3.7.3 No discussion during the meeting in this issue Future of 3D Graphics Compression 4 3D Graphics Compression Model (14496-25) activities 4.1 Textual specification Removal of the WSS tool since not supported by the reference software. 4.2 Software and conformance Title Authors Software Implementation for MPEG-4 Part 25 Blagica Jovanova, Marius Preda; Françoise Preteux A GUI is proposed as a wrapper for MP25 encoder and decoder software. Summary The GUI is compiled for Windows and exposes the essential encoder parameters for 3DMC, BBA and FAMC. Resolution Accepted, the GUI is considered as an utility part of the RefSoft. Commit the GUI on the SVN Title Authors Source code for Interpolation Compression for MPEP-4 part 25 Sinwook Lee Commitment from Samsung and Hangyang Univ to implement encoder and Summary decoder IC for MP25 Resolution Keep the reference to IC tools in the current version of the FDIS 5 Liaison Title Liaison meeting with Mobile Convergence Solution Forum 165 All Mobile Convergence Solution Forum is composed of 4 WG: MEGA, Summary Mega_framework, MEGA_SL, MEGA_Net. Common interests with 3DG are on graphics compression and API to access graphics. Increase the collaboration level between MCSF and MPEG 3DG. Issue Resolution liaison statement and nominate contact persons. Authors Title Liaison Statement from ISO TC 184/SC 4 Authors TC 184/SC 4 Summary A request from ISO TC 184/SC 4 concerning the cost of using MPEG-4. Answer by indicating the MPEG policy with respect to common patent Resolution statement. 6 Output documents and Resolutions of 3DGC 6.1 Part 4 Conformance testing 6.1.1 The 3DG subgroup recommends approval of the following documents No. Title 14496-4 Conformance testing 10120 DOCR on ISO/IEC 14496-4:2004/FPDAM 32 (FAMC Conformance) 10121 Text of ISO/IEC 14496-4:2004/FDAM 32 (FAMC Conformance) 10122 Text of ISO/IEC 14496-4:2004/PDAM 39 (Scene Partitioning Conformance) 6.2 Part 5 No 08/10/17 No No 08/10/17 08/10/17 Reference Software 6.2.1 No. The 3DG subgroup recommends approval of the following documents Title 14496-4 Reference Software 10123 DOCR on ISO/IEC 14496-5:2001/FPDAM 21 (FAMC Reference Software) 10124 Text of ISO/IEC 14496-5:2001/FDAM 21 (FAMC Reference Software) 10125 Text ISO/IEC 14496-5:2001/PDAM 25 (Scene Partitioning Reference Software) 6.3 TBP Available TBP Available No 08/10/17 Yes 08/10/17 No 08/10/17 Part 11 Scene Description 6.3.1 166 The Systems and 3DG subgroup recommend approval of the following documents No. Title 14496-11 Scene Description and Application Engine 10185 Text of ISO/IEC 14496-11:2005/FDAM6 (Scene Partitioning) 6.4 10126 10127 10128 10129 6.5 08/10/17 The 3DG subgroup recommends approval of the following documents Title 14496-16 Animation Framework eXtension (AFX) Text of ISO/IEC 14496-16:2006/AMD1:2007/COR2 Text of WD3.0 of ISO/IEC 14496-16:2006/AMD4 (Scalable Complexity 3D Mesh Compression) CE on Scalable Complexity 3D Mesh Coding WD of ISO/IEC 14496-16 3rd Edition Part 25 TBP Available No No 08/10/17 08/10/17 No No 08/10/17 08/10/17 3D Graphics Compression Model 6.5.1 The 3DG subgroup recommends approval of the following documents No. Title 14496-25 3D Graphics Compression Model 10132 DoC on ISO/IEC FCD 14496-25 10133 Text of ISO/IEC FDIS 14496-25 6.5.2 6.6 No Part 16 Animation Framework eXtension (AFX) 6.4.1 No. TBP Available TBP Available No Yes 08/10/17 08/10/17 The 3DG subgroup thanks FNB for comments on ISO/IEC 14496-25. Establishment of 3DGC Ad-Hoc Groups 10134 Mandate: AHG on 3DGC documents, software maintenance and core experiments 1. Conduct the experiments in Scalable Complexity Mesh Compression 2. Coordinate 3DGC related conformance and reference software 3. Maintain and edit 3DGC documents 4. Coordinate editing of the www.mpeg-3dgc.com web site Chairmen: Francisco Morán Burgos Patrick Gioia Duration: Until 87th Meeting Sunday before 87th meeting Meetings Reflector: mpeg-3dgc AT gti. ssr. upm. es Subscribe: http://www.gti.ssr.upm.es/mailman/listinfo/mpeg-3dgc 7 Closing of the Meeting See you in Lausanne. 167 168
© Copyright 2026 Paperzz