About Multimedia Presentation Generation and Multimedia Metadata: From Synthesis to Analysis, and Back?
1 like1,247 views
Ansgar Scherp's presentation discusses the importance of multimedia metadata in presentation generation, emphasizing dynamic and multi-channel outputs. The document highlights the challenge of retaining metadata during assembly and introduces the concept of emergent semantics to better describe multimedia content. Additionally, it outlines a formal modeling framework for multimedia metadata and presents use cases that address information overload in research and innovation contexts.
About Multimedia Presentation Generation and Multimedia Metadata: From Synthesis to Analysis, and Back?
- 1. Multimedia Presentation Generation and Multimedia Metadata: From Synthesis to Analysis, and Back? Ansgar Scherp
- 2. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 2 Multimedia Presentation Generation Ansgar Scherp, Susanne Boll: Paving the Last Mile for Multi-Channel Multimedia Presentation Generation. MMM 2005: 190-197 (Best Paper Award) It is all about the media metadata not the media content itself ... • Dynamic generation • Multi-channel output
- 3. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 3 Authoring Tool xSMART • First to enable context-driven multimedia authoring • Using media metadata and user profile information Ansgar Scherp, Susanne Boll: Context-driven smart authoring of multimedia content with xSMART. ACM Multimedia 2005: 802-803
- 4. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 4 We Care So Much About Metadata! • Really? So how can it be that we ... … almost loose all metadata after assemle? Semantics Barrier!
- 5. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 5 Idea: Emergent Semantics • Semantics that emerges from putting the single pieces of media content together • “Sum is more than just the set of its pieces” • Wait a minute: how to describe the semantics?
- 6. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 6 Example: Emergent Semantics S. Boll, P. Sandhaus, A. Scherp, U. Westermann: Semantics, content, and structure of many for the creation of personal photo albums. ACM Multimedia 2007: 641-650 • Rule-based • Customizable • Multi-channel
- 7. Slide 7ACM Multimedia 2016 Ansgar Scherp – [email protected] Embedding Metadata in SMIL <smil xmlns="http://w3.org/2006/SMIL30/..."> <head> <!-- Metadata --> <metadata id="meta-rdf"> </metadata> <!-- layout --> </head> <body> <!-- Presentation content --> <seq id="mainPresentation"> <par xml:id=“achievements">...</par> <par xml:id=“risks">...</par> </seq> </body> </smil> ???
- 8. Slide 8ACM Multimedia 2016 Ansgar Scherp – [email protected] Solution Approach Formal modeling framework for representing and integrating multimedia metadata Multimedia Metadata Ontology (M3O) Carsten Saathoff, Ansgar Scherp: Unlocking the semantics of multimedia presentations in the web with the multimedia metadata ontology. WWW 2010: 831-840
- 9. Slide 9ACM Multimedia 2016 Ansgar Scherp – [email protected] ACM Multimedia 2010, Firence, Italy
- 10. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 10 Some Cool Semantics Analyses ... Text Cancer (18899-3) Research (10436-6) USA (17829-1) … Smart Photo Selection (CHI'14) Gaze Analysis in Search (IUI'14) Document Classification (KCAP'15) (Nomination for Best Paper Award) Text Extraction from Images (DocEng'15)
- 11. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 11 MOVING back to the roots?! How to deal with the vast information in research and innovation? Generating cMOOCs Personalized advise (log analyses) Advanced search and retrieval EU H2020 project since April 2016, budget: 3.5 M €, URL: http://moving-project.eu/
- 12. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 12 Use Cases • Research on business information by public administrators – Understand complex situations – Increase compliance with current laws and regulations • Managing & mining research information – Reduce information overload – Assist in evaluating and selecting relevant information resources
- 13. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 13 Example: EconBiz's Guided Walk • URL: http://www.econbiz.de/eb/gw/
- 14. ACM Multimedia 2016 Ansgar Scherp – [email protected] Slide 14 Thank you ... ... for giving me a good reason and the fun to burrow in my own paper archive! Contact me! Email: [email protected] • Twitter: https://twitter.com/ansgarscherp • Slideshare: http://de.slideshare.net/ascherp • KD-Website: http://www.zbw.eu/en/research/knowledge-discovery/ http://www.kd.informatik.uni-kiel.de/en/