the meego multimedia stack
play

The MeeGo Multimedia Stack Dr. Stefan Kost Nokia - The MeeGo - PowerPoint PPT Presentation

Jun 24, 2023 •231 likes •479 views

The MeeGo Multimedia Stack Dr. Stefan Kost Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe The MeeGo Multimedia Stack MeeGo Intro Architecture Development GStreamer Dr. Stefan Kost Nokia - The MeeGo Multimedia

  1. The MeeGo Multimedia Stack Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  2. The MeeGo Multimedia Stack MeeGo Intro Architecture Development GStreamer Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  3. Quick MeeGo Intro ● MeeGo = Moblin + Maemo ● Linux distribution for CE devices ● Netbook, Phone (Handset), Connected TV, In-Vehicle ● http://meego.com ● Linux Foundation hosted project Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  4. Architecture http://meego.com/developers/meego-architecture Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  5. Architecture - Multimedia ● Kernel ● V4l2, Alsa ● Middleware ● GStreamer, Pulseaudio, GUPnP ● API ● Qt, Qt Mobility Multimedia, Qt GStreamer Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  6. Development ● Hardware Adaptation ● Core OS Platform ● Applications Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  7. Development – HW Adaptation ● Linux Kernel ● Drivers ● user space libraries (alsa, v4l2) ● Middleware plugins ● GStreamer plugins (Codecs, Camera, Video) Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  8. Development - Platform ● libraries from the Linux eco system ● GStreamer, GUPnP, PulseAudio, Xiph codecs, … Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  9. Development - Applications ● QT interfaces are the official one ● Lower level interfaces might have less stability guarantees Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  10. GStreamer – Use Cases ● Media Playback ● Voice and Video Call ● Camera Still and Video Capture ● Video Editing ● Media Transcoding ● Metadata Indexing and Thumbnailing Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  11. GStreamer - Framework Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  12. Media Playback ● MeeGo OS: ● GStreamer playbin2 ● GStreamer components for streaming, parsing, demuxing and rendering ● Vendor specific: ● Hw accelerated codecs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  13. VoIP / Video Call ● MeeGo OS: ● Telepathy ● Lots of GStreamer components ● Vendor specific: ● Accelerated voice and video codecs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  14. Camera Still and Video capture ● MeeGo OS: ● GStreamer camerabin ● GStreamer elements for format conversion, metadata (XMP, EXIF), muxing, data routing ● Vendor specific: ● Camera source :/ ● Accelerated video and image encoders Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  15. Video Editing ● MeeGo OS: ● GStreamer gnonlin ● GStreamer components for muxing, demuxing, format conversion, … ● Vendor Specific ● Accelerated codecs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  16. Metadata Indexing & Thumbnailing ● MeeGo Core OS: ● Tagreadbin (experimental) ● GStreamer components for parsing, demuxing ● Vendor specific: ● nothing Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  17. Hot Topics ● s/XVideoOverlays/TextureStreaming/ ? ● Bitstream passthrough ● Camera APIs ● Performance optimizations ● Accelerated Codecs & Filters ● Easy to use high level APIs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  18. Hot Topic – Video Rendering ● Xvideo interface is getting old ● Inherent memcpy ● Hard to integrate with alpha in Uis ● Classic GL is not well suited either ● Texture upload ● Texture streaming needed Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  19. Hot Topic – Bitstream passthrough ● GStreamer normally renders RAW A/V locally ● Remote devices can also decode ● BT Headsets, HDMI TV, SPDIF → Receiver ● Initial support in PulseAudio from Intel ● GStreamers playbin2 needs work Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  20. Hot Topic – Camera APIs ● Phone cameras != USB webcams ● V4l2 needs to abstract features better ● Lots of work on GStreamers camerabin(2) Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  21. Hot Topic - Performance ● better performance = longer use time ● camera recording, music/video playback, call ● locking is slow on ARM ● overhead for audio part in calls ● low memory footprint = more stuff cached Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  22. Hot Topic – Accelerated Plugins ● Software Codecs and Filters ● GStreamer uses ORC to enable CPU SIMD use ● OpenCL would be interesting for GPU use Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  23. Hot Topic – Hight Level API ● Qt Mobility Multimedia ● Mediaplayer API ● Audiocapture API ● Camera API ● More feedback needed http://doc.qt.nokia.com/qtmobility-1.0/multimedia.html Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  24. Thanks ! Any Questions ? Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

Recommend

Chapter 1 Introduction to Multimedia 1.1 What is Multimedia? 1.2 Multimedia and Hypermedia 1.3

Chapter 1 Introduction to Multimedia 1.1 What is Multimedia? 1.2 Multimedia and Hypermedia 1.3

Fundamentals of Multimedia, Chapter 1 Chapter 1 Introduction to Multimedia 1.1 What is Multimedia? 1.2 Multimedia and Hypermedia 1.3 World Wide Web 1.4 Overview of Multimedia Software Tools 1.5 Further Exploration 1 Li & Drew c

388 views • 18 slides
Multimedia Information Retrieval 1 What is multimedia information retrieval? 2 Basic Multimedia

Multimedia Information Retrieval 1 What is multimedia information retrieval? 2 Basic Multimedia

Multimedia Information Retrieval 1 What is multimedia information retrieval? 2 Basic Multimedia Search Technologies 3 Evaluation of MIR Systems 4 Added Value user interaction, visualisation and the MIR research landscape Multimedia

491 views • 26 slides
1 What is multimedia information retrieval? 1.1 Information retrieval 1.2 Multimedia 1.3

1 What is multimedia information retrieval? 1.1 Information retrieval 1.2 Multimedia 1.3

1 What is multimedia information retrieval? 1.1 Information retrieval 1.2 Multimedia 1.3 Semantic Gap? 1.4 Challenges of automated multimedia indexing 2 Basic multimedia search technologies 2.1 Meta-data driven retrieval 2.2 Piggy-back text

902 views • 56 slides
Streaming Multimedia Applications Multimedia Networking Multimedia Applications? What are

Streaming Multimedia Applications Multimedia Networking Multimedia Applications? What are

Streaming Multimedia Applications Multimedia Networking Multimedia Applications? What are they? An application that deals with one of more of the following data types: Text Images Audio Video Most common scenario

742 views • 62 slides
Multimedia Applications Multimedia Applications Srinidhi Varadarajan Multimedia Applications

Multimedia Applications Multimedia Applications Srinidhi Varadarajan Multimedia Applications

Multimedia Applications Multimedia Applications Srinidhi Varadarajan Multimedia Applications Multimedia Applications Multimedia requirements Streaming Phone over IP Recovering from Jitter and Loss RTP Diff-serv, Int-serv,

483 views • 27 slides
Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 Lszl

Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 Lszl

Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 Lszl Bszrmnyi Distributed Multimedia Systems Application Categorization Market-oriented view Kiosk, educational, cooperative work

694 views • 13 slides
Multimedia Systems Definition of Multimedia System A Multimedia System is a system capable of

Multimedia Systems Definition of Multimedia System A Multimedia System is a system capable of

MMGD0101 INTRODUCTION TO MULTIMEDIA Chapter 2 Multimedia Systems Definition of Multimedia System A Multimedia System is a system capable of processing multimedia data and applications. It is characterized by the processing, storage,

578 views • 16 slides
Stack and Queue Stack Overview Stack ADT Basic operations of stack Pushing, popping

Stack and Queue Stack Overview Stack ADT Basic operations of stack Pushing, popping

Stack and Queue Stack Overview Stack ADT Basic operations of stack Pushing, popping etc. Implementations of stacks using array linked list The Stack ADT A stack is a list with the restriction that insertions and

566 views • 44 slides
The Stack Eric McCreath The Stack The stack is a simple but useful data structure in computer

The Stack Eric McCreath The Stack The stack is a simple but useful data structure in computer

The Stack Eric McCreath The Stack The stack is a simple but useful data structure in computer science. The stack is an abstract data type that has two main operations. These are push which adds an element to the top of the stack and pop which

754 views • 8 slides
Stack ADT Tiziana Ligorio 1 Todays Plan Questons? Stack ADT 2 Abstract Data Types

Stack ADT Tiziana Ligorio 1 Todays Plan Questons? Stack ADT 2 Abstract Data Types

Stack ADT Tiziana Ligorio 1 Todays Plan Questons? Stack ADT 2 Abstract Data Types Bag List Stack 3 Stack 34 A data structure representing a stack of things Objects can be pushed onto the stack or popped from the stack

1.62k views • 116 slides
1 Array-based Stack (2.1.1) Algorithm pop (): if isEmpty () then A simple way of throw

1 Array-based Stack (2.1.1) Algorithm pop (): if isEmpty () then A simple way of throw

Elementary Data Structures Stacks, Queues, Vectors, Lists & Sequences Trees The Stack ADT (2.1.1) The Stack ADT stores arbitrary objects Insertions and deletions Auxiliary stack follow the last-in first-out operations: scheme

473 views • 13 slides
Multimedia Indexation Titus ZAHARIA, Pr. Titus.Zaharia@telecom-sudparis.eu Multimedia indexation

Multimedia Indexation Titus ZAHARIA, Pr. Titus.Zaharia@telecom-sudparis.eu Multimedia indexation

Multimedia Indexation Titus ZAHARIA, Pr. Titus.Zaharia@telecom-sudparis.eu Multimedia indexation Interactive multimedia Still i mage Video Audio Graphics (2D/3D, static or animated) Tera-bytes of digital AV data Multimedia

941 views • 70 slides
ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF THE STACK Add, remove rock and book from the top, or else 3 Stack at logical level A stack is an ADT in which elements add added and

1.06k views • 37 slides
ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF THE STACK Add, remove rock and book from the top, or else 3 Stack at logical level A stack is an ADT in which elements add added and

679 views • 19 slides
Call Stack Stack Bottom Memory region managed with stack discipline Procedures and the Call

Call Stack Stack Bottom Memory region managed with stack discipline Procedures and the Call

Call Stack Stack Bottom Memory region managed with stack discipline Procedures and the Call Stack higher %rsp holds lowest stack address addresses (address of "top" element) Topics stack grows Procedures toward lower

76 views • 5 slides
Stack 7 January 2019 OSU CSE 1 Stack The Stack component family allows you to manipulate

Stack 7 January 2019 OSU CSE 1 Stack The Stack component family allows you to manipulate

Stack 7 January 2019 OSU CSE 1 Stack The Stack component family allows you to manipulate strings of entries of any (arbitrary) type in LIFO (last-in-first-out) order A kind of dual to Queue Remember, "first" and

450 views • 33 slides
MULTIMEDIA RETRIEVAL Electronic album, Personalised electronic journals Education and Training

MULTIMEDIA RETRIEVAL Electronic album, Personalised electronic journals Education and Training

3/4/2008 Multimedia? Text, images, drawings(graphics), animation, video, sound(speech) PCs, DVDs, games, digital TV, Web surfing etc. Applications of Multimedia Home Video on demand, Interactive TV MULTIMEDIA RETRIEVAL Electronic

575 views • 18 slides
Compilers Stack Machines Alex Aiken Stack Machines Only storage is a stack An

Compilers Stack Machines Alex Aiken Stack Machines Only storage is a stack An

Compilers Stack Machines Alex Aiken Stack Machines Only storage is a stack An instruction r = F(a 1 ,a n ): Pops n operands from the stack Computes the operation F using the operands Pushes the result r on the stack Alex

362 views • 13 slides
01. MULTIMEDIA REVOLUTION 1 1 Contemporary Multimedia is the development, integration, and

01. MULTIMEDIA REVOLUTION 1 1 Contemporary Multimedia is the development, integration, and

9/3/20 01. MULTIMEDIA REVOLUTION 1 1 Contemporary Multimedia is the development, integration, and delivery of any combination of text, graphics, animation, sound or video through a computer or other electronic means. W H A T I S M U L T

368 views • 11 slides
Re-arquitetando o Re-arquitetando o Stack Overflow Stack Overflow ou como construmos o Stack

Re-arquitetando o Re-arquitetando o Stack Overflow Stack Overflow ou como construmos o Stack

Re-arquitetando o Re-arquitetando o Stack Overflow Stack Overflow ou como construmos o Stack Overflow for Teams Roberta Arcoverde 1 /whois /whois recifense programadora h 15 anos principal software developer na stack overflow

711 views • 52 slides
Internet Protocols Multimedia Netw orking for Multimedia T Animation, voice and video - not only

Internet Protocols Multimedia Netw orking for Multimedia T Animation, voice and video - not only

Internet Protocols Multimedia Netw orking for Multimedia T Animation, voice and video - not only text T Video, Distributed simulation, distribute work groups T Multimedia networks may replace DS VT-01 Jerry Eriksson telephone, television, etc T

567 views • 12 slides
Stack machines (Using slides adapted from the book) Stacks A stack machine maintains an

Stack machines (Using slides adapted from the book) Stacks A stack machine maintains an

Stack machines (Using slides adapted from the book) Stacks A stack machine maintains an unbounded stack of symbols We'll represent these stacks as strings Left end of the string is the top of the stack For example, abc is a stack

406 views • 12 slides
Multimedia Communications @CS.NCTU Lecture 11: Multimedia Networking Instructor: Kate Ching-Ju

Multimedia Communications @CS.NCTU Lecture 11: Multimedia Networking Instructor: Kate Ching-Ju

Multimedia Communications @CS.NCTU Lecture 11: Multimedia Networking Instructor: Kate Ching-Ju Lin ( ) 2 Why Multimedia Networking Matters? Watching video over Internet Uploading user-generated content Telephone calls

754 views • 52 slides
Internet Protocols for Multimedia DS VT-01 Jerry Eriksson Multimedia Netw orking T Animation,

Internet Protocols for Multimedia DS VT-01 Jerry Eriksson Multimedia Netw orking T Animation,

Internet Protocols for Multimedia DS VT-01 Jerry Eriksson Multimedia Netw orking T Animation, voice and video - not only text T Video, Distributed simulation, distribute work groups T Multimedia networks may replace telephone, television, etc T

690 views • 23 slides

More recommend