All posts by bouqueau

Official AV1 and VP9 support in GPAC

Dear reader,

GPAC has added support for new codecs recently:

  • AV1 support is available in nightly builds since July 10th, 2018. This include file creation with MP4Box (including MPEG DASH generation) and file playback with MP4Client. Support for AV1 encryption was added on September 20th, 2018.
  • VP9 support was completed on October 14th, 2018.

This article gives you some useful command lines to use AV1 streams, but the same can be applied for VP9 streams.

Command-line for importing AV1 streams into MP4 files

To store an AV1 bitstream into an ISOBMFF/MP4 file , use the following command line. If the input file is called *.av1, its content can be OBUs (as specified in Section 5 of the AV1 specification), IVF or Annex B bitstreams. WebM streams are not supported. You can also call OBU-based bistream *.obu and IVF files *.ivf:

If your file extension is not recognized by MP4Box, you can indicate the bitstream format with “:fmt=obu” or :fmt=AnnexB or fmt=IVF (case insensitive) as follows:

AV1 bitstreams may not contain frame rate information, you can use the following to indicate it:

Command-line for AV1 adaptive streaming preparation

You can use the usual MP4Box command line parameters to segment your AV1 MP4 file and prepare it for adaptive streaming. The following command line will generate an MPEG-DASH onDemand manifest based on an AV1 representation (with its ‘codecs’ parameter) and it will create a segmented MP4 file with segments starting at AV1 KEY FRAMEs and targeting 1 second duration.

Command-line for AV1 encryption/decryption

Encryption of AV1 streams in MP4 files follows the general principles given by MPEG’s Common Encryption specification.¬† To use MP4Box for encryption or decryption, use the following command lines where the file ‘info.xml’ is an XML file that provides encryption parameters, as described in more details here. Example of such XML files can be found in our test base.

Encryption:

Decryption:

Acknowledgements and conclusion

The work on AV1 and VP9 was largely sponsored by Alliance for Open Media and Netflix. Kudos to them ūüôā

As usual, if you find any bug or miss documentation, let us know.

Internship: next-generation video streaming analyzer (Paris, France)

GPAC is a Free Software multimedia framework. The project covers different aspects of multimedia, with a focus on multimedia packaging and presentation technologies (graphics, animation, interactivity, VR). We provide popular packagers, streamers and players on http://www.gpac.io.

The GPAC team builds tomorrow multimedia standards. The GPAC team is renowned for its participation in standards (ISO/MPEG, W3C, etc.). GPAC is the reference software for some core multimedia technologies and drives innovative technologies (scalable and interactive video, etc.).

The internship aims at exploring the CMAF standard. CMAF aims at unifying all the existing video streaming formats and is backed by Apple and Microsoft. The role of the intern is to participate in the development of a CMAF validation service.
Continue reading Internship: next-generation video streaming analyzer (Paris, France)

GPAC selected for the Google Summer Of Code (GSoC) 2016

GPAC GSoC page: https://summerofcode.withgoogle.com/organizations/6481702784335872/

Subjects: http://gpac.io/jobs/google-summer-of-code-ideas/

The timeline to see the subject and apply is quite short (25 March for student application deadline): https://developers.google.com/open-source/gsoc/timeline

Please pass along the message. GSoC is a good opportunity for projects to improve and find contributors!

If you have any question, please contact gsoc@gpac.io.

GPAC: build MP4Box only (all platforms)

Dear readers,

As many of you know, GPAC is a full framework providing authoring tools, packagers, streamers, a player and now some js stuff. This can make GPAC cumbersome to build.

However many of you are mainly interested in MP4Box which is easy to build. Whether you are on Linux, Windows or MacOS,¬†here is the definite guide to build MP4Box easily ūüôā

Edit 2015/11/03: added MSVC MP4Box minimal build.

Build MP4Box with Visual Studio

We published a minimal solution to build MP4Box.exe only, with zero dependency. No DLL to distribute.

You need Visual Studio 2010 or more recent (a pop-up will ask you to upgrade your projects, just accept). Open build/msvc10/gpac_mp4box_mini.sln and build (Debug or Release).

That’s all!

Build MP4Box with Make

On your system, you need the following tools installed on your system:

  • git
  • gcc
  • make
  • libpthread-dev (should be available on any development system)

In your favorite terminal, type:

To execute MP4Box, assuming you are still in the same directory (i.e. the root of the GPAC repository), you will find the MP4Box executable at:

To install MP4Box on your system:

Check installation

now when you type

you should see

which is the default install folder for the version we have just built. You can tweak this with the ‘-prefix=’ configure option.

If you see /usr/bin/MP4Box (no “local/” in here), uninstall GPAC from your local packager. On MacOS, go to Finder and unmount the app on the left panel, or uninstall it from your package manager (‘port’ or ‘homebrew’ or ‘fink’).

Update to a newer revision

Of course you want to keep updated with the latest build without having to download the full repository again or re-execute the configuration when not necessary (it may be necessary sometimes, see below “Clean your build” if things go unexpectedly):

That’s all!

Clean your build

If things go wrong and you suspect there is an issue in your configuration, the fastest way to restart a clean build is:

Cross-compilation

Cross-compiling GPAC is quite standard, and requires only a modification at the ‘configure’ step. Use ‘–extra-cflags=’ and ‘–extra-ldflags=’ to add your environmment flags:

For example, to use the ‘x86_64-w64-mingw32’ toolchain¬†to cross-build from Linux to Windows:

You can find more examples in our TravisCI script.

Next Step

We have started a multimedia component-level build system called Zenbuild. Zenbuild builds FFmpeg/libav, VLC or GPAC with most of their features enabled (librtmp, jack, openHEVC, etc.). You can start using Zenbuild, it is fully operational!

Using GDB in Visual Studio

Dear followers,

One of the target platform for GPAC is Windows. Developing for Windows in a comfortable manner requires Visual Studio, in particular for debugging. Microsoft recently announced great changes that will make Visual Studio users (including the GPAC developers) happy:

Edit: update from Microsoft on 2015/11/18.

Setup for local debugging

Install software:

  • Install Visual Studio 2015.¬†Install¬†the¬†“Tools for Visual C++ Mobile Development” in a sub-menu (disabled by default).
  • Install gdb/gdbserver. Use MinGW-w64 binaries and put them in your PATH¬†(you can rely on the excellent MSYS2¬†for a full development environment).
    /!\ Legacy MinGW and Cygwin gdb binaries are known to fail /!\

Build:

  • Use your usual build system and gcc or clang compiler. Don’t forget to enable debugging!

Debugging:

  • In your command-line, launch:
  • In Visual Studio:
    • Open the “command window” (either press CTRL+ALT+A or click: View menu -> Other Windows -> Command Window)
    • Launch:

That’s all! Once Debug.GDBLaunch is attached your program will run. Breakpoints are effective. And you can enjoy the Visual Studio debugging experience:

20150610_msvs_gdb

Setup for remote debugging

This is an extension of the gdbserver we used above. ¬†It allows to debug mobile (android/iOS) or any platform (linux, …) executables from a remote

For specific remote parameters, see:

GPAC scalable and hybrid demo, including French Tennis Open 2015

Dear readers,

For the last few years, the GPAC tools backed demos at the French Tennis Open (Roland Garros) in its demo corner called RG Labs. This year, through the H2B2VS project, we participated in a demonstration showing the use of Hybrid Broadcast Broadband delivery for Ultra HD video content.

The video was encoded using the SHVC format with two layers. The encoder was MPEG reference software. The base HEVC layer, corresponding to HD content, was delivered using MPEG-2 TS, produced by our MP42TS tool. The enhancement layer, enhancing the spatial resolution to UHD, was delivered using MPEG-DASH generated by MP4Box. Both streams were synchronized based on the recent MPEG-2 TS TEMI extensions (inserted by MP42TS in the mux) and played by MP4Client, rendered on this nice curved 4K TV. You can find the press release by France TV here.

RG_TV_small

The GPAC player is very powerful. It features a graphical statistics module able to display and control the player. Look at the screenshot below. It can also be used to choose your HLS or MPEG-DASH quality or limit the download bandwidth to simulate a saturated server environment.

statistics

During the first week of June we were also present at the MediaSync 2015 workshop for talk and demos, as well as invited in the demo session of TVX 2015. We presented some demonstrations developed during the H2B2VS project:

  • HD/UHD hybrid delivery, same demo as the one in RG labs, bug using Tears of Steel (left on the picture).
  • Sign language picture-in-picture service enhancement, with main content on broadcast and sign language video on broadband using MPEG-DASH (right on the picture).
  • Dynamic switch between broadcast and broadband versions of the same content, to allow trick modes in a broadcast (time shifting, rewind, fast forward).

TVX_small

The demonstrations were all using MP42TS for broadcast génération, MP4Box for live or onDemand DASH packaging and MP4Client for the playback. Complete instructions for reproducing the test bed are available here.