Adobe HDS Downloader

KSV · 04-23-2012, 08:24 PM

I have written a php script to join HDS fragments into flv file. it's the initial script so test it out and report if any problem occurs. you can either use --manifest switch or use any download manager with batch capabilities to download the fragments. f4f extension is optional.

if you fragments are serially numbered without a base filename (1.f4f, 2.f4f.......99.f4f) then you can run the script without any parameter and it will look for the fragments in current directory and output will be saved as Joined.flv.

However if your fragments are named with base filename (MyVideo-Seg1-Frag1.f4f, MyVideo-Seg1-Frag2.f4f.........MyVideo-Seg1-Frag99.f4f) then you can pass the base filename with --fragments parameter to the script and it will look for the fragments starting with this name and output will be saved as MyVideo-Seg1-Frag.flv.

Usage:

Code:

php AdobeHDS.php --manifest "your_manifest_url" --delete

1.f4f, 2.f4f.......99.f4f

Code:

php AdobeHDS.php

MyVideo-Seg1-Frag1.f4f, MyVideo-Seg1-Frag2.f4f.........MyVideo-Seg1-Frag99.f4f

Code:

php AdobeHDS.php MyVideo-Seg1-Frag

You can use script with following switches:

Code:

 --help              displays this help
 --debug             show debug output
 --delete            delete fragments after processing
 --fproxy            force proxy for downloading of fragments
 --play              dump stream to stdout for piping to media player
 --rename            rename fragments sequentially before processing
 --update            update the script to current git version
 --auth      [param] authentication string for fragment requests
 --duration  [param] stop recording after specified number of seconds
 --filesize  [param] split output file in chunks of specified size (MB)
 --fragments [param] base filename for fragments
 --manifest  [param] manifest file for downloading of fragments
 --outdir    [param] destination folder for output file
 --outfile   [param] filename to use for output file
 --parallel  [param] number of fragments to download simultaneously
 --proxy     [param] proxy for downloading of manifest
 --quality   [param] selected quality level (low|medium|high) or exact bitrate
 --referrer  [param] Referer to use for emulation of browser requests
 --start     [param] start from specified fragment
 --useragent [param] User-Agent to use for emulation of browser requests

Download:

Code:

https://github.com/K-S-V/Scripts

Proper switch usage:

1. useragent here
2. grabbing the manifest url and auth parameters with firefox here
3. proxy here
4. play here

PS: i have tested it only on few videos downloaded from pluzz.fr, fora.tv and Akamai Demos so it may or may not work with others. Also don't try to extract fragments from Browser cache. cache may contain fragments from different quality levels and you may have audio visual glitches in joined video. either use --manifest option or download all fragments with download manager.

===========================================

Installing PHP for dummies

===========================================

1. Download PHP 5.4 and extract it to C:\PHP folder.
2. Download PHP.ini and copy it to the same folder.
3. Right click on "My Computer" and go to Properties->Advanced->Environment Variables and add following string to the end of Path Variable.

Code:

;C:\PHP

4. Open cmd prompt and type php -v. if you have done above steps correctly then you will see something like following.

Code:

PHP 5.4.7 (cli) (built: Sep 12 2012 23:48:31)
Copyright (c) 1997-2012 The PHP Group
Zend Engine v2.4.0, Copyright (c) 1998-2012 Zend Technologies

Stream Ripper · 04-23-2012, 09:55 PM

Awesome, thanks!!

chap · 04-24-2012, 08:08 AM

Respect

works fine

KSV · 04-26-2012, 05:20 AM

Changes:

Code:

1. make .f4f extension optional for fragments
2. filter out frames with similar timestamps to make the resulting file remuxable with ffmpeg
3. better searching for audio video packets in fragments
4. should also work with older php versions
5. many other improvements

Download:

Code:

http://www.mediafire.com/file/9u3s97rc9vki4vp/AdobeHDS.php

if you have any problem, zip the first five fragments of video and upload it to MediaFire and provide the link.

KSV · 04-26-2012, 11:53 AM

Changes:

Code:

1. Added progress indicator
2. minor fix for frame filtering

Download:

Code:

http://www.mediafire.com/file/9mtabmtolx3o6rs/AdobeHDS.php

Bahman · 04-27-2012, 01:05 PM

Thank you!

compn · 04-27-2012, 01:47 PM

nice! now all we need is an easy way to download the segments and an easy way to force high bitrate streams.

bit2 · 04-28-2012, 07:54 AM

Thank you KSV! Works as advertised. :-) Fetching the fragments is quite easy (at least most of the time ... actually I've not yet met a "difficult" scenario). I'll write a blog post about the whole process of grabbing a HDS stream and saving it as mp4. I'll post the link when it gets public.

svnpenn · 04-28-2012, 10:15 PM

I made a repo for the commits.
Please delete my other post.

github.com/svnpenn/adobe-hds

KSV · 04-29-2012, 12:14 AM

Changes:

Code:

1. Added command line options
2. some other improvements

Download:

Code:

http://www.mediafire.com/file/dh6e3m06d1qs8pv/AdobeHDS.php

following switches are currently available.

Code:

 --help         displays this help
 --debug        show debug ouput
 --no-frameskip do not filter any frames
 --file [param] base filename for fragments

one of the important switch is --no-frameskip. if your video is using (H264 + AAC) then it's necessary to filter out some packets to make the joined file properly playable with vlc or remuxable with ffmpeg (though FFPlay and MPlayer doesn't have any problem even without any filtering). However if your file contains (VP6+MP3) then this filtering causes problem and you will see audio video glitches in merged video. to avoid this you have to join those videos with --no-frameskip switch. i was testing some videos from fora.tv. while their newer videos use (H264+AAC) older ones are encoded with (VP6+MP3). in short if you see any audio video glitches in merged video also try with --no-frameskip option.

Audio/video stream recording forums

Adobe HDS Downloader

Adobe HDS Downloader

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner

Re: Adobe HDS fragment joiner