Web content will not stream

[infidel]

your youtube-dl config works right out of the box, of course. No luck with get_flash_videos yet, I can't get pmsencoder to match the profile. For example this uri, which downloads ok on the commandline:

Code: Select all

get_flash_videos -p http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss

when attempted using your suggested config modified like so:

Code: Select all

config {
    def GET_FLASH_VIDEOS = '/usr/bin/get_flash_videos'
    def PERL = '/usr/bin/perl'

    profile ('Get Flash Videos') {
        pattern {
            domain $URI, [
                'comedycentral.com',
                'thedailyshow.com',
                'mtvnservices.com'
            ]
        }

        action {
            $DOWNLOADER = "$PERL $GET_FLASH_VIDEOS --quality high --filename $DOWNLOADER_OUT ${$URI}".tokenize()
        }
    }
}


yields no match:

Code: Select all

2010-12-15 14:02:34 [INFO|Profile|match|New I/O server worker #1-1]: matching profile: Get Flash Videos
2010-12-15 14:02:34 [WARN|Pattern|invoke0|New I/O server worker #1-1]: invalid match: http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids is not defined
2010-12-15 14:02:34 [WARN|Pattern|invoke0|New I/O server worker #1-1]: invalid match: http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids is not defined
2010-12-15 14:02:34 [WARN|Pattern|invoke0|New I/O server worker #1-1]: invalid match: http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids is not defined
2010-12-15 14:02:34 [WARN|Pattern|invoke0|New I/O server worker #1-1]: invalid match: http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids is not defined
2010-12-15 14:02:34 [WARN|Pattern|invoke0|New I/O server worker #1-1]: invalid match: http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids is not defined
2010-12-15 14:02:34 [INFO|Engine|launchTranscode|New I/O server worker #1-1]: 0 matches for: http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids
2010-12-15 14:02:34 [INFO|Engine|launchTranscode|New I/O server worker #1-1]: transcoder command: [mencoder, -o, /tmp/javaps3media/pmsencoder_transcoder_out_1292439754319, -prefer-ipv4, -oac, lavc, -of, lavf, -lavfopts, format=dvd, -ovc, lavc, -lavcopts, vcodec=mpeg2video:vbitrate=4096:threads=4:acodec=ac3:abitrate=128, -ofps, 25, -cache, 16384, -vf, harddup, http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids]


I guess I need a quick primer (or example) on how to set up the match regex.

[Osiris X]

@chocolateboy

Would you mind if I build and package (for Debian) pmsencoder from git with the community beta build of ps3 media server?
Note that it is not for distribution,but everything I do, I pass on to paissad the official Debian/Ubuntu maintaner for the PS3MS project.

Regards

Os

[brotherjohn]

I have the following RSS-video-feed which will not stream:
videofeed.Web,WinFuture=http://rss.feedsportal.com/c/617/f/448481/index.rss

@chocolateboy: Could you please write another 'profile script' for pmsencoder.conf file that makes it possible to watch these videos?
Do you have a documentation or an howto about this technique, so that I can perhaps help myself with the next RSS-feed?

Thank you in advance

[chocolateboy]

No luck with get_flash_videos yet, I can't get pmsencoder to match the profile.

I've made some changes. Pull the latest version of PMSEncoder and try with this profile:

Code: Select all

config {
    def GET_FLASH_VIDEOS = '/usr/bin/get_flash_videos'
    def PERL = '/usr/bin/perl'

    profile ('Get Flash Videos') {
        pattern {
            domain([
                'comedycentral.com',
                'thedailyshow.com',
                'mtvnservices.com'
            ])
        }

        action {
            $DOWNLOADER = "$PERL $GET_FLASH_VIDEOS --quality high --yes --filename $DOWNLOADER_OUT ${$URI}"
        }
    }
}


Note: domain now just takes a single domain or a list of domains; and the $DOWNLOADER is automatically tokenized if assigned as a string.

[infidel]

I've made some changes. Pull the latest version of PMSEncoder and try with this profile:

Thanks, I now get a match and downloading completes, but transcoding doesn't happen, i.e. mencoder isn't reading anything on its fifo. This may be due to a problem with the --filename switch in get_flash videos, since when I run the pmsencoder $DOWNLOADER command by itself:

Code: Select all

/usr/bin/perl /usr/bin/get_flash_videos --quality high --yes --filename /tmp/javaps3media/pmsencoder_downloader_out_1292460817069 http://www.thedailyshow.com/watch/tue-december-14-2010/obama-leaves-bill-clinton-in-white-house-briefing-room?xrs=rss_tdsvids

I get 'The_Daily_Show_-_Obama_Leaves_Bill_Clinton_in_White_House_Briefing_Room.flv' in the current directory, not in /tmp/... as specified by --filename. Debug.log also shows:

Code: Select all

[Thread-20] DEBUG 19:54:20.017 Done. Saved 45009419 bytes to The_Daily_Show_-_Obama_Leaves_Bill_Clinton_in_White_House_Briefing_Room.flv

so presumably the flv is being saved wherever $PWD was when the command was run.

This isn't a pmsencoder issue, but is there a way to fix it with a workaround in the action{} section of the profile?

[chocolateboy]

Would you mind if I build and package (for Debian) pmsencoder from git with the community beta build of ps3 media server?

I can't stop you, but I would advise building from an official release rather than from an unstable snapshot that might not even work.

[chocolateboy]

Could you please write another 'profile script' for pmsencoder.conf file that makes it possible to watch these videos?

Yes, but you'll have to wait for the next release of PMSEncoder to use it.

[chocolateboy]

This isn't a pmsencoder issue, but is there a way to fix it with a workaround in the action{} section of the profile?

Like you say, it's not a PMSEncoder issue, and it works for me with get_flash_videos 1.22.

[infidel]

It's bizarre; for some reason --filename seems to have no effect here (even with get_flash_videos 1.22), I'll have to raise the issue with them. Many thanks for the help, I'll post here if I find out anything useful.

update: the problem is that get_flash_videos doesn't pass along its --filename value to rtmpdump's --flv option.

[brotherjohn]

Could you please write another 'profile script' for pmsencoder.conf file that makes it possible to watch these videos?

Yes, but you'll have to wait for the next release of PMSEncoder to use it.

Thanks. Could you please migrate the following 'profiles' to the new pmsencoder version, too? When will you release the new version?....yes, yes. I know "WHEN IT'S DONE", but It's worth a try, isn't it ?

Code: Select all

profile ('Gamestar') {
        pattern {
            match uri: '^http://www\\.gamestar\\.de/index\\.cfm\\?pid=\\d+&pk=\\d+'
        }

        action {
            // set the scrape URI to the URI of the XML file containing the video's metadata
            scrape '/jw4/player\\.swf\\?config=(?<uri>[^"]+)'
            // now extract the video URI from the XML's <file>...</file> element
            scrape '<file>(?<uri>[^<]+)</file>'
        }
    }
   profile ('Gameswelt') {
        pattern {
            match uri: '^http://www\\.gameswelt\\.de/videos/videos/'
        }

        action {
            // extract the video URI from the value of the flashvars param
            scrape '<param\\s+name="flashvars".+(?<uri>http://video\\.gameswelt\\.de/[^&]+)'
        }
    }
    profile ('ZDF') {
        pattern {
            match uri: '^http://hstreaming\\.zdf\\.de/.+?\\.mov$'
        }

        action {
            // scrape the RTSP URI from the .mov "container" (actually a plain text file)
            scrape '(?<uri>rtsp://\\S+)'
            // now set the correct MEncoder options
            set 'rtsp-stream-over-tcp' // needed for some firewalls/routers
        }
    }
   profile ('ARD') {
        pattern {
            match uri: '^http://hstreaming\\.ard\\.de/.+?\\.mov$'
        }

        action {
            // scrape the RTSP URI from the .mov "container" (actually a plain text file)
            scrape '(?<uri>rtsp://\\S+)'
            // now set the correct MEncoder options
            set 'rtsp-stream-over-tcp' // needed for some firewalls/routers
        }
    }


Thanks for your great work on PMSENCODER!