ytmp - youtube without flash thanks to ngrep and mplayer

cmudik · 2010-09-03 18:48:25

I tried to update through makepkg and pacman -U in /var/abs/local/yaourtbild/ but problem still persists.

honki · 2010-09-04 00:00:30

cmudik wrote:

Hi,

nice work, but ytmp works for me only on vimeo.com site. Ytmpd is storing only vimeo video ids in /tmp/ytmpurls. I tried run this command in terminal

sudo ngrep -W byline -qilw 'get' tcp dst port 80 -d eth0

and for videos on youtube.com i get this

T 10.109.253.113:40425 -> 74.125.157.101:80 [AP]
GET /csi?v=2&s=youtube&action=watch5&srt=527&fmt=34&asv=3&plid=AASPS6NaK3VK-kTy&sprot=0&fv=LNX%2010%2C1%2C82%2C76&manu=Adobe%20Linux&vid=jfveZIXSDCg&rt=ct.102,bf.107,ol.487,fs.907,gv.1342,fvb.3620,vr.3709,vl.2367,aft.3709&e=907113,907025,905602 HTTP/1.1.
Host: csi.gstatic.com.
Connection: keep-alive.
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US) AppleWebKit/533.4 (KHTML, like Gecko) Chrome/5.0.375.127 Safari/533.4.
Referer: [url]http://www.youtube.com/watch?v=G0_2FvKkDPo&feature=rec-LGOUT-real_rn-1r-35-HM[/url].
Accept: */*.
Accept-Encoding: gzip,deflate,sdch.
Accept-Language: cs-CZ,cs;q=0.8.
Accept-Charset: windows-1250,utf-8;q=0.7,*;q=0.3.

hm, there's something weird going on here. the video id should be in the GET request, not in the referer. what is csi.gstatic.com? some kind of proxy maybe? What's even more strange is that there is actually a video id in the GET request, but it's not valid: www.youtube.com/watch?v=jfveZIXSDCg

do you remember which video you actually tried to watch at this time?

Hiato · 2010-09-06 11:44:00

Perhaps it's just me, but it seems as though ytmpd is trying to reference something by the name of /usr/lib/tlvince/getConfig.sh, which is not listed as a depend and, as such, doesn't exist on my system - this is with the git branch that I just pulled. Perhaps I could initialsise the variables manually in the script (or write my own wrapper) if you supply me with the vars it's supposed to scrape.

Edit: I have included

eval "$(grep '^[^#].*=' /etc/ytmp.conf | sed 's/=/=\"/;s/$/"/')"

and it seems to work instead of

. /usr/lib/tlvince/getConfig.sh
 $(getConfig ytmp)

Edit edit: it seems I didn't really understand what it was your sourco code was doing. My bad.

Last edited by Hiato (2010-09-06 13:07:24)

DIDI2002 · 2010-09-06 12:20:21

Really great work. Thanks for sharing! Can you give any advice on how to add new sites (e.g. blip.tv) to the script?

Pank · 2010-09-06 16:23:19

I am also getting the following error:

[~] sudo /etc/rc.d/ytmpd start
:: Starting ytmpd                                                        [BUSY] 
/usr/bin/ytmpd: line 3: /usr/lib/tlvince/getConfig.sh: No such file or directory                                                                         [FAIL]

lilsirecho · 2010-09-06 16:58:36

Does this package run in 64 bit arch?

DIDI2002 · 2010-09-06 17:00:35

The missing files can be downloaded from git: http://github.com/tlvince/ytmp/tree/master/lib

whompus · 2010-09-06 17:20:51

lilsirecho wrote:

Does this package run in 64 bit arch?

Works fine for me in 64 bit arch.

lilsirecho · 2010-09-06 17:36:34

Can this package be run-as-root?

jck · 2010-09-09 01:43:32

I cannot use this script if i access the internet using a proxy...

tlvince · 2010-09-09 02:10:29

Pank wrote:

I am also getting the following error:

[~] sudo /etc/rc.d/ytmpd start
:: Starting ytmpd                                                        [BUSY] 
/usr/bin/ytmpd: line 3: /usr/lib/tlvince/getConfig.sh: No such file or directory                                                                         [FAIL]

Sorry guys, my bad. Honki is away at the moment and hence the PKGBUILD on AUR has not been updated. Please use the latest version to fix the lib issues.

tlvince · 2010-09-09 02:23:16

DIDI2002 wrote:

Really great work. Thanks for sharing! Can you give any advice on how to add new sites (e.g. blip.tv) to the script?

Since we let youtube-dl handle the actual downloading (except for Vimeo), we have plans to add all the sites it supports.

Currently, we're checking all outgoing HTTP traffic to see if it matches a known pattern and if so, write the video host and id to /tmp/ytmpurls, which is in turn read in by ytmpc. It's a bit tricky (and not particularly robust) at the moment, but check on GitHub once we add more sites for a more detailed guide.

lilsirecho wrote:

Can this package be run-as-root?

It should be fine. Just edit the config in /etc/ytmp.conf.

ytmpd requires root privileges, where as ytmpc can be run as user or root.

jck wrote:

I cannot use this script if i access the internet using a proxy...

Do you set your proxy like:

export http_proxy="..."

Other than that, I can't think of any specific reason why one wouldn't work. Could you post any error messages you get (preferably on the issue tracker)?

Last edited by tlvince (2010-09-09 03:03:08)

skanky · 2010-10-07 20:06:15

I've just installed the latest version of this, and set it up as described at the source page.
However I'm getting a silent fail when I try and start ytmpd

sudo /etc/rc.d/ytmpd start

Here's the /etc/ytmp.conf

#INTERFACE=eth0
INTERFACE=wlan0

#GUI="kdialog"
#GUI="zenity"
GUI="dmenu"
#GUI="none"

DWN=""

PLAYER='mplayer -cache 2048'

YTQUAL='--max-quality=35' # download videos with max resolution of 480p
#YTQUAL='' #best quality available
#YTQUAL='-f 22' # only download 720p mp4s
# see http://en.wikipedia.org/wiki/YouTube#Quality_and_codecs

Any idea how to debug it?

redhalo · 2010-10-08 00:45:01

This is great, but does anyone have a solution to stop youtube pages from auto-playing in a non mozilla/opera browser?

tlvince · 2010-10-08 02:52:27

skanky wrote:

I've just installed the latest version of this, and set it up as described at the source page. However I'm getting a silent fail when I try and start ytmpd
...
Any idea how to debug it?

Sorry about this. It's probably failing on sourcing the lib functions (which is broken in the PKGBUILD). Did you manually copy the libs to /usr/lib/tlvince?

BTW, Honki seems to still be inactive, so I'll ask a TU to orphan the AUR package so I can update it.

redhalo wrote:

This is great, but does anyone have a solution to stop youtube pages from auto-playing in a non mozilla/opera browser?

Which browser do you use? For example, in Chromium, I disable all plugins (Options > Under the Bonnet > Content Settings > Plugins). When a page uses a plugin, I gives me the option to "Click to enable plugin". Jumanji handles it similarly. You could also try Flash Block (and the like) extensions.

sugardeath · 2010-10-08 07:54:03

I haven't run into any issues yet, but I plan to put this into heavy testing/usage. Very nice, should really help my netbook out! It's useful even on my desktop just to have the video outside of the browser. I'm loving it.

skanky · 2010-10-08 09:10:44

tlvince wrote:

skanky wrote:
I've just installed the latest version of this, and set it up as described at the source page. However I'm getting a silent fail when I try and start ytmpd
...
Any idea how to debug it?
Sorry about this. It's probably failing on sourcing the lib functions (which is broken in the PKGBUILD). Did you manually copy the libs to /usr/lib/tlvince?
BTW, Honki seems to still be inactive, so I'll ask a TU to orphan the AUR package so I can update it.

Thanks for the response.

 $ls /usr/lib/tlvince/
getConfig.sh  logging.sh

They were already there when I checked.

Last edited by skanky (2010-10-08 09:11:47)

skanky · 2010-10-08 09:24:32

And suddenly it's running. No idea why.
I just tried to start the daemon to see if I could get some error message and it ran.
Mean while I've got a bit more idea how it ties together now, so I'll dig a bit more if it reoccurs.

redhalo · 2010-10-08 10:10:58

tlvince wrote:

Which browser do you use? For example, in Chromium, I disable all plugins (Options > Under the Bonnet > Content Settings > Plugins). When a page uses a plugin, I gives me the option to "Click to enable plugin". Jumanji handles it similarly. You could also try Flash Block (and the like) extensions.

I'm using luakit, of which there are no extensions to speak of. I'll cross ask in their thread.

sugardeath · 2010-10-13 17:03:42

Has anyone used this on an open wireless network yet?

At university every now and then I get the zenity prompt with some youtube title that I definitely did not request. Sometimes my browser isn't even open.

ngrep is showing me all kinds of cross traffic on port 80 that doesn't have my machine as either the source or destination IP. I guess it's the way the access points are set up? I honestly don't know much about wireless.

Just figured I'd comment on this, since it can probably be fixed by grepping for the IP of the network device specified in the config.

kmason · 2010-10-13 17:18:54

Is it possible to make the client persistent? Right now I have to enter the command every time I go to a youtube url, and its kind of annoying.

sugardeath · 2010-10-13 19:19:47

kmason wrote:

Is it possible to make the client persistent? Right now I have to enter the command every time I go to a youtube url, and its kind of annoying.

The client is persistent. It runs in the background and grabs the urls constantly.

Does the client error out after each video?

kmason · 2010-10-13 19:32:08

sugardeath wrote:

kmason wrote:
Is it possible to make the client persistent? Right now I have to enter the command every time I go to a youtube url, and its kind of annoying.
The client is persistent. It runs in the background and grabs the urls constantly.
Does the client error out after each video?

Not as far as I know, but I didn't run it from the terminal, but rather from gmrun.

skanky · 2010-10-13 19:49:55

sugardeath wrote:

kmason wrote:
Is it possible to make the client persistent? Right now I have to enter the command every time I go to a youtube url, and its kind of annoying.
The client is persistent. It runs in the background and grabs the urls constantly.
Does the client error out after each video?

How do people run the client? I manually started this when I wanted to go to YT, but do people have it in a start-up script or similar?

sugardeath · 2010-10-13 20:46:48

I start mine in my .xinitrc on my desktop, but my netbook doesn't connect to a network until after the boot process, so I have to start it manually there in tilda.

Arch Linux

#26 2010-09-03 18:48:25

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#27 2010-09-04 00:00:30

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#28 2010-09-06 11:44:00

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#29 2010-09-06 12:20:21

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#30 2010-09-06 16:23:19

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#31 2010-09-06 16:58:36

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#32 2010-09-06 17:00:35

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#33 2010-09-06 17:20:51

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#34 2010-09-06 17:36:34

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#35 2010-09-09 01:43:32

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#36 2010-09-09 02:10:29

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#37 2010-09-09 02:23:16

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#38 2010-10-07 20:06:15

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#39 2010-10-08 00:45:01

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#40 2010-10-08 02:52:27

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#41 2010-10-08 07:54:03

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#42 2010-10-08 09:10:44

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#43 2010-10-08 09:24:32

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#44 2010-10-08 10:10:58

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#45 2010-10-13 17:03:42

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#46 2010-10-13 17:18:54

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#47 2010-10-13 19:19:47

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#48 2010-10-13 19:32:08

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#49 2010-10-13 19:49:55

Re: ytmp - youtube without flash thanks to ngrep and mplayer

#50 2010-10-13 20:46:48

Re: ytmp - youtube without flash thanks to ngrep and mplayer

Board footer