Script to extract JSON info from pyLoad

sweetthdevil · 2023-06-08 18:49:11

Hello all,

I used to have the following script working (stopped working about 2/3 weeks ago, but didn't realised) - it connect to pyLoad and extract a json response whether or not pyLoad was actually downloading or not.

#!/bin/bash

set -e
set -x

SessionID=$(curl -s "http://192.168.1.90:8000/api/login" -g -H "Host: 192.168.1.90:8000" -H "Content-Type: application/x-www-form-urlencoded" --data "username=user&password=password" | jq -r)

SessionStatus=$(curl -s  "http://192.168.1.90:8000/api/statusServer" -g -H "Host: 192.168.1.90" -H "Content-Type: application/x-www-form-urlencoded" --data "session=$SessionID" | jq -r '.active')

if [ $SessionStatus -eq 1 ]
then
  exit 0
else
  exit 1
fi

That's the JSON available on 'http://192.168.1.90:8000/api/statusServer':

{"pause": false, "active": 0, "queue": 4, "total": 5, "speed": 0, "download": true, "reconnect": false, "captcha": false}

And that's the answer I get, with the "null" return instead of the "0" or number of active download.

$ sh autosuspend_script/pyload_autosuspend.sh 
++ curl -s http://192.168.1.90:8000/api/login -g -H 'Host: 192.168.1.90:8000' -H 'Content-Type: application/x-www-form-urlencoded' --data 'username=user&password=password'
++ jq -r
+ SessionID='{
  "_permanent": true,
  "authenticated": true,
  "id": 1,
  "name": "pyload",
  "role": 0,
  "perms": 0,
  "template": "default",
  "_flashes": [
    [
      "message",
      "Logged in successfully"
    ]
  ]
}'
++ curl -s http://192.168.1.90:8000/api/statusServer -g -H 'Host: 192.168.1.90' -H 'Content-Type: application/x-www-form-urlencoded' --data 'session={
  "_permanent": true,
  "authenticated": true,
  "id": 1,
  "name": "pyload",
  "role": 0,
  "perms": 0,
  "template": "default",
  "_flashes": [
    [
      "message",
      "Logged in successfully"
    ]
  ]
}'
++ jq -r .active
+ SessionStatus=null
+ '[' null -eq 1 ']'
autosuspend_script/pyload_autosuspend.sh: line 10: [: null: integer expression expected
+ exit 1

Thank you for taking the time to read my topic, and for your assistance.

Trilby · 2023-06-08 19:15:44

Remove the pipe to 'jq -r ".active"' and post the actual output from that curl command in the context of that script.

Last edited by Trilby (2023-06-08 19:16:01)

sweetthdevil · 2023-06-08 19:26:58

Thank you for your help and assistance, please see below the output of the script without the 'jq'

$ sh autosuspend_script/pyload_autosuspend.s
h
++ curl -s http://192.168.1.90:8000/api/login -g -H 'Host: 192.
168.1.90:8000' -H 'Content-Type: application/x-www-form-urlenco
ded' --data 'username=user&password=password'
+ SessionID='{"_permanent": true, "authenticated": true, "id":
1, "name": "pyload", "role": 0, "perms": 0, "template": "defaul
t", "_flashes": [["message", "Logged in successfully"]]}'
++ curl -s http://192.168.1.90:8000/api/statusServer -g -H 'Hos
t: 192.168.1.90' -H 'Content-Type: application/x-www-form-urlen
coded' --data 'session={"_permanent": true, "authenticated": tr
ue, "id": 1, "name": "pyload", "role": 0, "perms": 0, "template
": "default", "_flashes": [["message", "Logged in successfully"
]]}'
+ SessionStatus='{"error": "Unauthorized"}'
+ '[' '{"error":' '"Unauthorized"}' -eq 1 ']'
autosuspend_script/pyload_autosuspend.sh: line 10: [: too many
arguments
+ exit 1

seth · 2023-06-08 19:39:50

It's also actually in the original post.
Now take a close look at it.
Does it look like "{"pause": false, "active": 0, "queue": 4, "total": 5, "speed": 0, "download": true, "reconnect": false, "captcha": false}"?

sweetthdevil · 2023-06-08 19:42:01

No it doesn't (uses to work mind)

It is the answer to the first URL api/login

seth · 2023-06-08 19:47:22

According to your OP it's the reply to both requests.

sweetthdevil · 2023-06-08 19:49:32

Sorry for any confusion, the first curl command is to log on and get the credentials to the second curl command to extract the right JSON response.

seth · 2023-06-08 19:53:04

+ SessionStatus='{"error": "Unauthorized"}'

sweetthdevil · 2023-06-08 19:55:39

Yes, I have seen that - and it seems that the credentials are no longer past on to the second curl command.

Credentials are correct though and I can't figure out why it is isn't working any longer.

Trilby · 2023-06-08 19:57:48

seth wrote:

It's also actually in the original post.

Well, no, it wasn't - that was my point. What was in the OP was the expected json reply which would pruduce a "0" if piped to that jq command. As it didn't produce a zero, it was clear the actual reply to the curl command was not what was expected. This was confirmed in post 3 which makes the problem quite clear.

For the authorization error, is there a reason you are passing a different "Host" header for the two curl commands? The second one drops the port specification.

Last edited by Trilby (2023-06-08 19:59:26)

seth · 2023-06-08 19:59:38

If you enter this into a terminal

curl -s http://192.168.1.90:8000/api/statusServer -g -H 'Host: 192.168.1.90' -H 'Content-Type: application/x-www-form-urlencoded' --data 'session={
  "_permanent": true,
  "authenticated": true,
  "id": 1,
  "name": "pyload",
  "role": 0,
  "perms": 0,
  "template": "default",
  "_flashes": [
    [
      "message",
      "Logged in successfully"
    ]
  ]
}'

what is the response.

sweetthdevil · 2023-06-08 20:40:47

See below the output

{"error": "Unauthorized"}

seth · 2023-06-08 20:46:59

Trilby wrote:

For the authorization error, is there a reason you are passing a different "Host" header for the two curl commands? The second one drops the port specification.

sweetthdevil · 2023-06-08 20:52:12

Sorry no reason, but I have now added the port onto the second curl command and I am still getting the error:

~]$ sh autosuspend_script/pyload_autosuspend.s
h
++ curl -s http://192.168.1.90:8000/api/login -g -H 'Host: 192.
168.1.90:8000' -H 'Content-Type: application/x-www-form-urlenco
ded' --data 'username=*****&password=****'
+ SessionID='{"_permanent": true, "authenticated": true, "id":
1, "name": "pyload", "role": 0, "perms": 0, "template": "defaul
t", "_flashes": [["message", "Logged in successfully"]]}'
++ curl -s http://192.168.1.90:8000/api/statusServer -g -H 'Hos
t: 192.168.1.90:8000' -H 'Content-Type: application/x-www-form-
urlencoded' --data 'session={"_permanent": true, "authenticated
": true, "id": 1, "name": "pyload", "role": 0, "perms": 0, "tem
plate": "default", "_flashes": [["message", "Logged in successf
ully"]]}'
+ SessionStatus='{"error": "Unauthorized"}'
+ '[' '{"error":' '"Unauthorized"}' -eq 1 ']'
autosuspend_script/pyload_autosuspend.sh: line 10: [: too many
arguments
+ exit 1

schard · 2023-06-08 20:55:59

"Content-Type: application/x-www-form-urlencoded" and then send "application/json".
If I was the webserver, I'd rap the sender over the knuckles.
How is this even working?

seth · 2023-06-08 21:04:22

--data-urlencode, but the SessionID doesn't look particularily "ID" to me either.

Trilby · 2023-06-08 21:29:07

seth wrote:

--data-urlencode, but the SessionID doesn't look particularily "ID" to me either.

This was also my thought from the start. That output confirms a login, but there's nothing in it at all that should be resent in another query. I speculated that if this ever worked it might be due to the server maintaining a log of the authorized client IP. But now I'm starting to think it perhaps previously worked only by accident, and now it is "failing" correctly.

sweetthdevil, do you have any documentation on which this means of loging in / authenticating is recommended? From a very brief web search pyLoad appears to provide a web interface on port 8000, and if a web user logged in, they'd most likely be provided a login cookie of some sort. Curl can manage browser cookies if needed - but you don't have any code to do so in that script.

More often, if there was a (not-strictly-web) API, you'd get back a token from a login command that you would then send in subsequent requests.

Last edited by Trilby (2023-06-08 21:31:13)

Arch Linux

#1 2023-06-08 18:49:11

Script to extract JSON info from pyLoad

#2 2023-06-08 19:15:44

Re: Script to extract JSON info from pyLoad

#3 2023-06-08 19:26:58

Re: Script to extract JSON info from pyLoad

#4 2023-06-08 19:39:50

Re: Script to extract JSON info from pyLoad

#5 2023-06-08 19:42:01

Re: Script to extract JSON info from pyLoad

#6 2023-06-08 19:47:22

Re: Script to extract JSON info from pyLoad

#7 2023-06-08 19:49:32

Re: Script to extract JSON info from pyLoad

#8 2023-06-08 19:53:04

Re: Script to extract JSON info from pyLoad

#9 2023-06-08 19:55:39

Re: Script to extract JSON info from pyLoad

#10 2023-06-08 19:57:48

Re: Script to extract JSON info from pyLoad

#11 2023-06-08 19:59:38

Re: Script to extract JSON info from pyLoad

#12 2023-06-08 20:40:47

Re: Script to extract JSON info from pyLoad

#13 2023-06-08 20:46:59

Re: Script to extract JSON info from pyLoad

#14 2023-06-08 20:52:12

Re: Script to extract JSON info from pyLoad

#15 2023-06-08 20:55:59

Re: Script to extract JSON info from pyLoad

#16 2023-06-08 21:04:22

Re: Script to extract JSON info from pyLoad

#17 2023-06-08 21:29:07

Re: Script to extract JSON info from pyLoad

Board footer