InformAction Forums

Posted: **Mon Jun 20, 2011 6:35 am**

please add "user agent" to placeholder menu

Posted: **Mon Jun 20, 2011 2:21 pm**

Just curious, why or where does the UA come into play?

Posted: **Mon Jun 20, 2011 4:11 pm**

Some sites are sensitive to UA(user agent). Like "www.adrive.com"
If UA browser and download manager is different. Download Manager does not download the file.

Posted: **Mon Jun 20, 2011 4:35 pm**

Well, I'll be.
And you think it is UA related?
Is this something new?

URL: http://www.adrive.com/public/8388d94209 ... dd9e2.html
(ShowTx.exe, 58,880 bytes, MD5 2693fee1794637a4acada0ffe10e2fc7)

Code: Select all

06/20/2011 12:23:28 PM.046 Connecting to download.adrive.com:80
06/20/2011 12:23:28 PM.046 Connecting to 38.111.148.76:80
06/20/2011 12:23:28 PM.171 Connected.
06/20/2011 12:23:28 PM.171 GET /public/view/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html HTTP/1.1
06/20/2011 12:23:28 PM.171 Accept: */*
06/20/2011 12:23:28 PM.171 Referer: http://download.adrive.com/public/view/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html
06/20/2011 12:23:28 PM.171 User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)
06/20/2011 12:23:28 PM.171 Host: download.adrive.com
06/20/2011 12:23:28 PM.171 Connection: Keep-Alive
06/20/2011 12:23:28 PM.203 Cookie: 8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2=c5318bd3296a8e2...
06/20/2011 12:23:28 PM.203 Pragma: no-cache
06/20/2011 12:23:28 PM.203 Cache-Control: no-cache
06/20/2011 12:23:28 PM.312 HTTP/1.1 200 OK
06/20/2011 12:23:28 PM.312 Date: Mon, 20 Jun 2011 16:23:27 GMT
06/20/2011 12:23:28 PM.312 Server: Apache
06/20/2011 12:23:28 PM.312 Keep-Alive: timeout=15, max=100
06/20/2011 12:23:28 PM.312 Connection: Keep-Alive
06/20/2011 12:23:28 PM.312 Transfer-Encoding: chunked
06/20/2011 12:23:28 PM.312 Content-Type: text/html; charset=UTF-8
06/20/2011 12:23:28 PM.312 Start receiving data.
06/20/2011 12:23:28 PM.328 Finished at 293

Net Transport uses this User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)
Yet I am: Mozilla/5.0 (Windows NT 5.1; rv:2.0.1) Gecko/20110608 Firefox/4.0.1 SeaMonkey/2.1

And instead of getting the expected file, I get an html file if I use Net Transport.
(Saving directly though the browser downloads ShowTx.exe as expected.)

Net Transport does have other UA's it can use, no "Firefox", much less any that agree with mine.
And no way to pass a UA to it.
Now if you configured your own, & a UA parameter was available, I suppose that should work.

(I've got to assume I've tried an actual download from there before using Net Transport, but can't check at least till this evening.)

Posted: **Mon Jun 20, 2011 5:05 pm**

If I spoof my UA: general.useragent.override;Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)

The download still does not work?

Code: Select all

06/20/2011 01:01:57 PM.343 Connecting to download.adrive.com:80
06/20/2011 01:01:57 PM.359 Connecting to 38.111.148.76:80
06/20/2011 01:01:57 PM.468 Connected.
06/20/2011 01:01:57 PM.468 GET /public/view/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html HTTP/1.1
06/20/2011 01:01:57 PM.468 Accept: */*
06/20/2011 01:01:57 PM.468 Referer: http://www.adrive.com/public/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html
06/20/2011 01:01:57 PM.468 User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)
06/20/2011 01:01:57 PM.468 Host: download.adrive.com
06/20/2011 01:01:57 PM.468 Connection: Keep-Alive
06/20/2011 01:01:57 PM.500 Cookie: 8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2=3beca6e9fc3d3dabcbfd77e0c74d636c; __utmz=195838076.1308586876.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); __utma=195838076.2123208409.1308586876.1308586876.1308586876.1; __utmc=195838076; __utmb=195838076.2.10.1308586876; __utma=195838076.1104757457.1300205074.1300205074.1308586912.2; __utmz=195838076.1300205075.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none); 8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2=57d6aab9a0ada5f27dfaa1141ae313cd
06/20/2011 01:01:57 PM.500 Pragma: no-cache
06/20/2011 01:01:57 PM.500 Cache-Control: no-cache
06/20/2011 01:01:57 PM.625 HTTP/1.1 200 OK
06/20/2011 01:01:57 PM.625 Date: Mon, 20 Jun 2011 17:01:56 GMT
06/20/2011 01:01:57 PM.625 Server: Apache
06/20/2011 01:01:57 PM.625 Keep-Alive: timeout=15, max=100
06/20/2011 01:01:57 PM.625 Connection: Keep-Alive
06/20/2011 01:01:57 PM.625 Transfer-Encoding: chunked
06/20/2011 01:01:57 PM.625 Content-Type: text/html; charset=UTF-8
06/20/2011 01:01:57 PM.625 Start receiving data.
06/20/2011 01:01:57 PM.625 Finished at 293

Code: Select all

(Request-Line)	GET /public/view/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html HTTP/1.1
Host	download.adrive.com
User-Agent	Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 1.1.4322)
Accept	text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language	en-us,en;q=0.5
Accept-Encoding	gzip, deflate
Accept-Charset	ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive	115
Referer	http://www.adrive.com/public/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html
Cookie	8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2=3beca6e9fc3d3dabcbfd77e0c74d636c
DNT	1
Connection	keep-alive

Code: Select all

(Status-Line)	HTTP/1.1 200 OK
Date	Mon, 20 Jun 2011 17:01:10 GMT
Server	Apache
Pragma	public
Expires	0
Cache-Control	must-revalidate, post-check=0, pre-check=0, public
Content-Description	File Transfer
Content-Disposition	attachment; filename="ShowTx.exe";
Content-Transfer-Encoding	binary
Accept-Ranges	bytes
Last-Modified	Mon, 20 Jun 2011 17:01:10 GMT
Content-Range	bytes 0-58879/58880
Content-Length	58880
Keep-Alive	timeout=15, max=100
Connection	Keep-Alive
Content-Type	application/x-download;charset=UTF-8

Did I spoof correctly or is it maybe a POST issue, Is uploaded.to broken?

Posted: **Mon Jun 20, 2011 11:15 pm**

(I've got to assume I've tried an actual download from there before using Net Transport, but can't check at least till this evening.)

Looks like I had not actually tried an Adrive download through Net Transport before.

Posted: **Tue Jun 21, 2011 4:39 am**

i use IDM and Firefox. my UA: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:5.0) Gecko/20100101 Firefox/5.0
i add link to IDM.
IDM web request: work.

change IDM "HKEY_CURRENT_USER\Software\DownloadManager\XXXXX\UA"
from
"Mozilla/5.0 (Windows NT 6.1; WOW64; rv:5.0) Gecko/20100101 Firefox/5.0"
to
"Mozilla/5.0 (Windows NT 6.1; WOW64; rv:2.0.1) Gecko/20100101 Firefox/4.0.1"

IDM web request: not work.

Posted: **Tue Jun 21, 2011 7:28 am**

OK, but which download manager supports dynamic UA change?
Now I know I could write the IDM registry key on the fly (but this would permanently change it for downloads happening from a different source later), but generally speaking (aside cURL and wGet, which are for Linux) I wouldn't know how to do it for other download managers.

Posted: **Tue Jun 21, 2011 8:16 am**

i know.
It was just an example.

I just want you to take a UA to add placeholder menu for Custom Download manager that need it.

thanks.

Posted: **Tue Jun 21, 2011 10:04 pm**

@therube: yes you'd be surprised how many sites will NOT work with UA they cannot nail down to a specific list they have and that includes say my UA as seen here, many sites, especially banks and some download sites, will reject access based on it. I don't personally care, I can change it on the fly but none the less, it has its occasional annoyances; while most sites will warn you and let you roll the dice; but most sites just don't care.

Posted: **Thu Jun 23, 2011 3:35 pm**

check download from www.adrive.com by flashgot:
FreeDownloadManager
InternetDownloadManager
and ...

not work

Posted: **Sun Jun 26, 2011 9:15 pm**

Looks like both the cookie & the UA needs to be correct.

Code: Select all

wget --save-cookies cookies.txt   http://www.adrive.com/public/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html

wget --load-cookies cookies.txt   http://download.adrive.com/public/view/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html
or
wget --load-cookies cookies.txt   http://download.adrive.com/public/view/8388d94209a7a9964f0deda06ed889b024f631e2cdc2bbdc9b59ecb7823dd9e2.html -U Wget/1.9.1

The -U or --user-agent can be used to spoof the UA.

With the "normal" SeaMonkey UA: Mozilla/5.0 (Windows NT 6.1; rv:5.0) Gecko/20110619 Firefox/5.0 SeaMonkey/2.2
Passing that to wget (& setting the cookie, manually as I did), I cannot get it download the file?

Setting general.useragent.override;Mozilla
I can successfully download with wget using a -U Mozilla command line parameter.

Not sure why the difference?

Posted: **Sat Jul 02, 2011 5:36 pm**

Done in latest development build.

InformAction Forums

please add "user agent" to placeholder menu

please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu

Re: please add "user agent" to placeholder menu