Flashgot with JDownloader is Extremely Slow!

[Viking]

Flashgot with JDownloader is Extremely Slow!

I use FlashGot All at this site:
http://www.invisionplus.net/forums/inde ... opic=22622.
It takes 1 min 40 sec to send the links (~100) to JDownloader!
Is there any way to speed this up??

[Viking]

Has anyone tried Flashgot with JDownloader? Is this an issue only with JDownloader or all Downloaders?
As far as I know, JD is the only downloader that works with flashGot and can decrypt this type of links.

[Giorgio Maone]

This is not FlashGot's fault, it's JDownloader's normal behavior.
FlashGot added all the 100 links instantaneously, but then JDownloader takes more than one minute for its necessary "decryption" preprocessing.
You can't even call it a bug: in fact, in order to "decrypt" these links, JDownloader has to pre-fetch the URL and examine it to find the "true" link to be added before you can see any link appearing in the download list.

[google]

Has anyone tried Flashgot with JDownloader? Is this an issue only with JDownloader or all Downloaders?
As far as I know, JD is the only downloader that works with flashGot and can decrypt this type of links.

Jdownloader sucks for anything but file-hosting site links. I've been trying to get it to work with normal HTTP links but no dice. Use DownThemAll! for Firefox instead, it works great with flashgot.

[Viking]

Has anyone tried Flashgot with JDownloader? Is this an issue only with JDownloader or all Downloaders?
As far as I know, JD is the only downloader that works with flashGot and can decrypt this type of links.

Jdownloader sucks for anything but file-hosting site links. I've been trying to get it to work with normal HTTP links but no dice. Use DownThemAll! for Firefox instead, it works great with flashgot.

DownThemAll does not work for image hosting links which need to be decrypted. Try it with the page given by the link given above. No images can be downloaded!
You need to use a program like Bulk Image Downloader or JDownloader (although JDownloader is currently more than an order of magnitude slower than BID).

[Giorgio Maone]

BTW, next FlashGot release (probably out tomorrow) will contain an Imagevenue preprocessor, which takes just 5 seconds to "decrypt" all those 100 links

However, JDownloader still spends at least another 30 seconds after FlashGot added the links "checking online availability" (which seems a bit redundant to me). I guess the main problem with JDownloader (either in decryption or in online status checking) is (lack of) concurrency: FlashGot pre-processes multiple links concurrently (depending on Firefox's network.http.max-connections-per-server about:config setting, default 15), while JDownloader seems to proceed sequentially.

[Viking]

BTW, next FlashGot release (probably out tomorrow) will contain an Imagevenue preprocessor, which takes just 5 seconds to "decrypt" all those 100 links

However, JDownloader still spends at least another 30 seconds after FlashGot added the links "checking online availability" (which seems a bit redundant to me). I guess the main problem with JDownloader (either in decryption or in online status checking) is (lack of) concurrency: FlashGot pre-processes multiple links concurrently (depending on Firefox's network.http.max-connections-per-server about:config setting, default 15), while JDownloader seems to proceed sequentially.

Giorgio,
That is great! However, there are a lot of different Imagehosting sites, of which Imagevenue is only one. Can you add decrypters for the rest as well.......... ? Maybe use the list of decrypters listed on the BID site. I am not sure which decrypters are included in JD .

Also, I like how BID can send the images to a directory named after the originated page. It seems difficult to implement in JD. However, since FlashGot asks for and sends the download directory to JD, maybe this could be implemented in FlashGot rather than in JD ?

BTW, I saw a post from "FlashGot" in the JD thread where I have been active (http://board.jdownloader.org/showthread ... #post61525). I assume that was from you (good detective work!)? I will duplicate this post there, and continue posting there, since to get this to work seamlessly we need also need the assistance of pspzockerscene.
TIA!!

[Giorgio Maone]

Please check FlashGot 1.2.1.09

[Viking]

The requested URL /download/releases/flashgot-1.2.1.09.xpi was not found on this server.
Which decrypters do you plan to include?

[Giorgio Maone]

The requested URL /download/releases/flashgot-1.2.1.09.xpi was not found on this server.

Ooops, fixed.
The changelog says it all.

[Viking]

I just tried it, using the example link above, both with JD (turned off online check) and with DTA.
Strangely, with JD only 21 of 94 files were found and downloaded.
With DTA only 5 of 94.

When I used the JD decrypter, about 85 files were found and downloaded (varied each time I tried it - see the JD thread)
With BID, all 94 files are found and downloaded.....

Apparently there is something wrong both with the FlashGot and the JD decrypters, while BID correctly decrypts all links.


p.s. you may want to change DTA (Turbo) to DTA (Oneclick). I had no clue what DTA (Turbo) was...

[Giorgio Maone]

Apparently there is something wrong both with the FlashGot and the JD decrypters, while BID correctly decrypts all links.

They both "decrypt" correctly, but imagevenue.com "final" links are timed, i.e. after "decryption" you've got a limited amount of time to download, after which they expire and you get a "404 not found" error.
BID performs the decryption just before starting the download, I guess, therefore is less constrained.
FlashGot can't, because the external download managers expect all the links in a batch and then manage the timing on their own.

[Viking]

BID performs the decryption just before starting the download, I guess, therefore is less constrained.
FlashGot can't, because the external download managers expect all the links in a batch and then manage the timing on their own.

Ah... Bummer! That means that I have no choice but to get and use BID .
Any chance otherwise that you can build in a simple, default downloader in FlashGot to circumvent this problem..... .
(The FlashGot Downloader would be used for decrypted links only).

EDIT:
It may also be possible to use the JD decrypter and set it to DL each link as it is added (and w/o online checking). I didn't test that.
Can I turn off the FlashGot decrypter (in v1.2.1.09)?

[Viking]

I had to go back to version v1.2.1.08 since I couldn't turn of the FlashGot decrypter in order to use JD's decrypter instead (pspzockerscene revised his decrypter for the next version to get around the expiration issue - actually he created a plug-in instead).

I have a feature request (actually two)......
1A. It would be great if you could send the page name from which the links were captured to JD! In the example above, the page name would be: "Tanya Dragon Onsky -> Leah Dizon Petite Amie"? In this way JD could set the package name for all files (images) on that page.
2B. It would also be very useful with a FlashGot option that sets the download sub-directory according to the page name. For example, if the download directory is set to C:\MyDownloads and this option is checked, then the images in the example above would be saved in "C:\MyDownloads\Tanya Dragon Onsky -> Leah Dizon Petite Amie"

TIA!!

p.s. Please also add an option to disable the FlashGot decrypters.

[Giorgio Maone]

I had to go back to version v1.2.1.08 since I couldn't turn of the FlashGot decrypter

You can.
about:config, create a boolean preference called flashgot.redir.imagevenue_com.enabled and set it to false.

1A. It would be great if you could send the page name from which the links were captured to JD! In the example above, the page name would be: "Tanya Dragon Onsky -> Leah Dizon Petite Amie"? In this way JD could set the package name for all files (images) on that page.

You should ask JD developers first for an endpoint accepting this parameter.

2B. It would also be very useful with a FlashGot option that sets the download sub-directory according to the page name. For example, if the download directory is set to C:\MyDownloads and this option is checked, then the images in the example above would be saved in "C:\MyDownloads\Tanya Dragon Onsky -> Leah Dizon Petite Amie"

Tentatively put in my TODO list.