Download Machine Operation

How to use Download machine

Get Java

Download machine is Java software, you need to have JDK or JRE. Get OpenJDK and install it.

Configure DMachine by editing dmachine.cnf.

Normally it is not needed unless you are using proxy.

You can look at all possible configuration options in sample config file here.

Proxy configuration

If you are using proxy servers they can be configured for both http and ftp protocols. Basic HTTP authentication is supported too.

http_proxy 195.146.100.5 3128 user:password
ftp_proxy 192.168.56.1 8080

Directory configuration

Various directories can be configured:

Fully downloaded files are in download_directory
Temporary, not yet fully downloaded files are in temporary_directory
Files which ceased to exit before we downloaded them entire are in attic_directory
Directory which is watched for queue files of any names is drop_directory

Queue file configuration

Queue files are specified by queue_file statement in configuration file or any file in the drop directory. After file is downloaded it can be optionally remove_downloads_from_queue_file. If you do not want to keep dmachine running you can set exit_on_empty_queue

Queue file commands

Usually in queue file(s) are only URLs which we want to get downloaded. There are also some commands which can be placed into queue files.

Alternative download locations

Download Machine uses only filename part of URL. If you are place:

http://www.server.com/file.zip (and)
http://mirror.server.com/mirrored/file.zip

into queue file, DM will think that these two are alternative URLs for the same file and try to combine both locations. If the same file is on the net with different filename you can use:

http://www.server.com/stuff/file-1.2.3.zip#file123.zip
http://www.server.org/stuff/file-123.zip#file123.zip

Custom Referer header

Some servers checks Referer header. Download Machine sends fake Referer header, which works in most time, but sometimes you will need a custom Referer header. You can place:

 Referer http://216.42.31.135/ http://www.zephyr.com/

and then every request to http://216…. will gets second (zephyr) URL as Referer.

Some servers needs Cookie header to be sent. Cookies are often used for authorization purposes and sometimes server can refuse a download if no valid cookie was found in request. First argument is server name and second is cookie value in format name=value[; …]

cookie http://www.fileplanet.com/ auth=542345123456

Check also other directory if file is already downloaded

Normally only download_directory is checked if file with the same name is already downloaded. If you want to check additional directories then:

check_also <regexp> <directory>

example:

check_also *.mp3 /home/hsn/mp3/Krishna_Das/

Save files to alternate directory

You might want to have some files stored into specific directory

save_to <regexp> <directory>