Forums  ›  Tools and Dats  ›  ROM-Management
 

Downloading roms..

Been looking about the site trying to find info. but cant seem to find any is there a way to download the roms apart from using browser?  ie: ftp? rom management software etc? thank you for any help

no, only with browser possible. But you can use a downloadmanger like jdownloader for downloading a  lot of files

You can also use wget:

wget -r -np -nd -nc -l 1 -A zip --http-user=myuser --ask-password https://bda.retroroms.info/downloads/mame/update-packs/mame-0194/

-r specify recursive download
-np don't ascend to the parent directory
-nd don't create directories
-nc skip downloads that would download to existing files (overwriting them)
-l maximum recursion depth (inf or 0 for infinite)
-A comma-separated list of accepted extensions

 

Also, make sure to run it in an empty directory.

I've been having issues going over my allowance very quickly with wget, so I don't recommend it (for now).

Having more success today with this. Same as before, but using a RegEx to only find zip files, and also set number of retries to 1:

wget -r -np -nd -nc -l 1 -A zip -t 1 --http-user=myuser --ask-password --accept-regex "^.+\.zip$" https://bda.retroroms.info/downloads/mame/update-packs/mame-0xxx/

R.I.P. BDA

Thanks for that wget suggestion, chriswyatt - your 2nd version using regex works like a charm (except macOS doesn't include "wget" out of the box - had to use a ruby command to load brew and then brew to install wget).

Got a couple questions:

1) today's run loaded the first 100 in update pack 0194 ... but I only got 99 zip files.  Looking through the terminal listing, I see index.html.tmp was downloaded, then the file was rejected based on your regex string (I assume).  It appears that file was still counted against my 100 file limit for today.  Is that how the download limits here work - a download is a download no matter whether wanted or not?

2) when I run the same command tomorrow within the same download folder on my Mac from terminal, will your wget string try to download the same 100 files it did today, find them already in my folder, then skip them and move on?  Or do I have to modify your wget string to start where today's download ended?

Thanks again for this easier download approach!

feleven

Does wget still work? I just paid for a premium account but I can't find a way to do any sort of bulk download other than downloading one CHD file at a time :(

I should have added I'm using the below command.

"C:\Program Files\Binaries\wget.exe" -r -l 1 --http-user=MYactualUSERname --ask-password https://bda.retroroms.info/downloads/mame/CHDs/

 Resolving bda.retroroms.info (bda.retroroms.info)... 203.26.211.104

Connecting to bda.retroroms.info (bda.retroroms.info)|203.26.211.104|:443... connected.

HTTP request sent, awaiting response... 403 Forbidden

2019-04-08 00:53:23 ERROR 403: Forbidden.

I  have succesfully used:

wget --http-user=yourUSERNAME --http-password=yourPASSWORD --referer=https://www.retroroms.info --user-agent="Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36" --input-file=yourLIST.txt

in yourLIST.txt (same folder of wget and where you download roms), lines like:

https://bda.retroroms.info/downloads/mame/mame-0206-full/005.zip
https://bda.retroroms.info/downloads/mame/mame-0206-full/100lions.zip
https://bda.retroroms.info/downloads/mame/mame-0206-full/10yard.zip

you can get your lines from http source of the site page, editing it with a good txt editor (es. textedit)

but .. pay attention to your daily limits :-)

es. put 100 lines for a normal account, 2000 to upgraded one etc.

best regards

 

Thank you, I was able to get it working with your assist. I have a followup question. I already have the .208 rom set. Primarily what I was looking for was the CHD files. It appears that in the CHDs folder for blitz as an example there is no .chd file. instead there are 3 rar's labeled part1,2, and 3. Is there some tool I should be using to merge these 3 files? I'm lost and can't seem to find a guide anywhere on this.

 

I'm lost and can't seem to find a guide anywhere on this.

The rar files are compressed files. You must unextract those files. You can accomplish this with 7zip: https://www.7-zip.org/ .
Install it then right click on your 1st file and choose extract here.

Cheers

I tried downloading with wget.

However, I could not download it.

 

"Unable to establish SSL connection"

 

What should I do in this case?

 

 

I tried downloading with wget.

However, I could not download it.

 

"Unable to establish SSL connection"

 

What should I do in this case?

 

 

cp.jpg158.1K12 views

new BDA is running (for testing) on port 82 -> https://bda.retroroms.info:82/downloads/

This weekend I downloaded about 10 roms and lost access to the whole site for 24 hours

For few weeks I can't connect to download area. Anyone have an idea, what may be wrong?

Hi  chriswyatt. I can’t download more than 1000 files pr day with wget. I explained the problem here https://www.retroroms.info/forum/topic/Download-limit-lower-when-using-Wget.htm

Can you maybe tell me if you can download more than that, as czokie (admin) says it might be wget that is limited, and it may be blocking me. He assures me it’s not the server that stops me.

Hoping you can help smile

You can also use wget:

wget -r -np -nd -nc -l 1 -A zip --http-user=myuser --ask-password https://bda.retroroms.info/downloads/mame/update-packs/mame-0194/

-r specify recursive download
-np don't ascend to the parent directory
-nd don't create directories
-nc skip downloads that would download to existing files (overwriting them)
-l maximum recursion depth (inf or 0 for infinite)
-A comma-separated list of accepted extensions

 

Also, make sure to run it in an empty directory.

 

Hi  Mario2. I can’t download more than 1000 files pr day with wget. I explained the problem here https://www.retroroms.info/forum/topic/Download-limit-lower-when-using-Wget.htm

I use the method you wrote, with list.txt and so on...

Can you maybe tell me if you can download more than that, as czokie (admin) says it might be wget that is limited, and it may be blocking me. He assures me it’s not the server that stops me.

Hoping you can help smile 

I  have succesfully used:

wget --http-user=yourUSERNAME --http-password=yourPASSWORD --referer=https://www.retroroms.info --user-agent="Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.103 Safari/537.36" --input-file=yourLIST.txt

in yourLIST.txt (same folder of wget and where you download roms), lines like:

https://bda.retroroms.info/downloads/mame/mame-0206-full/005.zip
https://bda.retroroms.info/downloads/mame/mame-0206-full/100lions.zip
https://bda.retroroms.info/downloads/mame/mame-0206-full/10yard.zip

you can get your lines from http source of the site page, editing it with a good txt editor (es. textedit)

but .. pay attention to your daily limits :-)

es. put 100 lines for a normal account, 2000 to upgraded one etc.

best regards

 

 

I'd like to update this in case someone still wants to grab an entire BDA directory without compiling a list (like in previous examples). Here's my wget instructions (hopefully for n00bs that haven't ever used wget or even command line before - if you need clarification on something let me know, and I'll update my steps to be more concise.

THIS TUTORIAL IS FOR WINDOWS, but the wget command should work in linux as well, but I assume if you're using that, you don't need your hand held that much.

Prep: Make sure you have a premium account. BDA at retroroms is hosted on HTTP protocol, so there's a lot of links (index.html* "files") that will be downloaded and count towards your dailydownload max. This method won't work for a basic account. Just bite the bullet and buy a premium account if you intend to download enmasse (leech) like this.

For this example, we're going to say we want to download all CHD files. That path is:
https://bda.retroroms.info:82/downloads/mame/CHDs/

You can find other paths by looking in the web browser address bar after you start at the /downloads base folder by going to:
https://bda.retroroms.info:82/downloads/

NOTE: In the instructions below explanations of what you're doing are in BOLD BRACKETS and should NOT be typed: [ like this ]

THOUGHT: Don't start from /downloads and have wget grab everything. You don't need it all even if you're starting from scratch. Try to take only what you need.

INSTRUCTIONS

  1. Download the latest wget. Only download ONE depending on your O/S (probably 64 bit if you have Windows 10, but I included the link to 32 bit, just in case):
  2. Now that you have the latest wget.exe, move it to C:\wget\
    • OPEN your download folder.
    • RIGHT CLICK the wget.exe file
    • CLICK "Cut"
    • Go to your C: drive
    • CREATE a new folder named:
      • wget
    • OPEN the new, empty wget folder.
    • RIGHT CLICK in the empty folder.
    • CLICK "Paste"
    • wget.exe should appear in the folder now.

  3. Now, open a command prompt window as administrator. Click Start > and without clicking anywhere, type cmd. Click "Run As Administrator" under the "Command Prompt" app

  4. Change to directory where you want to download files to. In this example, let's pretend you want to put the files on drive D: in the command prompt window, type:
    • D:    [ changes you to the D: drive ]
    • cd \  [ confirms you are in the root of the D: drive ]

  5. In the command example below:
    • COPY the ENTIRE COMMAND LINE and paste it into notepad (to remove any formatiing).
    • Still in notepad, change <YOURUSERNAME> and <YOURPASSWORD> to your actual retroroms username and password, and do NOT include the <> in the final command
    • COPY the entire line and paste it into the administrative command prompt window
    • hit ENTER.
      • COMMAND EXAMPLE:
        "C:\wget\wget.exe" -R "index.html*,*.txt,*.md5" -A "zip,chd,rar" --secure-protocol=TLSv1_1 -r -c -np -nc -l 2 --http-user=<YOURUSERNAME> --password=<YOURPASSWORD> https://bda.retroroms.info:82/downloads/mame/CHDs/

      • EXAMPLE COMMAND WITH USERNAME AND PASSWORD IN IT:
  6. The final command line should have NO LINE BREAKS (it should all be one line)
  7. And away we go. If you are grabbing the CHD folder, it will take some time (DAYS!!) it's not a small archive!

Some switches you might want/need to change in case you're getting other directories (explanations in brackets after the command switch):

  • -l 2 [ how many levels deep do you want to follow ]
  • path [ the part that include https:// change it to whatever path you want to get ]

Example Command Change (actual changes are made bold in the second command line):

In the above example, we want to download the mame/mame-0240/ directory. We change the level to 3 because if you browse into the folder through a webbrowser using the link near the top of this instructional, you can see it contains a CHD directory inside it and we want to grab those, too. 

Broken Download Recovery
If the download stops: 

  1. If the COMMAND PROMPT WINDOW IS STILL OPEN (:
    Just fix the cause of the problem (this can be varied, so I won't go into detail here), and rerun the EXACT SAME COMMAND. wget will skip any files that exist and start back at the first new file it finds). TIP: When you are in the command window, you can press the UP ARROW on the keyboard to redo the last command.

  2. If the COMMAND PROMPT WINDOW CLOSED (computer lost power, you clicked X by mistake, ect)
    Redo step 4 4 above, making sure that is you went to D: for example, that you now go to the EXACT SAME DIRECTORY now run the EXACT SAME COMMAND you ran to start your download the first time.


I hope this helps someone that comes along after finding this thread through a google search (like I did).

 

thanks DeadC0w, great help

Hey guys just joined. Am puting together a funtioning Mame Drive and have some questions. I am going through (https://journalxtra.com/mame/download-complete-sets-of-mess-and-mame-roms/https://journalxtra.com/mame/download-complete-sets-of-mess-and-mame-roms/) and downloading the majority of the files needed to set this up. I have downloaded "Full Pack: MAME Roms v0.197 (merged)" , "0.193 CHDs (merged)" and a couple of other extras.

I guess my questioin is do I need to download update packs from RetroRoms?

And is there any other thing I need to get to complete this project?

Thanks!

 

 

B