Download limit lower when using Wget

Hello 

I'm new on RetroRoms, but have been MAMEing since the 90'es.

I payed $15 for a month of good downloading (2000files pr. day), but found out it's a pain to click every file. 

I saw more people used Wget and I followed some advice and tried it myself.

I made a list of the links from the source code, and used this line to get the files automatically:

wget --http-user=MYUSER --http-password=MYPASSWORD --referer=https://www.retroroms.info --user-agent="Chrome/83.0.4103.97" --input-file=LIST.txt

LIST.txt only contains lines like this

https://bda.retroroms.info/downloads/mame/mame-0221-full/empcityu.zip

https://bda.retroroms.info/downloads/mame/mame-0221-full/empsback.zip

Now there are 2 questions:

1st night I only could download exactly 1000 files - half of my limit... does that mean I'm using 2 downloads pr. link, and is there a Wget command I have to use to fix it?

2nd night I only could download 100 files, like I wasn't a member, but my stats say I'm a member for another 24 days, so what might have happened?

Greetings

erling1000

PS. Screenshots attached

... it gets even weirder?

This night I downloaded again. A list of 2000 like above.

But I made a mistake, so the first 69 files were duplicates, and they were downloaded as

ep_21clb.zip.1

ep_21clba.zip.1

etc.

...

My total download was 1069 files 

The 69 duplicates and then exactly 1000 zipped roms (not duplicates) after that. Not 2000 in total like in the list and in my max amount of downloads, or any other logical number.

I hope someone can help  because I don't really know why it is like that.

...

Maybe yesterday was a typo in my code or something, but the 2 days with 1000 and 1069 downloads I don't understand.

Greetings

erling1000

PS. New screenshots attached.

Hi erling1000, I don't know why that should happens. As I don't have access to that logs ......I have ask czokie if he has time to find out why that happens ....

Hello Mucci.

Thanks, I hope he knows whats wrong 

Greetings

Continued... this night also exactly 1000 files downloaded the other 1000 not...

Seems to be the pattern

Initially, I will point you to a post:

https://www.retroroms.info/forum/topic/Downloads.htm

I dont know this answers your question however. The way the system works, is it will look at your limit, and apply that limit looking back 24 hours. If you download the same file twice, it will not count it again - as you saw with your duplicates. But why that number? Short answer is I dont know and it will take a bit of time to research. I have not had a look at that code in a long time ;)

Stay tuned.

CZ

I have a good answer for you. It's not the server.

The last times there were auth failures for you were as shown. And there were many approved requests in between. From what I can see, the server has blocked only when limit of 2000 was breached. I am going to make an assumption that there is an internal limit in your build of wget that is restricting the number of files as you have described. Certainly the requests were not blocked here.

CZ

Hi Czokie

Thanks for looking in to this. OK it’s not the server.

But still confused. Never knew there were different builds of wget, and they could be limited.

I’ll have to ask other users of wget and retroroms, if they can download more than 1000 files pr day. I can’t PM people, guess I can use this thread to contact them 

 https://www.retroroms.info/forum/topic/Downloading-roms-.htm

I Had a similar problem when my list file contained lines like;

https://bda.retroroms.info/downloads/mame/mame-0221-full/airblsjs.zip

But I seem to have solved it by adding the port number, ie;

https://bda.retroroms.info:82/downloads/mame/mame-0221-full/bbc_stl2m128.zip

Worth a try?

hmm yes BDA -> https://bda.retroroms.info:82/downloads/