PDA

View Full Version : Script for downloading images off a website.


Koonboi
07-30-2009, 11:37 PM
As some people might know and some might not care, 4scrape recently went down. And I was trying and couldn't find any alternatives, so I wanted a script to do it for personal use instead of web use. I want the script to search 4chan's /w/ and /wg/ boards saving every image posted on them, skipping filename repeats.
Can anyone help me make such a script? I use Arch Linux and I am willing to install any dependencies.
mozart
07-31-2009, 01:13 AM
I haven't really heard something like that. But what I do know is that Linux computers are able to download a whole directory. Try downloading those directories with those images using that method. It may be tasking, but will get the job done.
Koonboi
07-31-2009, 07:04 AM
I have tried downloading whole directories, and I get a 403 error.
Early Out
07-31-2009, 04:04 PM
I haven't really heard something like that.
Then perhaps you shouldn't be responding to the question.
felgall
07-31-2009, 06:06 PM
I have tried downloading whole directories, and I get a 403 error.

You get that error when you are not authorised to access the directory.
Koonboi
07-31-2009, 07:56 PM
You get that error when you are not authorised to access the directory.

xD I figured since I was forbidden. 4scrape originally indexed all the posts, then downloaded the images. I just want the images, but the index would be fine too.
felgall
07-31-2009, 08:23 PM
To be able to grab the content of the folder you just need to change the settings on the folder so as to allow what you are trying to do with it.
Koonboi
07-31-2009, 10:05 PM
To be able to grab the content of the folder you just need to change the settings on the folder so as to allow what you are trying to do with it.

It isn't my website, I can't change permissions.
felgall
07-31-2009, 11:21 PM
If it isn't your web site then you shouldn't be downloading the images from it - that is called theft.
Koonboi
08-01-2009, 01:38 PM
If it isn't your web site then you shouldn't be downloading the images from it - that is called theft.

:confused: It is a forum with user generated content, with the purpose of the forum being to share wallpapers. I want to download every single wallpaper, then sort through them.
felgall
08-01-2009, 03:04 PM
So ask the owner whether they have provided a way to do that. If it is allwed then there should be a way to do it. It may not be allowed as copying a wholld lot of images when you are only going to end up choosing one may use up a lot more bandwidth than the site wants any one person using.
Koonboi
08-02-2009, 01:17 AM
So ask the owner whether they have provided a way to do that. If it is allwed then there should be a way to do it. It may not be allowed as copying a wholld lot of images when you are only going to end up choosing one may use up a lot more bandwidth than the site wants any one person using.

As I have previously stated, it has been done before. Very well. I even have the files it was done with. The original creator didn't ahve time to maintain it anymore, so the website went offline and he released the files to "all who could figure out how to work it."But I just want the script that gets the images, not the website.