Easy way to download an entire site? - DFWstangs Forums
 
LinkBack Thread Tools Display Modes
post #1 of 27 (permalink) Old 11-05-2003, 12:59 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Easy way to download an entire site?

i have found a few sites that i would like to "archive" for my own purposes, but the only method i know of doing this is using the file, save as, feature in internet explorer. while this works of some sites, others will not allow me to save all the files i want, which is mostly pictures, due to the way the site is coded. can someone lend me a hand with this?

here is a link to one of the sites i am trying to "save".

WW http://fjortisar.stormaz.servebeer.com/girls/index.php WW
stangfreak03 is offline  
Sponsored Links
Advertisement
 
post #2 of 27 (permalink) Old 11-05-2003, 01:06 PM
-----------------------
 
Join Date: Jul 2002
Location: DFW
Posts: 1,417
try right clicking on the link and then choose save target as, then choose the destination of the file and .....wallah, you have it saved,
91rednotch is offline  
post #3 of 27 (permalink) Old 11-05-2003, 01:14 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
while i agree this would work, the site i am trying to save has easily over one thousand pictures. to save them i would have to click on each one, and this process would be extremely time consuming.
stangfreak03 is offline  
 
post #4 of 27 (permalink) Old 11-05-2003, 01:33 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
there are a few apps out there I can't remember the name of them now that will pull an enitire website down if they haven't wrote the code to block that... but it is basicly some mirror software...
I Stang U is offline  
post #5 of 27 (permalink) Old 11-05-2003, 01:41 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by I Stang U
there are a few apps out there I can't remember the name of them now that will pull an enitire website down if they haven't wrote the code to block that... but it is basicly some mirror software...
well that's what i'm looking for. anyone have any recommendations?
stangfreak03 is offline  
post #6 of 27 (permalink) Old 11-05-2003, 01:44 PM
¯\(º_o)/¯
 
AbecX's Avatar
 
Join Date: Nov 2001
Location: Las Colinas
Posts: 25,373
wget -m http://linkhere

If you dont run linux, sorry!
AbecX is offline  
post #7 of 27 (permalink) Old 11-05-2003, 01:47 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
when you do that on linux where does it copy it to?
I Stang U is offline  
post #8 of 27 (permalink) Old 11-05-2003, 01:49 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
--14:46:33-- http://fjortisar.stormaz.servebeer.com/girls/index.php
=> `fjortisar.stormaz.servebeer.com/girls/index.php'
Resolving fjortisar.stormaz.servebeer.com... done.
Connecting to fjortisar.stormaz.servebeer.com[213.113.43.197]:80... connected.
HTTP request sent, awaiting response...


this is what I get when I try that..
I Stang U is offline  
post #9 of 27 (permalink) Old 11-05-2003, 01:59 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by AbecX
wget -m http://linkhere

If you dont run linux, sorry!
that's alot of help.

i'm sure one of the ms guys here will be able to recommend an application that will do this.
stangfreak03 is offline  
post #10 of 27 (permalink) Old 11-05-2003, 02:33 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
it would help if that site was valid!!!!!!!!
I Stang U is offline  
post #11 of 27 (permalink) Old 11-05-2003, 02:42 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by I Stang U
it would help if that site was valid!!!!!!!!
well it was working yesterday. this was the reason i wanted to make a copy of it, it's constantly down or being moved. either way, if anyone has a recommendation for an app that can do this, please let me know.
stangfreak03 is offline  
post #12 of 27 (permalink) Old 11-05-2003, 02:53 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
well if you will find it working I will mirror it zip it and let you download it
I Stang U is offline  
post #13 of 27 (permalink) Old 11-05-2003, 03:09 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by I Stang U
well if you will find it working I will mirror it zip it and let you download it
well it seems to be back up. give it a shot. thanks!
stangfreak03 is offline  
post #14 of 27 (permalink) Old 11-05-2003, 03:12 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
or not :-(
I Stang U is offline  
post #15 of 27 (permalink) Old 11-05-2003, 03:15 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
well getting it now... lets see how long this shit takes LOL
I Stang U is offline  
post #16 of 27 (permalink) Old 11-05-2003, 03:16 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by I Stang U
or not :-(
is it not letting you in? i'm looking at the right now.
stangfreak03 is offline  
post #17 of 27 (permalink) Old 11-05-2003, 03:23 PM
El Camino
 
Stang2be's Avatar
 
Join Date: Sep 2003
Location: in front of the keyboard
Posts: 3,432
http://www.webattack.com/Shareware/d...swoffline.html

On a side note that site looks like those pages are database driven and pulled from there. I don't think any of those programs will go pull those down but I might be wrong.

If it was your standard pr0n site it might work if its just downloading the directory structure. Still a nice little collection of photos. We could all split up downloading them and then putting them all together for a nice compilation

Last edited by Stang2be; 11-05-2003 at 03:32 PM.
Stang2be is offline  
post #18 of 27 (permalink) Old 11-05-2003, 04:39 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by Stang2be
http://www.webattack.com/Shareware/d...swoffline.html

On a side note that site looks like those pages are database driven and pulled from there. I don't think any of those programs will go pull those down but I might be wrong.

If it was your standard pr0n site it might work if its just downloading the directory structure. Still a nice little collection of photos. We could all split up downloading them and then putting them all together for a nice compilation
actually it seems like this program can download all the pictures, but the free version is limited to how much you can download, and i have had no success finding a keygen for it. anyone up to find a keygen for offline commander v2.1?
stangfreak03 is offline  
post #19 of 27 (permalink) Old 11-05-2003, 04:48 PM
Bite Me!!!
 
I Stang U's Avatar
 
Join Date: Jul 2000
Location: A new Beast in Town!!
Posts: 2,457
I am getting it ;-)



it is just going to take a LONG time....
I Stang U is offline  
post #20 of 27 (permalink) Old 11-05-2003, 04:56 PM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by I Stang U
I am getting it ;-)



it is just going to take a LONG time....
sweet. with the offline commander i managed to get the thumbnails off of the first 5 pages, after that it asks for a "license key".
stangfreak03 is offline  
post #21 of 27 (permalink) Old 11-05-2003, 06:39 PM
El Camino
 
Stang2be's Avatar
 
Join Date: Sep 2003
Location: in front of the keyboard
Posts: 3,432
I've got my pc at the office on dual T1's trying to pull that site down with another program. So far it seems to have found most of the site just pulling it down now. I'll keep you posted on how it comes out.

2007 Taurus SEL - daily driver
1974 El Camino SS - 400sb

Quote:
Originally Posted by purrrfectstang
Umm.. what is the ID-10T settings?
Stang2be is offline  
post #22 of 27 (permalink) Old 11-06-2003, 06:22 AM
You lookin' at mah EYE?!
 
DarkWolf's Avatar
 
Join Date: May 2000
Location: Portland, OR
Posts: 8,316
Win HTTrack is a good free mirroring program. I use it mostly to archive webcomics that I don't want to sit and download picture by picture.

That might work for ya.

DarkWolf
Graphic Design / Photography / Web Design
DarkWolf is offline  
post #23 of 27 (permalink) Old 11-06-2003, 09:41 AM
El Camino
 
Stang2be's Avatar
 
Join Date: Sep 2003
Location: in front of the keyboard
Posts: 3,432
Got all that site downloaded.

I've cleaned it up now to a bunch of folders with the images.

Woot 150mb of jpgs.

2007 Taurus SEL - daily driver
1974 El Camino SS - 400sb

Quote:
Originally Posted by purrrfectstang
Umm.. what is the ID-10T settings?
Stang2be is offline  
post #24 of 27 (permalink) Old 11-06-2003, 10:35 AM Thread Starter
 
Join Date: Mar 2002
Posts: 581
Quote:
Originally posted by Stang2be
Got all that site downloaded.

I've cleaned it up now to a bunch of folders with the images.

Woot 150mb of jpgs.
what application did you use to download the files? i'd like to have a copy of that site for my collection. thanks.
stangfreak03 is offline  
post #25 of 27 (permalink) Old 11-06-2003, 01:45 PM
Googlist-Wikipedian
 
Hunt4m3x's Avatar
 
Join Date: Jul 2002
Location: de_aztec
Posts: 4,814
Use Teleport pro. That shit owns.

2005 Infiniti G35 Sedan Ivory Pearl Premium

2006 Infiniti FX45 Liquid Platinum

2010 Polaris Ranger RZR S Orange Madness







Ban count: 2
Hunt4m3x is offline  
post #26 of 27 (permalink) Old 11-06-2003, 01:51 PM
El Camino
 
Stang2be's Avatar
 
Join Date: Sep 2003
Location: in front of the keyboard
Posts: 3,432
Quote:
Originally posted by stangfreak03
what application did you use to download the files? i'd like to have a copy of that site for my collection. thanks.

http://www.webreaper.net/

2007 Taurus SEL - daily driver
1974 El Camino SS - 400sb

Quote:
Originally Posted by purrrfectstang
Umm.. what is the ID-10T settings?
Stang2be is offline  
post #27 of 27 (permalink) Old 11-08-2003, 04:40 AM
 
Join Date: Feb 2002
Posts: 641
Quote:
Originally posted by stangfreak03
that's alot of help.

i'm sure one of the ms guys here will be able to recommend an application that will do this.
how about wget for windows???
http://www.qtm.net/~twegscheid/wget.html

most of the simple utilitys for linux have already been ported to windows.
Nick is offline  
Sponsored Links
Advertisement
 
Reply

Bookmarks

Quick Reply
Message:
Options

Register Now



In order to be able to post messages on the DFWstangs Forums forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.

User Name:
Password
Please enter a password for your user account. Note that passwords are case-sensitive.

Password:


Confirm Password:
Email Address
Please enter a valid email address for yourself.

Email Address:
OR

Log-in










Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page
Display Modes
Linear Mode Linear Mode



Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On
Trackbacks are On
Pingbacks are On
Refbacks are On

 
For the best viewing experience please update your browser to Google Chrome