Free web site crawler? - DFWstangs Forums
 
LinkBack Thread Tools Display Modes
post #1 of 6 (permalink) Old 02-07-2010, 03:25 PM Thread Starter
Horse Trader
 
Darren M's Avatar
 
Join Date: Nov 2001
Location: Mansfield Tx 76063
Posts: 2,261
Free web site crawler?

Does anyone know where I can get a free web site crawler? What I want is an app that can crawl through a website reporting the various html pages and directories associated with that site. I need to see how secure my site is.
Any ideas?

thanks,
Darren

Wheel stands and bumper drags are signs of a poor suspension setup.

Freak'n AWESOME Mercury Marauder burn out
CLICK THE AD TO THE RIGHT OF THE VIDEO PLEASE!!!
Darren M is offline  
Sponsored Links
Advertisement
 
post #2 of 6 (permalink) Old 02-07-2010, 10:40 PM
Rockin' da fumanchu
 
Join Date: Nov 2005
Location: On the straight and narrow,stumbling at best, only by Gods grace.
Posts: 7,224
http://www.brothersoft.com/webreaper-5270.html I guess this is what you're asking for.





Listen to my buddy, Jeff Bolton, from 6-9 AM Mon-Fri.

Obamanomics = Trickle Up Poverty

Think you need to format/reinstall your OS(XP), read this first.
Tx Redneck is offline  
post #3 of 6 (permalink) Old 02-08-2010, 08:53 AM Thread Starter
Horse Trader
 
Darren M's Avatar
 
Join Date: Nov 2001
Location: Mansfield Tx 76063
Posts: 2,261
Thanks for the link! That looks to be what I'm looking for. However, I kind of expected it to find subdirectories off the root. Do you know if such a program exists?

Wheel stands and bumper drags are signs of a poor suspension setup.

Freak'n AWESOME Mercury Marauder burn out
CLICK THE AD TO THE RIGHT OF THE VIDEO PLEASE!!!
Darren M is offline  
 
post #4 of 6 (permalink) Old 02-08-2010, 09:51 AM
Rockin' da fumanchu
 
Join Date: Nov 2005
Location: On the straight and narrow,stumbling at best, only by Gods grace.
Posts: 7,224
TBH, I know nothing about that stuff, I just did a search for free web crawler on google.





Listen to my buddy, Jeff Bolton, from 6-9 AM Mon-Fri.

Obamanomics = Trickle Up Poverty

Think you need to format/reinstall your OS(XP), read this first.
Tx Redneck is offline  
post #5 of 6 (permalink) Old 02-08-2010, 10:23 AM Thread Starter
Horse Trader
 
Darren M's Avatar
 
Join Date: Nov 2001
Location: Mansfield Tx 76063
Posts: 2,261
Oh. Ok. Thanks anyway!

Wheel stands and bumper drags are signs of a poor suspension setup.

Freak'n AWESOME Mercury Marauder burn out
CLICK THE AD TO THE RIGHT OF THE VIDEO PLEASE!!!
Darren M is offline  
post #6 of 6 (permalink) Old 02-08-2010, 10:32 AM
Rockin' da fumanchu
 
Join Date: Nov 2005
Location: On the straight and narrow,stumbling at best, only by Gods grace.
Posts: 7,224
Sorry I couldn't be of more help. You might try going over to www.forums.pcpitstop.com and registering an acct and asking there.





Listen to my buddy, Jeff Bolton, from 6-9 AM Mon-Fri.

Obamanomics = Trickle Up Poverty

Think you need to format/reinstall your OS(XP), read this first.
Tx Redneck is offline  
Sponsored Links
Advertisement
 
Reply

Bookmarks

Quick Reply
Message:
Options

Register Now



In order to be able to post messages on the DFWstangs Forums forums, you must first register.
Please enter your desired user name, your email address and other required details in the form below.

User Name:
Password
Please enter a password for your user account. Note that passwords are case-sensitive.

Password:


Confirm Password:
Email Address
Please enter a valid email address for yourself.

Email Address:
OR

Log-in










Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page
Display Modes
Linear Mode Linear Mode



Posting Rules  
You may post new threads
You may post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On
Trackbacks are On
Pingbacks are On
Refbacks are On

 
For the best viewing experience please update your browser to Google Chrome