Tuesday, May 22, 2007

Logic to Check the Status of a URL

Open socket to host
Check socket status
Proceed to grab headers
Check headers status

IF the URL is a file or similar
Parse page and look for href patterns
For each URL
Open socket to host
Check socket status
Proceed to grab headers
Check headers status

End

// Local Filesystem - Perform integrity checks
// Local Filesystem - Checks on date attribute
// Local Filesystem - Replace domain with the localPath, check status

No comments: