FAQs: Verifying URLs
| • | What are some basic guidelines for checking URLs? |
| • | What should be the scope of a URL checker? |
| • | Should I tell the webmaster when I run the URL Checker? |
| • | How can I be sure the link is broken? |
| • | What if the content is different but the link is not broken? |
| • | What about sites that charge the institution based on access frequency? |
| • | How does the URL Checker report work if my site uses proxy servers? |
What are some basic guidelines for checking URLs?
The National Information Standards Organization.(NISO) has established a set of best practices for any organization or individual that utilizes any type of link checking. NISO defines URL checkers as programs that verify that the links embedded in Web pages are accurate and point to valid resources. These FAQs are based on the NISO best standards.
The SirsiDynix URL Checker (Urlchecker) report checks only the 856 link, not the subsequent links embedded on the checked page.
What should be the scope of a URL checker?
Don’t check more than you really need. A library’s catalog may point to a single service thousands of times (once to EBSCOhost for each journal title or citation, for example) and running a link checker against such a system can be extremely burdensome to the service provider. Omit these sites and work with providers to ensure valid construction of these links outside of the URL checker. SirsiDynix’s URL Checker report contains options for you to limit the Web sites to be checked by the report.
Should I tell the webmaster when I run the URL Checker?
It is a good idea to inform the Webmasters of the sites you are checking. Let them know you will be running these checks, and, if possible, get permission to do the link check. This is especially important if you have many links to a single site. Ask the Webmaster when is the best ”off-peak” time for their site and run the link checking then.
How can I be sure the link is broken?
Exercise caution when deciding a link is broken. If the URL Checker report or other link checker reports a broken link, it is usually safe to assume that the link really has been moved or removed. However, occasional network disruptions or host downtime can cause a temporary failure of the link. Such links should not be considered broken unless it can be confirmed through repeated access failures over a reasonable amount of time that the link is no longer accessible.
What if the content is different but the link is not broken?
Don’t depend on the static content of a page in deciding the validity of a link. Many Web pages are created dynamically and are constantly changing. Unless you are absolutely certain about the static nature of the page, don’t rely on simply examining the content of the page to determine if the link is still valid. For example, if you link from your site to the current weather of a particular city, the content of that Web page is likely to be different depending on when the link is accessed.
What about sites that charge the institution based on access frequency?
Be aware of the consequences of running the URL Checker report or any other type of URL checker. Some links may be to resources licensed from a third party with a fee associated with each time the link is accessed. Running the URL Checker report or link checking software will count as a chargeable access. Or, a license agreement might state that the link can only be accessed a specified number of times in a particular timeframe. In those cases, running the report or link checker will reduce the number of times your users can access that resource. Other conditions may apply which have financial implications, so be sure you understand licensing and usage terms and conditions before using the URL Checker report or other link checkers.
How does the URL Checker report work if my site uses proxy servers?
When the URL Checker report runs, it checks to see if the \Unicorn\Webcat\Config\proxy.cfg file exists. If the file exists, the report reads the file to determine the proxy server address and port number so it can access the Internet using the proxy server.
If the proxy.cfg file does not exist, or if the information it contains is incorrect, the URL Checker report will stop processing and print a message in the report log.
Related topics