This web crawler was built by Charles Toronto on behalf of the Brigham Young University HBLL World War I Document Archive in 2021, a compilation of freely accessible online primary source records on the Great War. The purpose of the bot is to scan the site's subdomain for broken links to external sites and compile them into a site maintenance list for Dr. Richard Hacken, manager of the website.
The only information that this bot collects from external links is the URL and HTTP status code. If you would prefer that the bot not crawl your website, please contact us so that we can add an exception to the bot.
- Dr. Richard Hacken
- eurodocs @ byu.edu