BrokenLinks 3.1 build: 9639 released: 2017-03-15 compiled with: Java 1.8.0_131 Jet jet12.0-pro-x86/1.8.0_131 tracks and repairs broken links and redirected links in conjunction with Xenu. Also includes utility to tidy URLs on a website.. Copyright: (c) 2008-2017 Canadian Mind Products. Java application. Download from: http://mindprod.com/products1.html#BROKENLINKS View formatted HTML Manual online at: http://mindprod.com/application/brokenlinks.manual.html ---- Notes: You must install the Java JRE to use this program. See http://mindprod.com/jgloss/jgloss/jre.html This program can only be used from the command prompt, (or via an command line style icon shortcut) e.g. under Windows command.exe or JPSoft tcmd.exe, formerly called the DOS box. Just clicking the programs in a directory listing will not do anything useful. Just typing the program names at the command prompt will not either. This program requires a manual install! See below. This program works with vanilla text files, (e.g. ASCII files or UTF-8 Unicode files). You will need a text editor to create and view them, not a word processor. e.g. notepad, Visual Slick Edit or other suitable text editor http://mindprod.com/jgloss/editor.html. You must use a monospaced font http://mindprod.com/jgloss/monospacedfonts.html (aka fixed pitch, aka programmer font) to view your files, or they won't look properly aligned. I put out an avalanche of free software into the world, and submit PAD files to hundreds of distribution sites, but I rarely hear back from anyone. What's happening? Does it all just work fine? It is so complicated nobody can figure out how to use it and they give up on it? It is it useful? Since everyone has the source, do people just fix the programs to their liking themselves? Did you have trouble installing? Do I presume you know too much? I would be happy to hear from you about your experiences, positive or negative and your requests for improvements. A one-line email to roedy@mindprod.com would be great. ===> Free <=== Full source included. You may even include the source code, modified or unmodified in free/commercial open source/proprietary programs that you write and distribute. May be used freely for any purpose but military. For more details on this restriction, see http://mindprod.com/contact/nonmil.html If you include any Canadian Mind Products code in your own applications, your app too must be labelled non-military use only. http://mindprod.com/contact/nonmil.html All Java jars and source code are included. If you need the class files or Javadoc, you will have to build them yourself. To streamline the zip downloads, class files and Javadoc have been removed. ---- Prerequisites: This program runs under any OS that supports Java, (e.g.W2K/XP/W2003/Vista/W2008/W7-32/W7-64/W8-32/W8-64/Linux/LinuxARM/LinuxX86 /LinuxX64/Ubuntu/Solaris/SolarisSPARC/SolarisSPARC64/SolarisX86/SolarisX64/OSX/AIX...) so long as you have <><> Java version 1.8 <><> or later installed (32-bit or 64-bit Java). See http://mindprod.com/jgloss/installingjava.html for details. ---- Installing on a PC: Download source and compiled jar files to run on your own machine as an application. First install a recent Java JDK or JVM. See http://mindprod.com/jgloss/installingjava.html. To install, extract the zip download with WinZip (or similar unzip utility) into any directory you please, often J:\ -- ticking off the use folder names option. To run as an application, type: java.exe %JAVA_OPTIONS -ea -jar J:\com\mindprod\brokenlinks\brokenlinks.jar {put any parms here} adjusting as necessary to account for where the jar file is. ---- Installing on a MacIntosh: Use Safari to download source and compiled jar files to run on your own machine as an application. Safari will automatically unpack the zip into ~/Downloads (version 10.5) [or on the Desktop (version 10.4 and earlier)]. First install a recent Java JDK or JVM. See http://mindprod.com/jgloss/installingjava.html. You may optionally move the download tree to a permanent home. I don't have a MacIntosh, just a PC, so I can't test my Java programs for Mac compatibility. In theory they should work without problems, but in practice that does not always happen. If you have problems please, let me know, preferably with screenshots and complete verbatim error messages. To run as an application, without parameters, just double click the jar file. To run as an application with parameters, in bash shell type: open Terminal.app cd ~/Desktop java.exe -ea -jar com/mindprod/brokenlinks/brokenlinks.jar {put any parms here} adjusting as necessary to account for where the jar file is. ---- Rebuilding: The zip already contains the necessary jar files, so unless you modify the program, there is no need to recompile the source or rebuild the jar. Configure.java basedir="E:/" in rebuild.xml to the drive where your files are. Use ANT and rebuild.xml, not build.xml, to recompile and recreate the jar. ---- Use: Brokenlinks is a tool to help you find and track broken links on your website, namely URLs that no longer point to anything useful. It is a back end to the Xenu Link Sleuth broken link detector that compensates for Xenu’s weakness of overwhelming you with reports of links that are not really broken. Brokenlinks retests ostensibly broken links and maintains a database of link integrity history. It partly compensates for various bugs and deficiencies in Xenu. Brokenlinks automatically repairs links that have been redirected, correcting your HTML to point to the new URL. BrokenLinks typically discovers that only 1% of the links Xenu reports as broken actually need to be repaired. 99% of them are just down temporarily or fail Xenu's quick probe, but pass BrokenLink's more patient test that more accurately simulates what a real browser does. TidyURLs cleans up all the hrefs= and src= on your website. This help ReplaceURLs work properly. ReplaceURLs patches URLs in your local website files to the new redirected values that BrokenLinks finds. The Brokenlinks manual at: http://mindprod.com/application/brokenlinks.manual.html explains in more detail what it is for and how to use it. I M P O R T A N T ! This version of BrokenLinks only works with a special version of Xenu that exports numeric status codes. You can get it from either: http://mindprod.com/zips/xenubeta20121111.zip or http://home.snafu.de/tilman/tmp/xenubeta.zip Why the scissors logo? It is a temporary logo until I can find a decent broken link icon. It represents a link being cut/broken. ---- Version History: 1.0 2008-07-21 initial version. 1.1 2008-08-01 export all HTML in one lump, complete with headers and footers. 1.2 2008-08-08 first version released to the public. No forgiveness on broken local links. and text version of summary report. 1.3 2008-10-29 handle empty URLs. 1.4 2008-11-29 add suspectForgivenessDays 1.5 2009-02-14 handle null status, properly delay reporting new broken links. 1.6 2009-02-20 refactor to use new HTTP library 1.7 2010-09-10 handle Xenu's new mailto checking. 1.8 2010-11-14 primitive permanent redirect handling. 1.9 2010-11-17 export of redirects working. Not yet polished. Add ReplaceURLs. 2.0 2010-12-30 export permanent and temporary redirects separately. 2.1 2010-12-31 correct bug in merging original and redirected urls. 2.2 2011-01-16 and TidyURLs utility to clean up all the hrefs on your website. 2.3 2011-02-08 handle https: redirects and faster https: link checking. 2.4 2012-02-26 faster probing using 30 threads. Must delete history.bin to use new version. 2.5 2012-02-28 faster probing of redirects with 30 threads. No longer need to sort/align results separately. 2.6 2012-06-02 simpler configuration. Now uses fixed file names in the current directory. Limit number of froms saved for speed/memory. Don't put ignored items in list. Faster lookup of status kind. 2.7 2012-11-22 uses special version of Xenu that includes numeric status. Faster. easier to configure new status codes. 2.8 2012-11-28 faster handling of local links. 2.9 2012-12-02 optional leave.csv file. 3.0 2013-01-20 ensure responsecodes.ser is accessible. Clarify error messages. 3.1 2017-03-15 try both with and without SNI on fail -30-