Spider image-maps and more …..
New : Spider will now follow image-maps.
Our spider will now pick out urls from any image maps you create using standard HTML.
New : We’ve added a user-agent string (“XmlSitemapGenerator - http://xmlsitemapgenerator.org”).
You can now see our spider activity more clearly in your server logs by looking for the user-agent string that our spider uses. This makes it easier to filter out the activity when doing stats.
Fix : Removed advance filters user interface as there we’re never functional.
We had this as a demonstrator UI that was never implemented, but it leaked in to our production environment so we removed it. Oops!
Please note : changes prior to 1st Jan 2013 do not feature in our online change log.