Online website optimization tools: explore and see your site like webengines. Count and display broken and internals links. Get Google pagerank for each file and generate a SiteMaps file in XML format. Keyword Crawler could also calculate word density in pages and display the metas and observes the directives of the robots.txt and 'robot' meta tags.
Changes in this version:
Support now robots.txt files, Content-Type HTTP header, META robot tag and some minor bugs corrections
Digg This!
Add to Del.icio.us
Add to Furl
Stumble
Recommend
Bookmark
Updates