Automatic Metatag Crawler

Friday, 02 January 2009 15:14
Hello everyone, sorry for the lack of updates, but christmas and all, you know how it is.

Anyway, I dont know if anyone else has ever had this problem, but I administor a rather large site (not this one unfortunately), but either way I have to manage a very large site, which has a very large amount of content. This content obviously has meta data associated with it. The only problem being that it MAY or MAY NOT actually have said meta data. Now this is a really big problem for me, as I cant quickly scan 1,000 page looking for keywords and decription and title tags, and its really infuriating, especially if there is loads missing, and its costing you traffic.

So anyway, after months of searching and hours of time being wasted looking for a product that would do this for me, I was coming up dry. I still think its really amazing that no one has made something which can automatically scan meta data and keywords. I mean who honestly wants to waste their time looking through thousands of pages to see which pages are missing their meta keywords and meta descriptions? Either way I didnt, so in the end I made my own little program to do it :)

Download the Automatic Meta Data CrawlerAutomatic Meta Data Crawler here

Not only does it crawl through your entire site checking for the existance of metadata, it also finds broken links, and missing tags. It outputs 2 files, one is every single bit of metadata on the site, and the other is a list of only missing meta keywords, meta description and title tags.

All files are output in comma seperated variable (CSV) files, for ease of use.

Enjoy! :D
Last Updated ( Friday, 02 January 2009 15:34 )
 
Sitemap