DISQUS

Andy Beard - Internet Business Systems Discussion: WordPress.com Bugged XML Sitemaps

  • Jacky Supit · 1 year ago
    nice found.
    i guest we can give them a little more time to do their best, and they might even use your feedback to make it better :)
  • Jacky Supit · 1 year ago
    where is my submitted comment?
    gone? caught by askimet or something?
  • AndyBeard · 1 year ago
    I use Spam Karma - need to leave a few comments before they avoid the moderation queue
  • Clement · 1 year ago
    Andy, Can you share with me the URL for Spam Karma.Do use it along with Akismet? At the meantime, I use only Akismet on my blog.
  • Jeet · 1 year ago
    Good find buddy. I am sure now that they have started generating sitemaps they will do it right in next release. Till then I would use the plug-ins :)
  • Al · 1 year ago
    An interesting and possibly simple idea would be to derive the frequency for the home page based on the average number of posts per day over the last 30 day window.

    Couple benefits I see:
    * People like Lorelle that post quite often, it'll be low
    * People that post sporadically, it'll be higher
    * Not all frequencies across wordpress.com will be the same. This may or may not have any impact but I suspect that Google will love you more (read:trust in some form) if the sitemap is accurate and reflects what Googlebot is seeing in terms of changesets going through a site.

    A similar line of thinking could be used for post pages. Default the frequency to a derivative of number of comments per post over a rolling 30 day window. After the statistics for your site show that you only receive comments for x days, it gets increased to weekly or higher depending.
  • Hunter Jackson · 1 year ago
    Andy,
    Very interesting. I saw this announcement this morning. I am upset that the spiders are only crawling pages every 7 days...wish we could edit it on wordpress.com where my blog is currently...at this time...hosted.

    hopefully they will be doing this soon!
  • zach · 1 year ago
    Wow, great article. Looking back at your past articles has taught me a lot. I subscribed to your feed. Maybe you could take a look at my site, and maybe even subscribe if you would like to.

    Thanks,
    Zach
  • Lorelle · 1 year ago
    This is great information, Andy, but for those who don't really understand what sitemaps are, WordPress and WordPress.com uses pings when a post is published through ping-o-matic to alert search engines and others that you've published a new post. This is the traditional "invitation" for them to send out their search bots.

    The sitemaps are a constantly current table of contents for your blog, updated every time you publish a new post. It acts like a road map, telling the search bots which recognize XML sitemaps which pages to index. On the first run through, it indexes everything. On the next visits, it can check via the dates to find out what is new or modified and index only the new information, allowing the bots to move faster through the sites and not waste so much time with duplicating effort and information.

    As for those who fear having these activated, they are a standard on most sites today, invisible to users and administrators. You control whether or not you want your WordPress or WordPress.com indexed through the Options panel.

    Sitemaps are recognized by Google, Yahoo, and MSN last time I was paying attention to these things. Not all search engines or site indexing bots recognize them, so while it improves indexing, keywords, links, and other traditional techniques still holds sway over SEO. This is just a tool that speeds up the work of the search engine bots.
  • Chris Lang · 1 year ago
    Andy, what plugin do you suggest using for sitemaps? Someone told me your RSS feed is consumable as a site map (it is xml) but it just errors in Webmaster tools. I don't have time to play around so I thought you would send us to the right one.
  • AndyBeard · 1 year ago
    I generally don't use one, though I am thinking about using one again.

    Generally everyone I know uses this one if anything
    http://wordpress.org/extend/plugins/google-site...
  • JunkieYard Dot Com · 1 year ago
    Yep, that's the one I'm using for my sites. If you want a sitemap with your WP, that's the one. It got so many options that you can configure and it will ping all the search engine everytime you publish a new post. They will come crawling to your sites. :D
  • Clement · 1 year ago
    Spot on! I use this sitemap generator on my self hosted WP blog and ever since I started using it I have noticed a huge improvement in how fast my pages get indexed in different search engines. The amount of traffic to my blog has also increased greatly.
  • REBlogGirl · 1 year ago
    Very nice. Just another reason why I don't use the big WP. We've seen this a lot on WP sites but never really thought about the consequences. We've played around a lot with our sitemap and are now using a script to generate it and base priority and change frequency on the average weekly traffic a post gets with special weight given to certain types of posts like listings and MLS RSS feed. This means our sitemaps are constantly in flux which seems to work very well. Google crawls the sites regularly and we saw massive SERP changes on the listing and RSS feed pages once this was implemented. I think that might be a valuable plugin for WP- a script that can help identify which posts should be given priority and generate new priority and change frequency data.
  • Mark · 1 year ago
    Thats the problem with sitemaps. If they aren't arranged properly, they can seriously hurt your google traffic
  • Hands-On Internet Marketing St · 1 year ago
    I use the Google XML Sitemap Generator for WP (I believe the same as Andy's link) at http://www.arnebrachhold.de/projects/wordpress-...

    It is very user-friendly and has tons of options to be defined by user, such as frequencies and crawl priorities for all content, posts and pages, and more.
  • Cornel · 1 year ago
    Not just your traffic... they hurt your ranking as well especially if they are incorrectly formatted. I have seen it in a couple of blogs I was runnning on Wordpress MU, after the corrections to the sitemap generator I was using one of the two blogs gained about 3 positions with no extra postings, the other just one.
  • One Year Millionaire · 1 year ago
    So if you have a sitemap that isn't properly set up it would hurt you more than no sitemap at all?
  • Ash · 1 year ago
    I don't believe you're ever better off without a xml sitemap. If you're having trouble, fix it. Don't disable it.

    I've heard of some people having trouble with Google XML Sitemaps plugin on Wordpress for scheduled posts but I've never had a problem on my blogs.
  • james · 1 year ago
    Subject Line : Beat Long Poll Lines with Absentee Ballots from StateDemocracy.org

    Many state and local election officials are encouraging voters to use Absentee Ballots to avoid the long lines and delays expected at the polls on November 4th due to the record-breaking surge in newly registered voters.

    Voters in most states still have time to obtain an Absentee Ballot by simply downloading an official application form available through www.StateDemocracy.org, a completely FREE public service from the nonprofit StateDemocracy Foundation.

    Read More: http://us-2008-election.blogspot.com/2008/10/be...
  • Detectives · 9 months ago
    I think keeping no sitemap is in fact much better than keeping a faulty one. I believe it affects in the crawling of the site by the search engine spiders. This is another reason why we try to avoid using WordPress.
  • Jonas Software · 9 months ago
    Wordpress.com is buggy as hell. Run your own installation!
  • mtb · 9 months ago
    This post and comments are a littledated but my findings with sitemaps has been nothing but positive. I occasionally check my dynamic site map and it is generating the correct links. I also occasionally resubmit to the search engines if a lot of links were genereated. My opinion is they do us good.
  • kalamana (Michael Hartmann) · 8 months ago