DNN-Forum

 This is reaaally driving me nuts. I thought it had something to do with me changing the performance settings and setting authenticated cacheability to public from 'server and private', but that doesn't seem to be the case.

Anyway - the issue is that the search bots are crawling the portals of one of our installs and recording duplicated content for the HTML modules only, everything else is fine. You can see what I'm talking about by visiting this link or performing a site:donspainting.com command and clicking on the cache link next to the page results.

The reason I thought it might have been the auth. cacheability settings was because while I was (am) logged in, I can use the 'check as googlebot' feature in google webmaster tools to re-crawl the page, and everything comes out fine. Even for a short while after I log out, it seems to be ok. 

But upon checking the sites again today while not logged in, the duplicated content reappears. 

I'm open to any thoughts or suggestions, because my brain is melting. Thanks!!!!

 

 

Well, after more searching I came across several posts that are somewhat related to this issue. It seems almost all of them affect 4.9.5 -

Here's the first mention from dotnetnuke.com - (not exactly related, but close enough)
http://www.dotnetnuke.com/Community/Forums/tabid/795/forumid/-1/threadid/319186/scope/posts/Default.aspx

And a more recent one:
http://www.dotnetnuke.com/Community/Forums/tabid/795/forumid/160/threadid/352897/scope/posts/Default.aspx

With some possible solutions, maybe?
http://support.dotnetnuke.com/issue/ViewIssue.aspx?id=8892&PROJID=2

http://chriscant.phdcc.com/2009/06/dnn-event-viewer-spider-errors.html

I just ran across these, so I thought I'd add em to this thread, just in case someone else bangs their head into this mess.

It's definitely something to do with the HTMLmodule cache settings (maybe other modules as well, but I haven't seen any evidence of that on our sites) - somehow the cache never gets cleared out, despite restarting the app or the recycling the server - it just makes go all screwy. argh. this sucks