The culprit is the timing of the Search Engine Indexer in the scheduler. The thing is, you have to
change the values. When DNN was initially setup, it came with a preset of Indexing every 30 minutes.
The problem is that when you have more and more content, it takes longer to perform the indexing,
so it gets to the 30 minute timeframe and then starts to reindex, even though the other index never
finished, so it throws error after error.
I had to stop the indexing, change the values, restart the Application and then startup the scheduler.
I changed the index to a 6 hour timeframe. My content won't show up so quickly on internal searches,
but at least it won't go into spasms anymore. This answer was actually provided by Mitch Sellers who
I contacted. I'm in the process of signing a contract to have him on retainer to help in the future. Well
worth the oney in my opinion to have someone who really knows what's going on.
Original post and answer at http://www.dnncreative.com/Forum/tabid/88/forumid/4/tpage/
1/view/topic/postid/9009/Default.aspx#9009