The truth is that the wee small hours appear to be the time when the search engine spiders/robots come to harvest all the information that has been added, to evaluate and include in search results.
We have been overrun on a few occassions recently, mainly Google and Inktomi (Yahoo and others), which was nice.
Scunner