crawler: fix performance problems: only save state once per timeslice (not after...
authorBrian Warner <warner@lothar.com>
Sat, 21 Feb 2009 21:56:49 +0000 (14:56 -0700)
committerBrian Warner <warner@lothar.com>
Sat, 21 Feb 2009 21:56:49 +0000 (14:56 -0700)
commit77f3b83d687d261968a0d10ab9dde77183a81717
treeedda80468609f21de05aa889c037408170b39f8a
parenta04d3b8fe88b22e11d3189e75efc5e22f7abf196
crawler: fix performance problems: only save state once per timeslice (not after every bucket), don't start the crawler until 5 minutes after node startup
src/allmydata/storage/crawler.py
src/allmydata/test/test_crawler.py
src/allmydata/test/test_storage.py