Phillip Pearson - web + electronics notes

tech notes and web hackery from a new zealander who was vaguely useful on the web back in 2002 (see: python community server, the blogging ecosystem, the new zealand coffee review, the internet topic exchange).

2002-10-4

Ecosystem updates delayed

Due to they way I've been working on Python Community Server recently, the ecosystem crawler keeps getting shut down partway through its run. As such, the cache has become more stale than it has ever been, and pages are actually getting expired. Normally I purge about 1000-2000 of them per day, but the crawler has taken to doing this itself today because I haven't been running it enough.

I suspect I also haven't got the permissions set right at the moment; I moved some of the cache off to a spare partition a week or so ago because the main one was running out of space, but I suspect that the crawler doesn't have access to the output directory now. Hmm. More later ;)