Search progress
(topic: search engine)
Checkpoint: The server just indexed 319 items (the 319 posts from this weblog) in 1 min 14 secs ... so about 4 items per second. That's using one XML-RPC call per item, and opening / closing the index each time.
I wonder which bit takes the most time. I bet if I packed them all up in one XML-RPC call and kept the index open the whole time, it would be heaps quicker. Realistically though, people only ever post one post at a time (this is for searching blog posts), so that particular optimization might not really make any sense.
... more like this: [blog search]
Checkpoint: The server just indexed 319 items (the 319 posts from this weblog) in 1 min 14 secs ... so about 4 items per second. That's using one XML-RPC call per item, and opening / closing the index each time.
I wonder which bit takes the most time. I bet if I packed them all up in one XML-RPC call and kept the index open the whole time, it would be heaps quicker. Realistically though, people only ever post one post at a time (this is for searching blog posts), so that particular optimization might not really make any sense.