Disqus - Latest Comments for pogil

Re: window office - Open Source Search Engine Evaluation

Paul Ogilvie — Thu, 22 May 2008 20:53:10 -0000

I actually view $1300 as a very low cost to get access to a useful testbed. I've been building some small test collections at mSpoke to evaluate components of our system and our on paper costs of collecting several thousand judgments are roughly 5 times the cost of accessing the .GOV2 collection, but when you factor in the time I've spent building the right framework for assessors as well as refining the assessment task to promote assessor consistency the cost is a lot larger.

With regards to participation at TREC, it is not uncommon for companies to participate at a minimal level of effort. You're not obligated to attend TREC or even write a paper.

I don't want to dismiss or discredit the idea of a more open collection of relevance judgments for queries, but as Iadh points out, creating large, useful test collections is not an easy task.

Re: window office

Paul Ogilvie — Mon, 19 May 2008 16:48:23 -0000

Try something like

ps.options(family='Times',pointsize=16)

for font sizes, but use

\setkeys{Gin}{width=3in,height=2.5in}

to set the width and height in latex before you switch to R mode. I also had to use a thicker line width factor than before to get results like what I showed above.

(I already had the answer in my latex, just forgot it when I first wrote the post!)

Re: window office

Paul Ogilvie — Mon, 19 May 2008 15:51:10 -0000

I wanted to follow up and say that aside from some little things like setting the executable flag on the downloaded files and learning about the ps.options R function, Sweave in R works really well. I had to re-tweak a few of the figure parameters, but I'm very happy with the results.