Limitatoins of a short review.

It appears from the Collabnet feedback, that El Reg reviewed Subversion against Perforce, and omitted key features of Subversion (and possibly Perforce).

In each instance, El Reg states, "can't cover that in a short review".

Computers are an exact science. There is no such thing as a short review, there is a complete or incomplete review.

What El Reg is really stating is that to maintain the length of text as short and readable as possible, to provide a real world usable article, they published an incomplete review.

This is extremely lame. There are more ways to protray feature comparison information in a review than to describe it textually, eg. A feature matrix - a graphical representation which can be reviewed in 5 secs.

At the very least, if El Reg are going to publish an incomplete article for the sake of readable text reduction, they should include 1 final paragraph which mentions the features that they didn't review in each product for the sake of keeping the article readable.

A review is either complete, or incomplete. El reg seriously failed here.

Harry.

In praise of being incomplete

"There is no such thing as a short review, there is a complete or incomplete review". Yes there is, we published a short review. It was also, of necessity, incomplete.

I don't think computers are as exact as you think they are. Many have trouble representing "one and a third" accurately and testing 100% of the logic paths through a program is usually infeasible. We live with it.

In ten years in technology journalism I've met all combinations of "short", "long", "interesting", "entertaining", "boring" and "turgid" in reviews - but I don't think I've met "complete". And when I was working in IT it never occured to me that a published review could be more than part of the input to product selection anyway.

I asked our reviewer, in effect, to explore two "fit for purpose" products and to discover what purposes they were fit for (although not in those exact terms). I think he did that and if the results attract you to one or other product, you are equipped to do your own "due diligence" in detail, with regard to your requirements.

We're not reviewing consumer toys here. I've been on Perforce training course and have 300 page books just on Perforce - you could do the same for Collabnet. I don't believe that a final paragraph listing the "features" (whatever they are) that we didn't review in detail would achieve very much (we'd just be arguing about the cut-off for the list). But you do have an opportunity, here, to bring these points up - and Collabnet and Perforce can comment on omissions that they think matter.

Completeness of reviews

Harry,

Many thanks for your feedback and taking the trouble to comment.

I should think on that basis all reviews are incomplete. Even the comparison charts you mention, while they can be helpful, are flawed insofar as they reduce each feature to a tick or a cross, disguising important differences of implementation.

Subversion is free and Perforce is free for up to 2 users, and I'd encourage you to try them out if you have unanswered questions.

Tim