Re: This is one of Microsofts biggest failures
The failure is to understand that proper testing is done by design. Testing code needs to try to break the code with a well defined test case. This is best done internally by a well trained and staffed testing organization who can work closely with the code wranglers when necessary. The test cases need to be derived to test conditions that are likely to break the code with special attention paid to those areas with historical problems like drivers.
The idea that an army of unpaid alpha and beta testers can substitute for them is idiotic at best. While I have an good idea what is involved in testing to do it correctly I would need to see the actual specifications to know what to test. (But I am a programmer not a tester so still not that good). None of the external 'testers' have access to these documents and are thus completely blind. Plus the 'testers' can not directly talk to the programmer when necessary; telemetry is a poor substitute.
Biting the hand that feeds IT
