100% unsinkable, all tests passed.

Here’s an announcement from the people at Moodle to think about:

I’m pleased to announce that we now have a Moodle 2..5 QA test pass rate of 100%, all ready for the upcoming release!

Many thanks to all our QA testers, as listed in the Testing credits, who made it through the list of over 400 tests quicker than ever!

I can see why someone would think 100% was a good mark on a test, it’s always appealing. I have to do a lot of certification for emergency services, I have an MA in History, and have done plenty of courses for QA and technical skills… I’ve done a LOT of tests. At this point, knowing what I know, I look at 100% and ask, “why was that test so easy? What is it really showing?”

If I were the people at Moodle, I’d be asking myself where the bugs are in their software and why their test matrix missed every single one of them. I don’t mean that as a shot against Moodle or the people doing the testing there, but I DO intend it as a criticism. To me, a 100% pass rate on a test matrix means that it’s time to start building a new test matrix. The job of testing is to find bugs, and Moodle has announced that their tests found none. As a user of Moodle I find that worrying… as a tester that’s had experience working with Moodle and other educational software, I find it even more worrying. Instead of asking “Is the Titanic 100% unsinkable,” someone should have asked, “Okay, what CAN sink this ship?”

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: