You’d think after 13 years I’d know better. Some lessons, though, are easily forgotten.
On Thursday last week we shipped version 1.1.2 of powerOne Financial Calculator to the App Store. It was accepted into the store on Friday. Saturday morning the first bug report rolled in that there was something wrong with template creation. It was pulling other templates in. Testing on this problem led me to a bigger problem — any templates created before version 1.1.2 were hidden from view.
On Saturday evening, after a half hour bug fix and a day’s testing we shipped version 1.1.3 to Apple, which was accepted into the App Store today. Luckily we escaped major catastrophe as neither bug was fatal — all previous templates were recovered and new templates are now created correctly again.
We have been at such a frantic pace here that we got lazy about testing. Sure, we were testing around the areas that were changed but we weren’t spending time testing everything before release. We didn’t think we had touched these areas — user-created templates — with version 1.1.2. We were wrong.
I learned this lesson the first time in March 1999. We shipped version 2.0 of FCPlus Professional… then version 2.0.1 then version 2.0.2 then version 2.0.3 all on day one. Nasty lesson learned.
So a reminder for this decade: write test cases, expand test cases, and actually step through them all before shipping.
A lesson learned that only caused a day’s panic and three days worth of consternation… but nothing else. Luckily.