snuffleupabug – a bug that is ignored because you think the reporter (who you consider less sophisticated than you) is making it up.
new type of bug
April 6th, 2009CubicTest, with pictures
February 8th, 2009In a recent post, I mentioned that I was planning on writing a test in CubicTest to help refactor an IP address validator web page.
I finished the test, and fixed the script. My overall impression is that CubicTest is fairly straightforward, and I have not yet used it to its strengths. I still want to play with subtests, test suites, and custom test steps.
Now for the pictures:
The IP Validator looks like this:
When you enter a possible IP address and click the button, the server-side script returns a nifty table with the result:
Unfortunately, there was a bug in the script. After the third address checked, the display looked like this:
That bug is not the interesting bug I wanted to keep. Here’s the quick test I came up with, using the CubicTest plugin:
During the test development, I added id attributes to the result table elements. That made the common contexts much easier to specify. And I had a few go rounds with eclipse editor weirdness switching the sense of the last check from “text on the page” to “text not on the page”.
OSTATLI a success, and a lot of fun
February 6th, 2009Yesterday, I was one of the attendees at the Open Source Test Automation Tool Love-In, hosted by Elisabeth Hendrickson at the QualityTree offices here in the Bay Area.
Other attendees included Dale Emery, Chris Sims, Jeffrey Frederick, Ken Pier, and Kevin Lawrence.
We chatted a bit about test automation philosophy, told war stories, and played with the tools.
I watched Elisabeth set up a RobotFramework test for some ATDD work she is doing with a new website. When she showed the “fixture” code and the interface capabilities of the tool, I was hooked. I’m going to write up some tests for the big-app-at-work next week.
Kevin Lawrence gave a demo of what he accomplished after 10 minutes of playing with CubicTest. It reminded me of the graphical workflow test for rails Brian Marick was working on.
Last night, I managed to get seleniumrc up and running on my MacBook, then this morning I got cubictest installed and running in eclipse. I think I’ll use it to write tests so I can refactor my ip address validator (the one with the interesting bug I’m keeping in, but the annoying bugs I want to fix).
Finally, Elisabeth shared a pointer to UISpec4J as a good unit test library for Swing.
Lots of other tool goodness happened, too.
Thanks again, Elisabeth, for calling and hosting the event.
Test Data Management
February 4th, 2009A quick hint about managing test data for “enterprise” applications.
Does the application under test rely on a large central database?
If so, is that large central database backed up on a regular basis?
If so, can you get access to the backup files?
For some testing tasks, it might be easier to just load a new database instance from those backups than to create and populate a database from scratch.
In one case, we dropped, truncated, and pruned a number of tables from the backup, then created a new backup file. A much smaller backup file. One that loaded in one hour instead of many hours.
some of my values
September 5th, 2008apropos of nothing, some stream of consciousness thoughts while scanning twitter. (hey look, I’m blogging again!)
- I like to know what I am doing, and why I am doing it. (mindfulness)
- I like to know what we are doing, and why we are doing it.
- I like to know what we did, and why we did it.
- I like feedback. Fast feedback, and close feedback.
- I like creating affordances.
- I like precision and accuracy.
- I like to tell my audience when I am compromising precision or accuracy in order to better reach another goal.
- I like people who are hungry to learn. (they make me a better teacher)
- I like french vanilla ice cream.
Learning Java through TDD
September 5th, 2008Over the past few weeks, I’ve been working through the book Agile Java – Crafting Code with Test Driven Development, by Jeff Langr. Why?
- I’m evaluating it as a self-study guide for a co-worker who wants to learn java.
- While I’ve read plenty of java, and made small modifications to existing java programs, I’ve never written a major java program from scratch, nor have I ever set out to systematically learn java. So I’m learning java. yay!
- While I’ve written plenty of tests, and I’ve modified some existing tests, and I’ve written tests before I’ve written code, I’ve never written a major program using xunit-style tests and doing TDD. So I’m learning TDD. yay!
- I’m also taking the opportunity to immerse myself in eclipse and intellij
I’ve had some interesting experiences (thoughts and feelings) doing this, and I’ll write up some details in separate posts.
I just finished lesson 12. Earlier, I wrote the following in my notes:
I’ve gotten through the end of lesson 6, and I’m very impressed. I feel confident that I can recommend this book to my coworker, and he’ll be better off going through it than not.
I’ve been using eclipse more than intellij for lessons 5 and 6, and I’m steadily becomeing more comfortable with it.
I found and installed the EclEmma plug-in, and very much like using code coverage to identify code I can delete after some refactoring. And I’m duly impressed that I get 100% code coverage when I run my tests*
*actually, almost 100%. the gaps are things like assertTrue not being called with a false condition (duh), never calling the constructor of a utility class, and not testing the default methods for enums. I can live with that, for now.
One thing I did not expect was that my brain felt like it filled up and overflowed, and I kept forgetting what I was doing, as I got towards the end of the lesson 6 exercises.
more on that last bit soon.
something I learned from my boss
September 4th, 2008(if it is wrong, consider me tragically misinformed)
In the Navy, when they have a “bad ship”, they disperse all of the crew throughout the fleet, then assemble a completely new crew and try again.
Applying this lesson in our context – if you have a “bad team”, break it up and assign the team members to other teams. Then staff the project with a new team and try again.
Just like breaking up a great team and assigning the members to other teams won’t necessarily turn those other teams into great teams, doing so with a bad team won’t necessarily turn the other teams into bad teams.
This lesson is not license to turn your brain off. Bad team != bad people, and sometimes there are people who would find a better fit at some other company or pursuing some other career.
groups who do good unit testing
September 4th, 2008In most software development groups I’ve worked, there have been at least one or two programmers who both believe in unit testing and have the discipline and knowledge to create good unit tests. This has not changed during my career.
I’ve seen a few groups where there are enough unit-test-infected programmers to create critical mass, and the entire group writes, maintains, and believes in unit tests.
I have seen even fewer companies that explicitly and consciously set out to build a group of programmers with the above critical mass in test-infectedness.
So I wonder if the majority of companies where good unit testing happens are the result of chance.
(in response to questions about Is unit testing doomed )
Don't call it a test plan?
August 10th, 2008Inspired by a tweet from “utahkay” where she stated
Organizations that still use the term “test plan” don’t get it yet.
Maybe call them “done plans” since they help us determine when something is done.
As an aside, I’m finding twitter an attractive outlet for writing.
What's on my mac
May 21st, 2008a quick, partial list of stuff I’ve installed, and use, on my mac:
- Aquamacs emacs
- Backdrop/MenuShade/Mousepose 2 (for screen casts)
- Carbon Copy Cloner
- Chicken of the VNC
- Colloquy/Snak/Adium (IM/IRC stuff – take your pick)
- Firefox 2
- Firefox 3
- Gizmo
- Growl
- iStat Menus (iSlayer.com)
- iTerm
- JungleDisk
- Minuteur
- NeoOffice
- Nocturne
- Parallels
- Plot (http://plot.micw.eu)
- Quicksilver
- Remote Desktop Connection
- Skype
- Spamsieve
- SSH Agent
- Twitterrific
- VLC



