Table of Contents
This article contains the following sections:
- Introduction
- Why Use JUnit?
- Design of JUnit
- Step 1: Install JUnit
- Step 2: Write a Test Case
- Step 3: Write a Test Suite
- Step 4: Run the Tests
- Step 5: Organize the Tests
- Testing Idioms
- Training
- Resources
Why Use JUnit?
Before we begin, it's worth asking why we should use JUnit at all. The subject of unit testing always conjures up visions of long nights slaving over a hot keyboard trying to meet the project's test case quota. However, unlike the Draconian style of conventional unit testing, using JUnit actually helps you write code faster while increasing code quality. Once you start using JUnit you'll begin to notice a powerful synergy emerging between coding and testing, ultimately leading to a development style of only writing new code when a test is failing.
Here are just a few reasons to use JUnit:
-
JUnit tests allow you to write code faster while increasing quality.
Yeah, I know, it sounds counter-intuitive, but it's true! When you write tests using JUnit, you'll spend less time debugging, and you'll have confidence that changes to your code actually work. This confidence allows you to get more aggressive about refactoring code and adding new features.
Without tests, it's easy to become paranoid about refactoring or adding new features because you don't know what might break as a result. With a comprehensive test suite, you can quickly run the tests after changing the code and gain confidence that your changes didn't break anything. If a bug is detected while running tests, the source code is fresh in your mind, so the bug is easily found. Tests written in JUnit help you write code at an extreme pace and spot defects quickly.
-
JUnit is elegantly simple.
Writing tests should be simple - that's the point! If writing tests is too complex or takes too much time, there's no incentive to start writing tests in the first place. With JUnit, you can quickly write tests that exercise your code and incrementally add tests as the software grows.
Once you've written some tests, you want to run them quickly and frequently without disrupting the creative design and development process. With JUnit, running tests is as easy and fast as running a compiler on your code. In fact, you should run your tests every time you run the compiler. The compiler tests the syntax of the code and the tests validate the integrity of the code.
-
JUnit tests check their own results and provide immediate feedback.
Testing is no fun if you have to manually compare the expected and actual result of tests, and it slows you down. JUnit tests can be run automatically and they check their own results. When you run tests, you get simple and immediate visual feedback as to whether the tests passed or failed. There's no need to manually comb through a report of test results.
-
JUnit tests can be composed into a hierarchy of test suites.
JUnit tests can be organized into test suites containing test cases and even other test suites. The composite behavior of JUnit tests allows you to assemble collections of tests and automatically regression test the entire test suite in one fell swoop. You can also run the tests for any layer within the test suite hierarchy.
-
Writing JUnit tests is inexpensive.
Using the JUnit testing framework, you can write tests cheaply and enjoy the convenience offered by the testing framework. Writing a test is as simple as writing a method that exercises the code to be tested and defining the expected result. The framework provides the context for running the test automatically and as part of a collection of other tests. This small investment in testing will continue to pay you back in time and quality.
-
JUnit tests increase the stability of software.
The fewer tests you write, the less stable your code becomes. Tests validate the stability of the software and instill confidence that changes haven't caused a ripple-effect through the software. The tests form the glue of the structural integrity of the software.
-
JUnit tests are developer tests.
JUnit tests are highly localized tests written to improve a developer's productivity and code quality. Unlike functional tests, which treat the system as a black box and ensure that the software works as a whole, unit tests are written to test the fundamental building blocks of the system from the inside out.
Developer's write and own the JUnit tests. When a development iteration is complete, the tests are promoted as part and parcel of the delivered product as a way of communicating, "Here's my deliverable and the tests which validate it."
-
JUnit tests are written in Java.
Testing Java software using Java tests forms a seamless bond between the test and the code under test. The tests become an extension to the overall software and code can be refactored from the tests into the software under test. The Java compiler helps the testing process by performing static syntax checking of the unit tests and ensuring that the software interface contracts are being obeyed.
-
JUnit is free!
Design of JUnit
JUnit is designed around two key design patterns: the Command pattern and the Composite pattern.
A TestCase is a command object. Any class that contains
test methods should subclass the TestCase class.
A TestCase can define any number of
public testXXX() methods. When you want to check the
expected and actual test results, you invoke a variation of the
assert() method.
TestCase subclasses that contain
multiple testXXX() methods can use
the setUp() and tearDown() methods to
initialize and release any common objects under test, referred to as
the test fixture. Each test runs in the context of its own fixture,
calling setUp() before and tearDown() after
each test method to ensure there can be no side effects among test
runs.
TestCase instances can be composed
into TestSuite hierarchies that automatically invoke all
the testXXX() methods defined in
each TestCase instance. A TestSuite is a
composite of other tests, either TestCase instances or
other TestSuite instances. The composite behavior
exhibited by the TestSuite allows you to assemble test
suites of test suites of tests, to an arbitrary depth, and run all the
tests automatically and uniformly to yield a single pass or fail
status.
Step 1: Install JUnit
-
First, download the latest version of JUnit, referred to below as
junit.zip. -
Then install JUnit on your platform of choice:
Windows
To install JUnit on Windows, follow these steps:
-
Unzip the
junit.zipdistribution file to a directory referred to as%JUNIT_HOME%. - Add JUnit to the classpath:
set CLASSPATH=%JUNIT_HOME%\junit.jar
Unix (bash)
To install JUnit on Unix, follow these steps:
-
Unzip the
junit.zipdistribution file to a directory referred to as$JUNIT_HOME. - Add JUnit to the classpath:
export CLASSPATH=$JUNIT_HOME/junit.jar
-
-
Test the installation by using either the textual or graphical test runner to run the sample tests distributed with JUnit.
Note: The sample tests are not contained in the
junit.jar, but in the installation directory directly. Therefore, make sure that the JUnit installation directory is in the CLASSPATH.To use the textual test runner, type:
java junit.textui.TestRunner junit.samples.AllTestsTo use the graphical test runner, type:
java junit.swingui.TestRunner junit.samples.AllTestsAll the tests should pass with an "OK" (textual runner) or a green bar (graphical runner). If the tests don't pass, verify that
junit.jaris in the CLASSPATH.
Step 2: Write a Test Case
First, we'll write a test case to exercise a single software component. We'll focus on writing tests that exercise the component behavior that has the highest potential for breakage, thereby maximizing our return on testing investment.
To write a test case, follow these steps:
-
Define a subclass of
TestCase. -
Override the
setUp()method to initialize object(s) under test. -
Optionally override the
tearDown()method to release object(s) under test. -
Define one or more public
testXXX()methods that exercise the object(s) under test and assert expected results.
The following is an example test case:
import junit.framework.TestCase;
public class ShoppingCartTest extends TestCase {
private ShoppingCart cart;
private Product book1;
/**
* Sets up the test fixture.
*
* Called before every test case method.
*/
protected void setUp() {
cart = new ShoppingCart();
book1 = new Product("Pragmatic Unit Testing", 29.95);
cart.addItem(book1);
}
/**
* Tears down the test fixture.
*
* Called after every test case method.
*/
protected void tearDown() {
// release objects under test here, if necessary
}
/**
* Tests emptying the cart.
*/
public void testEmpty() {
cart.empty();
assertEquals(0, cart.getItemCount());
}
/**
* Tests adding an item to the cart.
*/
public void testAddItem() {
Product book2 = new Product("Pragmatic Project Automation", 29.95);
cart.addItem(book2);
double expectedBalance = book1.getPrice() + book2.getPrice();
assertEquals(expectedBalance, cart.getBalance(), 0.0);
assertEquals(2, cart.getItemCount());
}
/**
* Tests removing an item from the cart.
*
* @throws ProductNotFoundException If the product was not in the cart.
*/
public void testRemoveItem() throws ProductNotFoundException {
cart.removeItem(book1);
assertEquals(0, cart.getItemCount());
}
/**
* Tests removing an unknown item from the cart.
*
* This test is successful if the
* ProductNotFoundException is raised.
*/
public void testRemoveItemNotInCart() {
try {
Product book3 = new Product("Pragmatic Version Control", 29.95);
cart.removeItem(book3);
fail("Should raise a ProductNotFoundException");
} catch(ProductNotFoundException expected) {
// successful test
}
}
}
(The complete source code for this example is available in the Resources section).
Step 3: Write a Test Suite
Next, we'll write a test suite that includes several test cases. The test suite will allow us to run all of its test cases in one fell swoop.
To write a test suite, follow these steps:
-
Write a Java class that defines a static
suite()factory method that creates aTestSuitecontaining all the tests. -
Optionally define a
main()method that runs theTestSuitein batch mode.
The following is an example test suite:
import junit.framework.Test;
import junit.framework.TestSuite;
public class EcommerceTestSuite {
public static Test suite() {
TestSuite suite = new TestSuite();
//
// The ShoppingCartTest we created above.
//
suite.addTestSuite(ShoppingCartTest.class);
//
// Another example test suite of tests.
//
suite.addTest(CreditCardTestSuite.suite());
//
// Add more tests here
//
return suite;
}
/**
* Runs the test suite using the textual runner.
*/
public static void main(String[] args) {
junit.textui.TestRunner.run(suite());
}
}
Step 4: Run the Tests
Now that we've written a test suite containing a collection of test
cases and other test suites, we can run either the test suite or any
of its test cases individually. Running a TestSuite will
automatically run all of its subordinate TestCase
instances and TestSuite instances. Running
a TestCase will automatically invoke all of its
public testXXX() methods.
JUnit provides both a textual and a graphical user interface. Both user interfaces indicate how many tests were run, any errors or failures, and a simple completion status. The simplicity of the user interfaces is the key to running tests quickly. You should be able to run your tests and know the test status with a glance, much like you do with a compiler.
To run our test case using the textual user interface, use:
java junit.textui.TestRunner ShoppingCartTest
The textual user interface displays "OK" if all the tests passed and failure messages if any of the tests failed.
To run the test case using the graphical user interface, use:
java junit.swingui.TestRunner ShoppingCartTest
The graphical user interface displays a Swing window with a green progress bar if all the tests passed or a red progress bar if any of the tests failed.
The EcommerceTestSuite can be run similarly:
java junit.swingui.TestRunner EcommerceTestSuite
Step 5: Organize the Tests
The last step is to decide where the tests will live within our development environment.
Here's the recommended way to organize tests:
-
Create test cases in the same package as the code under test. For example, the
com.mydotcom.ecommercepackage would contain all the application-level classes as well as the test cases for those components. -
To avoid combining application and testing code in your source directories, create a mirrored directory structure aligned with the package structure that contains the test code.
-
For each Java package in your application, define a
TestSuiteclass that contains all the tests for validating the code in the package. -
Define similar
TestSuiteclasses that create higher-level and lower-level test suites in the other packages (and sub-packages) of the application. -
Make sure your build process includes the compilation of all tests. This helps to ensure that your tests are always up-to-date with the latest code and keeps the tests fresh.
By creating a TestSuite in each Java package, at various
levels of packaging, you can run a TestSuite at any level
of abstraction. For example, you can define
a com.mydotcom.AllTests that runs all the tests in the
system and a com.mydotcom.ecommerce.EcommerceTestSuite
that runs only those tests validating the e-commerce components.
The testing hierarchy can extend to an arbitrary depth. Depending on the level of abstraction you're developing at in the system, you can run an appropriate test. Just pick a layer in the system and test it!
Here's an example test hierarchy:
AllTests (Top-level Test Suite)
SmokeTestSuite (Structural Integrity Tests)
EcommerceTestSuite
ShoppingCartTestCase
CreditCardTestSuite
AuthorizationTestCase
CaptureTestCase
VoidTestCase
UtilityTestSuite
MoneyTestCase
DatabaseTestSuite
ConnectionTestCase
TransactionTestCase
LoadTestSuite (Performance and Scalability Tests)
DatabaseTestSuite
ConnectionPoolTestCase
ThreadPoolTestCase
Testing Idioms
Keep the following things in mind when writing JUnit tests:
-
The software does well those things that the tests check.
-
Test a little, code a little, test a little, code a little...
-
Make sure all tests always run at 100%.
-
Run all the tests in the system at least once per day (or night).
-
Write tests for the areas of code with the highest probability of breakage.
-
Write tests that have the highest possible return on your testing investment.
-
If you find yourself debugging using
System.out.println(), write a test to automatically check the result instead. -
When a bug is reported, write a test to expose the bug.
-
The next time someone asks you for help debugging, help them write a test.
-
Write unit tests before writing the code and only write new code when a test is failing.
Training
Reduce defects and improve design and code quality with a two-day, on-site Test-Driven Development with JUnit Workshop that quickly spreads the testing bug throughout your team.
Resources
- Source Code - Complete source code for the ShoppingCartTest example
- JUnit - The official JUnit website
- JUnit FAQ - Frequently asked questions and answers
- A Dozen Ways to Get the Testing Bug by Mike Clark (java.net, 2004)
- Pragmatic Unit Testing by Andy Hunt and Dave Thomas (The Pragmatic Programmers, 2003)
