Checklist
2003-02-26 16:26:53 GMT
To all members,
I am looking for a java testing tool. So far I have heard great feedback for JUnit testing. Below is a checklist. How would you rank this product? Feel free to comment.
1. How easy is the tool for you maintenance testers to use?
2. Is it something that can be picked up quickly, or is a lot of training required?
3. Do any of the team members already have experience using the maintenance tool?
4. If training is necessary, are classes, books, or other forms of instruction available?
5. Will the maintenance tool work effectively on the computer system currently in place?
6. Or are memory, faster, processors, etc., going to be needed?
7. Is the maintenance tool itself easy to use?
8. Does it have a user-friendly interface?
9. Is it prone to user error?
10. Is the tool physically capable of testing you application? Many maintenance tools can only test in a non-GUI environment, while others in GUI environments.
11. Can the maintenance tool handle full project testing? That is, is it able to run hundreds if not thousands of test cases for extended periods of time?
12. Can the tool run for long periods of time without crashing, or is the tool itself full of bugs?
13. Talk to customers who currently us or have previously used the maintenance tool. Did it meet their needs?
14. How similar were their testing needs to yours and how well did the maintenance tool perform?
15. Try to select a maintenance tool that is advanced enough so the costs of updating tests don't overwhelm any benefits.
16. If a demo version is available, try it out before you make any decisions.
17. Does the price of the maintenance tool meet the requirements of the company maintenance and testing methodology?
18. Does the price of the maintenance tool fit the QA Department or company budget?
19. If required, does the tool cover black-box and white-box features?
20. Does the tool handle problem tracking effectively?
21. Does the tool automatically correlate a defect to a test case for regression testing?
22. Does the test library management system handle change control, version control, and configuration?
23. Does the tool capture metric information?
24. Does the tool provide management reporting and historical trends?
c
RSS Feed