Structured testing in practice

Table of Contents

• 1 Introduction
• 2 General aspects of software development processes
  • 2.1 Software development models
    • 2.1.1 Waterfall-Model
    • 2.1.2 V-Model
    • 2.1.3 W-Model
    • 2.1.4 eXtreme Programming (XP)
    • 2.1.5 Conclusion
  • 2.2 Quality factors and approaches
    • 2.2.1 Capability Maturity Model Integration ® (CMMI)
    • 2.2.2 Testing Maturity Model (TMMsm)
    • 2.2.3 Test Process Improvement Ⓡ (TPI)
    • 2.2.4 Comparison of TMM and TPI
    • 2.2.5 Conclusion
• 3 Testing specific aspects of software development processes
  • 3.1 The objectives and limits of testing
  • 3.2 The Test plan
    • 3.2.1 Strategical parts of the test plan
  • 3.3 Test plan defined in IEEE 829
    • 3.3.1 Test plan identifier
    • 3.3.2 Introduction
    • 3.3.3 Test items
    • 3.3.4 Features to be tested
    • 3.3.5 Features not to be tested
    • 3.3.6 Approach
    • 3.3.7 Item pass/fail criteria
    • 3.3.8 Suspension criteria and resumption requirements
    • 3.3.9 Test deliverables
    • 3.3.10 Testing tasks
    • 3.3.11 Environmental needs
    • 3.3.12 Responsibilities
    • 3.3.13 Staffing and training needs
    • 3.3.14 Schedule
    • 3.3.15 Risks and contingencies
    • 3.3.16 Approvals
• 4 Concrete implementation of structured testing in a company
  • 4.1 The starting point
  • 4.2 Analysis of the current test activities
    • 4.2.1 Test maturity matrix of testing at the starting point
  • 4.3 The way to structured testing
    • 4.3.1 The Test Browser
    • 4.3.2 Storage management
    • 4.3.3 Archiving process
    • 4.3.4 Test automation
    • 4.3.5 Test database
    • 4.3.6 Build management
    • 4.3.7 QaTraq A web based software test case management tool
  • 4.4 Conclusion

Objectives and Key Themes

This thesis examines the implementation of a structured software testing process as an integral part of the software development lifecycle. The work delves into established models from software development, quality assurance, and software testing, exploring their practical application. It then presents a concrete framework for automated test execution, test results processing, data archiving, and web-based test data management, culminating in a case study demonstrating the successful implementation of this framework within a software company.

• Structured software testing as an integrated part of the software development lifecycle
• The utilization of established models from software development, quality assurance, and software testing
• A framework for automated test execution, test results processing, data archiving, and web-based test data management
• Case study demonstrating the successful implementation of the framework within a software company
• Measurable quality improvement of the test process through the framework's introduction

Chapter Summaries

• Chapter 1 provides an introduction to the subject matter and sets the context for the subsequent chapters. It highlights the importance of software testing within the rapidly growing IT industry.
• Chapter 2 delves into the general aspects of software development processes, exploring various software development models such as Waterfall, V-Model, W-Model, and eXtreme Programming. It also discusses different quality factors and approaches, including the Capability Maturity Model Integration (CMMI), Testing Maturity Model (TMMsm), and Test Process Improvement (TPI).
• Chapter 3 focuses on testing-specific aspects of software development processes, addressing the objectives and limits of testing. It introduces the Test Plan and examines its strategic parts, particularly within the context of IEEE 829 standards.
• Chapter 4 presents the concrete implementation of structured testing within a company. This chapter examines the initial situation, analyzes the current test activities, and outlines the steps taken towards structured testing. It highlights key components of the implemented framework, including the Test Browser, storage management, archiving processes, test automation, test database, build management, and the QaTraq web-based software test case management tool.

Keywords

This work focuses on structured software testing, software development lifecycle, quality assurance, test automation, test data management, and the practical implementation of established models within a company. It also incorporates concepts from software development models such as Waterfall, V-Model, W-Model, and eXtreme Programming, as well as quality models such as CMMI, TMMsm, and TPI. The thesis utilizes a case study to illustrate the successful implementation of a structured testing framework within a software company, showcasing measurable improvements in quality.