L.O.B.S.T.E.R.

Lightweight Open BMW Software Traceability Evidence Report
!

Overview

Coverage

Category Ratio Coverage OK Items Total Items
Use Cases 0.0% 0.00% 0 6
Potential Errors 100.0% 100.00% 7 7
Test Specifications 100.0% 100.00% 4 4
System Requirements 0.0% 0.00% 0 5
Software Requirements 0.0% 0.00% 0 0
Code 0.0% 0.00% 0 10
System Tests 93.8% 93.75% 15 16
Software Tests 0.0% 0.00% 0 3

Tracing policy

LOBSTER Tracing Policy n_1cf7e301510c711b73d2b182b9dcf084 Use Cases n_8a4b9a55ec70e0ca32d3abcc64ac6879 Potential Errors n_1cf7e301510c711b73d2b182b9dcf084->n_8a4b9a55ec70e0ca32d3abcc64ac6879 n_419cfc02b324dc7d8faefa90ed608fb0 System Requirements n_1cf7e301510c711b73d2b182b9dcf084->n_419cfc02b324dc7d8faefa90ed608fb0 n_eeb09e7009c699f439a0daadf03458e7 Test Specifications n_8a4b9a55ec70e0ca32d3abcc64ac6879->n_eeb09e7009c699f439a0daadf03458e7 n_3f7ae1d4bec7e6d318ef39c7a7dcaa65 System Tests n_eeb09e7009c699f439a0daadf03458e7->n_3f7ae1d4bec7e6d318ef39c7a7dcaa65 n_9d273bd32c1fceb91b7d6a4d40e98bdd Software Requirements n_419cfc02b324dc7d8faefa90ed608fb0->n_9d273bd32c1fceb91b7d6a4d40e98bdd n_419cfc02b324dc7d8faefa90ed608fb0->n_3f7ae1d4bec7e6d318ef39c7a7dcaa65 n_ca0dbad92a874b2f69b549293387925e Code n_9d273bd32c1fceb91b7d6a4d40e98bdd->n_ca0dbad92a874b2f69b549293387925e n_c4738e043501e27ee3ef08d6a4883d27 Software Tests n_9d273bd32c1fceb91b7d6a4d40e98bdd->n_c4738e043501e27ee3ef08d6a4883d27

Filtering

Item Filters

Show Issues

Filter

Issues

Detailed report

Requirements and Specification

Use Cases

lobster/use_cases.trlc
TRLC Usecase UseCases.List_Requirements_to_Tests
As a requirements manager I want the traceability report to show the list of
requirements which are covered by tests.
Traces to:
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Usecase UseCases.List_Requirements_without_Tests
As a requirements manager I want the traceability report to show the list of
requirements which are not covered by tests.
Traces to:
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Usecase UseCases.List_Tests_to_Requirements
As a requirements manager I want the traceability report to show the list of
tests covering requirements.
Traces to:
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Usecase UseCases.List_Tests_without_Requirements
As a requirements manager I want the traceability report to show the list of
tests which are not covering any requirement.
Traces to:
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Usecase UseCases.Item_Coverage
As a requirements manager I want the traceability report to show the fraction of
the number of items in one level (of the tracing policy)
which fulfill the tracing policy,
divided by the total number of items in that level (of the tracing policy).
The fraction shall be shown as percentage.

Example:
If the tracing policy is: Tests --(trace to)--> Requirements,
then the report shall show the fraction of requirements which are covered by at
least one test, divided by the total number of requirements.
Traces to:
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Usecase UseCases.PKG_Misplaced_Trace_Warning
As a requirements manager I want lobster-pkg to print a warning
for lobster-traces in <DESCRIPTION> and <VALUE> nodes
which are not extracted (due to wrong XML node or path properties).
Traces to:
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

Potential Errors

lobster/tools/pkg/requirements/potential_errors.trlc
TRLC Potentialerror UseCases.Invalid_XML_Ignored
If at least one input file is invalid XML, the tool might ignore this fact
and continue processing the other files.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Potentialerror UseCases.Default_Path_Choice_pkg
If no input files are specified, the tool might inadvertently use the current
working directory (or any other default value for these configuration parameters)
as the location to search for input files.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Potentialerror UseCases.Wrong_Extraction_from_PKG
The data of the items in the output file is not consistent with the data in the input files.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Potentialerror UseCases.Too_many_PKG_files
Some non-relevant *.pkg files or *.ta files are consumed.
For example, some items are extracted from files which are not specified as input
by the user (but which could be found in the same folder as the specified input
files).
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Potentialerror UseCases.Too_many_Output_Items
The tool creates fake output items, which do not correspond to any real input
items.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Potentialerror UseCases.Too_few_Extraction_from_PKG
Some items are not extracted from input files.
For example, there are 100 applicable items in the input files but
the tool extracts only 42 items.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Potentialerror UseCases.No_Warning_for_Misplaced_Trace
No warning is issued for lobster-traces which do not fulfill the conditions
of the requirements [[Trace_in_Test_Step_Node]] and [[Trace_in_Analysis_Node]].
Traces to:
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

Test Specifications

lobster/tools/pkg/requirements/test_specifications.trlc
TRLC Testspecification UseCases.PKG_Files_Missing
The test shall verify that the lobster-pkg tool exits with a non-zero return code when the pkg files do not exist.
Example: Verify that the lobster-pkg tool throws an error when a non-existent pkg file is provided.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Testspecification UseCases.PKG_Files_Invalid
The test shall verify that the lobster-pkg tool exits with a non-zero return code when the pkg/ta files are invalid XML.
Example: Verify that the lobster-pkg tool throws an error when an invalid pkg/ta file is provided.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC Testspecification UseCases.Warning_for_Misplaced_Trace
The test shall verify that the lobster-pkg tool does warn user about misplaced traces in pkg/ta files.
Example: Verify that the lobster-pkg tool processes pkg/ta files with misplaced traces and
that a warning is issued in the console output.

Test steps:
- Provide a PKG or TA XML file with <VALUE> or <DESCRIPTION> nodes containing "lobster-trace:REQUIREMENT_ID"
but placed outside the valid locations described in [[Trace_in_Test_Step_Node]] and [[Trace_in_Analysis_Node]].
- Run the tool and verify that a warning is printed for each misplaced tag, including location information.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

System Requirements

lobster/tools/pkg/requirements/extraction_rules.trlc
TRLC System_requirement req.Pkg_Invalid_Xml
IF at least one input file is invalid XML,
THEN the tool shall exit with non-zero return code.
Issues:
  • missing up reference
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC System_requirement req.Pkg_File_Item
The tool SHALL create a LOBSTER output item of type "Activity" for each input file
IF the file represents a test case, identified by having an <INFORMATION> node
with a <TITLE> child node containing the string "TESTCASE"
OR IF a lobster-trace is given in an ANALYSIS block
(details see [[Trace_in_Analysis_Node]]).

The following requirements describe how to fill the "refs" attribute of these
items.

Note: If no requirements is fulfilled, which describes how to fill the "refs" attribute,
then the item SHALL be created with an empty "refs" attribute.
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC System_requirement req.Trace_in_Test_Step_Node
Note: Pay attention to the difference between TESTSTEP and TESTSTEPS!

The tool SHALL extract all tags (marked by "lobster-trace") from <VALUE> nodes
from the specified input files
WHERE all of the following conditions apply:
- The file SHALL be a test case, identified by having an <INFORMATION> node
with a <TITLE> child node containing the string "TESTCASE".
- The <TESTSTEPS> node is of type "testCase".
- The <TESTSTEP> node is the first child node of a <TESTSTEPS> node.
- The <TESTSTEP> node is named "TsBlock".
- The <VALUE> node is nested inside a <TESTSTEP> node.
- The <VALUE> node contains one or more substrings in the format
"lobster-trace:<REQUIREMENT_ID>"
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC System_requirement req.Trace_in_Analysis_Node
The tool SHALL extract all tags (marked by "lobster-trace") from <DESCRIPTION> nodes
from the specified input files
WHERE all of the following conditions apply:
- The <ANALYSISITEM> node is a **direct** child node of a <TRACE-ANALYSIS> node.
- The <ANALYSISITEM> node is of type "episode".
- The <DESCRIPTION> node is a **direct** child node of an <ANALYSISITEM> node.
- The <DESCRIPTION> node contains the substring in the format
"lobster-trace:<REQUIREMENT_ID>"
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
TRLC System_requirement req.Misplaced_Traces
The tool SHALL print a warning for tags in <DESCRIPTION> and <VALUE> nodes
which do not match the conditions of the requirements
[[Trace_in_Test_Step_Node]] and [[Trace_in_Analysis_Node]].
Issues:
  • missing up reference
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

Software Requirements

No items recorded at this level.

Implementation

Code

lobster/tools/pkg/pkg.py
Python Function pkg.get_valid_files
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.write_to_file
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.create_raw_entry
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.create_default_activity
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.xml_parser
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.extract_lobster_traces_from_trace_analysis
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.lobster_pkg
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Constructor pkg.PkgTool.__init__
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Method pkg.PkgTool._run_impl
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
Python Function pkg.main
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

Verification and Validation

System Tests

tests_system/lobster_pkg/test_invalid_scenario.py
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_not_existing_pkg_file:13
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_missing_input_parameter:28
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_not_existing_output_path:39
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_misplaced_lobster_trace_file:54
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_misplaced_tags_file:74
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_invalid_xml_file:92
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_invalid_scenario.InvalidInputFilePkgTest.test_invalid_input_pkg_file_without_output_argument:111
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
tests_system/lobster_pkg/test_valid_scenario.py
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_input_pkg_file:15
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_input_ta_file:36
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_ta_file_with_misplaced_traces:56
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_pkg_file_with_misplaced_traces:83
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_input_pkg_files:110
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_input_file_and_extra_file:133
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_input_pkg_folder:157
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_file_without_lobster_trace:185
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_valid_scenario.InputFilePkgTest.test_valid_file_without_testcase_tag:205
Derived from:
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

Software Tests

tests_unit/lobster_pkg/test_pkg.py
PyUnit Test test_pkg.LobsterPkgTests.test_get_valid_files:35
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_pkg.LobsterPkgTests.test_lobster_pkg_functions_with_valid_xml_format:82
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC
PyUnit Test test_pkg.LobsterPkgTests.test_lobster_pkg_functions_with_invalid_xml_format:117
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2025-09-18 11:06:21+00:00 UTC

LOBSTER Version: 1.0.2