L.O.B.S.T.E.R.

Lightweight Open BMW Software Traceability Evidence Report
!

Overview

Coverage

Category Ratio Coverage OK Items Total Items
System Requirements 66.7% 66.67% 2 3
Software Requirements 0.0% 0.00% 0 2
Code 0.0% 0.00% 0 32
System Test 6.2% 6.25% 1 16
Software Test 0.0% 0.00% 0 11

Tracing policy

LOBSTER Tracing Policy n_419cfc02b324dc7d8faefa90ed608fb0 System Requirements n_9339073f2b1d4621f57a8ee62d17fd72 System Test n_419cfc02b324dc7d8faefa90ed608fb0->n_9339073f2b1d4621f57a8ee62d17fd72 n_9d273bd32c1fceb91b7d6a4d40e98bdd Software Requirements n_ca0dbad92a874b2f69b549293387925e Code n_9d273bd32c1fceb91b7d6a4d40e98bdd->n_ca0dbad92a874b2f69b549293387925e n_bda6d4a6de3ca38ea829d2d19cbb418c Software Test n_9d273bd32c1fceb91b7d6a4d40e98bdd->n_bda6d4a6de3ca38ea829d2d19cbb418c

Filtering

Item Filters

Show Issues

Filter

Issues

Detailed report

Requirements and Specification

System Requirements

lobster/tools/cpptest/input_files.trlc
TRLC System_requirement cpptest_req.Input_File
IF a list element given through the yaml config file option "files" is a file
Issues:
  • missing reference to System Test
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
TRLC System_requirement_aspect cpptest_req.Input_File_Valid_Cpp_Test_File
AND IF the file content is valid,
THEN the tool shall write the output in the LOBSTER interchange format to the file given in the out parameter
AND exit with a zero return code.
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
TRLC System_requirement_aspect cpptest_req.Input_File_Invalid_Cpp_Test_File
OTHERWISE IF the file content is invalid,
THEN the tool shall write an error message to stderr
AND exit with a non-zero return code.
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC

Software Requirements

lobster/tools/cpptest/requirements.trlc
TRLC Software_requirement cpptest_req.Dummy_Requirement
This is not really a requirement. It will be used only to generate a minimal tracing report for each tool.
It can be deleted as soon as all the tools get their real requirements.
Issues:
  • missing reference to Code
  • missing reference to Software Test
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
TRLC Software_requirement cpptest_req.Dummy_Requirement_Unit_Test
This is not really a requirement. It will be used only to generate a minimal tracing report for each tool.
It can be deleted as soon as all the tools get their real requirements.
Issues:
  • missing reference to Code
  • missing reference to Software Test
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC

Implementation

Code

lobster/tools/cpptest/cpptest.py
Python Function cpptest.parse_config_file
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Function cpptest.get_test_file_list
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Function cpptest.collect_test_cases_from_test_files
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Function cpptest.create_lobster_items_output_dict_from_test_cases
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Function cpptest.write_lobster_items_output_dict
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Function cpptest.lobster_cpptest
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Constructor cpptest.CppTestTool.__init__
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method cpptest.CppTestTool._run_impl
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Function cpptest.main
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
lobster/tools/cpptest/parser/constants.py
Python Constructor constants.Constants.__init__
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
lobster/tools/cpptest/parser/requirements_parser.py
Python Method requirements_parser.ParserForRequirements.collect_test_cases_for_test_files
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method requirements_parser.ParserForRequirements.collect_test_cases
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
lobster/tools/cpptest/parser/test_case.py
Python Constructor test_case.TestCase.__init__
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._set_test_details
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._definition_end
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._set_test_and_suite_name
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._set_base_attributes
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._get_requirements_from_docu_lines
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._get_testmethod_tag
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._get_version_tag
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._add_multiline_attribute
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.is_line_commented
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.has_no_macro_or_commented
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.has_no_macro_or_commented_general
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.is_special_case
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.try_parse
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.try_parse_general
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._get_uri_from_requirement_detection
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._add_new_requirement_to_requirement_list
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase._get_require_tags
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.notracing_special_case
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
Python Method test_case.TestCase.get_range_for_doxygen_comments
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC

Verification and Validation

System Test

tests_system/lobster_cpptest/test_config_exceptions.py
PyUnit Test test_config_exceptions.ConfigParserExceptionsCpptestTest.test_missing_config_file:12
Issues:
  • unknown tracing target req UseCases.Config_File_Missing
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_config_exceptions.ConfigParserExceptionsCpptestTest.test_config_file_errors:28
Derived from:
Issues:
  • unknown tracing target req UseCases.Config_File_Key_Error
  • unknown tracing target req UseCases.Config_File_Syntax_Error
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
tests_system/lobster_cpptest/test_directories.py
PyUnit Test test_directories.DirectoriesCpptestTest.test_all_files_from_current_directory_consumed:14
Issues:
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_directories.DirectoriesCpptestTest.test_files_from_specified_directory_consumed:50
Issues:
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_directories.DirectoriesCpptestTest.test_specified_directory_and_files_consumed:80
Issues:
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_directories.DirectoriesCpptestTest.test_no_cpptest_file:113
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
tests_system/lobster_cpptest/test_extension.py
PyUnit Test test_extension.ExtensionCpptestTest.test_valid_extension_file:15
Issues:
  • unknown tracing target req Usecases.Incorrect_number_of_requirement_references_in_Output
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_extension.ExtensionCpptestTest.test_invalid_extension_file:42
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_extension.ExtensionCpptestTest.test_no_input_file:67
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
tests_system/lobster_cpptest/test_multiple_files.py
PyUnit Test test_multiple_files.MultipleFilesCpptestTest.test_multiple_files:15
Issues:
  • unknown tracing target req Usecases.Incorrect_number_of_requirement_references_in_Output
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_multiple_files.MultipleFilesCpptestTest.test_multiple_valid_invalid_files:50
Issues:
  • unknown tracing target req Usecases.Incorrect_number_of_requirement_references_in_Output
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_multiple_files.MultipleFilesCpptestTest.test_no_input_file:85
Issues:
  • unknown tracing target req Usecases.Incorrect_Number_of_Cpp_Tests_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
tests_system/lobster_cpptest/test_references.py
PyUnit Test test_references.ReferencesCpptestTest.test_no_references_cpptest_file:15
Issues:
  • unknown tracing target req UseCases.Incorrect_number_of_requirement_references_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_references.ReferencesCpptestTest.test_one_reference_in_cpptest_file:39
Issues:
  • unknown tracing target req UseCases.Incorrect_number_of_requirement_references_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_references.ReferencesCpptestTest.test_many_references_in_cpptest_file:63
Issues:
  • unknown tracing target req UseCases.Incorrect_number_of_requirement_references_in_Output
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
tests_system/lobster_cpptest/test_valid_scenario.py
PyUnit Test test_valid_scenario.InputFileCpptestTest.test_valid_input_cpptest_file:14
Derived from:
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC

Software Test

tests_unit/lobster_cpptest/test_cpptest.py
PyUnit Test test_cpptest.LobsterCpptestTests.test_collect_test_cases_from_test_files:57
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_parse_config_file_with_two_markers_for_two_outputs:71
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_parse_config_file_with_two_markers_for_one_output:121
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_get_test_file_list:153
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_get_test_file_list_no_file_with_matching_extension:168
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_get_test_file_list_not_existing_file_dir:184
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_single_file:200
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_single_directory:236
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_not_existing_file_dir:263
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_separate_output_config:294
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC
PyUnit Test test_cpptest.LobsterCpptestTests.test_test_case_parsing:395
Issues:
  • missing up reference
Build Reference: f8fd7fec387000b9da849c4c0ec20550b9334106 | Timestamp: 2025-08-05 14:16:58+00:00 UTC