L.O.B.S.T.E.R.

Lightweight Open BMW Software Traceability Evidence Report
✔ !

Overview

Coverage

Category Ratio Coverage OK Items Total Items
Use Cases 75.0% 75.00% 12 16
System Requirements 5.9% 5.88% 1 17
Software Requirements 0.0% 0.00% 0 2
System Tests 87.5% 87.50% 14 16
Software Tests 0.0% 0.00% 0 5

Tracing policy

LOBSTER Tracing Policy n_1cf7e301510c711b73d2b182b9dcf084 Use Cases n_419cfc02b324dc7d8faefa90ed608fb0 System Requirements n_1cf7e301510c711b73d2b182b9dcf084->n_419cfc02b324dc7d8faefa90ed608fb0 n_9d273bd32c1fceb91b7d6a4d40e98bdd Software Requirements n_419cfc02b324dc7d8faefa90ed608fb0->n_9d273bd32c1fceb91b7d6a4d40e98bdd n_3f7ae1d4bec7e6d318ef39c7a7dcaa65 System Tests n_419cfc02b324dc7d8faefa90ed608fb0->n_3f7ae1d4bec7e6d318ef39c7a7dcaa65 n_c4738e043501e27ee3ef08d6a4883d27 Software Tests n_9d273bd32c1fceb91b7d6a4d40e98bdd->n_c4738e043501e27ee3ef08d6a4883d27

Filtering

Item Filters

Show Issues

Filter

Issues

Detailed report

Requirements and Specification

Use Cases

lobster/use_cases.trlc
TRLC Usecase UseCases.List_Ok_Items
As a traceability manager I want the traceability report to list items that
fulfill the tracing policy, and how they do so,
so that I can decide whether to release my product.

Example:
If the tracing policy is: Tests --(trace to)--> Requirements,
then the report shall list all tests that link to at least one requirement,
and the report shall list all linked requirements per test.

The use case applies to the reverse direction as well.
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.List_Not_Ok_Items
As a traceability manager I want the traceability report to list items that
are not covered by other items, where coverage rules are specified by the
tracing policy,
so that I can identify gaps in the coverage.

Example:
If the tracing policy is: Tests --(trace to)--> Requirements,
then the report shall list all tests that do not link to any requirement.

The use case applies to the reverse direction as well.
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Item_Coverage
As a traceability manager I want the traceability report to show the fraction
of the number of items in one level (of the tracing policy)
which fulfill the tracing policy,
divided by the total number of items in that level (of the tracing policy).
The fraction shall be shown as percentage.

Example:
If the tracing policy is: Tests --(trace to)--> Requirements,
then the report shall show the fraction of requirements which are covered by at
least one test, divided by the total number of requirements.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.List_Requirements_to_Tests
As a requirements manager I want the traceability report to show the list of
requirements which are covered by tests.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.List_Requirements_without_Tests
As a requirements manager I want the traceability report to show the list of
requirements which are not covered by tests.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.List_Tests_to_Requirements
As a requirements manager I want the traceability report to show the list of
tests covering requirements.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.List_Tests_without_Requirements
As a requirements manager I want the traceability report to show the list of
tests which are not covering any requirement.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Show_Tracing_Policy
As a requirements manager I want the traceability report to show the tracing
policy used to generate the report.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Show_codebeamer_links
As a requirements manager I want the traceability report to mention the
codebeamer link to each requirement in codebeamer.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Item_GitHub_Source
As a requirements manager
I want the traceability report
to mention the GitHub location of each item which comes from a file inside a git
repository (hosted on my company's GitHub Enterprise server),
so that I can
- map the traceability report to a commit SHA, and
- easily navigate to the corresponding location.

The location shall include:
- the full URL including the git commit SHA,
- and the line number (if applicable).

Note:
- The assumption is that, the repository will be checked out locally by the user
or CI system, and the URL to the remote repository will be given as input to
the LOBSTER tool suite. That is, the tool suite does not have to detect the
commit SHA on its own.
- The line number is optional, because otherwise it is impossible to represent
files as a whole by a LOBSTER item.
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.HTML_Output
As a requirements manager I want to have the traceability report as a single
stand-alone HTML file.

Note: This simplifies any archiving process, because no additional CSS files or
alike are required.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.List_Findings
As a requirements manager I want the traceability report
to show a list with all findings
where the tracing policy is violated.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Failure_On_Invalid_Input
As a CI administrator
I want that the tool exits with a non-zero return code whenever it encounters
invalid input
so that the CI pipeline can catch invalid input automatically.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Tool_Usability
As a user of LOBSTER I want to have a good usability and standard
command-line ergonomics, like built-in help or automatic creation of output
destinations,
so that using the tools is intuitive and seamless in scripts and interactive
use.
Traces to:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.Colored_Findings
As a requirements manager I want the traceability report
to highlight the missing traces and detected traces in different color.
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Usecase UseCases.English_Language
As a requirements manager I want the traceability report
to be generated in English language.
Issues:
  • missing reference to System Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC

System Requirements

lobster/tools/core/html_report/requirements/git_information.trlc
TRLC System_requirement html_req.HTML_Report_Displays_Git_Commit_Information
When an item in the input report has a Git commit identifier whose metadata
is available, the generated HTML report shall display that identifier as
the build reference and display the commit's committer timestamp queried
from Git, converted to UTC.

Note: The committer timestamp records when this commit object was created
and may differ from the author timestamp, which records when the changes
were originally authored.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
lobster/tools/core/html_report/requirements/github_source_links.trlc
TRLC System_requirement html_req.HTML_Report_Renders_GitHub_Source_Links
For every item in the input report whose source location is a GitHub
reference, the generated HTML report shall render the source location as
a hyperlink that opens in a new tab.

The hyperlink destination shall be
"{gh_root}/blob/{commit}/{filename}" when no source line is provided,
and "{gh_root}/blob/{commit}/{filename}#L{line}" when a source line is
provided. The hyperlink text shall be "{filename}" when no source line
is provided, and "{filename}:{line}" when a source line is provided.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
lobster/tools/core/html_report/requirements/html_report_content.trlc
TRLC System_requirement html_req.HTML_Report_Uses_Valid_HTML_Syntax
The tool shall generate an HTML report that adheres to valid HTML syntax.
Derived from:
Issues:
  • missing reference to Software Requirements
  • missing reference to System Tests
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Meta_Tag_In_Html_Report
The HTML output file shall contain the meta tag
with attributes "http-equiv" and "content".
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Item_Data_Unique
The tool shall print all items from the input file into the HTML output file,
including their carried data.
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Tracing_Policy_Image
IF the tool "dot" is available,
THEN the tool shall include a visualization of the tracing policy
in the HTML report.
Derived from:
Issues:
  • missing reference to Software Requirements
  • missing reference to System Tests
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Only_Given_Input_File_Consumed
IF the tool is invoked with an explicit input ".lobster" file
THEN the tool shall generate the HTML report from that file.
OTHERWISE the tool shall use a default "report.lobster" input file name.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Processing_Data_With_Justifications
IF the input data contains items with justifications,
THEN the tool shall process the justifications correctly,
AND shall display the content according to the justifications in the HTML report.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.HTML_Report_Lists_Lobster_Items
IF a LOBSTER report contains items,
THEN the generated HTML file shall display those items and their associated
traceability information.
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.HTML_Report_Displays_Findings_Per_Item
IF an item in the LOBSTER report has one or more findings or tracing messages,
THEN the generated HTML file shall display those findings for that item.
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.HTML_Report_Displays_Coverage_Value
The generated HTML file shall display the coverage value for each level.
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
lobster/tools/core/html_report/requirements/input_file.trlc
TRLC System_requirement html_req.Missing_Lobster_File
IF the input .lobster file does not exist or is missing,
THEN the tool shall exit with a non-zero return code (2)
AND shall print an error message to STDERR indicating that the specified file is not a valid file.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Valid_Lobster_File
IF a valid .lobster file is provided as input
AND the command line argument "--out" is provided,
THEN the tool shall write a valid HTML report to the specified output file.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.Valid_Lobster_File_With_Md_Content
IF the conditions of [[Valid_Lobster_File]] are given
AND the command line argument "--render-md" is provided,
THEN the tool shall interpret the text property of every LOBSTER item as Markdown
and render it accordingly as HTML in the generated report.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement html_req.HTML_Report_Displays_Custom_data
IF a valid .lobster file containing a "custom_data" field
THEN the tool shall extract these values from the file
AND shall render them in the top-right corner of the generated HTML report.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
lobster/tools/core/html_report/requirements/requirements.trlc
TRLC System_requirement core_html_report_req.Clickable_Codebeamer_Item
If the input LOBSTER report file contains codebeamer items
THEN the generated HTML report
SHALL represent these as hyperlinks to the item on the codebeamer server,
where the codebeamer server URL is taken from the repo_root configuration parameter.
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC System_requirement core_html_report_req.Codebeamer_Item_Name
If the input LOBSTER report file contains codebeamer items
THEN the generated HTML report
SHALL represent these by their codebeamer item name, if it is given.
Derived from:
Issues:
  • missing reference to Software Requirements
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC

Software Requirements

TRLC Software_requirement core_html_report_req.Codebeamer_URL
The "to_html" method of the Codebeamer_Reference class
SHALL return a string representation of an HTML anchor element
to the codebeamer item by constructing the URL as follows:

"<repo_roo>/issue/<item_id><version_addon>"

where <repo_root> is taken from the configuration file,
and <item_id> is the codebeamer item ID taken from the LOBSTER input file,
and <version_addon> is "?version=<version>"
IF the version number of the codebeamer item is given,
OTHERWISE <version_addon> is an empty string.
Derived from:
Issues:
  • missing reference to Software Tests
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
TRLC Software_requirement core_html_report_req.Codebeamer_Item_as_String
The "to_string" method of the Codebeamer_Reference class
SHALL return the following string:

"cb item <ITEM_ID> '<NAME>'"

where <ITEM_ID> is the codebeamer item ID
and <NAME> the codebeamer item name given to the class constructor.
Issues:
  • missing up reference
  • missing reference to Software Tests
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC

Implementation

Verification and Validation

System Tests

tests_system/lobster_html_report/test_html_content.py
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_item_unique_data:36
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_complex_tracing_policy_data:76
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_multiple_input_files_in_working_directory:115
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_html_content_with_multiple_status:158
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_codebeamer_links:200
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_message_in_item:239
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_content.LobsterHtmlReportcontentTest.test_text_in_html_report:279
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
tests_system/lobster_html_report/test_html_report.py
PyUnit Test test_html_report.LobsterUIReportTests.test_show_issue_button:49
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterUIReportTests.test_status_buttons:90
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterUIReportTests.test_git_hash_timestamp:131
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterUIReportTests.test_meta_tag:162
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
tests_system/lobster_html_report/test_input_file.py
PyUnit Test test_input_file.LobsterHtmlReportInputFileTest.test_lobster_file_is_missing:36
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_input_file.LobsterHtmlReportInputFileTest.test_valid_lobster_file_succeeds:56
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_input_file.LobsterHtmlReportInputFileTest.test_custom_data_displayed_in_report:92
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_input_file.LobsterHtmlReportInputFileTest.test_valid_md_lobster_file_succeeds:130
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
tests_system/lobster_html_report/test_online_report_input.py
PyUnit Test test_online_report_input.LobsterOnlineReportInputTest.test_online_report_input:36
Derived from:
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC

Software Tests

tests_unit/lobster_html_report/test_html_report.py
PyUnit Test test_html_report.LobsterHtmlReportTests.test_timestamp_found_in_main_repo:27
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterHtmlReportTests.test_timestamp_unknown_commit:41
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterHtmlReportTests.test_timestamp_found_in_submodule:47
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterHtmlReportTests.test_name_hash_returns_expected_md5_hash:55
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC
PyUnit Test test_html_report.LobsterHtmlReportTests.test_name_hash_returns_different_hashes_for_different_inputs:68
Issues:
  • missing up reference
Build Reference: main | Timestamp: 2026-10-19 07:48:19+00:00 UTC

LOBSTER Version: 1.1.0-dev