🎉 VSEC Test v4.0.0 is now live! Release Notes ↗
Test Run

Test Run

A Test Run is the process of executing your defined tests. It involves running a selected Test Plan, which includes a collection of configured Test Cases, on a designated Bench and against the target. This action puts your test strategy into motion to verify the DUT’s behavior.

Test Run Queue
When multiple Test Runs are initiated, they are placed in a queue, ensuring that each run completes sequentially before the next one begins.
Downloadable Results
Test Run results are available for download as a report-style PDF and in a simple log format.

Executing a Test Run

  1. Sign-in to vsec.blockharbor.io

  2. Navigate to Test on the sidebar menu to enter the VSEC Test application and then select the Test Runs submenu.

  3. Click the Create Test Run button to open the prompt for creating a New Test Run.

  4. Fill out the required details to Create a Test Run.

    FieldRequirementDescription
    Bench *RequiredSelect the Bench to execute the testing through. This can be a physical Bench or a Simulation Bench.
    Test plan *RequiredSelect the Test Plan to execute.
    Test name *RequiredA unique, short descriptor (e.g., MY26 CAN Protocol Evaluation).
    DescriptionOptionalInternal notes or context regarding the purpose of this Test Run.
  5. Click the Create button to execute / queue the Test Run.

Running Tests on a Simulation Bench

Test Runs can be executed against a Simulation Bench instead of a physical Bench. Once selected, the Test Run executes the same way as on a physical Bench.

Not all Simulations support running Test Cases. The Bench select box only lists those that do.
  1. Click the Create Test Run button to open the prompt for creating a New Test Run.
  2. In the Bench select box, choose the desired Simulation (e.g., UDS and XCP Starter Challenge).
  3. Select the Test plan to execute.
  4. Specify a Test name.
  5. Click the Create button to execute / queue the Test Run.

A hourglass icon will show next to the Test Run when newly created and / or in queue.
A play icon will show next to the Test Run when actively executing.

Exporting Test Run Results

  1. Navigate to the Test Runs submenu.
  2. Select the desired Test Run by clicking the view icon ( ) on the corresponding row.
  3. Details and Test Case results will be displayed with a passed / failed / error status.
  4. Scroll to the bottom of the Test Run results and click one of these buttons to export:
    • DOWNLOAD LOG - A zip file showing details relating to any errors on the Test Cases (e.g., vehicle-my-2026_run.zip).
    • DOWNLOAD PDF - A report-style PDF with Pass / Fail stats and descriptions (e.g., vehicle-my-2026_report_3.pdf).
UNR 155 Reference
Where applicable, UNR 155 Cybersecurity Mitigations (Annex 5, Part B) will be provided.

Deleting Test Run Results

  1. Navigate to the Test Runs submenu.
  2. Click the trash can icon ( ) to delete the Test Run.
  3. A confirmation window will pop-up to confirm deletion. Click the Delete button to delete the Test Run.
ALERT: Deleted Test Runs cannot be restored
Last updated on