Timestamp associated with execution of the Test Step within a Test Run

Vishal Shanbhag
Vishal Shanbhag Member Posts: 3

Context: We have a set of test cases which have multiple test steps. Each of those individual test steps needs to be marked as a Pass/Fail when we execute the test run. 

Why we need to have a timestamp with each step execution in a test run: In the AV industry, while executing vehicle tests, we need to know the exact moment at which a step was executed in order to be able to trace back to that data for purpose of presenting a proof or for debugging. 

What currently exists:  The  test run has a date and a timestamp associated with it. 


Question: Does the step within a test run execution have an associated Date and Timestamp? If yes and not shown through the browser window, how can I access the date and timestamp associated with a Step within the Test Run.




------------------------------
Vishal Shanbhag
------------------------------

Comments

  • Ashley Ernst
    Ashley Ernst Jama Staff, Product Manager Moderator Posts: 45
    edited March 2023

    Hi Vishal, can you check out the activity and version widgets within the test run items and tell us if this has the appropriate level of detail for what you are looking for? The activity and version widgets must be enabled on the test run item by an Admin in order to see them on the item type. Each of these widgets have a different type of change log information. 

    ------------------------------
    Ashley Ernst
    CA
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 03-07-2023 11:47
    From: Vishal Shanbhag
    Subject: Timestamp associated with execution of the Test Step within a Test Run

    Context: We have a set of test cases which have multiple test steps. Each of those individual test steps needs to be marked as a Pass/Fail when we execute the test run. 

    Why we need to have a timestamp with each step execution in a test run: In the AV industry, while executing vehicle tests, we need to know the exact moment at which a step was executed in order to be able to trace back to that data for purpose of presenting a proof or for debugging. 

    What currently exists:  The  test run has a date and a timestamp associated with it. 


    Question: Does the step within a test run execution have an associated Date and Timestamp? If yes and not shown through the browser window, how can I access the date and timestamp associated with a Step within the Test Run.




    ------------------------------
    Vishal Shanbhag
    ------------------------------

    Ashley Ernst
    [Pronouns]
    Product Manager
    Jama Software
  • Vishal Shanbhag
    Vishal Shanbhag Member Posts: 3
    edited March 2023

    Hello Ashley, 
    Thank you for the response. I have admin rights and the activity widget is enabled for the Test Run item type as shown below in the screenshot.

    image

    I am able to see the changes to the test run attributes as shown below in the screnshoot 

    image
    Below is how the test run is defined (Test Run has multiple steps which are to be marked as a pass/fail individually when a test run is executed)
    image
    As you can see above, the test step 1 within the test run does not have a change log or a time at which it the status of the step 1 was changed from Not Run to Passed. How can I access the timestamp at which the test step status was changed?

    ------------------------------
    Vishal Shanbhag
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 03-22-2023 19:42
    From: Ashley Ernst
    Subject: Timestamp associated with execution of the Test Step within a Test Run

    Hi Vishal, can you check out the activity and version widgets within the test run items and tell us if this has the appropriate level of detail for what you are looking for? The activity and version widgets must be enabled on the test run item by an Admin in order to see them on the item type. Each of these widgets have a different type of change log information. 

    ------------------------------
    Ashley Ernst
    CA
    ------------------------------

    Original Message:
    Sent: 03-07-2023 11:47
    From: Vishal Shanbhag
    Subject: Timestamp associated with execution of the Test Step within a Test Run

    Context: We have a set of test cases which have multiple test steps. Each of those individual test steps needs to be marked as a Pass/Fail when we execute the test run. 

    Why we need to have a timestamp with each step execution in a test run: In the AV industry, while executing vehicle tests, we need to know the exact moment at which a step was executed in order to be able to trace back to that data for purpose of presenting a proof or for debugging. 

    What currently exists:  The  test run has a date and a timestamp associated with it. 


    Question: Does the step within a test run execution have an associated Date and Timestamp? If yes and not shown through the browser window, how can I access the date and timestamp associated with a Step within the Test Run.




    ------------------------------
    Vishal Shanbhag
    ------------------------------

  • Ashley Ernst
    Ashley Ernst Jama Staff, Product Manager Moderator Posts: 45
    edited April 2023

    Vishal, after further investigation, there is no place in the database that currently tracks changes per test step with a timestamp. As you've noticed, the system currently aggregates all changes to an item's version into one activity log only when the user hits 'save and close'. As of today, our product roadmap does not include plans to introduce timestamps at the individual step level.

    I did a quick search through our current user 'Product Ideas' in the Community's Product space and didn't find any existing ideas that resemble your usage scenario. You may add a new Idea so other users with similar process/usage needs may like and comment.  Our Product team regularly reviews these ideas to track which ideas gain traction across our user base.

    To add an Idea, navigate to the top of this page and click the 'Product' dropdown then select 'Ideation' from the available options. This will take you to the Product Ideation area of the Community site where you click 'Add' to create a new Idea where you can describe your process and usage scenario for the Product team and other users to review. 

    ------------------------------
    Ashley Ernst
    CA
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 03-22-2023 22:32
    From: Vishal Shanbhag
    Subject: Timestamp associated with execution of the Test Step within a Test Run

    Hello Ashley, 
    Thank you for the response. I have admin rights and the activity widget is enabled for the Test Run item type as shown below in the screenshot.

    image

    I am able to see the changes to the test run attributes as shown below in the screnshoot 

    image
    Below is how the test run is defined (Test Run has multiple steps which are to be marked as a pass/fail individually when a test run is executed)
    image
    As you can see above, the test step 1 within the test run does not have a change log or a time at which it the status of the step 1 was changed from Not Run to Passed. How can I access the timestamp at which the test step status was changed?

    ------------------------------
    Vishal Shanbhag
    ------------------------------

    Original Message:
    Sent: 03-22-2023 19:42
    From: Ashley Ernst
    Subject: Timestamp associated with execution of the Test Step within a Test Run

    Hi Vishal, can you check out the activity and version widgets within the test run items and tell us if this has the appropriate level of detail for what you are looking for? The activity and version widgets must be enabled on the test run item by an Admin in order to see them on the item type. Each of these widgets have a different type of change log information. 

    ------------------------------
    Ashley Ernst
    CA

    Original Message:
    Sent: 03-07-2023 11:47
    From: Vishal Shanbhag
    Subject: Timestamp associated with execution of the Test Step within a Test Run

    Context: We have a set of test cases which have multiple test steps. Each of those individual test steps needs to be marked as a Pass/Fail when we execute the test run. 

    Why we need to have a timestamp with each step execution in a test run: In the AV industry, while executing vehicle tests, we need to know the exact moment at which a step was executed in order to be able to trace back to that data for purpose of presenting a proof or for debugging. 

    What currently exists:  The  test run has a date and a timestamp associated with it. 


    Question: Does the step within a test run execution have an associated Date and Timestamp? If yes and not shown through the browser window, how can I access the date and timestamp associated with a Step within the Test Run.




    ------------------------------
    Vishal Shanbhag
    ------------------------------

    Ashley Ernst
    [Pronouns]
    Product Manager
    Jama Software