Test Management Archives

Tag Archive for: Test Management

No organization can thrive for nearly 70 years without evolving its processes, and Finnish Red Cross Blood Service (FRCBS) is no exception. The FRCBS’s Vein-to-Vein project is a prime example of how the organization has evolved to meet the digital age in order to provide the best care possible for those in need.

In 2016, FRCBS began to build the Vein-to-Vein system, a new information system for blood supply chain that covers blood donation and blood product manufacture, storage, and delivery to hospitals nationwide. Blood test results are also integrated into the information system. For the Vein-to-Vein information system project to be successful, data on blood products must work together seamlessly and the chain of data must remain unbroken, making the need for end-to-end traceability an incredibly important component.

This was one of many reasons the FRCBS began their search for a requirements and test management solution that could help them manage the complexity of the project. Their current test management solution, a pieced together system of Microsoft Excel and Microsoft Word documents, could not link risks and requirements to testing. Traceability was lacking, and the team knew the project’s success hinged on a solution that could clearly trace stakeholder requirements through testing, verification, and validation.

Like most organizations in 2020, FRCBS are working remotely throughout the country. Communication and collaboration were top priorities for the team. They knew that version control and review cycles would be compromised if they continued to use Excel and Word for their requirements and test management.

With the Vein-to-Vein information system, we are building the foundation for the digital future of the blood supply chain. It was abundantly clear to us that Word and Excel could not handle the amount of test cases and plans this project required.”

– Susanna Pöhö Development Manager, Digital Services at FRCBS

Finnish Red Cross Blood Services Sees Improved Traceability, Communication, and Collaboration

In June of 2018 FRCBS began onboarding Jama Connect and with the help of CGI Finland — and Jama Software’s easy-to-use platform — they were up and running in 6 months. The FRCBS now uses Jama Connect for testing and risk management.

FRCBS estimates that the testing team has improved their communication and collaboration by 50%, and with the improved communication, the team estimates that their review cycles have been shortened by 80%.

“With Jama Connect, we can link high-level system requirements and risks and test cases. Jama Connect makes it possible to ensure the test cases cover the entire information system, and nothing is being overlooked.”

– Susanna Majuri, System Specialist at FRCBS

Jama Connect has enabled improved end-to-end traceability and test management and allowed the teams to put more efficient processes in place. Because of Jama Connect, FRCBS estimates that the testing team has improved their communication and collaboration by 50%, and with the improved communication, the team estimates that their review cycles have been shortened by 80%.

Audit Preparation Simplified and Shortened

While the system is not technically a CE-marked medical device, the Vein-to-Vein system must meet high quality standards, including GxP quality guidelines and other key regulations. Jama Connect has allowed them to easily demonstrate compliance in a digital format. The FRCBS team estimates that Jama Connect has helped reduce audit preparation time by more than 50%.

“Jama Connect plays a central role in our audit process. We’re able to easily show executed tests, and the whole hierarchy of high-level system requirements, risks, test cases, and scenarios,” said Pöhö.

Finnish Red Cross’ Digital Future with Jama Connect

As the Finnish Red Cross organization continues its efforts to digitize development projects, FRCBS sets a great example with their implementation of Jama Connect.

“We implemented Jama Connect in the middle of large-scale information system project. Our only regret is that we didn’t implement it sooner in the project so we could leverage Jama Connect’s full capabilities,” said Pöhö. “In the future, it will be easier once we widen the range of usage across the organization.” “We’d like to broaden our use of Jama Connect across the company, especially for testing and validation. It’s a new, modern way of working that’s improved our processes immensely,” said Pöhö.

To see more information about the importance of traceability in complex product development, we’ve compiled a handy list of valuable resources for you!

SEE MORE RESOURCES

Companies are facing immense pressure to deliver complex products to market faster while balancing rigorous safety standard compliance with standards like ISO 26262 in the automotive industry and DO-178C in aerospace.

Testing plays a key role in the successful development of safety-critical systems. However, many organizations still perform testing manually which can lead to the introduction of errors, inconsistencies in code analysis, delays in project timelines, and increased chances of recalls or failure to meet safety standard compliance.

Teams and managers need to feel audit-ready and confident they are meeting the objectives in these standards. Execution teams need the flexibility to work in their preferred tools to maintain efficiency. Striking the right balance is crucial.

On January 15th, we teamed up with Liverpool Data Research Associates (LDRA) for a webinar discussing how — through a direct integration between the Jama Connect™ and LDRA tool suites — organizations can better strike this balance.

Watch the full webinar here or read the highlights below.

Integrating Jama Connect & LDRA for Increased Confidence

Jama Connect makes it easy for teams to define, align, and execute on requirements (high level to low level), tests and other assets across the product development lifecycle. Jama Connect’s built-in traceability can help organizations identify coverage gaps in the product development process. Jama Connect’s Test Management Center supports workflows for manual testing enabling engineering and quality assurance teams to organize and execute requirements-based test plans and test cases to ensure quality and compliance. As products become more complex and automation becomes required, Jama Connect integrates to automated testing tools to support a cost-effective, scalable, and flexible solution

The LDRA tool suite specializes in automated software verification, including the analysis of standards compliance and of structural coverage. The LDRA tool suite can run unit tests, dynamic tests, and static code analysis on embedded software code used to power complex products and systems in regulated industries.

Automated Testing is now commonplace, not only in the unregulated software space, but in safety critical products and systems as well. Manual testing simply will not scale as products become more complex with embedded software. These automated tests and results of automated test runs need to be traced to requirements for compliance and safety reasons.

Through an integration between Jama Connect and LDRA, organizations can combine the strengths of a market leading, fit-for-purpose requirements management tool and a powerful, automated testing tool.

Driving Value

But why integrate? What value does this bring to organizations and teams?

Firstly, by integrating these tools, teams gain efficiency. This integration removes manual export/import processes that waste time and can lead to errors. The nature of the integration gives testing teams greater control over the movement of assets across tools and builds confidence in the overall compliance process.

Additionally, this integration strengthens traceability across tools. Requirements, tests, and test results are published in both tools. Traceability reports can be produced in both tools to review results and analyze system coverage. Teams can gain confidence that the entire system is covered, from requirements down to code.

Lastly, this integration eases the path to compliance and helps strike the balance between speed and safety. Improved efficiency through the integration lets teams work in their tools of choice and makes results available in both tools. Through strengthened traceability, teams will feel more “audit ready” and will help meet the objectives set in rigorous compliance standards like ISO 26262 and DO-178C.

To learn more about how the ISO 26262 standard impacts automotive development, download our white paper.

As we enter a new decade of technological advancements, Jama Software asked select thought leaders from various industries for the trends and events they foresee unfolding over the next 10 years.

In the fifth installment of our 2020s Predictions series, we’re featuring software testing predictions from Ricardo Camacho, Technical Product Marketing Manager at LDRA.

Jama Software: What are the biggest trends you’re seeing in software testing and how are they impacting product development?

Ricardo Camacho: I’m seeing a continued trend in the embracing of test automation. Not just to keep pace with the adoption and refinement in DevOps and Agile practices, but also due to increasing demands in software safety and security which is of great concern in today’s world. Each industry has different challenges, so different needs or focuses in test automation solutions are being sought.

One example of this is in the automotive industry, and particularly in the Advanced Driver-Assistance Systems (ADAS) – a prime example of a complex and evolutionary type of system. Here you have development of advanced magnetics position sensor in the electronic power steering application, and there are other sensors like speed, inertial, and image which factor into that ecosystem.

These systems are also distributed systems and the components are being provided by different suppliers with different software stacks, using different software development methodologies made up of millions of lines of code. Test automation by way of adhering to a common coding standard for product development for all suppliers establishes a standard platform. In other words, a universal software development platform for vehicle software across all suppliers that address safety, security, and defect-free product goals. Not only have some automotive companies developed their own coding standards to enforce this, but we also see it by the movement and merger of MISRA and the AUTOSAR industry standards.

JS: Are there any technological advancements that you are seeing in software testing

RC: I’m seeing the emerging use of Artificial intelligence (AI) and machine learning for software testing, which continues to evolve and will make an enormous impact. Today, in most organizations, thousands of test cases are created, many are redundant, and some have defects. Also, test scripts are not intelligent enough to determine state conditions of the system under test, so sleep or wait instructions need to be added to properly fulfill testing needs. The interdependencies between test scripts further adds more complexity which tends to cause test failures and script changes. Furthermore, some testing continues to require human interaction, or visual inspection, which makes it error prone. So, AI is the next evolutionary step in software testing.

Artificial intelligence provides many efficiencies and fills many of the missing gaps in software testing. One of the biggest impacts will be through spidering. Where the AI will crawl the application, collecting data and even taking screen shots to learn about the expected behavior of the application. The AI can then compare future runs to known patterns, exposing deviations quickly. AI similarly addresses Application Program Interface (API) testing by recording and mocking responses which significantly reduces the time it takes to perform API testing. Additionally, AI is not limited to just text comparisons in validation. AI can validate all types of data (e.g. video, audio, images).

Therefore, with AI’s help, more robust and reliable test cases are produced and in less time. AI improves test coverage, accuracy, and provides superior insight into the health of the application. AI is bringing a transformation in software testing and it’s here in the horizon. Thus, 2020 will bring forward these types of needed solutions.

Learn how Jama Software is partnering with LDRA to deliver a test validation and verification solution for safety- and security-critical embedded software by watching this video.