TESTED WITH SQUISH

JSOL CORPORATION

Computer Aided Engineering trusted by manufacturers worldwide.

40%

of all test cases automated

85%

reduction in workload compared to manual testing

About JSOL Corporation

JSOL Corporation is a systems consulting and solution integrator funded by NTT DATA Japan and The Japan Research Institute, Limited.
Since its establishment in 2006, the company has contributed to enhance the corporate value of its customers by leveraging its extensive business expertise and system development capabilities cultivated in the manufacturing, logistics, financial, and public sectors. JSOL is also recognized for its advanced analytical technologies in the field of engineering science.

JSOL Corporation uses Squish, a GUI test automation tool provided by Qt Group, for GUI testing of JMAG, simulation software for electric device design. The Qt framework was chosen as the standard for developing JMAG's GUI. As Squish is well-suited to Qt, approximately 40% of all test cases were automated by using it. The workload for automated testing is now reduced to about 15% of manual testing.

The use of Squish has been more effective than originally anticipated, and we are particularly pleased with the test workload reduction to 15%, which has greatly enhanced JMAG's quality assurance efficiency.

Masayuki Kawai, IT Professional (CAE Quality), JMAG Business Company, JSOL Corporation

Why JSOL chose Squish

E2E test improves object recognition accuracy and testing productivity.

Achieved automation of approximately 40% of the total 15,000 test cases.

Automation reduced test execution workload by 85% compared to manual testing.

Enhanced accuracy allows for multiple automated test runs within a single test period.

Enabled efficient test execution using a comprehensive and precise API.

Preshipment tests for performance-improvement releases increased to 9 times per year, making manual testing a challenge.

JSOL is one of the leading IT service coordinators in Japan, providing total solutions from consulting sales to system construction, operation, and maintenance in IT consulting. The company's business consists of two main areas. The IT solutions field leverages extensive experience in business process re-engineering using ERP and other technologies for manufacturing, logistics services, and the public sector. The Computer Aided Engineering (CAE: design and development support system) solution field supports craftmanship in the manufacturing industry by developing software for CAE, including structural analysis, production technology analysis, electromagnetical analysis, and material analysis, as well as providing technical support, consulting, and outsourced analysis.

JMAG is one of JSOL’s leading products in the field of CAE. Fully developed in-house, it is used by companies and universities around the world to design and develop electric devices, including motors, generators, transformers, solenoids, and actuators.

JMAG Business Company, a dedicated division within JSOL, is responsible for the development, distribution, and support of JMAG. The team closely align with customer needs to provide effective electric device design solutions. JMAG Business Company has established two independent teams to ensure functionality and quality: one focused on development and the other on testing. Squish, Qt Group's GUI testing solution, plays a key role in automating GUI testing across multiple JMAG versions.

JMAG offers fast and precise solver performance, advanced modeling features, and diverse result analysis functions. We have focused on developing the GUI to ensure it's user-friendly for both new and experienced users, with frequent improvements. We started conducting detailed and frequent regression testing to ensure system stability and quickly release new features. We handled manual testing until the mid-2010s. However, since around 2017, we have added two service packs released three times a year, alongside three annual version updates, leading to nine pre-shipment tests each year. We were concerned that manual testing couldn't keep pace.

Masayuki Kawai, IT Professional (CAE Quality), JMAG Business Company

Squish, well suited for Qt, integrated into the release process in 2018

Regression testing was scheduled for two months, but despite increased development, the release date was fixed, and the testing period couldn't be extended. To eliminate the risk of overlooked defects caused by preconceptions or biases, third-party verification was required, making it necessary to find a way to shorten the verification period compared to the current process. Additionally, the budget constraints made it difficult to hire more test personnel despite the increased testing needs. At this point, they focused on Squish, which they had been using intermittently.

JMAG Business Company had been using Squish for over a decade before it became part of the Qt Group. We were already using Qt for GUI development, so we chose Squish because it complemented Qt well. However, we hadn't fully implemented automated testing yet. As testing became more frequent, we decided to use Squish in our release process to save time and money while ensuring high test quality, says Mr Kawai

Test execution workload reduced by approx. 85%

The company has experienced numerous benefits with Squish fully utilized.

Firstly, Squish enables flexible coding and integrates smoothly with Qt applications, enhancing productivity. Unlike other GUI test automation tools that restrict code creation and hinder custom processing, Squish allows for relatively free processing. In addition to seamless integration with external tools, Squish accurately identifies screen positions and locations by using object names defined in Qt in E2E (A testing method that checks the functionality of an entire system or process from the user's point of view) testing, where object recognition can be challenging.

The compatibility with Qt applications enhances automated GUI testing, ensuring smooth performance with minimal impact from test environments. This is the greatest benefit, says Mr Kawai.

Secondly, the impact of using Squish is made clearly visible. Out of about 15,000 test cases, around 40% are now automated. Using Squish has cut the workload for automated testing by about 85%, reducing it to just 15% of what manual testing required. Over the past six years, there were no missed test cases. Now, even the smallest bugs can be detected, the team can run automated tests multiple times during the testing phase. We believe that the rate of test automation can be further increased in the future.

We believe test automation can grow even more in the future. Without Squish, we would have needed to increase our testing team by 60-70% or extend the testing timeline, which might have disrupted our business requirement to release JMAG updates as planned, says Mr Kawai

Thirdly, the rich API improves test creation efficiency. For example, with other tools, automated GUI tests often fail because they attempt to click before the screen is fully loaded. Squish provides an API that waits until the timeout interval elapses, enabling testers to test efficiently. Additionally, Squish's API libraries are so straightforward and user-friendly that they don't require any technical support.

Learn about Squish for Qt

The goal is to automate 70% of GUI regression testing in JMAG

JMAG Business Company aims to enhance their knowledge of Squish's features and increase the automation of GUI regression testing in JMAG to 70%.

Squish has exceeded our expectations by cutting test execution time to just 15%, significantly boosting JMAG's quality assurance efficiency. Many other automated testing tools often stop testing unexpectedly, leading to higher costs. However, Squish is highly reliable, allowing tests to run smoothly even over the weekend. Overall, choosing to move forward with full-scale test automation resulted in a great success. We look forward to receiving more information and support from Qt Group to enhance our use of Squish in the future, says Mr Kawai.

With the brand message of "Creating innovative solutions," JSOL will persistently pursue new value propositions, see them through to completion, and act with integrity. Qt Group is committed to supporting JSOL by providing comprehensive global expertise.

Oh, there's more

JSOL | Tested with Squish

JSOL Corporation enhances quality assurance in JMAG using Squish, automating 40% of test cases and reducing workload by 85%, ensuring efficient and re...

Success Story ABB | Squish for Qt

Discover the winning combination of stability and convenience with Squish for Qt with the ABB Group. Elevate your testing process today!

Success Story Skyguide | Squish for Qt

Skyguide, headquartered in Geneva, Switzerland, is a company with a longstanding history of contribution to the development of Swiss aviation.