The easy business case for automated testing

By Christine Blinke
April 20, 2017

In the ongoing pursuit of efficiency and cost awareness among market participants, trading technology is often at the center of attention. Still there is at least one key function in trading systems left largely untouched by productivity and streamlining measures, and that is testing.

Manual testing of trading infrastructure solutions remains prevalent within today’s financial markets. Even routine tasks such as regression testing are typically performed manually. This is surprising, considering that testing is an area that is particularly well suited to automation.

Automation has the potential to save time and reduce costs while improving quality by reducing the risk of errors. It can also facilitate regulatory compliance, another pressing issue for market participants. One commonly used approach is to employ offshore services for labor-intensive manual processes, such as regression testing regimes. But this amounts to little more than a cost control measure, a solution which simply lowers the price for what remains inadequate testing.

Model-based testing

Automated testing is simplified by the far-reaching standardization of information exchange in financial markets, which applies to transactions and market data. Standard protocols and APIs define specific models of behavior that enable the use of model-based testing, which is not limited to human thought of how a system should, or could possibly behave.

Using automation techniques such as model-based testing and service virtualization, testing can be performed dramatically more effectively while enabling more fine-grained testing. The cost per test case can be reduced by orders of magnitude. This means that a higher volume of testing can be performed where the system is fully exercised, for the benefit of quality and reliability. The permutations generated by model based testing have a much higher likelihood of uncovering unexpected errors.

Further compounding the testing issue are changes by counterparties to their systems that can have an impact on internal systems.  When one component in the trading infrastructure is upgraded, the entire chain needs to be tested. Many of these tests are standard and repetitive, which again makes an excellent case for automation.

Many sell-sides already use some testing automation tools, but these are mostly limited in terms of automation capabilities and functional scope. Even when firms have adopted best practices in the areas of continuous integration, continuous deployment, and DevOps, there is still considerable effort required to configure systems for various testing scenarios in complex distributed test environments.

This is where service virtualization, the ability to emulate behavior of systems based upon well-defined protocols, can provide significant benefits, reducing the manual workload and costs.

Getting started

The learning curve and lack of available expertise may have limited the use of model-based testing and service virtualization, but unnecessarily so. Applying these practices in well-defined domains such as FIX can provide a powerful and readily accessible automated testing environment that offers an immediate return.

With a focus on improving existing processes and systems, automated testing is a first step in reducing overhead, simplifying system upgrades and taking advantage of new technology as it emerges.

Aside from the cost advantage, there is a clear business case for automated testing, as manual processes add to the risk of human error, which can lead to trading errors and lost business.

Finally, regulatory compliance is an additional factor when considering automated testing. Automated systems produce output that can be used to meet reporting requirements with little effort.

 

 

Related Content

To SI or not to SI, that is the question

To SI or not to SI, that is the question

Blog With MiFID II regulation now less than 12 months away, the race to ensure compliance heats up. In a recent letter penned by Steven Maijoor ESMA Chair, Mr Maijoor expressed concerns on the “potential establishment of networks of Systematic Internalisers (SIs) to circumvent certain MiFID II obligations.” The implementation of MiFID I saw the introduction […] June 13, 2017

Americas Trading Briefing: trends and challenges

Americas Trading Briefing: trends and challenges

Blog It was a pleasure to have an opportunity to speak at the 2017 Americas Trading Briefing, which was graciously hosted by Goldman Sachs. As usual, the room was filled with more than 250 senior market participants and 25 expert speakers to discuss important topics, trends and issues we face together as the FIX Trading Community. […] June 7, 2017

The evolving ETF landscape – and how to capitalize on it

The evolving ETF landscape – and how to capitalize on it

Articles & Reports In recent years, exchange-traded funds (ETFs) have seen phenomenal activity and growth. Regulation, product innovation and investor appetite have driven global Assets under management (AUM) to record levels, while also fueling increasing market structure complexity and straining trading platform capabilities across the board. Itiviti, in conjunction with GreySpark Partners, recently engaged in a comprehensive review […] May 18, 2017

How automation takes the pain out of onboarding and certification

How automation takes the pain out of onboarding and certification

Automation & Testing For many sell-side firms, client onboarding and certification is a drag on productivity. The traditional methods used to perform these processes are manual, and therefore time-consuming. Because the process is so labor intensive, some firms maintain substantial backlogs of clients waiting for connections to trade. Slow onboarding is costing the business, as it leads to […] May 2, 2017