Application Test Suite - Majority of test cases failing with high memory consumption

Document ID : KB000102352
Last Modified Date : 26/06/2018
Show Technical Document Details
Issue:
Running over 350 tests case in one Suite and all in parallel and getting below error:

C:\Users\vpath001\lisatmp_10.1.0\lads\A65CC73744CE11E8BCD63A1820524153\Virtual_Services_ESB_Regression_Automation\Tests\PaymentManagement_v1_0\authorizePayment\authorizePayment_IVR_MYACCT_SUCCESS.tst failed due to exception ============================================================================
| Message: java.rmi.RemoteException: Unexpected reference to target tcp://server.abc.com:2011/C1F1A18C44CE11E89FE80050569B18F4 lost making call hasTestErrorFired known soft targets: metricsCB1A9AAE44CE11E89FE80050569B18F4]
----------------------------------------------------------------------------
 Trapped Exception: Unexpected reference to target tcp://server.abc.com:2011/C1F1A18C44CE11E89FE80050569B18F4 lost making call hasTestErrorFired known soft targets:
Cause:
As per development:

With this many test cases running in parallel, it will crash with memory issues but no hprof. It's not an event issue.

This is a memory issue.

There's no hard number we can give for the maximum number of parallel tests you can run.

It depends entirely on what kind of tests we're talking about.

One huge test with a bunch of data sets could take the same amount of memory as a hundred small, simple tests. 
Resolution:
Since it has been verified that this works with the test case broken out into multiple Suite with a lower amount of test cases in each Suite, the only reliable statement we can make is this:

When you start running out of memory then that's too many test cases

So it is suggest to create multiple Suites a lower amount of test cases.