Processing Engines (PEs) are configured and optimized using settings in the Processing Engine Dashboard. Specifically, Streams can be configured on a Processing Engine by Processing Engine basis which defines the number of parallel processes that an individual Engine can execute. The default value is set to 5 each but can be lowered or raised to acquire optimal performance. This activity is typically completed by Professional Services and includes the analysis of customer environment resources and CIM job load requirements.
If all Streams for a particular engine are in use, you may see a message like the below logged in the PE logs.
10.106 Stream is not available for ProcessingEngine SSPE00000002. Another attempt to get a stream will be made in 10 seconds.
It is expected to see these messages occasionally during heavy loads on the database or during heavy job loads. If you are seeing these type of messages frequently without the mentioned conditions, it may mean that the limit is set too low and increasing the limit may be helpful. Increasing the number of streams for Processing Engines also means more work on the database.
CAUTION: In some cases, increasing the number too high can put more work on the database causing the condition to occur more frequently rather than help. The values have to be tweaked to determine the best configuration on a per system basis.