Adaptive Batching

Adaptive batching is configured by setting the engine's adaptiveCommitBatchCeiling configuration parameter to a non-zero value. The following illustrates how this is done.

<services>
  <service name="MyApp" className="com.foo.MyApp">
    <adaptiveCommitBatchCeiling>32</adaptiveCommitBatchCeiling>
  </service>
</service>

The adaptiveCommitBatchCeiling is set to 0 by default which disables adaptive batching. Configuring the Rumi runtime to optimize for throughput i.e. set nv.optimizefor=throughput automatically sets the adaptive batch ceiling is set to 64 unless otherwise explicitly configured otherwise.

Last updated