trtexec#

trtexec Flag Changes#

Changes to flag workspace and minTiming

1trtexec \
2    --onnx=/path/to/model.onnx \
3    --saveEngine=/path/to/engine.trt \
4    --optShapes=input:$INPUT_SHAPE \
5
6    --workspace=1024 \
7    --minTiming=1

1trtexec \
2    --onnx=/path/to/model.onnx \
3    --saveEngine=/path/to/engine.trt \
4    --optShapes=input:$INPUT_SHAPE \
5
6    --memPoolSize=workspace:1024

Removed trtexec Flags#

The following trtexec flags are listed next to their superseded flag.

  • --deploy > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --output > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --model > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --uff > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --uffInput > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --uffNHWC > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --batch > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --maxBatch > TensorRT 10.x does not support Caffe input, UFF input, and implicit batch dimension mode.

  • --minTiming > --avgTiming

  • --preview=features options: disableExternalTacticSourcesForCore0805 and fasterDynamicShapes0805 > N/A

  • --workspace=N > --memPoolSize=poolspec

  • --explicitPrecision > Removed

  • --nativeInstanceNorm > Removed

  • --heuristic > --builderOptimizationLevel=<N> (where <N> can be 0, 1, or 2)

  • --buildOnly > --skipInference

  • --nvtxMode > --profilingVerbosity

Deprecated trtexec Flags#

The following trtexec flags are listed next to their deprecated superseded flag.

  • --sparsity=force > Use polygraphy surgeon prune to rewrite the weights to a sparsity pattern and then run --sparsity=enable.

  • --plugins > --staticPlugins

  • --preview=profileSharing0806 > Enabled by default and has no effect.

  • --profilingVerbosity=default > --profilingVerbosity=layer_names_only

  • --profilingVerbosity=verbose > --profilingVerbosity=detailed

  • --streams > --infStreams

  • --weightless > --stripWeights

On this page