forked from Hitmare/Eris_api_tensor_patch
Hitmare 0dfdc4f931 | ||
---|---|---|
.. | ||
modules | ||
Readme.md |
Readme.md
TRT- Patch from https://gist.github.com/Saren-Arterius/2014d9799361711d25ff33740990a7b8
Modified for Linux by estro
Copy files from modules
folder into your modules
folder. replace existing files.
Original files for restoring can be found in the #Original
folder
Copy api.py
from the previous folder into modules/api
and enable eris_TRTpatch
or eris_imagelimit
::: warn If you use the TRTpatch with the Imagelimit you will need to create a Dynamic Tensor Profile with the following settings:
min/opt/max batch size: 1
min/opt/max width: 256/576/1024
min/opt/max height: 256/704/1024
min/opt/max tokens: 75/75/500
`
Those settings are very critical to have the TRT Plugin working correctly
:::