cofob
/
Eris_api_tensor_patch
forked from Hitmare/Eris_api_tensor_patch
1
0
Fork 0
Code Pull Requests Activity
Eris_api_tensor_patch/TRT-Patch
History
Hitmare 28b331f4e8 Update for 1.7.0 
Update for the 1.7.0 version of the original file
 		2023-12-23 15:02:50 +00:00
..
#Original Upload files to "TRT-Patch/#Original" 2023-11-14 19:45:47 +00:00
modules Update for 1.7.0 2023-12-23 15:02:50 +00:00
Readme.md min/opt/max batch size change 2023-11-14 20:38:06 +00:00

Readme.md

TRT- Patch from https://gist.github.com/Saren-Arterius/2014d9799361711d25ff33740990a7b8
Modified for Linux by estro

Copy files from modules folder into your modules folder. replace existing files.

Original files for restoring can be found in the #Original folder

Copy api.py from the previous folder into modules/api and enable eris_TRTpatch or eris_imagelimit

::: warn If you use the TRTpatch with the Imagelimit you will need to create a Dynamic Tensor Profile with the following settings:

min/opt/max batch size: 1, 2, 4

min/opt/max width: 256/576/1024

min/opt/max height: 256/704/1024

min/opt/max tokens: 75/75/500`

Those settings are very critical to have the TRT Plugin working correctly

:::