Hitmare
/
Eris_api_tensor_patch
1
0
Fork 1
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update TRT-Patch/Readme.md

This commit is contained in:
Hitmare 2024-01-29 23:05:39 +00:00
parent f8ea16349e
commit 6ce183544f
1 changed files with 12 additions and 14 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

26
TRT-Patch/Readme.md
View File

@ -7,17 +7,15 @@ Original files for restoring can be found in the `#Original` folder
Copy `api.py` from the previous folder into `modules/api` and enable `eris_TRTpatch` or `eris_imagelimit`
::: warn
If you use the TRTpatch with the Imagelimit you will need to create a **__Dynamic Tensor Profile__** with the following settings:
`min/opt/max batch size: 1, 2, 4`
`min/opt/max width: 256/576/1024`
`min/opt/max height: 256/704/1024`
`min/opt/max tokens: 75/75/500`\`
Those settings are **__very critical__** to have the TRT Plugin working correctly
:::
> **Warning**\
>If you use the TRTpatch with the Imagelimit you will need to create a **__Dynamic Tensor Profile__** with the following settings:\
>\
>`min/opt/max batch size: 1, 2, 4`\
>\
>`min/opt/max width: 256/576/1024`\
>\
>`min/opt/max height: 256/704/1024`\
>\
>`min/opt/max tokens: 75/75/500`\
>\
>Those settings are **__very critical__** to have the TRT Plugin working correctly \