23 lines
746 B
Markdown
23 lines
746 B
Markdown
|
TRT- Patch from <https://gist.github.com/Saren-Arterius/2014d9799361711d25ff33740990a7b8>
|
||
|
|
Modified for Linux by estro
|
||
|
|
|
||
|
|
Copy files from `modules` folder into your `modules` folder. replace existing files.
|
||
|
|
|
||
|
|
Original files for restoring can be found in the `#Original` folder
|
||
|
|
|
||
|
|
Copy `api.py` from the previous folder into `modules/api` and enable `eris_TRTpatch` or `eris_imagelimit`
|
||
|
|
|
||
|
|
::: warn
|
||
|
|
If you use the TRTpatch with the Imagelimit you will need to create a **__Dynamic Tensor Profile__** with the following settings:
|
||
|
|
|
||
|
|
`min/opt/max batch size: 1`
|
||
|
|
|
||
|
|
`min/opt/max width: 256/576/1024`
|
||
|
|
|
||
|
|
`min/opt/max height: 256/704/1024`
|
||
|
|
|
||
|
|
`min/opt/max tokens: 75/75/500`\`
|
||
|
|
|
||
|
|
Those settings are **__very critical__** to have the TRT Plugin working correctly
|
||
|
|
|
||
|
|
:::
|