Error when building the TRT engine on InternVL2 examples #2679
Labels
bug
Something isn't working
Investigating
LLM API/Workflow
triaged
Issue has been triaged by maintainers
System Info
NVIDIA Driver Version: 550.54.15
CUDA Version: 12.4
GPU: NVIDIA A100-SXM4-40GB
System: Linux (Ubuntu)
Who can help?
When I am trying to build the TRT engine on the multimodal examples for InternVL2, I get the following error:
It seems to occur for both
4b
and8b
versions.Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
Expected behavior
The engine should build.
actual behavior
A
TypeError
arises, that has to do withembed_positions
.additional notes
I am also using poetry if that matters.
The text was updated successfully, but these errors were encountered: