how are you getting 7gb of vram usage
#3
by ctranslate2-4you - opened
When I run the script I posed in the "error" issue created on here I'm getting ~11gb-12 vram usage. How are you getting 7gb and can you post a benchmarking script or something?
