LiteRT-LM

GPU precision bug

#4
by jeisonvendetta - opened

Check out this thread;
here I describe an issue I'm having with GPU precision errors. Maybe it can be fixed by adjusting how quantization is handled in .literltm.

https://huggingface.co/google/gemma-4-E2B-it/discussions/10#69d59469f6669de8771e1d96

Что за херня ?

@Harrypppoootteerr
Don't be rude. That's vulgar.

Sign up or log in to comment