It does not translate at all?
#2
by anik550689 - opened
It is not translating.. or am I doing something wrong?
System used: Mac M3llama-cli --model ./seed-x-ppo-7b-q8_0.gguf -p "translate from Japanese to English:足下から鳥が立つ"
Output: translate from Japanese to English:足下から鳥が立つ！ [end of text]
@anik550689 Thanks for your interest on Seed-X. Please refer to https://huggingface.co/ByteDance-Seed/Seed-X-PPO-7B#quickstart.
You need to use it at vllm, other inference engines don't work.
@YuLu0713 Thanks for the instruction. It now works properly:
llama-cli --model ./seed-x-ppo-7b-q4_k_m.gguf -p "translate from Japanese to English:オリンピックメダルは銀より金を喜ぶが、預金者 は長らく金より銀を喜んできた。<en>"
Output: translate from Japanese to English:オリンピックメダルは銀より金を喜ぶが、預金者は長らく金より銀を喜んできた。<en> Olympians prefer gold to silver, but depositors have long preferred silver to gold. [end of text]
anik550689 changed discussion status to closed