Enforce Eager

#1
by hampsonw - opened

Can you help me understand why enforce-eager flag needs to be set? Seems counterintuitive for speculative decoder meant to increase performance based on my understanding but I could certainly be missing something. Thanks for the models and the work it's greatly appreciated!

Red Hat AI org

Good catch, it's not necessary just a typo carried over from an old model card. I've removed it. Thanks!

fantastic news thank you for the reply!

hampsonw changed discussion status to closed

Sign up or log in to comment