How to use allenai/F_pre_8kv_8k_14k_SWA with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("allenai/F_pre_8kv_8k_14k_SWA", dtype="auto")