nm-testing

/

Llama-3_1-Nemotron-Ultra-253B-v1-FP8-dynamic

like 2

Follow

NM Testing 97

You guys will read this error message without any modification on config.json.

...
OSError: We couldn't connect to 'https://huggingface.co' to load the files, and couldn't find them in the cached files.
...

You should edit config.json like below

  "auto_map": {
    "AutoConfig": "configuration_decilm.DeciLMConfig",
    "AutoModelForCausalLM": "decilm.DeciLMForCausalLM"
  },

Then the engine tries to find configuration_decilm.py and decilm.py in the model directory.