Error when running model worker

#1
by cheese111 - opened

Hi, tried running this locally but faced some errors. Followed the steps on the LLaVA github; applied delta weights to llama weights but got the following error.

wondering if anyone knows what caused the error. Thanks & sorry for the inconvience

extra info: download llama 7B from https://huggingface.co/huggyllama/llama-7b/tree/main, then these delta weights, tried reapplying weights, installed all libraries except deepspeed because I'm using windows

2023-07-17 23:34:54 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40000, worker_address='http://localhost:40000', controller_address='http://localhost:10000', model_path='C:\Users\rotte\Downloads\llama-7b', model_base=None, model_name=None, multi_modal=False, keep_aspect_ratio=False, num_gpus=1, limit_model_concurrency=5, stream_interval=2, no_register=False)
2023-07-17 23:34:54 | INFO | model_worker | Loading the model C:\Users\rotte\Downloads\llama-7b on worker abaf9f ...
2023-07-17 23:34:54 | ERROR | stderr |
Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]
2023-07-17 23:34:54 | ERROR | stderr | --- Logging error ---
2023-07-17 23:34:54 | ERROR | stderr | Traceback (most recent call last):
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init__.py", line 1103, in emit
2023-07-17 23:34:54 | ERROR | stderr | stream.write(msg + self.terminator)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\encodings\cp1252.py", line 19, in encode
2023-07-17 23:34:54 | ERROR | stderr | return codecs.charmap_encode(input,self.errors,encoding_table)[0]
2023-07-17 23:34:54 | ERROR | stderr | UnicodeEncodeError: 'charmap' codec can't encode characters in position 72-201: character maps to
2023-07-17 23:34:54 | ERROR | stderr |
2023-07-17 23:34:54 | ERROR | stderr | During handling of the above exception, another exception occurred:
2023-07-17 23:34:54 | ERROR | stderr |
2023-07-17 23:34:54 | ERROR | stderr | Traceback (most recent call last):
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1103, in emit
2023-07-17 23:34:54 | ERROR | stderr | stream.write(msg + self.terminator)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\encodings\cp1252.py", line 19, in encode
2023-07-17 23:34:54 | ERROR | stderr | return codecs.charmap_encode(input,self.errors,encoding_table)[0]
2023-07-17 23:34:54 | ERROR | stderr | UnicodeEncodeError: 'charmap' codec can't encode characters in position 71-200: character maps to
2023-07-17 23:34:54 | ERROR | stderr | Call stack:
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\runpy.py", line 196, in run_module_as_main
2023-07-17 23:34:54 | ERROR | stderr | return run_code(code, main_globals, None,
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\runpy.py", line 86, in run_code
2023-07-17 23:34:54 | ERROR | stderr | exec(code, run_globals)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\serve\model_worker.py", line 416, in
2023-07-17 23:34:54 | ERROR | stderr | worker = ModelWorker(args.controller_address,
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\serve\model_worker.py", line 164, in init
2023-07-17 23:34:54 | ERROR | stderr | self.tokenizer, self.model, self.image_processor, self.context_len = load_model(
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\serve\model_worker.py", line 106, in load_model
2023-07-17 23:34:54 | ERROR | stderr | model = AutoModelForCausalLM.from_pretrained(model_path, torch_dtype=torch.float16, low_cpu_mem_usage=True, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\transformers\models\auto\auto_factory.py", line 471, in from_pretrained
2023-07-17 23:34:54 | ERROR | stderr | return model_class.from_pretrained(
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\transformers\modeling_utils.py", line 2643, in from_pretrained
2023-07-17 23:34:54 | ERROR | stderr | ) = cls.load_pretrained_model(
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\transformers\modeling_utils.py", line 2948, in load_pretrained_model
2023-07-17 23:34:54 | ERROR | stderr | for shard_file in resolved_archive_file:
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1188, in iter
2023-07-17 23:34:54 | ERROR | stderr | self.update(n - last_print_n)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1239, in update
2023-07-17 23:34:54 | ERROR | stderr | self.refresh(lock_args=self.lock_args)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1344, in refresh
2023-07-17 23:34:54 | ERROR | stderr | self.display()
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1492, in display
2023-07-17 23:34:54 | ERROR | stderr | self.sp(self.str() if msg is None else msg)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 347, in print_status
2023-07-17 23:34:54 | ERROR | stderr | fp_write('\r' + s + (' ' * max(last_len[0] - len_s, 0)))
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 341, in fp_write
2023-07-17 23:34:54 | ERROR | stderr | fp_flush()
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\utils.py", line 127, in inner
2023-07-17 23:34:54 | ERROR | stderr | return func(*args, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\utils.py", line 89, in flush
2023-07-17 23:34:54 | ERROR | stderr | self.logger.log(self.log_level, self.linebuf.rstrip())
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1547, in log
2023-07-17 23:34:54 | ERROR | stderr | self.log(level, msg, args, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1624, in log
2023-07-17 23:34:54 | ERROR | stderr | self.handle(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1634, in handle
2023-07-17 23:34:54 | ERROR | stderr | self.callHandlers(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1696, in callHandlers
2023-07-17 23:34:54 | ERROR | stderr | hdlr.handle(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 968, in handle
2023-07-17 23:34:54 | ERROR | stderr | self.emit(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging\handlers.py", line 75, in emit
2023-07-17 23:34:54 | ERROR | stderr | logging.FileHandler.emit(self, record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1218, in emit
2023-07-17 23:34:54 | ERROR | stderr | StreamHandler.emit(self, record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1108, in emit
2023-07-17 23:34:54 | ERROR | stderr | self.handleError(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init.py", line 1021, in handleError
2023-07-17 23:34:54 | ERROR | stderr | sys.stderr.write('--- Logging error ---\n')
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\utils.py", line 83, in write
2023-07-17 23:34:54 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip())
2023-07-17 23:34:54 | ERROR | stderr | --- Logging error ---
2023-07-17 23:34:54 | ERROR | stderr | Traceback (most recent call last):
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1103, in emit
2023-07-17 23:34:54 | ERROR | stderr | stream.write(msg + self.terminator)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\encodings\cp1252.py", line 19, in encode
2023-07-17 23:34:54 | ERROR | stderr | return codecs.charmap_encode(input,self.errors,encoding_table)[0]
2023-07-17 23:34:54 | ERROR | stderr | UnicodeEncodeError: 'charmap' codec can't encode characters in position 72-201: character maps to
2023-07-17 23:34:54 | ERROR | stderr |
2023-07-17 23:34:54 | ERROR | stderr | During handling of the above exception, another exception occurred:
2023-07-17 23:34:54 | ERROR | stderr |
2023-07-17 23:34:54 | ERROR | stderr | Traceback (most recent call last):
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init.py", line 1103, in emit
2023-07-17 23:34:54 | ERROR | stderr | stream.write(msg + self.terminator)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\encodings\cp1252.py", line 19, in encode
2023-07-17 23:34:54 | ERROR | stderr | return codecs.charmap_encode(input,self.errors,encoding_table)[0]
2023-07-17 23:34:54 | ERROR | stderr | UnicodeEncodeError: 'charmap' codec can't encode characters in position 71-200: character maps to
2023-07-17 23:34:54 | ERROR | stderr |
2023-07-17 23:34:54 | ERROR | stderr | During handling of the above exception, another exception occurred:
2023-07-17 23:34:54 | ERROR | stderr |
2023-07-17 23:34:54 | ERROR | stderr | Traceback (most recent call last):
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1103, in emit
2023-07-17 23:34:54 | ERROR | stderr | stream.write(msg + self.terminator)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\encodings\cp1252.py", line 19, in encode
2023-07-17 23:34:54 | ERROR | stderr | return codecs.charmap_encode(input,self.errors,encoding_table)[0]
2023-07-17 23:34:54 | ERROR | stderr | UnicodeEncodeError: 'charmap' codec can't encode characters in position 81-210: character maps to
2023-07-17 23:34:54 | ERROR | stderr | Call stack:
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\runpy.py", line 196, in run_module_as_main
2023-07-17 23:34:54 | ERROR | stderr | return run_code(code, main_globals, None,
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\runpy.py", line 86, in run_code
2023-07-17 23:34:54 | ERROR | stderr | exec(code, run_globals)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\serve\model_worker.py", line 416, in
2023-07-17 23:34:54 | ERROR | stderr | worker = ModelWorker(args.controller_address,
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\serve\model_worker.py", line 164, in init
2023-07-17 23:34:54 | ERROR | stderr | self.tokenizer, self.model, self.image_processor, self.context_len = load_model(
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\serve\model_worker.py", line 106, in load_model
2023-07-17 23:34:54 | ERROR | stderr | model = AutoModelForCausalLM.from_pretrained(model_path, torch_dtype=torch.float16, low_cpu_mem_usage=True, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\transformers\models\auto\auto_factory.py", line 471, in from_pretrained
2023-07-17 23:34:54 | ERROR | stderr | return model_class.from_pretrained(
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\transformers\modeling_utils.py", line 2643, in from_pretrained
2023-07-17 23:34:54 | ERROR | stderr | ) = cls.load_pretrained_model(
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\transformers\modeling_utils.py", line 2948, in load_pretrained_model
2023-07-17 23:34:54 | ERROR | stderr | for shard_file in resolved_archive_file:
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1188, in iter
2023-07-17 23:34:54 | ERROR | stderr | self.update(n - last_print_n)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1239, in update
2023-07-17 23:34:54 | ERROR | stderr | self.refresh(lock_args=self.lock_args)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1344, in refresh
2023-07-17 23:34:54 | ERROR | stderr | self.display()
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 1492, in display
2023-07-17 23:34:54 | ERROR | stderr | self.sp(self.str() if msg is None else msg)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 347, in print_status
2023-07-17 23:34:54 | ERROR | stderr | fp_write('\r' + s + (' ' * max(last_len[0] - len_s, 0)))
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\std.py", line 341, in fp_write
2023-07-17 23:34:54 | ERROR | stderr | fp_flush()
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\site-packages\tqdm\utils.py", line 127, in inner
2023-07-17 23:34:54 | ERROR | stderr | return func(*args, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\utils.py", line 89, in flush
2023-07-17 23:34:54 | ERROR | stderr | self.logger.log(self.log_level, self.linebuf.rstrip())
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1547, in log
2023-07-17 23:34:54 | ERROR | stderr | self.log(level, msg, args, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1624, in log
2023-07-17 23:34:54 | ERROR | stderr | self.handle(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1634, in handle
2023-07-17 23:34:54 | ERROR | stderr | self.callHandlers(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1696, in callHandlers
2023-07-17 23:34:54 | ERROR | stderr | hdlr.handle(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 968, in handle
2023-07-17 23:34:54 | ERROR | stderr | self.emit(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging\handlers.py", line 75, in emit
2023-07-17 23:34:54 | ERROR | stderr | logging.FileHandler.emit(self, record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1218, in emit
2023-07-17 23:34:54 | ERROR | stderr | StreamHandler.emit(self, record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1108, in emit
2023-07-17 23:34:54 | ERROR | stderr | self.handleError(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init.py", line 1021, in handleError
2023-07-17 23:34:54 | ERROR | stderr | sys.stderr.write('--- Logging error ---\n')
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\utils.py", line 83, in write
2023-07-17 23:34:54 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip())
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1547, in log
2023-07-17 23:34:54 | ERROR | stderr | self.log(level, msg, args, **kwargs)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1624, in log
2023-07-17 23:34:54 | ERROR | stderr | self.handle(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1634, in handle
2023-07-17 23:34:54 | ERROR | stderr | self.callHandlers(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init.py", line 1696, in callHandlers
2023-07-17 23:34:54 | ERROR | stderr | hdlr.handle(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 968, in handle
2023-07-17 23:34:54 | ERROR | stderr | self.emit(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging\handlers.py", line 75, in emit
2023-07-17 23:34:54 | ERROR | stderr | logging.FileHandler.emit(self, record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init.py", line 1218, in emit
2023-07-17 23:34:54 | ERROR | stderr | StreamHandler.emit(self, record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init
.py", line 1108, in emit
2023-07-17 23:34:54 | ERROR | stderr | self.handleError(record)
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\miniconda3\envs\llava\lib\logging_init_.py", line 1038, in handleError
2023-07-17 23:34:54 | ERROR | stderr | sys.stderr.write('Message: %r\n'
2023-07-17 23:34:54 | ERROR | stderr | File "C:\Users\rotte\Downloads\LLaVA\llava\utils.py", line 83, in write
2023-07-17 23:34:54 | ERROR | stderr | self.logger.log(self.log_level, line.rstrip())

Env:
Package Version Editable project location


accelerate 0.21.0
aiofiles 23.1.0
aiohttp 3.8.4
aiosignal 1.3.1
altair 5.0.1
annotated-types 0.5.0
anyio 3.7.1
appdirs 1.4.4
async-timeout 4.0.2
attrs 23.1.0
brotlipy 0.7.0
certifi 2023.5.7
cffi 1.15.1
chardet 5.1.0
charset-normalizer 2.0.4
click 8.1.5
colorama 0.4.6
contourpy 1.1.0
cryptography 39.0.1
cycler 0.11.0
docker-pycreds 0.4.0
einops 0.6.1
exceptiongroup 1.1.2
fastapi 0.100.0
ffmpy 0.3.1
filelock 3.12.2
fonttools 4.41.0
frozenlist 1.4.0
fsspec 2023.6.0
gitdb 4.0.10
GitPython 3.1.32
gradio 3.35.2
gradio_client 0.2.9
h11 0.14.0
httpcore 0.17.3
httpx 0.24.0
huggingface-hub 0.16.4
idna 3.4
Jinja2 3.1.2
jsonschema 4.18.3
jsonschema-specifications 2023.6.1
kiwisolver 1.4.4
libaio 0.9.1
linkify-it-py 2.0.2
llava 0.2.0 C:\Users\rotte\Downloads\LLaVA
markdown-it-py 2.2.0
markdown2 2.4.9
MarkupSafe 2.1.1
matplotlib 3.7.2
mdit-py-plugins 0.3.3
mdurl 0.1.2
mkl-fft 1.3.6
mkl-random 1.2.2
mkl-service 2.4.0
mpmath 1.2.1
multidict 6.0.4
networkx 2.8.4
ninja 1.11.1
numpy 1.25.0
orjson 3.9.2
packaging 23.1
pandas 2.0.3
pathtools 0.1.2
peft 0.3.0
Pillow 9.3.0
pip 23.1.2
protobuf 3.20.3
psutil 5.9.5
pycparser 2.21
pydantic 2.0.3
pydantic_core 2.3.0
pydub 0.25.1
Pygments 2.15.1
pyOpenSSL 23.0.0
pyparsing 3.0.9
PySocks 1.7.1
python-dateutil 2.8.2
python-multipart 0.0.6
pytz 2023.3
PyYAML 6.0
referencing 0.29.1
regex 2023.6.3
requests 2.29.0
rpds-py 0.8.11
safetensors 0.3.1
semantic-version 2.10.0
sentencepiece 0.1.99
sentry-sdk 1.28.1
setproctitle 1.3.2
setuptools 67.8.0
shortuuid 1.0.11
six 1.16.0
smmap 5.0.0
sniffio 1.3.0
starlette 0.27.0
svgwrite 1.4.3
sympy 1.11.1
tokenizers 0.12.1
toolz 0.12.0
torch 2.0.1
torchaudio 2.0.2+cu118
torchvision 0.15.2+cu118
tqdm 4.65.0
transformers 4.28.0.dev0
typing_extensions 4.6.3
tzdata 2023.3
uc-micro-py 1.0.2
urllib3 1.26.16
uvicorn 0.23.0
wandb 0.15.5
wavedrom 2.0.3.post3
websockets 11.0.3
wheel 0.38.4
win-inet-pton 1.1.0
yarl 1.9.2

update: appears to be a gradio issue, model runs fine with CLI inference

cheese111 changed discussion status to closed

Sign up or log in to comment