Does that model support function call?
#3
by whh - opened
I use openai library to inovke the model:
resp = client.chat.completions.create(
model="MiroThinker-v1.5-30B",
messages=[
{"role": "user", "content": "calculate 3 + 5"}
],
tools=[
{
"type": "function",
"function": {
"name": "add",
"description": "a special add",
"parameters": {
"type": "object",
"properties": {
"a": {"type": "integer"},
"b": {"type": "integer"}
},
"required": ["a", "b"]
}
}
}
],
tool_choice="auto"
)
but I got the following error:
(whh_env) (whh_env) [wuwenhao@ma-0008 neo4j_search]$ python test1.py
Traceback (most recent call last):
File "/home/xxx/test1.py", line 8, in <module>
resp = client.chat.completions.create(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xxx/.uv/venv/whh_env/lib/python3.12/site-packages/openai/_utils/_utils.py", line 286, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/home/xxx/.uv/venv/whh_env/lib/python3.12/site-packages/openai/resources/chat/completions/completions.py", line 1189, in create
return self._post(
^^^^^^^^^^^
File "/home/xxx/.uv/venv/whh_env/lib/python3.12/site-packages/openai/_base_client.py", line 1259, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/xxxx/.uv/venv/whh_env/lib/python3.12/site-packages/openai/_base_client.py", line 1047, in request
raise self._make_status_error_from_response(err.response) from None
openai.InternalServerError: Internal Server Error
(whh_env) (whh_env) [wuwenhao@ma-0008 neo4j_search]$