for multimodal input always results in error

#1
by lonikar - opened

Data incompatible with tuples format. Each message should be a list of length 2 despite providing image and additional text as inputs

lonikar changed discussion status to closed

In the code you need to change this line in the block:

# Update chat history with properly formatted entries
if not isinstance(chat_history, list):
    chat_history = []
chat_history.append((user_message_for_display, text_response))

to

chat_history.append([user_message_for_display, text_response])

Change just ( ) to [ ], it should work

Sorry, seems the problem is deeper.

Oh, yeah, thanks for checking this space. I wish HF had scratchpad spaces or something like that. I always forget to turn private mode on. This is not ready code, it's just me hacking away at their code, trying to see what I can learn from it. If I make meaningful progress I'll make sure to ping you @hexgrimm

Sign up or log in to comment