Multiple function_tool call needed

#12
by kq - opened

running GLM-4.5-Air using vllm together with either toolparser glm45 or xlam, seems can only call one tool_call at one time.
and the toolcalling is also not always stable, some time fail to the the function tool.
it's it a build-in feature ? or can be fix by some way?
tool calling is of vital importance for me, can someone help with this?

Hey, use this PR of llama.cpp. Tool calling fixed there -> link

Sign up or log in to comment