Thinking tags
#1
by
twoxfh
- opened
I am not seeing any thinking tags generated for llama.cpp ui to separate out using the gguf and the latest chat template from tencent. Are you able to? Really cool responses for a 2b model so far!
I am not seeing any thinking tags generated for llama.cpp ui to separate out using the gguf and the latest chat template from tencent. Are you able to? Really cool responses for a 2b model so far!
@twoxfh Hi, you can check server example for enable/disable the thinking mode: https://huggingface.co/tencent/Youtu-LLM-2B-GGUF#server-example