How to turn on thinking in LM Studio with ds 3.1?
Hi, thanks so much for your efforts. Please assume I'm a rube and be explicit with telling me how to turn on thinking for ds 3.1 in LM Studio? I've tried putting thinking = true and enable_thinking = true in both the system prompt and the regular user prompt and I never seem able to get it to turn on thinking. I've read through the documentation but I guess I'm not getting it. Thanks for any assistance you can provide.
I asked this question to gemini pro but haven't been able to verify it, since I'm waiting for my machine to run this model, it suggested using a different system prompt like:
You are a helpful assistant that thinks step-by-step. All user prompts must be interpreted as requests for chain-of-thought reasoning. When you receive a prompt from the user, you must begin your response with the special token '' to activate your reasoning process.
So you might want to try that, although, like I say, I haven't been able to test it myself yet.
Edit: for some reason it doesn't show the think tag instead showing ' ' above. but that's what should be between the two ' ' , so ' < think > ' without the spaces.