YAML for model responce #3236
Closed
KSemenenko
started this conversation in
Ideas
Replies: 2 comments
-
and we can use https://github.com/hadashiA/VYaml to make it faster |
Beta Was this translation helpful? Give feedback.
0 replies
-
From my own experience, the models have an much easier time outputting YAML because it doesn't need to worry about closing tags and escaping characters like quotes. I also agree that YAML would use fewer tokens. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have a theory than YAML will take less tokens than JSON,
If so, is it possible that using this format in requests will make them cheaper?
And according to my survey, json sometimes turns out to be invalid.
Beta Was this translation helpful? Give feedback.
All reactions