llama-swap can strip specific keys in JSON requests. This is useful for removing the ability for clients to set sampling parameters like temperature, top_k, top_p, etc.
- Move all default values into one place. - Update tests to be more cross platform
* Add windows specific test changes * Change the command line parsing library - Possible breaking changes for windows users!