config.example.yaml: Improve matrix vs groups info
For some use cases groups are simpler to use. Note this in the documentation that it is still fully supported.
This commit is contained in:
+12
-3
@@ -347,11 +347,20 @@ models:
|
|||||||
# matrix: run concurrent models with a solver-based swap DSL
|
# matrix: run concurrent models with a solver-based swap DSL
|
||||||
# =============================================================================
|
# =============================================================================
|
||||||
#
|
#
|
||||||
# Note:
|
# Matrix or Groups?
|
||||||
# A config must use either a matrix or legacy groups, not both. A configuration error
|
#
|
||||||
# will occur if both are defined. Configuration examples for legacy Groups can be found:
|
# Groups are available and fully supported. The syntax may be easier to use
|
||||||
|
# for simple use cases.
|
||||||
|
#
|
||||||
|
# Documentation can be found here:
|
||||||
# https://github.com/mostlygeek/llama-swap/blob/40e39f7/config.example.yaml#L334-L396
|
# https://github.com/mostlygeek/llama-swap/blob/40e39f7/config.example.yaml#L334-L396
|
||||||
#
|
#
|
||||||
|
# A config can only use a matrix (recommended) or groups. A configuration error
|
||||||
|
# will occur if both are defined. Groups is legacy but is fully supported with
|
||||||
|
# no plans to deprecate it.
|
||||||
|
#
|
||||||
|
# ~~~~~
|
||||||
|
#
|
||||||
# The matrix declares valid combinations of models that can run concurrently.
|
# The matrix declares valid combinations of models that can run concurrently.
|
||||||
# When a model is requested, the solver finds the cheapest way to make it
|
# When a model is requested, the solver finds the cheapest way to make it
|
||||||
# available by evicting as few (and least costly) running models as possible.
|
# available by evicting as few (and least costly) running models as possible.
|
||||||
|
|||||||
Reference in New Issue
Block a user