Default package

Get desktop application:
View/edit binary Protocol Buffers messages

• rpc models (ListAdaptersRequest, ListAdaptersResponse)

  multi_lora_decoding.proto:21

  Lists all the currently loaded LoRA adapters

  message ListAdaptersRequest

  multi_lora_decoding.proto:31

  (message has no fields)

  message ListAdaptersResponse

  multi_lora_decoding.proto:33

  • bool success = 1

    True if successful, False otherwise

  • string error_message = 2

    Error message if listing the adapters

  • repeated AdapterInfo adapter_infos = 3

    List of information about loaded adapters.

• rpc load_lora_adapter (LoadAdapterRequest, LoadAdapterResponse)

  multi_lora_decoding.proto:24

  Loads a new LoRA adapter.

  message LoadAdapterRequest

  multi_lora_decoding.proto:49

  • string adapter_id = 1

    Unique ID/name for the adapter

  • string adapter_path = 2

    Path to the LoRA adapter (config & weights)

  message LoadAdapterResponse

  multi_lora_decoding.proto:54

  • bool success = 1

    True if successful, false otherwise

  • string error_message = 2

    Error message if loading failed

• rpc unload_lora_adapter (UnloadAdapterRequest, UnloadAdapterResponse)

  multi_lora_decoding.proto:27

  Unloads a LoRA adapter

  message UnloadAdapterRequest

  multi_lora_decoding.proto:59

  • string adapter_id = 1

    ID/Name of the adapter to unload

  message UnloadAdapterResponse

  multi_lora_decoding.proto:63

  • bool success = 1

    True if successful, false otherwise

  • string error_message = 2

    Error message if unloading failed

Information about a single loaded LoRA adapter

Used in: ListAdaptersResponse

• string adapter_id = 1

• int64 loading_cost = 2

• int64 size_hbm = 3

• int64 size_cpu = 4

• float last_accessed = 5

• string status = 6