Proto commits in canonical/lxd

These 59 commits are when the Protocol Buffers files have changed:

2026-10-02

lxd/migration: Add the metadata-only flag to the migration header A standby replica on a mirrored Ceph pool already holds the data by the time the replicator pushes an instance, so only the records should travel. The sink is the side that knows it is such a standby, so it tells the source through the response header, the way it already does for a refresh. A bool on the header rather than a new MigrationFSType because the type describes the transfer format and every driver advertises which formats it supports. A synthetic format would ripple through the type negotiation for a mode that has no transfer at all. Field 6 is a gap left by a removed field, so the new field takes 14 rather than reuse it. Signed-off-by: tugbataluy <tugba.taluy@canonical.com>

2024-03-27

lxd/migration/protobuf: Add RBD_AND_RSYNC migration type Signed-off-by: Julian Pelizäus <julian.pelizaeus@canonical.com>

The documentation is generated from this commit.

2024-03-07

lxd/migration/protobuf: Add RBD_AND_RSYNC migration type Signed-off-by: Julian Pelizäus <julian.pelizaeus@canonical.com>

The documentation is generated from this commit.

2023-07-27

lxd/migration: Adds CRIUType_VM_QEMU protobuf type Although CRIUType prefix here is a misnomer, it aligns with the repurposing of the criu socket for all instance type state transfers, not just containers (using CRIU). Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2023-03-31

lxd/migration: Adds CRIUType_VM_QEMU protobuf type Although CRIUType prefix here is a misnomer, it aligns with the repurposing of the criu socket for all instance type state transfers, not just containers (using CRIU). Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2023-03-23

lxc/migration: Update protobuf with zfs zvol support Signed-off-by: Thomas Hipp <thomas.hipp@canonical.com>

2023-02-13

lxc/migration: Update protobuf with zfs zvol support Signed-off-by: Thomas Hipp <thomas.hipp@canonical.com>

2023-01-09

lxd/migration: remove stats protobuf definitions The protobuf definitions for CRIU stats is provided by the go-criu package in `crit/images/stats.proto`. The duplicate definitions in `migration.proto` have been removed and `migration.pb.go` updated. Signed-off-by: Prajwal S N <prajwalnadig21@gmail.com>

2022-09-29

lxd/migration: remove stats protobuf definitions The protobuf definitions for CRIU stats is provided by the go-criu package in `crit/images/stats.proto`. The duplicate definitions in `migration.proto` have been removed and `migration.pb.go` updated. Signed-off-by: Prajwal S N <prajwalnadig21@gmail.com>

2022-06-20

lxd/migration/utils: Adds IndexHeaderVersion to migration header This supports indicating which version (if any) of the index migration header will be sent/recv. Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2022-05-22

lxd/migration/utils: Adds IndexHeaderVersion to migration header This supports indicating which version (if any) of the index migration header will be sent/recv. Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2022-03-16

lxd/migration: Add header_subvolume_uuids to protobuf Signed-off-by: Thomas Hipp <thomas.hipp@canonical.com>

lxd/migration: Add new zfs feature to protobuf This adds the `migration_header` zfs feature to protobuf. Signed-off-by: Thomas Hipp <thomas.hipp@canonical.com>

2021-10-12

lxd/migration: Update protobuf config Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2021-10-04

lxd/migration: Update protobuf config Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2021-01-06

lxd/migration: Adds expiry_date field to snapshots protobuf Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2021-01-04

lxd/migration: Adds expiry_date field to snapshots protobuf Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2020-05-07

lxd/migration/migrate/proto: Adds BTRFS Features to offer header Adds following features: migration_header - indicates a migration header will be sent/recv in data channel first. header_subvolumes - indicates migration can send/recv subvolumes. Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

lxd/migration/migrate/proto: Adds BTRFS Features to offer header Adds following features: migration_header - indicates a migration header will be sent/recv in data channel first. header_subvolumes - indicates migration can send/recv subvolumes. Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2020-04-24

lxd/migration: Adds volumeSize field to MigrationHeader Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

lxd/migration/migrate/proto: Fix alignment Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2020-04-23

lxd/migration: Adds volumeSize field to MigrationHeader Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

lxd/migration/migrate/proto: Fix alignment Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2020-03-13

lxd/migration: Adds BLOCK_AND_RSYNC migration transport type Will be used for migrating VMs as they have both config volumes (that will use RSYNC) and block volumes. Signed-off-by: Thomas Parrott <thomas.parrott@canonical.com>

2019-06-23

Drop vendor directory Signed-off-by: Free Ekanayaka <free.ekanayaka@canonical.com>

2019-05-23

vendor: Temporary Raft vendoring Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2019-05-21

vendor: Temporary Raft vendoring Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2019-02-08

lxd/migration: Negotiate ZFS compression Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

lxd/migration: Bi-directional rsync negotiation Closes #5270 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-11-26

lxd/migration: Negotiate ZFS compression Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-11-25

lxd/migration: Bi-directional rsync negotiation Closes #5270 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-11-22

rsync: Tweak transfer options (delete & compress) LXD when interacting with recent clients will now support: - --delete (to avoid random conflicts) - --compress --compress-level=2 (to reduce bandwidth usage) The level 2 compress appears to be the best CPU/bandwidth tradeoff for most common images and shouldn't cause slowdowns in most cases. Closes #5215 Closes #5212 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-11-09

lxd: Add support for incremental container copy Signed-off-by: Thomas Hipp <thomas.hipp@canonical.com>

2018-10-29

rsync: Tweak transfer options (delete & compress) LXD when interacting with recent clients will now support: - --delete (to avoid random conflicts) - --compress --compress-level=2 (to reduce bandwidth usage) The level 2 compress appears to be the best CPU/bandwidth tradeoff for most common images and shouldn't cause slowdowns in most cases. Closes #5215 Closes #5212 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-09-10

global: Advertise rsync features Closes #4962 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-08-23

global: Advertise rsync features Closes #4962 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-07-26

migration: fix cross version migrations New fields that are added to the protobuf definitions need to be optional so to not break migration between different LXD versions. Closes #4780. Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

2018-07-16

migration: fix cross version migrations New fields that are added to the protobuf definitions need to be optional so to not break migration between different LXD versions. Closes #4780. Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

2018-07-15

lxd/migration: Update protocol Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-03-24

migration: Keep snapshot timestamps in migration Closes #4362 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-02-24

lxd: Move migration code to own package Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2018-02-22

lxd: Move migration code to own package Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2017-12-13

migrate.proto: silence protobuf compiler warning The protobuf compiler complains that it defaults to 'proto2': [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: lxd/migrate.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.) This just explicitly sets the default. Signed-off-by: Adrian Reber <areber@redhat.com> Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

2017-12-05

migrate: finish pre-dumping if threshold reached This adds support to stop the pre-dumping if a certain threshold has been reached. Instead of blindly relying on the 'max' iterations this commit makes it possible to finish the pre-dumping if enough memory has already been migrated using the pre-copy migration optimization. The configuration option is: migration.incremental.memory.goal (default to 70%) If the current pre-dump more pages (%) migrated using pre-dumping than defined in above variable the pre-copy migration is finished even if the 'max' iterations has not been reached. The lower the number the sooner the pre-copy migration will finish, but the container downtime during migration will be longer as a result of the time required to transfer the memory pages. The higher the number is, the shorter the container downtime during migration. Signed-off-by: Adrian Reber <areber@redhat.com> Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

migrate.proto: silence protobuf compiler warning The protobuf compiler complains that it defaults to 'proto2': [libprotobuf WARNING google/protobuf/compiler/parser.cc:546] No syntax specified for the proto file: lxd/migrate.proto. Please use 'syntax = "proto2";' or 'syntax = "proto3";' to specify a syntax version. (Defaulted to proto2 syntax.) This just explicitly sets the default. Signed-off-by: Adrian Reber <areber@redhat.com> Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

migrate: prepare for pre-copy migration (part 3) This introduces a protocol for the rsync transfers to support a variable number of pre-dumps. The number of pre-dumps depends on the workload, the threshold and the number of pre-dumps. Signed-off-by: Adrian Reber <areber@redhat.com> Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

migration: prepare for pre-copy migration (part 2) In addition to the previous pre-copy migration prepare commit which changed the parameters of the Migrate() function this extends the protocol between migration source and destination to detect if pre-copy migration should be used. Currently pre-copy migration defaults to off and can be enabled by setting 'migration.incremental.memory' to true. If it is 'true' and the migration destination side also acknowledges that it supports pre-copy migration the variable 'use_pre_dumps' is set to 'true' and the following commits can use this variable to use pre-copy migration or not in the upcoming patches. Signed-off-by: Adrian Reber <areber@redhat.com> Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

2017-09-28

migration: stateless incremental containers This adds a new criu migration type "NONE" which can be used to perform mock live migration. Any step but actually calling criu will be performed. Closes #3798. Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

2017-07-23

ceph: add storage_ceph_migration.go Signed-off-by: Christian Brauner <christian.brauner@ubuntu.com>

2016-09-23

Add architecture, stateful, prefix config/devices with local Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

container copy: preserve snapshot configuration Previously, we weren't preserving snapshot configuration (as noted in the TODO). Let's do that. Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

2016-09-16

Add architecture, stateful, prefix config/devices with local Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

container copy: preserve snapshot configuration Previously, we weren't preserving snapshot configuration (as noted in the TODO). Let's do that. Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

2015-12-04

migration: migrate snapshots too This commit also moves snapshots when copying containers. Note that it is pretty dumb: it also copies snapshots in the hot path of migraiton, which is a bad deal. Further, it will only copy things between directory storage backends; this adds the framework necessary for fs specific backend send/receive, to be used in later patches. Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

2015-09-15

get rid of migration subpackage We'll need this to fix migration, since we need to call the apparmor/seccomp primitives, and those live in lxd/, and we can't do circular imports. (Moving the security stuff to a security/ package is also nontrivial, since that depends on containerLXD, which itself should be in a separate package, etc. etc.) Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

2015-08-07

Send the host uid/gid map over the migration socket Closes #838 Signed-off-by: Stéphane Graber <stgraber@ubuntu.com>

2015-03-13

implement support for non-live container moves Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

2015-03-06

s/FilesystemType/MigrationFSType/g Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>

use protobufs over migration control socket This fixes one of the TODOs described in the first migration commit. Signed-off-by: Tycho Andersen <tycho.andersen@canonical.com>