Proto commits in projecteru2/core

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

Commit:195b249
Author:Yu Yang
Committer:GitHub

support ignoring workload lock in RawEngine operation (#636) * support ignoring workload lock in RawEngine operation * add UT

The documentation is generated from this commit.

Commit:54bdcc9
Author:Yu Yang
Committer:GitHub

support skipping image pull when deploy (#635) * allow int for memory * support skipping image pull when deploy * add UT for ignore image pull

Commit:a29fe9b
Author:Yu Yang
Committer:GitHub

Raw engine (#612) * remove virt http client * add RawEngine api * add UT

Commit:825eaf0
Author:hongji
Committer:GitHub

support send large file to workload (#532) * Add send large file * Finished the code and can compile successfully, but it hasn't been tested yet * now it can send large file chunk by chunk, but still need to make some adjustments * add file size in metadata * now it can send servel large file, but sometimes they faild and i don't know the reason * modify return parameters for `SendLargeFile` * bug fix * modify the definition of grpc * delete some annotation and modify the code * fix dead lock, modify chunk size * bug fix * add some annotation * rollback makefile * modify the function 'newWorkloadExecutor' and let it just send one file * modify the RPC method 'send', let it call 'SendLargeFile' * modify the struct of 'SendLargeFileOptions' * clean up the code * clean up the code * regenerate mock * delete debug code * add test for SendLarge in cluster * replace copychunk to copy in send * let chunkSize as a const * bug fix: need to add waitgroup in the very beginning * lint * use defer * fix bug that cannot return err in goroutine * use different err parameter in function * adjust the code for CR

Commit:dd058ca
Author:Yu Yang
Committer:GitHub

add DRAIN strategy (#609)

Commit:43c325d
Author:CMGS

show node test attribute

Commit:75cf86e
Author:CMGS

add a new test tag for node if node use for testing

Commit:8c86efa
Author:CMGS
Committer:CMGS

fix all logical error, not finish yet

Commit:4c2b8fb
Author:CMGS
Committer:CMGS

make resource great again

Commit:bb7c652
Author:CMGS
Committer:GitHub

Log rewrite and refactor (#594) * revise sentry report * revise sentry report * bind sentry and log * fix log issue * struct logs! * remove useless code * rewrite todo context

Commit:653e64d
Author:CMGS
Committer:CMGS

support build with platform

Commit:ce50438
Author:CMGS
Committer:CMGS

refactor stage 2

Commit:4fe8207
Author:CMGS
Committer:CMGS

[skip ci] refactor stage 1

Commit:870c7d9
Author:CMGS
Committer:CMGS

[skip ci] sync with iops control

Commit:9485b58
Author:CMGS

clean deprecated rpc interface

Commit:ac037e7
Author:DuodenumL
Committer:GitHub

Resource Plugin (#491) * resource plugin * modify rpc layer to adapt to the resource plugin * temporarily remove metrics * modify the engine layer to adapt to the resource plugin * modify cluster layer to adapt to the resource plugin * unit tests * metrics * compatible * lint & disable nolintlint temporarily * migerate tools & unit tests * review

Commit:43d7381
Author:CMGS
Committer:GitHub

refactor wal stage 1 (#561) * refactor wal2 * remove useless step in remove * minor refactor createworkloadhandler

Commit:36d1c03
Author:CMGS
Committer:GitHub

support get engine by node, only show which engine type (#557)

Commit:dfef999
Author:DuodenumL
Committer:GitHub

migrate selfmon to eru-core (#528) * migrate selfmon to core * engine cache checker

Commit:d903237
Author:DuodenumL
Committer:GitHub

support setting tls configs in "SetNode" (#526)

Commit:117368c
Author:zc
Committer:GitHub

Add stream APIs for PodNodes and PodResource (#524) * add stream APIs for PodNodes related operations * implement PodresourceStream * streamize ListPodNodes, get rpc/transform out of extra IO * implement PodNodesStream * update unitests * return node even if failed to fetch info

Commit:cbe538e
Author:Joseph Gu
Committer:GitHub

implement imageList (#513)

Commit:00fb8bd
Author:DuodenumL
Committer:GitHub

[SPPSP-2925] add timeout to ListPodNodes (#506)

Commit:d1f0546
Author:zc
Committer:CMGS

update proto, allow users to specify file own&perm

Commit:6d3c4ea
Author:DuodenumL
Committer:tonic

fix selfmon related known issues

Commit:9b11ca9
Author:雾雨
Committer:GitHub

update node via set node (#457) Co-authored-by: nyanpassu <nyanpassu@outlook.com>

Commit:b2f866c
Author:tonic
Committer:GitHub

optimize set workload status (#428) * optimize set workload status * use pre defined error

Commit:3b74a61
Author:tonic
Committer:GitHub

return core identifier in info rpc (#404)

Commit:cfb89c7
Author:tonic
Committer:tonic

add node filter compatibility

Commit:8729267
Author:zc
Committer:GitHub

Add Commands fields in Entrypoint (#389)

Commit:9a2dea0
Author:tonic
Committer:tonic

add control number to identify

Commit:d5e8a01
Author:tonic
Committer:GitHub

init numa memory should be returned too (#383)

Commit:9453d84
Author:Easton
Committer:GitHub

added `Env` in `message Workload` for #378 (#379) * added `Env` in `message Workload` * reverted go.sum

Commit:c90580c
Author:CMGS
Committer:CMGS

support ulimit for docker engine #362

Commit:41c527b
Author:tonic
Committer:GitHub

support excluding nodes when creating workloads (#365) * support excluding nodes when creating workloads * use context to control `ListPodNodes` * use a NodeFilter to do filtering * to pass golangci-lint * remove compatibility

Commit:f44a0e0
Author:tonic
Committer:GitHub

add get node status method (#351) * add get node status method * add unittests

Commit:cd5681d
Author:CMGS
Committer:GitHub

redefine restart and keep backward compatible (#345)

Commit:cb6eaa9
Author:CMGS
Committer:GitHub

redefine restart policy (#344)

Commit:8afc19a
Author:zc
Committer:GitHub

demultiplex exec output into stdout / stderr (#327) * drop obsolete engine APIs: ExecCreate, ExecAttach * add std_type in ExecuteMessage * demultiplex std stream into stdout/stderr * Lambda and Log API can distinguish std stream * pass unittest

Commit:06419bc
Author:CMGS
Committer:CMGS

remove fill global, fill now can calcuate with capacity

Commit:6aab298
Author:tonic
Committer:GitHub

add SetNodeStatus and NodeStatusStream API (#323) * add SetNodeStatus and NodeStatusStream API * IDs -> ids, use /status prefix instead * regenerate mock

Commit:8c3fc63
Author:zc
Committer:GitHub

add strategy method: FILLGLOBAL (#305) * add strategy method: FILLGLOBAL * pass test

Commit:3c409cd
Author:CMGS

fix make grpc warning

Commit:2788601
Author:tonic
Committer:GitHub

add follow option (#302)

Commit:c60fac9
Author:tonic
Committer:GitHub

remove network mode (#301)

Commit:11f86cd
Author:CMGS
Committer:GitHub

refactor: new send and copy (#287) * bugfix: minor revised copy RPC interface * refactor: send and copy

Commit:9490bac
Author:CMGS
Committer:GitHub

rename all container to workload (#271) * rename container to workload * store create time in workload meta

Commit:e65c465
Author:CMGS
Committer:CMGS

support calculate capacity without deploy strategy

Commit:97094bd
Author:CMGS
Committer:GitHub

calcuate capacity before creating (#268)

Commit:2817b76
Author:CMGS
Committer:CMGS

Refactor a bit, combine node resouce and pod resouce calculation (#264) * support get all nodes by ListPodNodes API * cleanup comments * support store status forever * decrease service put frequency * remove useless * combine node resource and pod resource

Commit:6dadb17
Author:zc
Committer:GitHub

Simplified Realloc and Refined Misc (#261) * redefine resource rpc interface * redefine transform interface * redefine cpumem and storage * redefine a lot * simplify realloc: accept single container ID * Txn rollback func can know which part fails * simplify volume dispense: compatible computing Co-authored-by: CMGS <ilskdw@gmail.com>

Commit:30f925f
Author:CMGS
Committer:GitHub

refactor: revise a lot (#259)

Commit:51a0fa5
Author:zc
Committer:GitHub

resource request & limit (#258) * re-design data structure for resource request/limit * modify grpc api: add *_request field in deployopt * container records request and limit * module change: independent resources module * realloc adapts for resource request/limit * pass unittest and add more test * GetContainer response contains resource request

Commit:f2c5f6a
Author:CMGS
Committer:CMGS

minor revise strategy rpc define

Commit:600dc8b
Author:CMGS

minor revise strategy rpc define

Commit:7dbe69e
Author:CMGS
Committer:CMGS

support multiple nodenames (#255)

Commit:30eb518
Author:CMGS
Committer:GitHub

split strategy and scheduler (#249) * split strategy and scheduler * add utils tests to ensure everything ok

Commit:117b5f7
Author:zc
Committer:CMGS

add RPC WatchServiceStatus into protobuf

Commit:fd80ffd
Author:CMGS
Committer:CMGS

refactor network interface, will response subnets (#240)

Commit:cd44595
Author:CMGS
Committer:GitHub

support network control (#239)

Commit:a9d896f
Author:CMGS
Committer:GitHub

pod resource return volumes usage (#232)

Commit:fdfc485
Author:CMGS
Committer:GitHub

support fix resource when get node resource (#231)

Commit:d9015db
Author:CMGS
Committer:GitHub

use triOpt in node set (#230)

Commit:92447db
Author:CMGS
Committer:CMGS

use tri options to revise cpu bind and memory limit (#227) * use tri options to revise cpu bind and memory limit * refactor realloc resource interface with options

Commit:f5fa132
Author:CMGS
Committer:GitHub

support override memory limit options when reallocing (#226)

Commit:22e0c91
Author:CMGS
Committer:CMGS

apply lint suggestions, add rpc Info API

Commit:7b7d9b3
Author:CMGS
Committer:CMGS

refactor all txn methods, seems safe for all APIs now

Commit:e41d600
Author:zc
Committer:GitHub

image build supports vm (#201) * add method ImageBuildFromExist into engine interface * add existID in build option * refactor calcium build * implement build from exist * bump version 05.01 * add build option field: build_method * move BuildOption from enginetypes into types * fix ut * add missing image types * build from scm is default method * add errorDetail message when building fails * catch up with ut coverage rate

Commit:c60b6b5
Author:段子彧
Committer:GitHub

realloc.go support bindCpu/unbindCpu (#190) * realloc support bindCpu/unbindCpu

Commit:ba6f8b1
Author:YongHaoHu
Committer:CMGS

realloc: Send Error to watcher instead of boolean success.

Commit:68f3cff
Author:CMGS
Committer:CMGS

add mark containers down to set node api

Commit:1278f37
Author:CMGS
Committer:CMGS

support log stream options

Commit:677104b
Author:zc
Committer:CMGS

schedule volume resource (#161) * add volume_map into protobuf * node management in rpc layer * node management in cluster and store * container operation with volume on protobuf * cluster interface and rpc adapter * calcium can UpdateNodeResource with volume map: create / dissociate / remove * implement multiple fragments scheduling algorithm * share host struct to distribute resource * bugfix and pass test * specify int64 for ResourceMap * introduce VolumePlan type, create volumes using scheduled plans * store.AddNode interface: introduce parameter object * engine handles auto volume * unittest for volume distribution algorithm * createContainerMessage contains volume plan * refactor: rename, minors * realloc volume schedule * typo, bugfix and minors * replenish types/node_test * keep the same device binding as existing container's(vm's) when realloc * unittest for realloc * soothe lint * get container with volumes and volume plan * unittest covers realloc more * realloc hard volume, like /tmp:/tmp * engine knows whether volume changed by realloc request * delete VolumeUsed in NodeInfo: useless * remedy CompareStringSlice comments

Commit:790af99
Author:CMGS

remove node without podname

Commit:9c6eaf4
Author:CMGS
Committer:CMGS

lock node without podname

Commit:647ecb1
Author:CMGS
Committer:CMGS

refactor node implement

Commit:7e01bb9
Author:CMGS
Committer:CMGS

support label filter at list containers methods

Commit:db92c91
Author:CMGS
Committer:CMGS

support label filter at node list

Commit:bb3e62b
Author:CMGS
Committer:CMGS

build with git dir for reasons

Commit:4e16be8
Author:CMGS
Committer:CMGS

support force set containers status

Commit:0e5ae28
Author:CMGS
Committer:CMGS

use different key to store containers status

Commit:06da695
Author:CMGS
Committer:CMGS

refactor get/set/watch container status

Commit:4bf0d53
Author:CMGS
Committer:CMGS

refactor container status

Commit:573dc1f
Author:CMGS
Committer:CMGS

revise container status stream API

Commit:938ff59
Author:CMGS
Committer:CMGS

revise container status API

Commit:f974d07
Author:CMGS
Committer:CMGS

new meta design

Commit:1b26d64
Author:CMGS
Committer:CMGS

refactor container status APIs

Commit:e06259f
Author:CMGS
Committer:CMGS

async run and wait

Commit:bd8bacc
Author:zc
Committer:CMGS

refine lambda (#128) * refine lambda * fix lambda without stdin * break down into helper for stream and channel * exec -it bash * response exitcode to executeContainer * unify executeInside * unify RunAndWaitMessage and ExecuteContainerMessage into AttachContainerMessage * fix test * minor fixes: typo, log, style

Commit:5876569
Author:CMGS
Committer:CMGS

not add 50G storage quota

Commit:96d8ad9
Author:CMGS
Committer:CMGS

raw args for support something specify

Commit:222cf9b
Author:CMGS
Committer:CMGS

no more ttl when update container status

Commit:1425d9d
Author:CMGS
Committer:CMGS

less inspect if necessary

Commit:a387d63
Author:CMGS
Committer:CMGS

minor revise APIs

Commit:a7a22d2
Author:zc
Committer:CMGS

non-interactive ExecuteContainer (#107) * add GRPC protobuf ExecuteContainer * implement exec interface for rpc server * minor fix: brotobuf field name * Calcium.ExecuteContainer * engine can execute container * harness existing interface: ExecCreate && ExecAttach * minor fixes * bump version: 19.07.11 -> 19.07.12

Commit:c3bb536
Author:CMGS
Committer:CMGS

limit listcontainers API response

Commit:0de55d8
Author:CMGS
Committer:CMGS

stream list containers for huge containers

Commit:8cfb874
Author:CMGS
Committer:CMGS

refactor set-node api

Commit:276729c
Author:CMGS
Committer:CMGS

use SetNode API to replace SetNodeAvailable API

Commit:72a2520
Author:CMGS
Committer:CMGS

add ttl to deploy status