Proto commits in PaddlePaddle/PARL

These 10 commits are when the Protocol Buffers files have changed:

Commit:eb1ebbf
Author:Bo Zhou
Committer:GitHub

Actor status (#1071) * add status detection for remote instance * upgrade paddle version in documentation compilation env * copyright * remove code for debug

The documentation is generated from this commit.

Commit:4ebd8a0
Author:Bo Zhou
Committer:GitHub

[WIP] starting a single heartbeat server at client side (#1044) * starting a single hearbeat server at client side * remove unit tests for stop function in heartbeat_severt * remove undefined varialbes * add destroy function * copyright * fix bug in counting the number of acitve clients * fix bug in reset_job_test.py that does not kill all subprocesses * increase waiting time for testing the number of actors * kill the grpc hearbeat process while disconnecting the client * typo * add variable client_is_alive * modify xparl port for testing * remove initialization argument client_heartbeat_address in class InitializedJob * remove actor_ref_monitor * typo * avoid creating a large amount of socket at the same time * fork the process at first * update comment * -j10 * -j10 * fix typo in unittests * typo * typo * unittest * using terminate instead of kill in py36 * provide a base class for unit test of xparl * add file * typo * typo * unittest * unittest * unittest * unittest * unittest * unittest

Commit:81e7015
Author:zenghsh3
Committer:GitHub

first PR of heartbeat refactor (#489) * first PR of heartbeat refactor * fix typo * fix bug * fix python2 compatibility; fix bugs * fix bug * setDaemon should be used before start * add dependences of grpc and protobuf * refine comments * fix dependences

Commit:2d21e5d
Author:Bo Zhou
Committer:GitHub

Evo kit (#244) * rename namespace * update torch code * rename deepes to evokit * update readme * Update CMakeLists.txt * update build.sh

Commit:6d23261
Author:Bo Zhou
Committer:GitHub

update code format to meet icode requirement (#243) * update code format to meet icode requirement * update torch code

Commit:53da94b
Author:Bo Zhou
Committer:GitHub

update directory structure to support the icode platform (#242) * update directory structure to support the icode platform * remove source code generated by protobuf * move code into the core directory

Commit:31ee4fa
Author:rical730
Committer:GitHub

add gaussian sampling method with noise table (#241) * add gaussian sampling method with noise table * add table sampling test and agent param_size test * add model param_size test * get param size of paddle demo * rename gaussian_table_sampling to cached_gaussian_sampling * add unittest to sampling method and uniform indentation to 2 spaces Co-authored-by: TomorrowIsAnOtherDay <2466956298@qq.com>

Commit:7539601
Author:Bo Zhou
Committer:GitHub

add an agent for the support of asynchronous update (#235) * rename SamplingKey to SamplingInfo * add asynchronous lsagent * rename AsyncAgent to AsyncESAgent * fix comments * Update async_es_agent.cc * Sampling Info * commemt * commemt

Commit:b1cabc2
Author:rical730
Committer:GitHub

add SGD and Adam Optimizer for DeepES (#222) * add SGD and Adam Optimizer for DeepES * update deepes readme * add warning when input different size in the same param update() * add error return in update(), add optimizer.cc * separate SGD and Adam, optimizer type in config is not case sensitive * delete optimizer.cc * config optimizer in deepes.proto * more readable * update maddpg readme, fixed gym version

Commit:c848bda
Author:Bo Zhou
Committer:GitHub

deepES framework & a demo that is compatible with torch (#214) * add deepES & a demo that is compatible with torch * add copyright & update protoc file path * add copyright * rm useless files * update dependency on libtorch * add the demonstration gif * update gif * Create README.md * Update README.md * Update README.md * Update README.md * update scripts * update scripts#2 * update torch_predictor