Proto commits in nknorg/nkn

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

2023-01-29

add ledger mode to node data and getnodestate rpc response Signed-off-by: Yilun <zyl.skysniper@gmail.com>

The documentation is generated from this commit.

2023-01-07

Implement txn pool syncing by random address and time window Signed-off-by: billfort <fxbao@hotmail.com>

2021-08-16

add fastsync state msg protbuf definition

2021-04-23

Implement stricter sigchain verify logic and sigchain objection Signed-off-by: Yilun <zyl.skysniper@gmail.com>

add generate id2 function with registration fee

Use generalized ID version instead of ID1 and ID2 Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-10-09

Change subscribe meta internal type from string to bytes Protobuf bytes and string have the same encoding but different restrictions: string can now only contain utf-8 characters. However, the current chain data contains non-utf-8 string in meta generated using old pb version, which will cause new version fail to save certain blocks. Changing internal type to bytes will resolve the issue without breaking compatibility. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-09-24

Switch from gogo pb to google pb to reduce memory usage on mobile Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-04-24

Add pin sigchain protocol to reduce relay ram usage (stage 1/2) When most nodes have updated, sigChainElemCacheExpiration will be reduced in the next stage to reduce ram usage. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Migrate sigchain sigAlgo from hash to signature Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-04-22

Add https json rpc address in getws[s]addr response Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-04-21

Fix gofmt, ineffassign, misspell warnings Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-04-14

Fix gofmt, ineffassign, misspell warnings Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-04-10

Migrate sigchain sigAlgo from hash to signature Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-03-02

add name transfer function

Add name registration fee

2020-02-25

Fix pb message field name inconsistent Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2020-01-07

Use remote node wss port instead of local port Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-12-13

Add getWssAddr API

2019-10-12

Implement multicast and compression protocol Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-09-03

add pubsub enchancements 1. prolong existing subscription 2. rpc method to get subscription duration and meta 3. specify offset and limit when requesting subscribers 4. make bucket optional (0 by default) 5. unsubscribe 6. get subscribers from pool too 7. fix subscription count BVS

2019-07-01

modify json format infomation of block modify json format infomation of block Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Modify Block, Header and Transaction structures Use Marshal function for serialization of Block. Use SerializeUnsigned function for calculating the hash. Use the same strategy for Header and Transaction. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Delete types. make new folders: transaction and block 1. delete types. make new folders: transaction and block 2. move all *.proto from types to pb/ 3. move all *.proto from por to pb/ Signed-off-by: NoelBright <noel.n.bright@gmail.com>

move Block and Header structures to types 1. move Block and Header structures to types Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Use proto buffer to make block and header structures 1. Use proto buffer to make block and header structures Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Use New Transaction Struct with Protobuffer 1. add new MsgTx, BlockHeader and Block types. 2. Use protobuffer to instead old struct. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Add src id and dest id in sigchain header Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Rename Signer/ChordId to SignerPk/SignerId in block header Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change nanopay height+duration to expiration For nanopay to be safe, all txn expiration needs to be no later than any nano expiration (for the same nanopay), and thus it's not a good idea to use duration to have dymanic expiration. Instead, it's better to use static expiration height and do not change it for the duration of the nanopay. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

add issueAsset structure and modify account structure 1. add issueAsset structure 2. modify account structure 3. add assetid for NKN asset. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Rename pb enum to follow pb naming standard Signed-off-by: Yilun <zyl.skysniper@gmail.com>

rename commit txn type to sigchain txn type Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Implement client signed sigchain element Signed-off-by: Yilun <zyl.skysniper@gmail.com>

implement initial version of nano pay

Implement efficient sigchain broadcasting Previously each node will send sigchain (commit) txn directly to all neighbors, so each node will receive the same sigchain txn once from all its neighbors. Now each node will first send the height and sighash of sigchain txn to its neighbors, and its neighbor will request it if it's the most optimal sigchain so far for the height. This will greatly reduce sigchain broadcasting overhead. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Implement fast block propagation by only requesting txn hash Previously a block proposal is transmitted with all txn in it. However, this will lead to significant block progation delay and bandwidth waste if most txnx in the proposal are already progagated enough before proposal is sent. Therefore, it's enough to only include a list of txn short hash or hash in block proposal, and receiver will request the missing txns in it. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Use pb struct directly in message to avoid double unmarshal Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Remove dot imports except for importing nkn/common Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change all msg type to unsigned The hop by hop encryption introduced in last commit provides authenticated encryption and thus have the same (actually better) security guarantee (only to the receiver though). So it's no longer needed for direct msg to be signed. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Rename ConsensusData to RandomBeacon 1. Rename ConsensusData to RandomBeacon> 2. Change it to 64 bytes to provide enough entropy for most purposes. 3. use RandomBytes defined in crypto/util/util.go to generate random nunber. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

add GenerateID transaction in pb/payload.proto add GenerateID transaction in pb/payload.proto. message GenerateID { bytes public_key = 1; bytes registration_fee = 2; } Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Start block verification after sigchain cached is filled This prevent new node from blocking consensus due to empty sigchain cache. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change sigchain algorithm to Optimize bandwidth and cpu usage * Signature chain now use the hash of msg + VRF of block hash as "signature" and reveal VRF when it's no longer used. Only one VRF computation is required per block epoch, hugely reduces the CPU overhead. * Sigchain is no longer part of the relay packet. Just the last signature (constant size) is added to the relay packet so that the space overhead is O(1) and < 100 bytes. * The sigchain will be recovered by backtracking. Each node will only attempt to recover one sigchain per block epoch. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

update SigChain and SigChainElem proto structure add 'Proof' member in SigChainElem. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

fixbug: use pb.ED25519 for sigchain instead of pb.ECDSA Signed-off-by: NoelBright <noel.n.bright@gmail.com>

delete unused member in Header structure delete NextBookKeeper and Programs in Header structure Signed-off-by: NoelBright <noel.n.bright@gmail.com>

modify proto files according the standard style according https://developers.google.com/protocol-buffers/docs/style to format block.proto, header.proto, transaction.proto. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-06-30

Change nanopay height+duration to expiration For nanopay to be safe, all txn expiration needs to be no later than any nano expiration (for the same nanopay), and thus it's not a good idea to use duration to have dymanic expiration. Instead, it's better to use static expiration height and do not change it for the duration of the nanopay. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

add issueAsset structure and modify account structure 1. add issueAsset structure 2. modify account structure 3. add assetid for NKN asset. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Rename Signer/ChordId to SignerPk/SignerId in block header Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Rename pb enum to follow pb naming standard Signed-off-by: Yilun <zyl.skysniper@gmail.com>

rename commit txn type to sigchain txn type Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Implement client signed sigchain element Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Implement fast block propagation by only requesting txn hash Previously a block proposal is transmitted with all txn in it. However, this will lead to significant block progation delay and bandwidth waste if most txnx in the proposal are already progagated enough before proposal is sent. Therefore, it's enough to only include a list of txn short hash or hash in block proposal, and receiver will request the missing txns in it. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

implement initial version of nano pay

Implement efficient sigchain broadcasting Previously each node will send sigchain (commit) txn directly to all neighbors, so each node will receive the same sigchain txn once from all its neighbors. Now each node will first send the height and sighash of sigchain txn to its neighbors, and its neighbor will request it if it's the most optimal sigchain so far for the height. This will greatly reduce sigchain broadcasting overhead. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Use pb struct directly in message to avoid double unmarshal Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Remove dot imports except for importing nkn/common Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change all msg type to unsigned The hop by hop encryption introduced in last commit provides authenticated encryption and thus have the same (actually better) security guarantee (only to the receiver though). So it's no longer needed for direct msg to be signed. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Rename ConsensusData to RandomBeacon 1. Rename ConsensusData to RandomBeacon> 2. Change it to 64 bytes to provide enough entropy for most purposes. 3. use RandomBytes defined in crypto/util/util.go to generate random nunber. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

modify proto files according the standard style according https://developers.google.com/protocol-buffers/docs/style to format block.proto, header.proto, transaction.proto. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

modify json format infomation of block modify json format infomation of block Signed-off-by: NoelBright <noel.n.bright@gmail.com>

delete unused member in Header structure delete NextBookKeeper and Programs in Header structure Signed-off-by: NoelBright <noel.n.bright@gmail.com>

fixbug: use pb.ED25519 for sigchain instead of pb.ECDSA Signed-off-by: NoelBright <noel.n.bright@gmail.com>

add GenerateID transaction in pb/payload.proto add GenerateID transaction in pb/payload.proto. message GenerateID { bytes public_key = 1; bytes registration_fee = 2; } Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Start block verification after sigchain cached is filled This prevent new node from blocking consensus due to empty sigchain cache. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Add src id and dest id in sigchain header Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change sigchain algorithm to Optimize bandwidth and cpu usage * Signature chain now use the hash of msg + VRF of block hash as "signature" and reveal VRF when it's no longer used. Only one VRF computation is required per block epoch, hugely reduces the CPU overhead. * Sigchain is no longer part of the relay packet. Just the last signature (constant size) is added to the relay packet so that the space overhead is O(1) and < 100 bytes. * The sigchain will be recovered by backtracking. Each node will only attempt to recover one sigchain per block epoch. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

update SigChain and SigChainElem proto structure add 'Proof' member in SigChainElem. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Modify Block, Header and Transaction structures Use Marshal function for serialization of Block. Use SerializeUnsigned function for calculating the hash. Use the same strategy for Header and Transaction. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Use proto buffer to make block and header structures 1. Use proto buffer to make block and header structures Signed-off-by: NoelBright <noel.n.bright@gmail.com>

move Block and Header structures to types 1. move Block and Header structures to types Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Delete types. make new folders: transaction and block 1. delete types. make new folders: transaction and block 2. move all *.proto from types to pb/ 3. move all *.proto from por to pb/ Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Use New Transaction Struct with Protobuffer 1. add new MsgTx, BlockHeader and Block types. 2. Use protobuffer to instead old struct. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-06-29

Rename Signer/ChordId to SignerPk/SignerId in block header Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-06-28

Change nanopay height+duration to expiration For nanopay to be safe, all txn expiration needs to be no later than any nano expiration (for the same nanopay), and thus it's not a good idea to use duration to have dymanic expiration. Instead, it's better to use static expiration height and do not change it for the duration of the nanopay. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

add issueAsset structure and modify account structure 1. add issueAsset structure 2. modify account structure 3. add assetid for NKN asset. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-06-20

Rename pb enum to follow pb naming standard Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-06-19

rename commit txn type to sigchain txn type Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Implement client signed sigchain element Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-06-11

implement initial version of nano pay

2019-06-04

Implement efficient sigchain broadcasting Previously each node will send sigchain (commit) txn directly to all neighbors, so each node will receive the same sigchain txn once from all its neighbors. Now each node will first send the height and sighash of sigchain txn to its neighbors, and its neighbor will request it if it's the most optimal sigchain so far for the height. This will greatly reduce sigchain broadcasting overhead. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Implement fast block propagation by only requesting txn hash Previously a block proposal is transmitted with all txn in it. However, this will lead to significant block progation delay and bandwidth waste if most txnx in the proposal are already progagated enough before proposal is sent. Therefore, it's enough to only include a list of txn short hash or hash in block proposal, and receiver will request the missing txns in it. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Use pb struct directly in message to avoid double unmarshal Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-06-03

Remove dot imports except for importing nkn/common Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change all msg type to unsigned The hop by hop encryption introduced in last commit provides authenticated encryption and thus have the same (actually better) security guarantee (only to the receiver though). So it's no longer needed for direct msg to be signed. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Rename ConsensusData to RandomBeacon 1. Rename ConsensusData to RandomBeacon> 2. Change it to 64 bytes to provide enough entropy for most purposes. 3. use RandomBytes defined in crypto/util/util.go to generate random nunber. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

add GenerateID transaction in pb/payload.proto add GenerateID transaction in pb/payload.proto. message GenerateID { bytes public_key = 1; bytes registration_fee = 2; } Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-05-27

Start block verification after sigchain cached is filled This prevent new node from blocking consensus due to empty sigchain cache. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-05-20

update SigChain and SigChainElem proto structure add 'Proof' member in SigChainElem. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

Add src id and dest id in sigchain header Signed-off-by: Yilun <zyl.skysniper@gmail.com>

Change sigchain algorithm to Optimize bandwidth and cpu usage * Signature chain now use the hash of msg + VRF of block hash as "signature" and reveal VRF when it's no longer used. Only one VRF computation is required per block epoch, hugely reduces the CPU overhead. * Sigchain is no longer part of the relay packet. Just the last signature (constant size) is added to the relay packet so that the space overhead is O(1) and < 100 bytes. * The sigchain will be recovered by backtracking. Each node will only attempt to recover one sigchain per block epoch. Signed-off-by: Yilun <zyl.skysniper@gmail.com>

2019-03-29

fixbug: use pb.ED25519 for sigchain instead of pb.ECDSA Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-03-28

delete unused member in Header structure delete NextBookKeeper and Programs in Header structure Signed-off-by: NoelBright <noel.n.bright@gmail.com>

modify proto files according the standard style according https://developers.google.com/protocol-buffers/docs/style to format block.proto, header.proto, transaction.proto. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

modify json format infomation of block modify json format infomation of block Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-03-08

Modify Block, Header and Transaction structures Use Marshal function for serialization of Block. Use SerializeUnsigned function for calculating the hash. Use the same strategy for Header and Transaction. Signed-off-by: NoelBright <noel.n.bright@gmail.com>

2019-03-01

Delete types. make new folders: transaction and block 1. delete types. make new folders: transaction and block 2. move all *.proto from types to pb/ 3. move all *.proto from por to pb/ Signed-off-by: NoelBright <noel.n.bright@gmail.com>

move Block and Header structures to types 1. move Block and Header structures to types Signed-off-by: NoelBright <noel.n.bright@gmail.com>