Proto commits in gobitfly/eth2-beaconchain-explorer

These 20 commits are when the Protocol Buffers files have changed:

Commit:a073010
Author:Tangui-Bitfly
Committer:GitHub

feat(BEDS-536): add `re-index-blocks` cmd to fix internal transfers status (#2965) * fix(internal transaction): recursively revert traces * fix: SQLReaderDb interface missing methods * fix(eth1tx): remove transfers if reverted * fix(internal tx): only save the highest root revert * ci lint * feat: updated eth1 proto file * feat: updated Eth1InternalTransaction in eth1.proto file * feat: added Reverted value to Eth1InternalTransactionIndexed * feat: add check for internal txs while querying the block from erigon node and set the status to 2 if tx has failed partially * feat: updated reverted internal txs check logic * feat(types): add status enum and add status partially executed * refactor(client/erigon): simplify transaction indexing flow * feat(client/erigon): rework geth traces * fix: lint * feat: add status to Eth1TransactionIndexed msg and update hash formatting * fix: updated internal tx handling in GetBlock func * fix: updated internal txs parsing in GetBlock * fix: optimise the memory of internla tx parsing * lint * fix(internal): remove revert + status logic from client to transformers * test(internal): test for revert transformer on tx and itx * feat(cmd): add re-index-blocks cmd * chore(proto): clean proto Eth1Transaction and Eth1TransactionIndexed * fix(TransformItx): empty revertSource + error before skipping * feat(BEDS-536): implement misc `fix-internal-txs-from-node` cmd with batch processing from Erigon node (#2967) * wip: move itx status parsing logic to transformers func * wip: implementing fix-internal-txs misc cmd * wip: updated geth client initialisation * wip: moved blocks by batch logic to erigon.go * wip: updated block by number batch call * updated blocks batch processing * feat: added transformers for bulk mutations * fix: save current block height in local variable when performing mutation of the block data * fix: add check for start and end block flags * fix: updated erigon client * fix: add check for batchcall size and return if it's empty * cleanup unused code * cleanup * updated cmd name to fix-internal-txs-from-node * fix: uncles, blobGasUsed & excessBlobGas parsing * rm timings, update GetBlocksByBatch func * fix: revised ReindexITxsFromNode func logic * fix: update the logic for parsing uncles, BlobGasUsed and ExcessBlobGas * (BEDS-536) Use raw db for resync (#2972) * rpc/erigon: use raw bigtable * rpc/erigon: use cache raw db * rpc/erigon: correct path for geth traces * cmd/reindex: improve performance + fix raw store cache * rpc/erigon: fix sender address * db2/store: add remote server + client * fix ci * store/bigtable: fix range limits go mod * store/bigtable: fix grpc error on close * updated Receipts len check * updated traceMode to geth * fix ci * clenup * rpc/erigon: parse traces geth handle CALLCODE * fix(transform itx): allow internal index == ITX_PER_TX_LIMIT * fix(bigtable): retry on grpc internal err * fix(re index): log error rather than returning error and panicking * feat(re index): re print read error at the end * fix(TransformEnsNameRegistered): return none nil if ignored chainID * fix(db2/WithFallback): fallback on syscall.ECONNRESET * fix(blockHash): prevent wrong calculated hash * fix: return error if mismatch between receipts and transactions length * fix: blockhash read from node response * fix: merge go mod --------- Co-authored-by: Monika-Bitfly <181824500+Monika-Bitfly@users.noreply.github.com> Co-authored-by: Patrick Pfeiffer <306324+guybrush@users.noreply.github.com>

The documentation is generated from this commit.

Commit:acd149d
Author:Tangui Clairet

chore(proto): clean proto Eth1Transaction and Eth1TransactionIndexed

The documentation is generated from this commit.

Commit:abaaae2
Author:Tangui Clairet
Committer:Tangui Clairet

fix(internal): remove revert + status logic from client to transformers

Commit:2a0a2fa
Author:Monika-Bitfly

feat: add status to Eth1TransactionIndexed msg and update hash formatting

Commit:bb1d8ab
Author:Tangui Clairet

feat(types): add status enum and add status partially executed

Commit:a2d8210
Author:Monika-Bitfly

feat: updated Eth1InternalTransaction in eth1.proto file

Commit:19e6108
Author:Monika-Bitfly

feat: updated eth1 proto file

Commit:ed188e4
Author:remoterami
Committer:GitHub

(BIDS-2550) fixed contract invocation detection by adding metadata column (#2618) * (BIDS-2550) saving contract updates to bigtable (BIDS-2550) use field for blob transactions (BIDS-2550) save contract updates to bigtable (BIDS-2550) removed metadataUpdates indirection; added destruction detection (BIDS-2550) support for internal transactions (BIDS-2550) handle contract destruction, show correct data (BIDS-2550) detect failed transactions (BIDS-2550) applied (most) suggestions (BIDS-2550) remove contract state updates on forks this approach might be a bit naive though, as bigtable probably can't filter by time efficiently (BIDS-2550) applied feedback (BIDS-2550) fixed invalid bt blockKey timestamps (BIDS-2550) added bigtable transform (BIDS-2550) correct variable naming (BIDS-2550) added new transform to list of all (BIDS-2550) fixed ts search (BIDS-2550) fixed failed itx detection, fixed update sorting, variable naming (BIDS-2550) fixed bigtable rowrange (BIDS-2550) using distinct contract update bt key (BIDS-2550) add column filter to ClearByPrefix misc command (BIDS-2550) delete keys output clarified (BIDS-2550) ui issue fixed, bit assumptions adjusted (BIDS-2550) fixed columns filter (BIDS-2550) disabled column filter * (BIDS-2550) fixed column filter * (BIDS-2550) added contract detection for parity traces * (BIDS-2550) fix parity contract detection * (BIDS-2550) using utils.LogFatal

Commit:d6a77bf
Author:Patrick Pfeiffer

(BIDS-2346) update eth1.proto, update go-ethereum

Commit:897e9f5
Author:Patrick Pfeiffer

(BIDS-2346) update indexing of blocks

Commit:37e8c75
Author:Patrick Pfeiffer

(BIDS-2346) update eth1.proto for blobtxs

Commit:445452b
Author:Patrick Pfeiffer

(BIDS-2346) update eth1.proto for blobs

Commit:a595ad4
Author:Patrick Pfeiffer
Committer:Patrick Pfeiffer

(BIDS-2346) make onetimeexport delete epochs first before reexporting

Commit:2cba024
Author:Patrick Pfeiffer

(BIDS-2346) index blob-metadata

Commit:0c8c4d3
Author:Patrick Pfeiffer

(BIDS-2346) update eth1 proto

Commit:6cc5b70
Author:MauserBitfly
Committer:GitHub

Bids 1458/ens backend via event indexing (#2251) * (BIDS-1458) ENS backend

Commit:97d520a
Author:peter

(BIDS-1211) index withdrawal events and mark withdrawal target address for balance updates

Commit:9817a23
Author:Stefan

protobuf withdrawals

Commit:0ac98ca
Author:Manuel Caspari
Committer:GitHub

Bigtable Machine Metric (#1656) * bigtable machine metrics, migrator for psql to bigtable * remove partition creation from stats, return error if stats failed to insert * migrator performance improvement (export per day), machine metrics notifications, generics * cleanup and custom epoch wait intervals for notifications * fix infinite machine offline notification by reintroducing range of last 90min * run old machine stats and new in parallel in api

Commit:94fdfa2
Author:Peter (bitfly)
Committer:GitHub

Staging eth1 (#1545) * add getblock info call for erigon eth1 nodes * add eth1 client interface * add extraction of ERC1155 tokens from tx receipts * add initial eth1 block exporter * fix progress report * fix undefined NET * add blocks view * update indexer * mod tidy * fix merge redeclare * eth1indexer: transform transactions from blocks to data table * add bigtable transforms and erc20 bindings * index tx use column qualifiers for logs and traces * index transactions, interal tx, erc20 * update invokes contract conditions * add erc1155 and erc721 bindings * parse erc1155 logs * erc account for topics * byte compare topics * first index run * fix address hash.bytes -> bytes * pad itx to 6 places * transform uncles * Add index range checks * add blocks miner index * add missing itx indices * add comments update indexes * add to from time for erc transforms * add read function for tx, itx and erc20 * fix transaction to * increase tx padding * improve read methods * update family and column names * update blocks query * add read functions * add accounts page * rewrite GetEth1ERC1155ForAddress with newrange * remove log * update eip1155 read method * increase log padding * improve bigtable read methods * output tx hash on padding overflow * add execution address page * transactions infinite scroll * fix ordering transactions * add paging for erc and fix asc transforms * add hash navigation for pills * fix eport ordering of transactions * add itx and erc20 token index to account view * add erc token data * include MethodId in tx view * fix mev calculation * add balance update module * add token route * add token handler * only show tabs with values * add automatic indexing of eth1 data * improve formatting add empty result set placeholder image * do not export empty itx & root itx * improve formatting * harmonize flags handling of eth1 indexer * don't show loading for entries < 25 * add blocks and uncles tab * add balance update module * make table headers sticky * initial token view * improve balance updater * format erc20 transfers in account view * fix logging messages * retrieve account balance on demand * Implement dynamic ERC20 Metadata retrieval and balance formatting * Improve ERC20 token handling * add missing erc20 index * improve erc721 and erc1155 token indexing * fix token indexing * allow filtering for a specific address in the erc20 token tracker * Add name tags * Fix token value display * improve metadatra fetching & caching * improve token tracker * add in/out/self * add /unitConverter view * improve name caching * adjust unit converter path * add unit converter to header menu * adjust unit converter path on menu header * add contract metadata retrieval * prepare tx viewer * add eth1 tx viewer * hide empty tabs, only show loading when necessary * migrate to redis for data caching * redis: debug use local cache * improve caching * Initialize Redis * add address qrcode * address qr code lib * rework caching * fix go mod * #BIDS-436 Implement Block Table Page * redis: debug use local cache * fix caching bugs * fix cache init * gracefull handle timeouts when fetching balance updates * inverse qr & responsive header * fix token tracker name tags * gasnow page data hanlding * improve metadata fetching logic * Improve geth/erigon rpc handling * fix formatAddressLong function * fix various warnings * fix various warnings * fix various warnings * add eth1 address earch function * add search for eth1 addresses & transactions * add searching for eth1 addresses & tx hashes * #BIDS-436 Implement Block Table Page * prepare chain reorg handling * disable gasnow updater temporarily * add view for pre merge pow blocks (WIP) * fix tx viewer crashbug * improve address layout * fix various warnings * fiux warnings * add chain reorg handling * improve responsiveness & add ether value * improve chain reorg handling performance * implement erc20 token price update * #BIDS-436 Implement Block Table Page * fix various warnings * Added some error checks in GetBalanceForAddress * formattingaddress short * add blur; improve overflow * max table column width * add InternalTransactionCount to block entity * improve table overflow * improve formatting * add balance component * make token price updater configurable * do not serialize contract abi object * sort tokens by dollar value * fixes; improve formatting * empty token placeholder * add erc721 erc1155 handlers * fix ethbalance * fix ethbalance * add inf erc721; fixes inf scroll * fix eth fmt * fix token ranking * fix balance export * Added view for post merge PoS blocks (WIP) * add full balance refresh mode * update explorer initialization * make network for eth1 export configurable * db,bigtable: recreate ABI attribute when reading from cache * clean up tnx view * respect chainid when accessing bigtable data * enforce chain id on explorer * enable abi retrieval for goerli network * fix errors in misc file * #BIDS-436 Implement Block Table Page * improve mobile view * svg support dark theme * improve formatting * improve formatting * Extend functionality of FormatAddress * #BIDS-436 Implement Block Table Page * Added precomma limit for Format Amount Formated * Added copy to clipboard option to FormatAddress * #BIDS-438 Implement Transactions Table Page * tokan page overview cards * Bug fixing: concurrent map iteration and map write * Greatly improve loading more transactions * #BIDS-438 Implement Transactions Table Page * add erc20 tokens transferred to tnx view * rename bigtable file * fix merge artifacts * fix bulk balance check * fix linting issues * re-enable export * fix balance checker * use temp directoy of last attestation cache dir is not set & only initialize cache if required * fix execution block tempalte formatting * fix overview block tempalte formatting * fix duplicate blocks * fix formatting * fmt bigtable.go Co-authored-by: Stefan <stefan@bitfly.at> Co-authored-by: Lucca <lucca.dukic@bitfly.at> Co-authored-by: recy21 <stefan.fuhrmann@bitfly.at> Co-authored-by: InvisibleBitfly <110384239+InvisibleBitfly@users.noreply.github.com>