Proto commits in dolthub/dolt

These 99 commits are when the Protocol Buffers files have changed:

Commit:7983c51
Author:Aaron Son
Committer:Aaron Son

proto: Add client_capabilities URL-minting requests on remotesapi. Some Dolt clients deal with certain URLs better than others. In particular, older Dolt clients can see bad fetch performance in some network contexts when they are hitting HTTP/2 endpoints. Add a field, client_capabilities, on GetDownloadLocsRequest, StreamChunkLocationsRequest, RefreshTableFileUrl and ListTableFiles which allows a client to communicate its capabilities. For now, one capability exists: CLIENT_CAPABILITY_HTTP2_DOWNLOAD. Implementations of remotesapi can use the presence of the advertised capability to know it is safe to mint HTTP/2 capable URLs in a context where they previously would have minted only HTTP/1.1 URLs.

Commit:15cc86b
Author:Aaron Son

TEMP COMMIT: Protos for StreamChunks bounce config.

Commit:ef62aea
Author:Aaron Son

TEMP COMMIT: chunkstore get_seq on StreamChunks.

Commit:a554f84
Author:Aaron Son

TEMP COMMIT: remotesapi StreamChunks.

Commit:5338543
Author:Aaron Son
Committer:Aaron Son

go,proto: Add a comment about StreamDownloadLocations being deprecated.

Commit:59f0944
Author:Aaron Son
Committer:Aaron Son

proto: remotesapi: chunkstore.proto: Add new StreamChunkLocations RPC. StreamChunkLocations is a more efficient StreamDownloadLocations. It is available on a given remotesapi implementation if GetRepoMetadataResponse advertises FEATURE_STREAM_CHUNK_LOCATIONS in its features.

Commit:b350424
Author:Aaron Son
Committer:Aaron Son

proto,go: Change StreamChunkLocations to pass chunk_hashes as bytes, instead of repeated bytes. Saves ~10% on the wire.

Commit:dc2f91b
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add split offset to the TableFileInfo proto spec

The documentation is generated from this commit.

Commit:876f9ea
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add the split_offset field to TableFileDetails

Commit:c720aef
Author:Neil Macneale IV
Committer:Neil Macneale IV

WIP - checkpoint. push directy to gcs works

Commit:2f4b0d7
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add the split_offset field to TableFileDetails

Commit:7f06cb3
Author:Neil Macneale IV
Committer:Neil Macneale IV

WIP - checkpoint. push directy to gcs works

Commit:b8c3867
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add split offset to the TableFileInfo proto spec

The documentation is generated from this commit.

Commit:48f7a11
Author:Neil Macneale IV
Committer:Neil Macneale IV

WIP - checkpoint. push directy to gcs works

Commit:553a945
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add the split_offset field to TableFileDetails

Commit:892a6ac
Author:Neil Macneale IV

Add the split_offset field to TableFileDetails

Commit:bfa542c
Author:Neil Macneale IV

WIP - checkpoint. push directy to gcs works

Commit:f19ebfd
Author:Aaron Son
Committer:Aaron Son

go,proto: Move eventsapi schema into a separate repository. This results in less weird contortions and less opportunity for dependency drift from consumers of Dolt.

Commit:a271b2c
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add suffix to TableFileDetails in grpc

Commit:cae0e2f
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add suffix to TableFileDetails in grpc

Commit:a73bfed
Author:Neil Macneale IV
Committer:Neil Macneale IV

Simplest possible update to gRPC interface for archive spans

Commit:9855980
Author:Neil Macneale IV
Committer:Neil Macneale IV

Simplest possible update to gRPC interface for archive spans

Commit:0beb46e
Author:Neil Macneale IV
Committer:Neil Macneale IV

Add DictionaryChunks to proto spec

Commit:e46f7c0
Author:coffeegoddd

wip: working on proto stuff

Commit:c994714
Author:Stephanie You

add rebase event

Commit:5efbae4
Author:Aaron Son

proto: remotesapi: chunkstore.proto: Add a comment for PushConcurrencyControl.

Commit:b832e3b
Author:Aaron Son

dolt push: Only assert on a clean working set when doing a push if we are running against a server which requests it.

Commit:6cdd0fb
Author:Zach Musgrave

Merge main, resolve new event conflict

Commit:eef66f7
Author:Zach Musgrave

New propto fields

Commit:fccec02
Author:Stephanie You
Committer:Stephanie You

basic dolt reflog implementation

Commit:b480f97
Author:Aaron Son
Committer:Aaron Son

proto/dolt/services/replicationapi: Add a simple RPC as a first pass for replicating DROP DATABASE.

Commit:1002a5d
Author:Aaron Son
Committer:Aaron Son

go: sqle: cluster: First pass at replicating branch control permissions.

Commit:38eeec5
Author:Aaron Son

Merge remote-tracking branch 'origin/main' into aaron/cluster-replication-users-and-grants

Commit:043d00c
Author:Stephanie You

adds new profile event from ld

Commit:08f91f7
Author:Aaron Son
Committer:Aaron Son

go/libraries/doltcore/sqle/cluster: Add replication of user and grant changes from primary to standby replicas.

Commit:2eb99a4
Author:Solipsis

Fix formatting in event_constants.proto

Commit:b16dc01
Author:Solipsis

Add `dolt show` event constant.

Commit:23d4d97
Author:jennifersp
Committer:GitHub

add stash commands to clientEventType (#5347)

Commit:526b9a3
Author:Aaron Son

proto,go: Add RepoPath field to remotesapi Request messages. Pass it along in remotestorage ChunkStore.

Commit:85a46e3
Author:Aaron Son

proto/dolt/services/remotesapi/v1alpha1: Allow GetUploadLocs TableFileDetails to come with num_chunks.

Commit:6eb9e6c
Author:Aaron Son
Committer:Aaron Son

proto,go/.../remotestorage: Add repo_token support. doltremoteapi can return an opaque token which makes it cheaper to access the repository than just using the RepoId. This updates protos and remotestorage implementation to cache that token and use it for future accesses of the same repository.

Commit:2da4ba7
Author:jennifersp

add to client event type

Commit:2049362
Author:Aaron Son

proto: Bump eventsapi proto. Pick up definition for ClientEventType_DUMP.

Commit:4373668
Author:Dustin Brown
Committer:Dustin Brown

/{go,proto}: refactor Sources, update ListTableFilesResponse

Commit:89f000d
Author:Aaron Son

PR feedback.

Commit:8faae88
Author:Aaron Son

proto,go: chunkstore: Sketch out refreshing table file URLs on fetch.

Commit:2622f68
Author:Dustin Brown
Committer:Dustin Brown

/{go,proto}: fix based on pr feedback

Commit:1ada49a
Author:Dustin Brown
Committer:Dustin Brown

/{go,proto}: add manifestContents.appendix for storing spec references to level ordered tablefiles

Commit:9f75c4c
Author:Dustin Brown

{proto, go}: add metrics for new commands

Commit:15d9c95
Author:Aaron Son
Committer:Aaron Son

proto: Add StreamDownloadLocations to ChunkStoreService.

Commit:84c3066
Author:Aaron Son

go/**/*.go: Update copyright headers for company name change.

Commit:b5bb663
Author:Daylon Wilkins
Committer:Daylon Wilkins

Reference new org name and updated trigger logic

Commit:0e8d871
Author:Aaron Son
Committer:Aaron Son

proto/services/eventsapi: Add REMOTEAPI_ADD_TABLE_FILES event.

Commit:3d718e5
Author:Aaron Son

proto: remoatesapi: GetRepoMetadataResponse: Add repository_size field for communicating approximate repository size.

Commit:9baf7ad
Author:Aaron Son
Committer:Aaron Son

go/cmd/dolt: commands/credcmds/import: Add import command for importing existing JWK credential.

Commit:4023efb
Author:Aaron Son

go/cmd/dolt: credcmds/check: Add dolt creds check command.

Commit:24f720c
Author:Matt Jesuele
Committer:Matt Jesuele

Basic dolt blame

Commit:67be3c3
Author:Brian Hendriks
Committer:GitHub

upload correctness checking (#160) Now sending the md5, as well as the content length of the table files we will upload to the dolthub remote api. This is used to make sure what is uploaded is complete and correct.

Commit:e1d48af
Author:Aaron Son
Committer:Aaron Son

proto/dolt/services/eventsapi: Adopt the version of eventsapi that lives in ld repo instead of here.

Commit:be2c70d
Author:Dustin Brown
Committer:Dustin Brown

fix tag number on pb remote_url_scheme

Commit:4ac6692
Author:Dustin Brown
Committer:Dustin Brown

fix active remote url to only save the url scheme

Commit:143b8ef
Author:Brian Hendriks

Merge master -> bh/push-pull-revert

Commit:20ebbea
Author:Dustin Brown
Committer:Dustin Brown

Add event attributes to clone, push, pull, fetch, and chunkstore methods

Commit:23dd79f
Author:Dustin Brown
Committer:Dustin Brown

Refactor events package to remove circular dependencies that will occur from upcoming changes

Commit:ee1ec46
Author:Brian Hendriks
Committer:GitHub

Push and Pull v2 (#89)

Commit:1435a8f
Author:Brian Hendriks
Committer:GitHub

Bh/clone2 (#83) New clone implementation works on the table files directly.

Commit:d26bd56
Author:Dustin Brown
Committer:Dustin Brown

updated imports to use new folder structure and minor fixes

Commit:51e3725
Author:Aaron Son

Merge remote-tracking branch 'origin/master' into aaron/proto-fully-qualified-go-imports

Commit:33d484b
Author:Aaron Son
Committer:Aaron Son

proto: Use fully qualified paths for go_packages.

Commit:7a5c394
Author:Aaron Son
Committer:Aaron Son

proto: remotesapi: chunkstore: Update message names and fields to clarify between chunk hashes on downloads and table file hashes on uploads.

Commit:12aef1a
Author:Brian Hendriks

PR feedback

Commit:4e66b79
Author:Dustin Brown
Committer:Dustin Brown

Add client events to dolt commands

Commit:d15d3c9
Author:Brian Hendriks

WIP events framework

Commit:9d6e3bc
Author:Brian Hendriks

fix formatting

Commit:8956845
Author:Brian Hendriks

Add client_event.proto and compiled .go file

Commit:dfebac8
Author:Aaron Son

Jenkinsfile,dolt/go/utils/copyrighthdrs: Add a small utility program for checking copyright headers.

Commit:2d74d6d
Author:Aaron Son
Committer:Aaron Son

dolt/go: First pass at supporting multiple bin formats in dolthub remotes. NomsBlockStore gets seeded with a version string specifier which gets threaded through various contexts. If the existing manifest specifies a different format, then that takes priority.

Commit:ddc02e1
Author:Aaron Son
Committer:Aaron Son

dolt/go/proto: chunkstore.proto: Add GetRepoMetadata which can return NBS and NBF versions for the remote ChunkStore.

Commit:17bd99a
Author:Brian Hendriks
Committer:Brian Hendriks

removed portions of noms we dont need / won't maintain in preparation for moving to our repo

This commit does not contain any .proto files.

Commit:e2f166d
Author:Brian Hendriks
Committer:GitHub

Bh/deploy remotes (#742) * remote chunk service ready for deployment

Commit:3772d35
Author:Brian Hendriks
Committer:GitHub

bh/fix remotes (#623) * fix typo * add logging * bump version

Commit:fdd5aef
Author:Aaron Son

dolt/proto: Update Makefile for new go pkg paths.

Commit:0ee9a42
Author:Brian Hendriks
Committer:GitHub

remote chunkstore framework (#414) * remote chunkstore framework * test server * semi-working commands for remotes

Commit:1192165
Author:Aaron Son
Committer:Aaron Son

dolt/proto: v1alpha1/credentials.proto -> remotesapi/v1alpha1/credentials.proto. Adopt new go_package convention. Also fixes some dolthubapi imports that were missed in go/services/dolthubapi.

Commit:c439a1a
Author:Aaron Son
Committer:Aaron Son

dolt/go/libraries/doltcore/env/creds: Minor style tweaks.

Commit:89dc4d9
Author:Aaron Son

dolt/proto: username, display_name, email_address in WhoAmIResponse.

Commit:1463c54
Author:Brian Hendriks

removed unused

Commit:a368f83
Author:Brian Hendriks

Service protos

Commit:9a97005
Author:Brian Hendriks
Committer:GitHub

Windoze (#22) * cross platform file locks * cross platform mmap * remove unix specific imports * Use dep to manage dependencies

Commit:cfe9ff5
Author:Aaron Son

dolt/go: Convert to go modules.

This commit does not contain any .proto files.

Commit:2185a33
Author:Brian Hendriks
Committer:GitHub

Git for data (#138) Almost functional dolt

Commit:2a70661
Author:Brian Hendriks
Committer:GitHub

add gcp dependencies to noms/vendor (#6) * add gcp dependencies to noms/vendor * vendor gax-go

Commit:05975af
Author:Aaron Boodman
Committer:Aaron Boodman

Remove unneeded deps

This commit does not contain any .proto files.

Commit:1f936ce
Author:Dan Willhite
Committer:Dan Willhite

Update go-ipfs

Commit:464c70c
Author:Dan Willhite
Committer:Dan Willhite

Update gx packages

Commit:c0aa950
Author:Dan Willhite
Committer:Dan Willhite

New version of ipfs and dependencies

Commit:1a7e006
Author:Aaron Boodman
Committer:GitHub

Landing beginning of IPFS experiment on trunk (#3625) * add ipfs dependencies * Add initial ipfs chunkstore

Commit:ed00b99
Author:Aaron Boodman
Committer:Aaron Boodman

vendor changes

This commit does not contain any .proto files.

Commit:0e222f7
Author:Dan Willhite

First stab at Picasa importer.