Proto commits in google/fleetspeak

These 94 commits are when the Protocol Buffers files have changed:

2025-04-08

No public description FUTURE_COPYBARA_INTEGRATE_REVIEW=https://github.com/google/fleetspeak/pull/562 from google:spanner-preview 1d6e34dfe6fb0d12cc22a9e70e8f03b4013ca4f2 PiperOrigin-RevId: 738434459

The documentation is generated from this commit.

2025-02-13

Adds github action commands for Spanner

The documentation is generated from this commit.

2024-12-16

Change the semantics of message annotations. They are not necessarily only for debugging information and can be used by message consumers and/or Fleetspeak component implementations such as services as they see fit. PiperOrigin-RevId: 706708191

2024-12-10

Harden StdinService configs Make StdinService configs explicitly opt into accepting args or stdin by the incoming InputMessages. Because there are no known users of StdinService, this should not break any existing configs. PiperOrigin-RevId: 704641242

2024-12-09

stdinservice: Simplify (Remove resource usage monitoring feature) We are not aware of anyone using this. If you do, please speak up! PiperOrigin-RevId: 704357387

2024-06-28

Incorporates reviewer feedback

Merge branch 'google:master' into feature/http2

2024-06-26

Add client option to compress outbound traffic. The option to enable compression can be found in communicator settings, which are typically located in the communicator.txt file in the configuration directory. PiperOrigin-RevId: 646824917

2024-06-21

Adds preferHttp transport config

2024-06-03

Merge pull request #510 from dhrgit:cps PiperOrigin-RevId: 638960075

2024-05-30

Revert "new service factory: CPS (Cloud Pub/Sub)"

new service factory: CPS (Cloud Pub/Sub) This commit adds a new service factory, whereby messages are delivered by publishing to a Cloud Pub/Sub topic.

2024-04-26

Add server name field to config PiperOrigin-RevId: 628432290

2024-01-18

daemonservice_test: Speed up test run * TestHeartbeat: Speed up by reducing timeouts and resource-monitoring periods * Use `time.Duration` where durations are used, instead of seconds * execution: adapt busySleep() to work with `time.Duration` * Rename "deadline" to "timeout" in sync with convention in package `context` * TestBacklog*, TestLoopback*: Drain the `sc.OutChan` on test shutdown * These four tests were stuck trying to shut down the test client (~20secs) * TestMemoryLimit: Sped up by reducing recource-monitoring periods PiperOrigin-RevId: 599509820

2023-11-24

Adds envoy xfcc header processing

2023-11-11

Merge pull request #390 from daschwanden:feature-frontend-cleartext PiperOrigin-RevId: 581519910

2023-11-08

Addresses reviewer feedback

2023-10-31

Adds communicator test cases

2023-10-27

Adds changes for clear text frontend mode

2023-10-18

Fix proto comment

Addresses reviewer feedback re documenting protos.

2023-10-17

Implements client certificate checksum header

Merge branch 'master' into client-cert-header

Addresses reviewer feedback

Use more structured frontend mode configuration PiperOrigin-RevId: 574161588

2023-10-10

No public description PiperOrigin-RevId: 572210614

2023-09-30

Adds test cases for checksum verification

2023-09-29

Merge branch 'google:master' into client-cert-header

2023-09-27

Frontend mode enum (#379) Adds Frontend Mode enum logic that requires an explicit configuration setting to change the frontend certificate-checking behavior.

2023-09-02

Implements client side cert header

2023-08-30

Format Proto files

2023-08-28

Merge pull request #364 from coperni/client-certificate-header Allow Fleetspeak server to validate client certificate in http header

2023-07-18

Remove fleetspeak/src/osquery

2023-07-03

Add client certificate validation for http headers

2023-05-31

Notifying server-side services about blocked status of clients. (#360) * Added is_blocklisted_source to common.Message. * Filling Message.is_blocklisted_source when processing stored messages.

2023-05-17

Extended StreamClientIds to filter by "last contact time" and "blacklisted" attributes. (#356) * Changed the Datastore StreamClientIds signature, added implementations for MySQL and Sqlite, added tests. * Along the way: made datatore's AddClient write the "Blacklisted" attribute of the incoming ClientData to the database. Added a test to enforce this behavior. * Changed the gRPC proto for StreamClientIds method to accept "include_blacklisted" and "last_contact_after" attributes in the args.

2021-04-22

Introduce new streaming RPCs to the admin server. (#320) * Introduce new streaming RPCs to the admin server. The new RPCs are: - `StreamClientIds` - `StreamClientContacts` The motivation is that both the client and client contacts tables can be very large. * MySQL datastore: use `runOnce` for streaming operations. * Clear res[] on retry.

2021-02-24

Add GetPendingMessages RPC to admin server. (#315)

2021-01-12

Make the https component of the fleetspeak server optional. (#310) * Make the https component of the fleetspeak server optional. This change makes it possible to run a pure fleetspeak admin server (without running a HTTPS server as well). The purpose of this change is to enable a distributed open source setup, consisting of multiple HTTPS servers behind a load balancer and multiple admin servers behind a second load balancer. The pure admin server needs to be able to use a http based notifier, without running a http based notification listener as well. For this, a new config option is introduced. * Improve comment for https_config.

2020-10-21

Updating to Go 1.15 and fixing protobufs compilation. (#304) * Updated to Go 1.15 - the latest stable release (1.13 seems to have a slightly different modules behaviour). * Updating Go implies rebuilding protobufs. Along the way greatly simplified protobufs compilation and fixed .proto definitions to not generate protoc compiler warnings. * Committing updated go.mod and go.sum.

2020-10-20

Monitoring number of open file descriptors on the clients. (#303) * Monitoring number of open file descriptors. * Currently working only on Linux. * Aggregating data on the client and storing in ClientResourceUsageRecords on the server.

2020-09-16

Support time range in FetchResourceUsageRecords instead of limit (#294)

2020-09-01

Add RPC method to call FetchResourceUsageRecords over gRPC service (#281) This PR exposes FetchResourceUsageRecords datastore method to the existing admin gRPC service by creating a RPC method FetchClientResourceUsageRecords and two corresponding RPC messages FetchClientResourceUsageRecordsRequest and FetchClientResourceUsageRecordsResponse.

2020-08-20

Add test with unicast message (#278) * Add testing unicast messages * Start using server notifications * Add separate function createUnicastRequest() * Refactor tests and fix unicastMessagesTest * Fix lint error

2020-08-18

Add health checks (#276) * Add health checks - Added optional health check service to fleetspeak server binary. It's a simple http server that respondes with 200 OK status on all requests. - Updated configs of FS servers in cloud installation: now all the servers start a health check service. - Added a firewall rule for health checks in Terraform config * Refactor Refactor modifyFleetspeakServerConfig() parameters. Start to use http.Server in server health checks.

2020-06-23

Add methods to FRR grpc Master service (#251) * Add methods to FRR grpc Master service Added CreateHunt() and CompletedRequests() to Master service in frr.proto, and updated frr tests. These 2 methods will be used in Fleetspeak e2e testing framework * Return non-rpc FRR Master server methods * Add CreateHuntResponse message

2020-06-09

Making Fleetspeak server metrics scrapable by Prometheus (#247) New prometheusStatsCollector exports metrics gathered from Fleetspeak server to Prometheus client, making the metrics scrapable.

2020-02-12

Add support for using a proxy in the client. (#229)

2020-02-03

Admin server can now be configured to run as part of a server binary. (#228) * Made admin server one of Fleetspeak server components. * Added default configuration entry for admin_config. * Simplistic e2e test.

2020-01-27

Implemented "Die" and "RestartService" system actions. (#220)

2019-12-09

Added DeletePendingMessages admin RPC call. (#215) * Added DeletePendingMessages database call and implemented it for MySQL and sqlite. * Added a corresponding admin RPC call. * Added a corresponding method to the Python client. This should help in cases when a client has a number of messages in the queue that can potentially take a long time to be processed. At the moment there's no way and no requirement to specify the service to delete the pending mesages for. This should be fine for the first iteration.

2019-09-02

Removed the demo folder. It's not used anywhere in tests and is essentially not maintained. Removing it in anticipation of GRR-based opensource testing.

2019-08-20

Add support for storing debug information alongside messages. (#199)

2019-04-09

Add notifier support to component module.

2019-04-05

Client 2 (#185) * Add streaming support to generic client. * fleetspeak_config writes a linux client configuration file. * Add persistence manager support to the generic client code. * example.config fixup * config_windows.go fixup * Write darwin and windows client configs. * config.go fixup * Review fixup.

2019-04-04

Client Packaging (#184) * Fix a few outdated comments. * Initial generic client configuration proto format. * Initial generic client entry point. * Rename server package building code. * Initial client package build script.

Typo type fixes. (#183) * Minor fixes. * Fix typo.

2019-04-02

Fill out fleetspeak-config tool to handle server configuration. Add example input file, include in package.

Config tool input proto.

Plugins to components (#179) * Replace plugin system with simpler component configuration strategy. * Regen protos. * Remove reference to plugins from package build code. * Initial test of component configuration code. * Add copyright blocks and a few high level comments.

2018-07-27

Review fixes.

2018-07-24

Add proto for osquery connector.

2018-06-18

Add per-service control message info to ContactData.

2018-06-14

Add plugin loading support for remaining component types.

Add an https communicator plugin.

Add support for Communicator plugins.

Add support for loading service factories.

Initial plugin system. Implement plugins for sqlite and mysql. Define server binary which can be extended using plugins.

2018-05-24

Review fixup.

2018-05-23

Add new control indicator to ContactData.

2018-05-16

Add process_terminated field to ClientResourceUsageRecord proto.

2018-05-11

Further propagate notification subsystem.

Begin implementing StreamingMessageServer. Supports streaming uploads, still needs support for streaming downloads, needs tests, etc.

2018-05-09

Send notifications to the server when services get killed by Fleetspeak.

2018-03-22

Add std output configuration parameters.

2018-02-16

Implement heartbeat monitoring in daemonservices

2018-02-15

Implement daemonservice memory supervision This is similar to the Nanny functionality from the parent project, github.com/google/grr

2018-02-13

Support certificate chains.

2018-02-09

Change validation info to a message with a dict of tags.

2018-02-08

Review fixes.

Add resource monitoring params to service configs

2018-02-07

Proto regen.

Add version to ResourceUsageData.

Add version string to StartupData.

2018-01-31

Add blacklisted flag to fleetspeak.server.Client.

2018-01-19

Pull in changes from real repo.

Implement sending startup data through channels.

2018-01-16

Add background flag to fleetspeak.Message.

2018-01-15

Add LastClock to Client proto.

Add current client time to ContactData.

2018-01-05

Add BlacklistClient to admin grpc interface.

2017-12-25

Add ContactHistory call to admin interface.

2017-11-23

Sync with internal codebase

2017-09-20

Initial commit