These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)
| Commit: | 305f9fa | |
|---|---|---|
| Author: | Ariel Szekely | |
Push naming changes around shmem flag into go code
The documentation is generated from this commit.
| Commit: | d56e06f | |
|---|---|---|
| Author: | Ariel Szekely | |
Fix how we return errs from blinksrv to avoid procd panics
| Commit: | eb2cf6a | |
|---|---|---|
| Author: | Ariel Szekely | |
Merge serverless-bench into blink
| Commit: | e414704 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add ability for sigmap proxy server to respond to proxied RPCs over shmem
| Commit: | 4677b8b | |
|---|---|---|
| Author: | Ariel Szekely | |
Enable SPPROXY conns over TCP if blink is enabled
| Commit: | 5e2a246 | |
|---|---|---|
| Author: | Ariel Szekely | |
If using blink, mount spproxyd from the procd container into the host, so the blihnksrv can mount it into the chroot point for the restored proc
| Commit: | 6756b11 | |
|---|---|---|
| Author: | Ariel Szekely | |
Check in some progress on a blinksrv
| Commit: | bb9036e | |
|---|---|---|
| Author: | Ariel Szekely | |
Add stubs to plug in blink procs
| Commit: | 26a433c | |
|---|---|---|
| Author: | Ariel Szekely | |
Support in-infrastructure untaring of proc bins
| Commit: | f363d73 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add cosandbox versions of sebs benchmarks, and make shmem buf size configurable (in the proc struct) for both WASM procs and cosandboxes
| Commit: | 165eb4b | |
|---|---|---|
| Author: | Ariel Szekely | |
Uniformize initscript/bootscript -> cosandbox"
| Commit: | 3fcadda | |
|---|---|---|
| Author: | Ariel Szekely | |
Add generic single-blob RPC type to support proxying Get-type RPCs for WASM procs
| Commit: | 9559172 | |
|---|---|---|
| Author: | Ariel Szekely | |
Switch to an enum to determine proc container type
| Commit: | 88c48ac | |
|---|---|---|
| Author: | Ariel Szekely | |
Very basic/hacky way of running python procs
| Commit: | 5397bbd | |
|---|---|---|
| Author: | Ariel Szekely | |
Check in initial implementation/skeleton code of a wasmd server which runs wasm procs
| Commit: | 40b3dba | |
|---|---|---|
| Author: | Nicolas Camenisch | |
| Committer: | Nicolas Camenisch | |
Replace pylock.Wheel.Hashes map with a struct (containing only sha256); use proto.Wheel inside pyenv
| Commit: | 10af998 | |
|---|---|---|
| Author: | Nicolas Camenisch | |
Add atomic multi‑wheel installs with lock handles and automatic session‑detach cleanup to prevent evicted package races. Introduce idempotent lock release tracking plus tests for detach/cleanup behavior
| Commit: | c202afd | |
|---|---|---|
| Author: | Nicolas Camenisch | |
WIP Cleaning up pyenv
| Commit: | 291ff05 | |
|---|---|---|
| Author: | Nicolas Camenisch | |
Merge branch 'master' into python-merge
| Commit: | 31cd971 | |
|---|---|---|
| Author: | Nicolas Camenisch | |
| Committer: | Nicolas Camenisch | |
Make python package manager a centralized service running alongside msched
| Commit: | 5c83bff | |
|---|---|---|
| Author: | Ariel Szekely | |
Capture wasm script exit status, and report it to procsrv"
| Commit: | 020ec7b | |
|---|---|---|
| Author: | Ariel Szekely | |
Select proc for which to measure PSS less hackily
| Commit: | db9273d | |
|---|---|---|
| Author: | Ariel Szekely | |
Add RPC API for UXSrv
| Commit: | d69af07 | |
|---|---|---|
| Author: | Ariel Szekely | |
Make shmem segment size configurable in proc struct
| Commit: | 4a3589c | |
|---|---|---|
| Author: | Nicolas Camenisch | |
| Committer: | Nicolas Camenisch | |
First zygote forking implementation
| Commit: | 5385578 | |
|---|---|---|
| Author: | Ariel Szekely | |
Enable in-memory caching of s3 objects in S3 proxy RPC server for better memcached-cached comparison
| Commit: | 8ff8adb | |
|---|---|---|
| Author: | Ariel Szekely | |
More fine-grained logging info for imgresize bench & state transfer
| Commit: | 9e3a808 | |
|---|---|---|
| Author: | Ariel Szekely | |
Include transfer time start in SPProxy GetReply response, so we can calculate transfer time for the paper timeline graph cleanly
| Commit: | 45a530d | |
|---|---|---|
| Author: | Ariel Szekely | |
Support WASM recv without reading data, forwarding of RPCs via wasm module, and use it to implement bootscript-assisted output writing in imgresize bench
| Commit: | c988ad8 | |
|---|---|---|
| Author: | Ariel Szekely | |
Check in some work using k8s as a backend for running procs, add support for multi-bin procs (to enable using a Go proc as a shim for a non-SigmaOS program like etcd), and make the etcd shim start etcd and connect to it
| Commit: | f3abae7 | |
|---|---|---|
| Author: | Ariel Szekely | |
Implement S3 proxy Put API, and use it in imgresize bench
| Commit: | d1845fb | |
|---|---|---|
| Author: | Ariel Szekely | |
Note the queueable resource proc ID to which a proc belongs in the proc struct
| Commit: | 69c5e91 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add an RPC endpoint to spproxy to allow procd to wait for boot script completion
| Commit: | 1b919bc | |
|---|---|---|
| Author: | Ariel Szekely | |
LCsched oversubscription plan for queueable procs with initscripts
| Commit: | 10c4a21 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add accessors for bootscript resource reservations
| Commit: | a2d6db6 | |
|---|---|---|
| Author: | Ariel Szekely | |
Better accessors for proc resource reservations
| Commit: | 248bf4f | |
|---|---|---|
| Author: | Ariel Szekely | |
Separate proc struct's resource reservation into its own type
| Commit: | 40d0a7a | |
|---|---|---|
| Author: | Ariel Szekely | |
Optionally use s3 RPC clnt in imgresize
| Commit: | 7e2cebd | |
|---|---|---|
| Author: | Ariel Szekely | |
Move s3 proxy implementation into srv package, and add an RPC endpoint for S3 proxy
| Commit: | df5368d | |
|---|---|---|
| Author: | Ariel Szekely | |
Separate cached init RPC protos into their own lib/package so that they can be compiled separately in order to minimize initscript size
| Commit: | 1262662 | |
|---|---|---|
| Author: | Ariel Szekely | |
Separate out cacheclnt protos into those required to initialize vecdb, and those not
| Commit: | 4e05f9b | |
|---|---|---|
| Author: | Ariel Szekely | |
Start/stop additional cossim servers in parallel
| Commit: | 7f6b786 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add RPC server metrics request/reply protobufs
| Commit: | 3979c31 | |
|---|---|---|
| Author: | Ariel Szekely | |
Implement a simple user matching microservice for Hotel, and have it use cached & cossim microservices
| Commit: | ef9ff80 | |
|---|---|---|
| Author: | Ariel Szekely | |
| Committer: | Ariel Szekely | |
Some improvements and bug-fixes: - Fix some bugs in cache application client/server and how they interacted with EPCacheSrv - Add a GetBytes function to cacheclnt to enable reading byte slices without unmarshaling into protobufs - Fix some bugs in how cossim registered itself with epcachesrv - When creating the cachedsvcclnt to set up a cossim job, optionally use the EPCache
| Commit: | bc14a77 | |
|---|---|---|
| Author: | Nicolas Camenisch | |
| Committer: | Nicolas Camenisch | |
Use cpp/python clntlib instead of pylib/clntlib
| Commit: | bc3698b | |
|---|---|---|
| Author: | Ariel Szekely | |
Implement multi-buffer IoVec frames to enable zero-copy serving of request which concatenate output buffers
| Commit: | 9036886 | |
|---|---|---|
| Author: | Nicolas Camenisch | |
Merge branch 'python-support'
| Commit: | 8ca7de1 | |
|---|---|---|
| Author: | Ariel Szekely | |
Checkpoint progress communicating with spproxy via shared memory
| Commit: | de247ed | |
|---|---|---|
| Author: | Ariel Szekely | |
Rework cache multi-dump request to enable zero-copy I/O on the client-side
| Commit: | 983ad55 | |
|---|---|---|
| Author: | Ariel Szekely | |
Implement batched dump RPC for Golang cached server, and use it in the non-delegated CPP scaler server
| Commit: | 07d2a99 | |
|---|---|---|
| Author: | Ariel Szekely | |
Clean up multi-delegated-RPC fetching impl
| Commit: | 4e22ba3 | |
|---|---|---|
| Author: | Ariel Szekely | |
Fetch delegated RPCs in a batch to avoid traversing the RPC stack for every single one
| Commit: | 4ff659a | |
|---|---|---|
| Author: | Ariel Szekely | |
Fix serr test which didn't complie
| Commit: | 5d6f2d5 | |
|---|---|---|
| Author: | Ariel Szekely | |
Store proc boot script in a blob in procenv, to avoid copying it around
| Commit: | 895c6a0 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add cachesrv RPC function to retrieve information about shard "hotness", and test that it works
| Commit: | 1111ff2 | |
|---|---|---|
| Author: | Ariel Szekely | |
Merge test-in-docker-errio into cpp
| Commit: | 23f84fa | |
|---|---|---|
| Author: | Ariel Szekely | |
Run Cosine Similarity scaling benchmark with WASM boot script
| Commit: | 775dc4b | |
|---|---|---|
| Author: | Frans Kaashoek | |
Provide exactly-once Submit and Acquire
| Commit: | af65f65 | |
|---|---|---|
| Author: | Frans Kaashoek | |
Experiment with passing an AcquireId on AcquireTasks implemented using Tfence.
| Commit: | cceb04e | |
|---|---|---|
| Author: | Frans Kaashoek | |
Retrieve fence from imgd leader
| Commit: | 6eb6c38 | |
|---|---|---|
| Author: | Ariel Szekely | |
Only create spproxy procclnt if desired
| Commit: | d808535 | |
|---|---|---|
| Author: | Frans Kaashoek | |
| Committer: | Frans Kaashoek | |
Rename SubmitStop to SubmittedLastTask; the former name is confusing and has resulted in a bug in ft/task/srv.go, as shown by new test, and which a later commit will fix.
| Commit: | 609bebe | |
|---|---|---|
| Author: | Frans Kaashoek | |
Merge branch 'fttask-server' into test-in-docker-merge
| Commit: | f99b970 | |
|---|---|---|
| Author: | Frans Kaashoek | |
Merge branch 'test-in-docker' into test-in-docker-errio
| Commit: | 58ccbfb | |
|---|---|---|
| Author: | Frans Kaashoek | |
Checkpoint WIP: remove depreceated kvd
| Commit: | 47f7f7c | |
|---|---|---|
| Author: | Ariel Szekely | |
Move delegated init RPCs into proc struct instead of sticking them in proc env struct
| Commit: | 8e6c5d5 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add code to store & retrieve results from delegated RPCs
| Commit: | f745890 | |
|---|---|---|
| Author: | Ariel Szekely | |
Have spproxy run delegated cache multiGet RPC on behalf of the CPP proc
| Commit: | fd9dce2 | |
|---|---|---|
| Author: | Ariel Szekely | |
Rework cache multi-get to speed up IOV Blob writes by concatenating all results into one byte slice, and then use this byte-slice for zero-copy unmarshaling in the CPP server
| Commit: | 8b6d1d4 | |
|---|---|---|
| Author: | Ariel Szekely | |
Multi-get implementation for cache srv
| Commit: | ac899da | |
|---|---|---|
| Author: | Ariel Szekely | |
Tag CPP cossim reqs/reps with IDs to trace latencies
| Commit: | 4a996a2 | |
|---|---|---|
| Author: | Ariel Szekely | |
Give more control to clients of the cossim server, to enable them to perform cosine similarity comparisons against subsets of the vector DB.
| Commit: | e19a524 | |
|---|---|---|
| Author: | Ariel Szekely | |
Wrap cosine similarity server in a job
| Commit: | 5a08efb | |
|---|---|---|
| Author: | Ariel Szekely | |
Check in some cosine similarity server progress
| Commit: | 82b0fda | |
|---|---|---|
| Author: | Ariel Szekely | |
Starter code for a cosine similarity calculation server
| Commit: | 8c10d48 | |
|---|---|---|
| Author: | Ariel Szekely | |
Only send the proc env in control messages to spproxysrv, not the whole proc
| Commit: | 19b0abd | |
|---|---|---|
| Author: | Ariel Szekely | |
Add a socket to spproxysrv which can be used to exchange control messages with procd. Have procd use this socket to inform spproxysrv of new procs which will require sigmaclnt creation, so that spproxysrv can start the clnt creation process while the proc starts up
| Commit: | 8903e23 | |
|---|---|---|
| Author: | Ariel Szekely | |
Merge epcache into cpp
| Commit: | 4335184 | |
|---|---|---|
| Author: | Ariel Szekely | |
When a new msched registers itself with lcsched, immediately premount it
| Commit: | 34417f7 | |
|---|---|---|
| Author: | Frans Kaashoek | |
Support SIGMADEBUGPROCS to limit debug logging to selected programs
| Commit: | e92a715 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add infrastructure to run valgrind on procs
| Commit: | 8af6c16 | |
|---|---|---|
| Author: | Ariel Szekely | |
Basic C++ spin server
| Commit: | 9cac277 | |
|---|---|---|
| Author: | Ivy Wu | |
Update C++ library
| Commit: | 3b96946 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add netsrv implementation in CPP, add a sigmaproxy RPC to register endpoints, and use it in the echosrv proc
| Commit: | 2cf30f2 | |
|---|---|---|
| Author: | Ryan Chang | |
| Committer: | Ryan Chang | |
Clean up partition test by making server restart after missing pings; also allows srv to give up leadership to new srvs in case of partition
| Commit: | 5279653 | |
|---|---|---|
| Author: | Ryan Chang | |
Clean up partition test by making server restart after missing pings; also allows srv to give up leadership to new srvs in case of partition
| Commit: | eca5448 | |
|---|---|---|
| Author: | Ivy Wu | |
Hello World works with CPP library
| Commit: | 68edddb | |
|---|---|---|
| Author: | Frederick Tang | |
added support for parallel restore
| Commit: | 4efe01e | |
|---|---|---|
| Author: | Ariel Szekely | |
Add exit statuses to CPP-proxied procAPI
| Commit: | 0c8e193 | |
|---|---|---|
| Author: | rcya1 | |
Merge branch 'fttask-server' of https://github.com/mit-pdos/sigmaos into fttask-server
| Commit: | 532c0b9 | |
|---|---|---|
| Author: | Ryan Chang | |
Improve proc balancing (hopefully) and consolidate adding outputs / marking as done
| Commit: | 2f794f8 | |
|---|---|---|
| Author: | rcya1 | |
Initial pass at moving args to reducer (not tested yet)
| Commit: | 500365d | |
|---|---|---|
| Author: | Ivy Wu | |
RPC calls write to spproxy
| Commit: | e51cf57 | |
|---|---|---|
| Author: | Ryan Chang | |
Use old version of fttask for benchmarking
| Commit: | e694226 | |
|---|---|---|
| Author: | Ariel Szekely | |
Use new endpoint caching plan for named/msched endpoints
| Commit: | 9b5ba93 | |
|---|---|---|
| Author: | Ryan Chang | |
temp fix for protobuf collision
| Commit: | 87c9381 | |
|---|---|---|
| Author: | Ariel Szekely | |
Add a more general EP caching plan to proc env
| Commit: | 665dcd4 | |
|---|---|---|
| Author: | Ariel Szekely | |
Merge test-in-docker into epcache branch
| Commit: | cfe0d1f | |
|---|---|---|
| Author: | Ryan Chang | |
Merge branch 'master' into fttask-server