Proto commits in UWQuickstep/quickstep

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

2018-06-04

Data Provider thread added. - Thread used for receiving block requests from clients and sending the contents of a block back to the client.

The documentation is generated from this commit.

2018-05-09

QUICKSTEP-121: Added the self-join support.

2017-12-23

Improvements and bug fixes

Quickstep for GRAIL

2017-12-11

Initialize updates for transitive closure

2017-11-27

Updates to compact key hash table

Hash-Join-Fuse: Feature added and tests modified.

2017-11-20

Fix number of work orders generated for insert multiple tuples. (Also added unit tests)

2017-10-11

Updates to casts

Updates to meta type

Updates for array type

Updates for adding generic types

Refactor type system and operations.

2017-08-30

Add "COPY TO" operator for exporting data from Quickstep.

2017-08-27

Added num_partitions in RelationalOperator.

2017-08-26

Added partition_id in WorkOrder.

2017-08-02

Determine #InitPartitions for CollisionFreeVectorTable in the optimizer.

2017-07-21

Determine #Partitions for Aggr State Hash Table in the optimizer.

2017-06-15

Added the execution support for LIP with partitions.

Using PartitionSchemeHeader in Physical Plan node.

Added the support for partitioned (but not parallel) aggregations.

2017-06-14

Added operator and execution support for partitioned nested loops join.

Added RandomPartitionSchemeHeader.

Added operator support for BuildLipFilter with partitioned inputs.

2017-06-13

QUICKSTEP-76: Enabled LIP in the distributed version.

2017-05-02

Add protobuf support for union all operator.

Deserialization logic is implemented for relational operators.

Add common-subexpression support.

WorkOrder proto clean-up.

2017-04-29

Adds NetworkIO to CLI Main changes: -IOHandle represents a single interaction with quickstep -CMAKE flag to enable, off by default -2 flags for ip, port of network IO -new executable for network client -Tests

2017-04-24

Add ThreadPrivateCompactKeyHashTable as a fast path data structure for aggregation.

2017-04-23

Add common-subexpression support.

2017-04-20

WorkOrder proto clean-up.

Add protobuf support for union all operator.

2017-04-17

Implemented serialization logic of all relational operators.

2017-04-11

First commit for frontend-backend separation.

2017-03-26

QUICKSTEP-73: Multi-attribute PartitionSchemeHeader.

2017-03-17

Used an alternative implementation for the proto map.

2017-03-16

Refactored the data exchange operation. Unlike the original implementation needs two round messages, the redesigned block pull now needs only one round RPC, unless there is a RPC failure. The network address for peer StorageManager is cached locally, and will be updated once a block is created by a newly added peer.

Removed unnecessary messages in BlockLocator.

2017-03-10

Added the preload support in the distributed version.

2017-03-05

Removed the unnecessary messages for saving query results in the distributed version.

2017-03-03

Refactored command execution in the distributed version.

2017-03-01

Added command support in the distributed version.

2017-02-09

Fuse Aggregate with LeftOuterJoin to accelerate evaluation.

2017-02-08

Removed the temp query result relation in the distributed version.

2017-02-07

- Adds CollisionFreeVectorTable to support specialized fast path aggregation for range-bounded single integer group-by key. - Supports copy elision for aggregation.

2017-01-31

Add BitVectorExactFilter as a LIP filter and supports Join-to-Semijoin transformation.

2017-01-28

Make the third party directory leaner. - Added shell script to download prerequisite third party libs, instead of relying on pre-existing source files in the third party directory. - The shell script performs checks for the presence of required bash commands on the system, before starting to run. - Deleted third party library code for some modules. - Added re2 CMakeLists patch file. - Ignore warnings during re2 compilation. - Compilation fixes due to google benchmark upgrade. - Fixes for the compilation error in Window aggregation unit test. - Perform check for the current directory before running the third party scripts. - Created macro for setting GFLAG library name and use only gflags as a target. - Move third party source files to third_party/src directory. - Update travis workflow. - Upgrade cmake as required for benchmark library to be compiled in travis. - Added patch for linking rt library in benchmark.

2017-01-26

Added the partitioned hash join in the distributed version.

2017-01-20

Added Operator support for Partitioned HashJoin.

2017-01-18

Added partition_id in feedInputBlock.

2017-01-11

Refactored the method to reconstruct PartitionSchemeHeader.

2017-01-08

Removes packed row store.

2016-12-20

Add min/max statistics and the exactness flag into CatalogRelationStatistics.

2016-12-11

remove c++ files

This commit does not contain any .proto files.

2016-12-05

Added DistributedCli executable.

Scheduling based on data locality info.

2016-11-21

Refactored PolicyEnforcerBase::decrementNumQueuedWorkOrders.

2016-11-18

Unified WorkOrderCompletionMessage.

2016-11-03

Updates.

2016-11-01

Updates

2016-10-24

Add backend support for LIPFilters.

2016-10-21

ExecutionGenerator and QueryContext support for LIPFilters.

Initiated query execution data structure in all Shiftbosses.

2016-10-18

Clean up the old bloom-filter implementation which are attached to HashTables.

2016-09-07

[QUICKSTEP-53] New representation and faster comparison operators for DateLit - New representation for DateLit. - New comparison implementations for DateLit. Closes #98

2016-09-06

Introduced DestroyAggregationState operator - Similar to the pattern with DestroyHash, this operator destroys the AggregationState once the Finalize aggregation operator finishes its execution. - Optimizer support for DestroyAggregationState operator. - Removed unused QueryContext::releaseAggregationState method.

2016-08-23

Initial commit.

2016-08-22

Initial commit.

MinMaxStatistics

Attach bloom filters to select

Initial commit

2016-08-09

Removed an unused message type.

2016-08-08

Added PolicyEnforcer implementation for the distributed version.

Minor updates to Shiftboss.

2016-08-07

QUICKSTEP-40: Fix Copyright notice to confirm to Apache.

2016-08-04

Processed InitiateRebuild message for the distributed version.

2016-08-03

Add visualization for execution plan DAGs combined with profiling stats

2016-08-01

Cleaned up the messages w/ a dummy payload.

RANGE mode and computation optimization. - Supported RANGE mode for window aggregation. - Optimized the AVG calculation time complexity from O(nk) to O(n), where n is the number of tuples and k is the window size.

2016-07-28

Renamed a QueryExecutionMessage.

Introduced Shiftboss for the distributed version.

- Supported ROWS mode for AVG window aggregation. - Created WindowAggregateFunctions in expressions/window_aggregation. - Created WindowAggregationHandle for AVG to actually do the calculation. - Other functions will be supported in future PRs. - RANGE mode is not supported yet.

Added QueryManagerDistributed.

Added the Date Type.

2016-07-27

Introduced Shiftboss for the distributed version.

2016-07-25

- Supported ROWS mode for AVG window aggregation. - Created WindowAggregateFunctions in expressions/window_aggregation. - Created WindowAggregationHandle for AVG to actually do the calculation. - Other functions will be supported in future PRs. - RANGE mode is not supported yet.

2016-07-19

Added QueryManagerDistributed.

2016-07-16

Added the Date Type.

2016-07-11

Get rid of Bloom filter random seed

WIP version of BloomFilter hash fn change

Revert "WIP version of BloomFilter hash fn change" This reverts commit a92ddcab4fdf677e95b88389a3f07d95d8a883de.

2016-07-09

Remove unused AlwaysCreateBlockInsertDestination

2016-07-08

Added ExecutionGenerator support for Window Aggregation.

Used the basic column store for tmp relations w/o variable length attributes.

2016-07-05

Function to log work order execution statistics. - Change log severity levels. - Minor style fixes. - Minor logging message added.

2016-06-23

QUICKSTEP-6: New fixed precision number type: Decimal.

2016-06-20

QUICKSTEP-18: Allow BasicColumnStoreTupleStorageSubBlock to be unsorted Review comments applied Revert build fix for Lexer (separate PR has been opened)

2016-06-15

Measure execution time of WorkOrders. - Measure order execution time for both normal and rebuild work orders. - Split the WorkOrderCompletion proto message in two: Normal and Rebuild work orders, with a possibility that in the future the two messages will have different fields. - Add execution time field in both WorkOrderComplete proto messages. - Include the recorded time in both WorkOrderComplete proto messages that are sent back to Foreman.