Proto commits in jsupancic/deep_hand_pose

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

2015-09-19

Im2col and Convolution layers support N spatial axes

The documentation is generated from this commit.

caffe.proto: generalize ConvolutionParameter to N spatial axes

2015-08-26

Add TileLayer

2015-08-25

Merge pull request #2032 from jeffdonahue/embed-layer Embed layer for lookup table of one hot encodings

2015-08-14

Adam solver This commit implements the Adam solver by Kingma et. al for CPU and GPU. All solver parameters are defined in the caffe.proto. This also adds an example for the MNIST dataset.

2015-08-13

Merge pull request #2903 from ronghanghu/multi_gpu Multi-GPU Data Parallelism

2015-08-12

Data Layers Parallel for Multi-GPU Allow data layers (and also PythonLayer when used as data layer) to be shared among worker solver's training net, and also test net for future-proof if one wants to do Multi-GPU testing. Data layers are locked during forward to ensure sequential forward.

2015-08-10

Implement AdaDelta; add test cases; add mnist examples

2015-08-09

Add DataReader for parallel training with one DB session - Make sure each solver accesses a different subset of the data - Sequential reading of DB for performance - Prefetch a configurable amount of data to host memory - Distribute data to solvers in round-robin way for determinism

Implement RMSProp Solver Implement RMSProp solver and cleaned up to adjust to new solver interface that uses accumulated gradients and refactored regularization.

2015-08-08

Add EmbedLayer for inner products with sparse input (one-hot vectors), with unit tests

temporarily switch the snapshot_format default back to BINARYPROTO out of anticipation for user issues due to issue #2885, which causes Caffe to crash when it attempts to snapshot nets with duplicate layer names

2015-08-07

Snapshot model weights/solver state to HDF5 files. Summary of changes: - HDF5 helper functions were moved into a separate file util/hdf5.cpp - hdf5_save_nd_dataset now saves n-d blobs, can save diffs instead of data - Minor fix for memory leak in HDF5 functions (delete instead of delete[]) - Extra methods have been added to both Net/Solver enabling snapshotting and restoring from HDF5 files - snapshot_format was added to SolverParameters, with possible values HDF5 or BINARYPROTO (default HDF5) - kMaxBlobAxes was reduced to 32 to match the limitations of HDF5

add double_data, double_diff to BlobProto for weights/snapshots saved when using Dtype == double

PythonLayer takes parameters by string

2015-08-04

ImageData layer default batch size of 1, and check for zero batch size

2015-06-03

Add ReductionLayer to reduce any number of "tail" axes to a scalar value Currently implements operations SUM, MEAN, ASUM (sum of absolute values), and SUMSQ (sum of squares)

FlattenLayer gets a FlattenParameter with an axis, end_axis

Add LogLayer

2015-05-30

Merge pull request #1977 from shelhamer/accum-grad Decouple the computational batch size and minibatch size by accumulating gradients

Merge pull request #2410 from sguada/datum_transform Datum transform

2015-05-27

zero-init param diffs and accumulate gradients (With layers whose backward accumulates gradients), this effectively decouples the computational batch from the SGD minibatch. Each iteration accumulates gradients over iter_size batches, then parameters are updated.

2015-05-26

Merge pull request #1946 from nickcarlevaris/msra_init Add MSRAFiller, an Xavier-like filler designed for use with ReLUs

Added MSRAFiller, an Xavier-like filler designed for use with ReLUs ...instead of tanh. Based on paper: He et al, "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification," 2015. - add VarianceNorm option to FillerParameters which allows one to normalize by fan_in, fan_out or their average. - update XavierFiller to use the VarianceNorm option (default behavior unchanged). - add tests for MSRAFiller and XavierFiller.

2015-05-18

clean up redundant message comments

2015-05-16

Merge pull request #2466 from ducha-aiki/mvn-less Remove unnecessary variance computation from backward in MVN layer

2015-05-15

Merge pull request #2095 from mtamburrano/skip_propagate_down_param Added param skip_propagate_down to LayerParameter

Remove unnecessary variance computation from backward in MVN layer

Added "propagate_down" param to LayerParameter

Add ReshapeParameter axis and num_axes to reshape only a particular span of the input shape

Added a Reshape layer for copying-free modification of blob dimensions.

ReshapeLayer fixups for ND blobs

Merge pull request #2177 from pgao/spp_layer Spatial Pyramid Pooling Layer

Spatial Pyramid Pooling Layer

2015-05-04

Added support for original implementation, using (margin - d^2), through the legacy_version parameter.

2015-04-09

Allow Transform of encoded datum. Allow initialize transformed_blob from datum or transform params. Allow force_color and force_gray as transform params.

2015-03-13

HDF5DataLayer shuffle: minor cleanup; clarification in HDF5DataParameter

shuffle data

2015-03-12

PReLU Layer and its tests described in Kaiming He et al, "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification", arxiv 2015. Belows are commit message histories that I had while developing. PReLULayer takes FillerParameter for init PReLU testing consistency with ReLU Fix : PReLU test concistency check PReLU tests in-place computation, and it failed in GPU Fix: PReLU in-place backward in GPU PReLULayer called an incorrect API for copying data (caffe_gpu_memcpy). First argment of `caffe_gpu_memcpy` should be size of memory region in byte. I modified to use `caffe_copy` function. Fix: style errors Fix: number of axes of input blob must be >= 2 Use 1D blob, zero-D blob. Rename: hw -> dim

2015-03-09

AccuracyLayer: add ignore_label param

Fixup AccuracyLayer like SoftmaxLossLayer in #1970 -- fixes #2063

2015-03-03

DummyDataLayer outputs blobs of arbitrary shape

ConcatLayer: generalized Blob axes

SliceLayer: generalized Blob axes

SoftmaxLayer: generalized Blob axes

Blobs are ND arrays (for N not necessarily equals 4). vector<int> shape_ instead of (num, channels, height, width).

InnerProductLayer can multiply along any axis

Add BlobShape message; use for Net input shapes

2015-02-20

Merge pull request #1910 from philkr/encoded add force_encoded_color flag to the data layer and warn about mixed encoding

added a force_encoded_color flag to the data layer. Printing a warning if images of different channel dimensions are encoded together

2015-02-17

give phase to Net and Layer Give the responsibility for phase to Net and Layer, making phase an immutable choice at instantiation and dropping it from the Caffe singleton.

[pycaffe] allow Layer to be extended from Python This is done by adding PythonLayer as a boost::python HeldType.

2015-02-14

Add gradient clipping -- limit L2 norm of parameter gradients

2015-02-06

fix for layer-type-str: loss_param and DECONVOLUTION type should have been included in V1LayerParameter, get upgraded

2015-02-05

get rid of NetParameterPrettyPrint as layer is now after inputs (whoohoo)

'layers' -> 'layer'

start layer parameter field IDs at 100 (always want them printed at the end, and want to allow more fields to be added in the future, so reserve fields 10-99 for that purpose)

restore upgrade_proto

automagic upgrade for v1->v2

add message ParamSpec to replace param name, blobs_lr, weight_decay, ...

Layer type is a string

2015-02-01

Merge pull request #1615 from longjon/deconv-layer Add deconvolution layer with refactoring of convolution layer to share code

2015-01-30

Merge pull request #1654 from longjon/softmax-missing-values Add missing value support to SoftmaxLossLayer

debug_info in NetParameter so it can be enabled outside training

2015-01-17

Make comments for sparse GaussianFiller match actual behavior (Fixes #1497 reported by @denizyuret)

2015-01-11

add DeconvolutionLayer, using BaseConvolutionLayer

2014-12-31

add spatial normalization option to SoftmaxLossLayer With missing values (and batches of varying spatial dimension), normalizing each batch across instances can inappropriately give different instances different weights, so we give the option of simply normalizing by the batch size instead.

add missing value support to SoftmaxLossLayer

2014-12-22

Added Multistep, Poly and Sigmoid learning rate decay policies Conflicts: include/caffe/solver.hpp src/caffe/proto/caffe.proto src/caffe/solver.cpp

Display averaged loss over the last several iterations

2014-10-16

Merge pull request #190 from sguada/new_lr_policies New lr policies, MultiStep and StepEarly

Add root_folder to ImageDataLayer

Added cache_images to WindowDataLayer Added root_folder to WindowDataLayer to locate images

2014-10-15

Added encoded datum to io

2014-10-14

Refactored leveldb and lmdb code.

2014-10-10

Added Multistep, Poly and Sigmoid learning rate decay policies Conflicts: include/caffe/solver.hpp src/caffe/proto/caffe.proto src/caffe/solver.cpp

2014-10-06

correct naming in comment and message about average_loss

2014-10-04

Merge pull request #1070 from sguada/move_data_mean Refactor data_transform to allow datum, cv:Mat and Blob transformation

2014-10-03

Added mean_value to specify mean channel substraction Added example of use to models/bvlc_reference_caffenet/train_val_mean_value.prototxt

Added global_pooling to set the kernel size equal to the bottom size Added check for padding and stride with global_pooling

Initial cv::Mat transformation Added cv::Mat transformation to ImageDataLayer Conflicts: src/caffe/layers/image_data_layer.cpp Added transform Datum to Blob Conflicts: src/caffe/layers/base_data_layer.cpp src/caffe/layers/base_data_layer.cu Added transform cv::Mat to Blob Added transform Vector<Datum> to Blob Conflicts: src/caffe/data_transformer.cpp

2014-10-02

Add ExpLayer to calculate y = base ^ (scale * x + shift)

caffe.proto: do some minor cleanup (fix comments, alphabetization)

2014-10-01

Merge pull request #1096 from qipeng/smoothed-cost Display averaged loss over the last several iterations

2014-09-22

added support for "k" LRN parameter to upgrade_proto

adds a parameter to the LRN layer (denoted as "k" in [Krizhevsky et al., NIPS 2012])

2014-09-19

Merge pull request #959 from nickcarlevaris/contrastive_loss Add contrastive loss layer, tests, and a siamese network example

2014-09-17

Display averaged loss over the last several iterations

2014-09-14

fix spelling error in caffe.proto

fix out-of-date next ID comment for SolverParameter

2014-09-08

Added contrastive loss layer, associated tests, and a siamese network example using shared weights and the contrastive loss.

Implemented elementwise max layer

2014-09-07

add cuDNN to build

groom proto: sort layer type parameters, put loss_weight after basics

add engine parameter for multiple computational strategies add `engine` switch to layers for selecting a computational backend when there is a choice. Currently the standard Caffe implementation is the only backend.

2014-09-05

Merge pull request #1036 from longjon/test-initialization-param Add test_initialization option to allow skipping initial test

2014-09-04

add SILENCE layer -- takes one or more inputs and produces no output This is useful for suppressing undesired outputs.

add test_initialization option to allow skipping initial test

2014-09-03

Add transformer to the memory data layer

Move transform param one level up in the proto to reduce redundancy