Proto commits in stephenyan1231/caffe-public

These commits are when the Protocol Buffers files have changed: (only the last 100 relevant commits are shown)

Commit:5482a7a
Author:Zhicheng Yan

update lstm_2dlayer and renet_lstm_layer

Commit:0188f04
Author:Zhicheng Yan

a complementary commit for implementation of LSTM_2DLayer and ReNetLSTMLayer

Commit:0bd331b
Author:Zhicheng Yan

fix bugs in the implementation of 2D LSTM layer

Commit:49aa344
Author:Zhicheng Yan

a complementary commit for the previous commit: reimplement 2D LSTM in layer class LSTM_2DLayer

Commit:e962dc3
Author:Zhicheng Yan

add video-enhance/data/uniform_set/global_ftr_lmdb and feature mean files

Commit:28e736c
Author:Zhicheng Yan

For class DataManager and DataVariableSizeManager, when selective list is provided, random shuffle is enabled by default.

Commit:3a3bbe8
Author:Zhicheng Yan

support matrix quantization for convolutional layer

Commit:4a7f2c2
Author:Zhicheng Yan

fix some bugs

Commit:e87c0dc
Author:Zhicheng Yan

support matrix quantization for inner product layer

Commit:483fef9
Author:Zhicheng Yan

add support for DataVariableSizeLayer to use encoded lmdb database

Commit:c2c4ef4
Author:Zhicheng Yan

use encoded lmdb database. Supprt selective list in data layer

Commit:c313023
Author:Zhicheng Yan

add shift_stitch_layer shift_pooling_layer

Commit:3d6ad60
Author:Zhicheng Yan

support overfeat-style dense testing. An example script is at examples/imagenet/test_VGG_ILSVRC_16_layers_dense_testing.sh

Commit:0433eeb
Author:Zhicheng Yan

add data_variable_size_layer.cpp data_variable_size_transformer.cpp

Commit:5f50945
Author:Zhicheng Yan

support multi-scale training as in VGG paper.

Commit:aac89f7
Author:Zhicheng Yan

HDCNN v1.1

Commit:f2724ea
Author:Jeff Donahue
Committer:Jeff Donahue

Add RecurrentLayer: an abstract superclass for other recurrent layer types

Commit:8bafc35
Author:Jeff Donahue
Committer:Jeff Donahue

AccuracyLayer: add 'denominator' param

Commit:654f5df
Author:Jeff Donahue
Committer:Jeff Donahue

EltwiseLayer can take a blob of per-num coefficients

Commit:23d5c03
Author:Jeff Donahue
Committer:Jeff Donahue

Add (very simple version of) ReshapeLayer

Commit:57aaa65
Author:Zhicheng Yan

fix a bug that the phase(TRAIN or TEST) in data_transformer_ in DataManageris NOT initialized properly. Thus, in periodic testing stage during training, testing image is randomly cropped.

Commit:61f47e8
Author:Zhicheng Yan

(1)add spatial_accuracy_layer (2) prepare extract_VGG_ILSVRC_16_layers_parser_fc7.sh to demonstrate efficient pixelwise feature extraction using shift and stitch trick

Commit:756fe19
Author:Zhicheng Yan

add shift_pooling_layer and shift_stitch_layer

Commit:bb8a91d
Author:Jeff Donahue
Committer:Jeff Donahue

Add EmbedLayer for inner products with sparse input (one-hot vectors), with unit tests

Commit:6965746
Author:Jonathan L Long
Committer:Jeff Donahue

zero-init param diffs and accumulate gradients (With layers whose backwards accumlate gradients), this effectively decouples the computational batch from the SGD minibatch. Each iteration accumulates gradients over iter_size batches, then parameters are updated.

Commit:6fe2b04
Author:Jeff Donahue
Committer:Jeff Donahue

HDF5DataLayer shuffle: minor cleanup; clarification in HDF5DataParameter

Commit:249aba4
Author:wieschol
Committer:Jeff Donahue

shuffle data

Commit:bb5bf43
Author:Takuya Narihira
Committer:Takuya Narihira

PReLU Layer and its tests described in Kaiming He et al, "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification", arxiv 2015. Belows are commit message histories that I had while developing. PReLULayer takes FillerParameter for init PReLU testing consistency with ReLU Fix : PReLU test concistency check PReLU tests in-place computation, and it failed in GPU Fix: PReLU in-place backward in GPU PReLULayer called an incorrect API for copying data (caffe_gpu_memcpy). First argment of `caffe_gpu_memcpy` should be size of memory region in byte. I modified to use `caffe_copy` function. Fix: style errors Fix: number of axes of input blob must be >= 2 Use 1D blob, zero-D blob. Rename: hw -> dim

Commit:6ea7a66
Author:max argus
Committer:Jeff Donahue

AccuracyLayer: add ignore_label param

Commit:7a40f74
Author:Jeff Donahue
Committer:Jeff Donahue

Fixup AccuracyLayer like SoftmaxLossLayer in #1970 -- fixes #2063

Commit:1ada9e8
Author:Zhicheng Yan

first workable multigpu caffe

Commit:7462c84
Author:Jeff Donahue
Committer:Jeff Donahue

DummyDataLayer outputs blobs of arbitrary shape

Commit:abec302
Author:Jeff Donahue
Committer:Jeff Donahue

SoftmaxLayer: generalized Blob axes

Commit:8afdcd0
Author:Jeff Donahue
Committer:Jeff Donahue

ConcatLayer: generalized Blob axes

Commit:b868916
Author:Jeff Donahue
Committer:Jeff Donahue

SliceLayer: generalized Blob axes

Commit:29581e6
Author:Jeff Donahue
Committer:Jeff Donahue

InnerProductLayer can multiply along any axis

Commit:1434e87
Author:Jeff Donahue
Committer:Jeff Donahue

Blobs are ND arrays (for N not necessarily equals 4). vector<int> shape_ instead of (num, channels, height, width).

Commit:5407f82
Author:Jeff Donahue
Committer:Jeff Donahue

Add BlobShape message; use for Net input shapes

Commit:9114424
Author:Evan Shelhamer

Merge pull request #1910 from philkr/encoded add force_encoded_color flag to the data layer and warn about mixed encoding

Commit:a2f7f47
Author:philkr
Committer:philkr

added a force_encoded_color flag to the data layer. Printing a warning if images of different channel dimensions are encoded together

Commit:6eb0931
Author:Evan Shelhamer
Committer:Evan Shelhamer

give phase to Net and Layer Give the responsibility for phase to Net and Layer, making phase an immutable choice at instantiation and dropping it from the Caffe singleton.

Commit:d94f107
Author:Jonathan L Long
Committer:Jonathan L Long

[pycaffe] allow Layer to be extended from Python This is done by adding PythonLayer as a boost::python HeldType.

Commit:f38ddef
Author:Jeff Donahue
Committer:Jeff Donahue

Add gradient clipping -- limit L2 norm of parameter gradients

Commit:6a22697
Author:Jeff Donahue
Committer:Jeff Donahue

fix for layer-type-str: loss_param and DECONVOLUTION type should have been included in V1LayerParameter, get upgraded

Commit:11a4c16
Author:Jeff Donahue
Committer:Jeff Donahue

start layer parameter field IDs at 100 (always want them printed at the end, and want to allow more fields to be added in the future, so reserve fields 10-99 for that purpose)

Commit:62d1d3a
Author:Jeff Donahue
Committer:Jeff Donahue

get rid of NetParameterPrettyPrint as layer is now after inputs (whoohoo)

Commit:2e6a82c
Author:Jeff Donahue
Committer:Jeff Donahue

automagic upgrade for v1->v2

Commit:78b02e5
Author:Jeff Donahue
Committer:Jeff Donahue

add message ParamSpec to replace param name, blobs_lr, weight_decay, ...

Commit:af37eac
Author:Jeff Donahue
Committer:Jeff Donahue

'layers' -> 'layer'

Commit:bb5ba1b
Author:Jeff Donahue
Committer:Jeff Donahue

restore upgrade_proto

Commit:3b13846
Author:Jeff Donahue
Committer:Jeff Donahue

Layer type is a string

Commit:9767b99
Author:Evan Shelhamer

Merge pull request #1615 from longjon/deconv-layer Add deconvolution layer with refactoring of convolution layer to share code

Commit:cff3007
Author:Evan Shelhamer

Merge pull request #1654 from longjon/softmax-missing-values Add missing value support to SoftmaxLossLayer

Commit:3519d05
Author:Jeff Donahue
Committer:Jeff Donahue

debug_info in NetParameter so it can be enabled outside training

Commit:1304173
Author:Jeff Donahue
Committer:Jeff Donahue

Make comments for sparse GaussianFiller match actual behavior (Fixes #1497 reported by @denizyuret)

Commit:3617352
Author:Jonathan L Long
Committer:Jonathan L Long

add DeconvolutionLayer, using BaseConvolutionLayer

Commit:34321e4
Author:Jonathan L Long
Committer:Jonathan L Long

add spatial normalization option to SoftmaxLossLayer With missing values (and batches of varying spatial dimension), normalizing each batch across instances can inappropriately give different instances different weights, so we give the option of simply normalizing by the batch size instead.

Commit:5843b52
Author:Jonathan L Long
Committer:Jonathan L Long

add missing value support to SoftmaxLossLayer

Commit:18749f8
Author:Sergio
Committer:Sergio

Added Multistep, Poly and Sigmoid learning rate decay policies Conflicts: include/caffe/solver.hpp src/caffe/proto/caffe.proto src/caffe/solver.cpp

Commit:9e756bf
Author:qipeng
Committer:Sergio

Display averaged loss over the last several iterations

Commit:bdd0a00
Author:Sergio Guadarrama

Merge pull request #190 from sguada/new_lr_policies New lr policies, MultiStep and StepEarly

Commit:14f548d
Author:Sergio
Committer:Sergio

Added cache_images to WindowDataLayer Added root_folder to WindowDataLayer to locate images

Commit:e9d6e5a
Author:Sergio
Committer:Sergio

Add root_folder to ImageDataLayer

Commit:9fc7f36
Author:Sergio
Committer:Sergio

Added encoded datum to io

Commit:6ad4f95
Author:Kevin James Matzen
Committer:Kevin James Matzen

Refactored leveldb and lmdb code.

Commit:b025da7
Author:Sergio
Committer:Sergio

Added Multistep, Poly and Sigmoid learning rate decay policies Conflicts: include/caffe/solver.hpp src/caffe/proto/caffe.proto src/caffe/solver.cpp

Commit:914da95
Author:Jonathan L Long
Committer:Jonathan L Long

correct naming in comment and message about average_loss

Commit:0ba046b
Author:Sergio Guadarrama

Merge pull request #1070 from sguada/move_data_mean Refactor data_transform to allow datum, cv:Mat and Blob transformation

Commit:a9572b1
Author:Sergio
Committer:Sergio

Added mean_value to specify mean channel substraction Added example of use to models/bvlc_reference_caffenet/train_val_mean_value.prototxt

Commit:760ffaa
Author:Sergio
Committer:Sergio

Added global_pooling to set the kernel size equal to the bottom size Added check for padding and stride with global_pooling

Commit:4602439
Author:Sergio
Committer:Sergio

Initial cv::Mat transformation Added cv::Mat transformation to ImageDataLayer Conflicts: src/caffe/layers/image_data_layer.cpp Added transform Datum to Blob Conflicts: src/caffe/layers/base_data_layer.cpp src/caffe/layers/base_data_layer.cu Added transform cv::Mat to Blob Added transform Vector<Datum> to Blob Conflicts: src/caffe/data_transformer.cpp

Commit:7995a38
Author:Jeff Donahue
Committer:Jeff Donahue

Add ExpLayer to calculate y = base ^ (scale * x + shift)

Commit:e6ba910
Author:Jeff Donahue

caffe.proto: do some minor cleanup (fix comments, alphabetization)

Commit:c76ba28
Author:Jeff Donahue

Merge pull request #1096 from qipeng/smoothed-cost Display averaged loss over the last several iterations

Commit:fc1d3c0
Author:Zhicheng Yan

code cleaning

Commit:502141d
Author:Karen Simonyan
Committer:Karen Simonyan

adds a parameter to the LRN layer (denoted as "k" in [Krizhevsky et al., NIPS 2012])

Commit:aeb0e98
Author:Karen Simonyan
Committer:Karen Simonyan

added support for "k" LRN parameter to upgrade_proto

Commit:7c3c089
Author:Evan Shelhamer

Merge pull request #959 from nickcarlevaris/contrastive_loss Add contrastive loss layer, tests, and a siamese network example

The documentation is generated from this commit.

Commit:03e0e01
Author:qipeng

Display averaged loss over the last several iterations

Commit:e294f6a
Author:Jonathan L Long

fix spelling error in caffe.proto

Commit:d54846c
Author:Jonathan L Long

fix out-of-date next ID comment for SolverParameter

Commit:d149c9a
Author:Nick Carlevaris-Bianco
Committer:Nick Carlevaris-Bianco

Added contrastive loss layer, associated tests, and a siamese network example using shared weights and the contrastive loss.

Commit:761c815
Author:to3i
Committer:Jeff Donahue

Implemented elementwise max layer

Commit:77d9124
Author:Evan Shelhamer
Committer:Evan Shelhamer

add cuDNN to build

Commit:a3dcca2
Author:Evan Shelhamer
Committer:Evan Shelhamer

add engine parameter for multiple computational strategies add `engine` switch to layers for selecting a computational backend when there is a choice. Currently the standard Caffe implementation is the only backend.

Commit:cd52392
Author:Evan Shelhamer
Committer:Evan Shelhamer

groom proto: sort layer type parameters, put loss_weight after basics

Commit:50d9d0d
Author:Evan Shelhamer

Merge pull request #1036 from longjon/test-initialization-param Add test_initialization option to allow skipping initial test

Commit:d8f56fb
Author:Jeff Donahue
Committer:Jonathan L Long

add SILENCE layer -- takes one or more inputs and produces no output This is useful for suppressing undesired outputs.

Commit:2bdf516
Author:Jonathan L Long
Committer:Jonathan L Long

add test_initialization option to allow skipping initial test

Commit:4c35ad2
Author:Kai Li
Committer:Kai Li

Add transformer to the memory data layer

Commit:3c9a13c
Author:Kai Li
Committer:Kai Li

Move transform param one level up in the proto to reduce redundancy

Commit:a683c40
Author:qipeng
Committer:Jeff Donahue

Added L1 regularization support for the weights

Commit:b0ec531
Author:qipeng
Committer:Jeff Donahue

fixed caffe.proto after a mistaken rebase

Commit:23d4430
Author:qipeng
Committer:Jeff Donahue

fixes after rebase

Commit:29b3b24
Author:qipeng
Committer:Jeff Donahue

proto conflit, lint, and math_functions (compiler complaint)

Commit:dbb9296
Author:Jeff Donahue
Committer:Jeff Donahue

cleanup caffe.proto

Commit:6d5f766
Author:Zhicheng Yan

add two new layers MULTINOMIAL_LOGISTIC_SPARSITY_LOSS and PROBABLISTIC_AVERAGE_PROB

Commit:910db97
Author:Jeff Donahue
Committer:Jeff Donahue

Add "stable_prod_grad" option (on by default) to ELTWISE layer to compute the eltwise product gradient using a slower but stabler formula.

Commit:408ce03
Author:Zhicheng Yan

add FLOAT_DATA layer to allow float-typed input data

Commit:3141e71
Author:Evan Shelhamer
Committer:Evan Shelhamer

restore old data transformation parameters for compatibility