Merge pull request #5315 from nouiz/news

.mailmap

@@ -31,9 +31,14 @@ Bart van Merrienboer <bart.vanmerrienboer@gmail.com> Bart <bart.vanmerrienboer@g
 Bogdan Budescu <bbudescu@gmail.com> bbudescu <bbudescu@gmail.com>
 Brian Cheung <briancheung@users.noreply.github.com> briancheung <bcheung5@gmail.com>
 Caglar <ca9lar@gmail.com> Caglar <caglar@users.noreply.github.com>
+Cesar Laurent <cesarlaurent77@gmail.com> César Laurent <Thrandis@users.noreply.github.com>
 Chienli Ma <maqianlie@gmail.com> Chienli Ma(马千里) <maqianlie@gmail.com>
 Chienli Ma <maqianlie@gmail.com> ChienliMa <maqianlie@gmail.com>
 Chiheb Trabelsi <chiheb.tr@gmail.com> Chiheb Trabelsi <trabelsc@bart5>
+Chinnadhurai Sankar <chinnadhurai@gmail.com> Chinnadhurai Sankar <sankarch@leto04.iro.umontreal.ca>
+Chinnadhurai Sankar <chinnadhurai@gmail.com> Chinnadhurai Sankar <sankarch@leto50.iro.umontreal.ca>
+Chinnadhurai Sankar <chinnadhurai@gmail.com> Chinnadhurai Sankar <sankarch@kepler2.iro.umontreal.ca>
+Chinnadhurai Sankar <chinnadhurai@gmail.com> Chinnadhurai Sankar <sankarch@kepler3.iro.umontreal.ca>
 David Warde-Farley <wardefar@iro.umontreal.ca> David Warde-Farley <dwf@cs.toronto.edu>
 David Warde-Farley <wardefar@iro.umontreal.ca> David Warde Farley <dwf@cs.toronto.edu>
 David Warde-Farley <wardefar@iro.umontreal.ca> David Warde-Farley <d.warde.farley@gmail.com>
@@ -47,6 +52,8 @@ Dumitru Erhan <dumitru.erhan@gmail.com> erhandum@bikat.iro.umontreal.ca <erhandu
 Dzmitry Bahdanau <dimabgv@gmail.com> rizar <dimabv@tut.by>
 Eric Hunsberger <hunse@ctn> hunse <hunse@ctn>
 Ethan Buchman <ebuchman@uoguelph.ca> ebuchman <ebuchman@uoguelph.ca>
+Evelyn Mitchell <efm-github@linsomniac.com> evelynmitchell <efm-github@linsomniac.com>
+Fei Wang <fay96816@gmail.com> fay <fay96816@gmail.com>
 Francesco Visin <fvisin@gmail.com> Francesco <fvisin@users.noreply.github.com>
 Francesco Visin <fvisin@gmail.com> fvisin <fvisin@gmail.com>
 Francois Savard <devnull@localhost> fsavard <devnull@localhost>
@@ -60,6 +67,7 @@ Frederic Bastien <nouiz@nouiz.org> bastienf@ldapk3.scinet.utoronto.ca <bastienf@
 Frederic Bastien <nouiz@nouiz.org> nouiz <nouiz@nouiz.org>
 Frederic Bastien <nouiz@nouiz.org> Frederic <nouiz@nouiz.org>
 Frederic Bastien <nouiz@nouiz.org> Frédéric Bastien <frederic.bastien@gmail.com>
+Gennadiy Tupitsin <genichyar@genichyar.com> genichyar <genichyar@genichyar.com>
 Grégoire Mesnil <gregoire.mesnil@gmail.com> Grégoire <gregoire.mesnil@laposte.net>
 Guillaume Alain <guillaume.alain.umontreal@gmail.com> Guillaume Alain <gyomalin@gmail.com>
 Guillaume Desjardins <guillaume.desjardins@gmail.com> desjagui <devnull@localhost>
@@ -106,6 +114,7 @@ Joseph Turian <turian@iro.umontreal.ca> turian@rubis.iro.umontreal.ca <turian@ru
 Joseph Turian <turian@iro.umontreal.ca> turianjo@is23.m <turianjo@is23.m>
 Josh Bleecher Snyder <josharian@gmail.com> Josh Bleecher Snyder <josharian+github@gmail.com>
 Jörg Bornschein <jb@capsec.org> Joerg Bornschein <bornschein@fias.uni-frankfurt.de>
+Karthik Karanth <karanth.karthik@gmail.com> medakk <karanth.karthik@gmail.com>
 Kelvin Xu <kelvin.xu@umontreal.ca> Kelvin Xu <iamkelvinxu@gmail.com>
 Kelvin Xu <kelvin.xu@umontreal.ca> kelvinxu <iamkelvinxu@gmail.com>
 Kelvin Xu <kelvin.xu@umontreal.ca> Kelvin Xu <xukelvin@leto01.iro.umontreal.ca>
@@ -116,12 +125,14 @@ Kelvin Xu <kelvin.xu@umontreal.ca> Kelvin Xu <xukelvin@eos13.iro.umontreal.ca>
 Kelvin Xu <kelvin.xu@umontreal.ca> Kelvin Xu <xukelvin@eos7.iro.umontreal.ca>
 Kelvin Xu <kelvin.xu@umontreal.ca> Kelvin Xu <xukelvin@eos18.iro.umontreal.ca>
 Kelvin Xu <kelvin.xu@umontreal.ca> Kelvin Xu <xukelvin@eos20.iro.umontreal.ca>
+Kv Manohar <kvmanohar22@gmail.com> kvmanohar22 <kvmanohar22@gmail.com>
 Kyung Hyun Cho <cho.k.hyun@gmail.com> Kyunghyun Cho <kyunghyuncho@Kyunghyuns-MacBook-Pro.local>
 Kyung Hyun Cho <cho.k.hyun@gmail.com> Kyunghyun Cho <kyunghyuncho@kyunghyuns-mbp.sf.umontreal.ca>
 Li Yao <yaoli.email@gmail.com> Li Yao <li.yao@umontreal.ca>
 Li Yao <yaoli.email@gmail.com> Li Yao <yaoli@iro>
 Li Yao <yaoli.email@gmail.com> yaoli <yaoli.email@gmail.com>
 Li Yao <yaoli.email@gmail.com> Li <you@yourdomain.example.com>
+Liwei Cai <cai_lw@126.com> cai-lw <cai_lw@126.com>
 Lucas Beyer <lucasb.eyer.be@gmail.com> lucasb-eyer <lucasb.eyer.be@gmail.com>
 Ludwig Schmidt-Hackenberg <ludwig@iupr.com> Ludwig Schmidt-Hackenberg <ludwig@schmidt-hackenberg.net>
 Luke Metz <luke.metz@students.olin.edu> = <luke.metz@students.olin.edu>
@@ -131,6 +142,7 @@ Mehdi Mirza <memirzamo@gmail.com> Mehdi Mirza <memimo@users.noreply.github.com>
 Mehdi Mirza <memirzamo@gmail.com> memimo <memirzamo@gmail.com>
 Moslem Kazemi <moslemk@gmail.com> Moslem Kazemi <moslemk@users.noreply.github.com>
 Moslem Kazemi <moslemk@gmail.com> Mo <moslemk@gmail.com>
+Nan Rosemary Ke <rosemary.ke@west.cmu.edu> nke001 <rosemary.nan.ke@gmail.com>
 Nicolas Ballas <ballas.n@gmail.com> Kcub <ballas@lrde.epita.fr>
 Nicolas Ballas <ballas.n@gmail.com> ballasn <ballas.n@gmail.com>
 Nicolas Boulanger-Lewandowski <nicolas_boulanger@hotmail.com> boulanni <nicolas_boulanger@hotmail.com>
@@ -167,6 +179,7 @@ Razvan Pascanu <r.pascanu@gmail.com> Razvan Pascanu <rman@rman-pad.(none)>
 Razvan Pascanu <r.pascanu@gmail.com> pascanur@simplet.iro.umontreal.ca <pascanur@simplet.iro.umontreal.ca>
 Razvan Pascanu <r.pascanu@gmail.com> rman@rpad <rman@rpad>
 Roy Xue <xljroy@gmail.com> Lijun Xue <xljroy@gmail.com>
+Ruslana Makovetsky <ruslana@cim.mcgill.ca> ruslanagit <ruslana@cim.mcgill.ca>
 Sander Dieleman <sanderdieleman@gmail.com> benanne <sanderdieleman@gmail.com>
 Sebastian Berg <sebastian@sipsolutions.net> seberg <sebastian@sipsolutions.net>
 Sebastien Jean <jeasebas@iro.umontreal.ca> sebastien <jeasebas@iro.umontreal.ca>
@@ -176,6 +189,8 @@ Simon Lefrancois <simon.lefrancois@umontreal.ca> slefrancois <simon.lefrancois@u
 Sina Honari <honaris@iro.umontreal.ca> SinaHonari <sina2222@gmail.com>
 Sina Honari <honaris@iro.umontreal.ca> Sina Honari <honaris@eos21.iro.umontreal.ca>
 Søren Kaae Sønderby <skaaesonderby@gmail.com> skaae <skaaesonderby@gmail.com>
+Steven Bocco <stevenbocco@gmail.com> notoraptor <stevenbocco@gmail.com>
+Steven Bocco <stevenbocco@gmail.com> notoraptor <notoraptor@users.noreply.github.com>
 Steven Pigeon <pigeon@iro.umontreal.ca> steven-pigeon <pigeon@iro.umontreal.ca>
 Valentin Bisson <valentin.bisson@umontreal.ca> onze <onzeonline@gmail.com>
 Xavier Bouthillier <xavier.bouthillier@gmail.com> Xavier Bouthillier <xavier.bouthillier@umontreal.ca>
@@ -183,6 +198,7 @@ Xavier Bouthillier <xavier.bouthillier@gmail.com> Xavier Bouthillier/ <xavier.bo
 Xavier Glorot <glorotxa@iro.umontreal.ca> glorotxa <glorotxa@iro.umontreal.ca>
 Xavier Glorot <glorotxa@iro.umontreal.ca> glorotxa@timide.iro.umontreal.ca <glorotxa@timide.iro.umontreal.ca>
 Vincent Dumoulin <vi.dumoulin@gmail.com> vdumoulin <vi.dumoulin@gmail.com>
+Vitaliy Kurlin <vitaliykurin@gmail.com> yobibyte <vitaliykurin@gmail.com>
 Vivek Kulkarni <viveksck@gmail.com> Vivek Kulkarni <vvkulkarni@cs.stonybrook.edu>
 Wei Li <kuantkid@gmail.com> kuantkid <kuantkid@gmail.com>
 Yoshua Bengio <bengioy@iro.umontreal.ca> bengioy@bengio-mac.local <bengioy@bengio-mac.local>

NEWS_DEV.txt

@@ -13,50 +13,221 @@ git shortlog -sn rel-0.8.0..
 
 # docker?
 
+TODO: better Theano conv doc
+
 Highlight:
+ - Many computation and compilation speed up
+ - More numerical stability by default for some graph
+ - Jenkins (gpu tests run on PR in addition to daily buildbot)
+ - More graph optimization (faster execution and smaller graph, so more readable)
+ - Less c code compilation
+ - Better Python 3.5 support
+ - Support newer Mac and Windows version
+ - Conda packages for Mac, Linux and Windows
+ - scan with checkpoint (trade off between speed and memory usage, useful for long sequences)
+ - Added a bool dtype
 
-Computation and compilation speed up
-Multi-cores convolution and pooling on CPU
-More numerical stability by default for some graph.
-New 3d convolution and pooling interface
-CuDNN: 5.1, batch normalization, RNN
-Dilated convolution
-Multiple-GPU, synchrone update (via platoon, use NCCL)
-Partial function evaluation
-Add gradient of solve, tensorinv (CPU), tensorsolve (CPU) searchsorted (CPU)
-Add Multinomial Without Replacement
-Pooling parameters can change at run time
-Jenkins (gpu tests run on PR in addition to daily buildbot)
+ - New back-end:
+   - float16 storage
+   - print pci bus id
+   - More pooling support on GPU when cudnn isn't there.
 
+Interface changes:
+ - New pooling interface
+ - Pooling parameters can change at run time
+ - When converting empty list/tuple, now we use floatX dtype
+ - The MRG random generator now try to infer the broadcast pattern of its output
+ - Move softsign out of sandbox to theano.tensor.nnet.softsign
+ - Roll make the shift be modulo the size of the axis we roll on
 
-Add DownsampleFactorMaxGradGrad.grad
-Better Python 3.5 support
-Mac, Windows new versions fixes
-More Rop support
-More stack trace in error message
-Speed up cholesky grad
-conv3d2d support full and half mode
-indexing support ellipsis a[..., 3], a[1,...,3]
+Convolution updates:
+ - Multi-cores convolution and pooling on CPU
+ - New abstract 3d convolution interface similar to the 2d convolution interface
+ - Dilated convolution
 
-Details
-Doc/error message fixes/updtes
-GpuJoin support negative axis.
-Move softsign out of sandbox to theano.tensor.nnet.softsign
-norm(keepdims) param added
-Add flag profiling.ignore_first_call
-More op in the new back-end.
-Crash fixes
-More graph optimizations
-tensor5, dtensor5...
-compiledir_format support device
-make scan grad more deterministic.
-Add support for space in path
-Roll make the shift be modulo the size of the axis we roll on
 
+GPU:
+ - CuDNN: support versoin 5.1 and wrap batch normalization (2d and 3d) and RNN functions
+ - Multiple-GPU, synchrone update (via platoon, use NCCL)
+ - GpuAdvancedSubtensor in new back-end
+ - Gemv(matrix-vector product) speed up for special shape
+ - Support for MaxAndArgMax for some axis combination
+ - cublas gemv workaround when we reduce on an axis with a dimensions size of 0
+
+New feature:
+ - Add gradient of solve, tensorinv (CPU), tensorsolve (CPU) searchsorted (CPU)
+ - Add Multinomial Without Replacement
+ - conv3d2d support full and half mode (REMOVE?)
+ - Add DownsampleFactorMaxGradGrad.grad
+ - Allow partial evaluation of compiled function
+ - More Rop support
+ - Indexing support ellipsis: a[..., 3], a[1,...,3]
+ - Added theano.tensor.{tensor5,dtensor5, ...}
+ - compiledir_format support device
+
+
+Others:
+ - Speed up argmax only on gpu (without also needing the max)
+ - A few unfrequent bugfix 
+ - More stack trace in error message
+ - Speed up cholesky grad
+ - log(sum(exp(...))) now get stability optimized
 
 
-ALL THE PR BELLOW HAVE BEEN CHECKED
 
+
+Other more detailed changes:
+ - Allow more then one output to be an destructive inplace
+ - Add flag profiling.ignore_first_call, useful to profile the new gpu back-end
+ - Doc/error message fixes/updates
+ - More support of negative axis
+ - Added the keepdims parameter to the norm function
+ - Crash fixes
+ - Make scan gradiant more deterministic
+ - Add support for space in path on Windows
+ - remove ProfileMode (use Theano flag profile=True instead)
+
+
+
+ALL THE PR BELLOW HAVE BEEN CHECKED
+* https://github.com/Theano/Theano/pull/5309
+* https://github.com/Theano/Theano/pull/5306
+* https://github.com/Theano/Theano/pull/5289
+* https://github.com/Theano/Theano/pull/5307
+* https://github.com/Theano/Theano/pull/5290
+* https://github.com/Theano/Theano/pull/5303
+* https://github.com/Theano/Theano/pull/5302
+* https://github.com/Theano/Theano/pull/5300
+* https://github.com/Theano/Theano/pull/5304
+* https://github.com/Theano/Theano/pull/5271
+* https://github.com/Theano/Theano/pull/5247
+* https://github.com/Theano/Theano/pull/5288
+* https://github.com/Theano/Theano/pull/5265
+* https://github.com/Theano/Theano/pull/5223
+* https://github.com/Theano/Theano/pull/5297
+* https://github.com/Theano/Theano/pull/5293
+* https://github.com/Theano/Theano/pull/5286
+* https://github.com/Theano/Theano/pull/5287
+* https://github.com/Theano/Theano/pull/5198
+* https://github.com/Theano/Theano/pull/5282
+* https://github.com/Theano/Theano/pull/5254
+* https://github.com/Theano/Theano/pull/5281
+* https://github.com/Theano/Theano/pull/5231
+* https://github.com/Theano/Theano/pull/5239
+* https://github.com/Theano/Theano/pull/5266
+* https://github.com/Theano/Theano/pull/5277
+* https://github.com/Theano/Theano/pull/5275
+* https://github.com/Theano/Theano/pull/5153
+* https://github.com/Theano/Theano/pull/5269
+* https://github.com/Theano/Theano/pull/5270
+* https://github.com/Theano/Theano/pull/5257
+* https://github.com/Theano/Theano/pull/5245
+* https://github.com/Theano/Theano/pull/5244
+* https://github.com/Theano/Theano/pull/5241
+* https://github.com/Theano/Theano/pull/5251
+* https://github.com/Theano/Theano/pull/5250
+* https://github.com/Theano/Theano/pull/5234
+* https://github.com/Theano/Theano/pull/5242
+* https://github.com/Theano/Theano/pull/5210
+* https://github.com/Theano/Theano/pull/5240
+* https://github.com/Theano/Theano/pull/5229
+* https://github.com/Theano/Theano/pull/5237
+* https://github.com/Theano/Theano/pull/5226
+* https://github.com/Theano/Theano/pull/5212
+* https://github.com/Theano/Theano/pull/4749
+* https://github.com/Theano/Theano/pull/5235
+* https://github.com/Theano/Theano/pull/5214
+* https://github.com/Theano/Theano/pull/5232
+* https://github.com/Theano/Theano/pull/5211
+* https://github.com/Theano/Theano/pull/5205
+* https://github.com/Theano/Theano/pull/5168
+* https://github.com/Theano/Theano/pull/5208
+* https://github.com/Theano/Theano/pull/5199
+* https://github.com/Theano/Theano/pull/5174
+* https://github.com/Theano/Theano/pull/5196
+* https://github.com/Theano/Theano/pull/5185
+* https://github.com/Theano/Theano/pull/5194
+* https://github.com/Theano/Theano/pull/5155
+* https://github.com/Theano/Theano/pull/5193
+* https://github.com/Theano/Theano/pull/5152
+* https://github.com/Theano/Theano/pull/5175
+* https://github.com/Theano/Theano/pull/4355
+* https://github.com/Theano/Theano/pull/5179
+* https://github.com/Theano/Theano/pull/5181
+* https://github.com/Theano/Theano/pull/5132
+* https://github.com/Theano/Theano/pull/5178
+* https://github.com/Theano/Theano/pull/5077
+* https://github.com/Theano/Theano/pull/5159
+* https://github.com/Theano/Theano/pull/5173
+* https://github.com/Theano/Theano/pull/5172
+* https://github.com/Theano/Theano/pull/5164
+* https://github.com/Theano/Theano/pull/5163
+* https://github.com/Theano/Theano/pull/5165
+* https://github.com/Theano/Theano/pull/5166
+* https://github.com/Theano/Theano/pull/5097
+* https://github.com/Theano/Theano/pull/5142
+* https://github.com/Theano/Theano/pull/5133
+* https://github.com/Theano/Theano/pull/5076
+* https://github.com/Theano/Theano/pull/5091
+* https://github.com/Theano/Theano/pull/5160
+* https://github.com/Theano/Theano/pull/5144
+* https://github.com/Theano/Theano/pull/5146
+* https://github.com/Theano/Theano/pull/5119
+* https://github.com/Theano/Theano/pull/5134
+* https://github.com/Theano/Theano/pull/5098
+* https://github.com/Theano/Theano/pull/4736
+* https://github.com/Theano/Theano/pull/5126
+* https://github.com/Theano/Theano/pull/5122
+* https://github.com/Theano/Theano/pull/5086
+* https://github.com/Theano/Theano/pull/4996
+* https://github.com/Theano/Theano/pull/5108
+* https://github.com/Theano/Theano/pull/5105
+* https://github.com/Theano/Theano/pull/4915
+* https://github.com/Theano/Theano/pull/5103
+* https://github.com/Theano/Theano/pull/5096
+* https://github.com/Theano/Theano/pull/5069
+* https://github.com/Theano/Theano/pull/5083
+* https://github.com/Theano/Theano/pull/5073
+* https://github.com/Theano/Theano/pull/5082
+* https://github.com/Theano/Theano/pull/5093
+* https://github.com/Theano/Theano/pull/5084
+* https://github.com/Theano/Theano/pull/5089
+* https://github.com/Theano/Theano/pull/5090
+* https://github.com/Theano/Theano/pull/4948
+* https://github.com/Theano/Theano/pull/5087
+* https://github.com/Theano/Theano/pull/4884
+* https://github.com/Theano/Theano/pull/4862
+* https://github.com/Theano/Theano/pull/5070
+* https://github.com/Theano/Theano/pull/5054
+* https://github.com/Theano/Theano/pull/5060
+* https://github.com/Theano/Theano/pull/5065
+* https://github.com/Theano/Theano/pull/5049
+* https://github.com/Theano/Theano/pull/5062
+* https://github.com/Theano/Theano/pull/5061
+* https://github.com/Theano/Theano/pull/5058
+* https://github.com/Theano/Theano/pull/5057
+* https://github.com/Theano/Theano/pull/4763
+* https://github.com/Theano/Theano/pull/4961
+* https://github.com/Theano/Theano/pull/5050
+* https://github.com/Theano/Theano/pull/5045
+* https://github.com/Theano/Theano/pull/4039
+* https://github.com/Theano/Theano/pull/5028
+* https://github.com/Theano/Theano/pull/4935
+* https://github.com/Theano/Theano/pull/5033
+* https://github.com/Theano/Theano/pull/5038
+* https://github.com/Theano/Theano/pull/5032
+* https://github.com/Theano/Theano/pull/5037
+* https://github.com/Theano/Theano/pull/5031
+* https://github.com/Theano/Theano/pull/5029
+* https://github.com/Theano/Theano/pull/5010
+* https://github.com/Theano/Theano/pull/5014
+* https://github.com/Theano/Theano/pull/5025
+* https://github.com/Theano/Theano/pull/5027
+* https://github.com/Theano/Theano/pull/4992
+* https://github.com/Theano/Theano/pull/5013
+* https://github.com/Theano/Theano/pull/5015
+* https://github.com/Theano/Theano/pull/5023
+* https://github.com/Theano/Theano/pull/4850
 * https://github.com/Theano/Theano/pull/5001
 * https://github.com/Theano/Theano/pull/5002
 * https://github.com/Theano/Theano/pull/4984