Merge pull request #6279 from notoraptor/prepare-release-0.10-beta

.mailmap

@@ -15,6 +15,7 @@ abalkin <abalkin@enlnt.com> abalkin <abalkin>
 abalkin <abalkin@enlnt.com> abalkin <serpent.speak@gmail.com>
 abalkin <abalkin@enlnt.com> Alexander Belopolsky <abalkin@enlnt.com>
 abalkin <abalkin@enlnt.com> Alexander Belopolsky <a@enlnt.com>
+Aleksandar Botev <botevmg@gmail.com> botev <botevmg@gmail.com>
 Alex Lamb <alex6200@gmail.com> AlexLamb <alex6200@gmail.com>
 Alex Lamb <alex6200@gmail.com> DeathMonster666 <alex6200@gmail.com>
 Alexandre de Brebisson <adbrebs@gmail.com> AdeB <adbrebs@gmail.com>
@@ -25,6 +26,7 @@ Andre Holzner <Andre.Georg.Holzner@cern.ch> andreh <andreh@localhost>
 Andre Holzner <Andre.Georg.Holzner@cern.ch> Andre Holzner <holzner@andres-mbp-2.fritz.box>
 Arjun Jain <arjunjain@gmail.com> Arjun Jain <stencilman@users.noreply.github.com>
 Arnaud Bergeron <abergeron@gmail.com> <abergeron@gmail.com>
+Arnaud Bergeron <abergeron@gmail.com> <bergearn@iro.umontreal.ca>
 <abergeron@gmail.com> <anakha@kami.(none)>
 Balázs Hidasi <hidasi.balazs@gravityrd.com> Balázs <hidasib@gmail.com>
 Bart van Merrienboer <bart.vanmerrienboer@gmail.com> Bart van Merriënboer <bart.vanmerrienboer@gmail.com>
@@ -62,9 +64,14 @@ Dzmitry Bahdanau <dimabgv@gmail.com> rizar <dimabv@tut.by>
 Eric Hunsberger <hunse@ctn> hunse <hunse@ctn>
 Ethan Buchman <ebuchman@uoguelph.ca> ebuchman <ebuchman@uoguelph.ca>
 Evelyn Mitchell <efm-github@linsomniac.com> evelynmitchell <efm-github@linsomniac.com>
+Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@bart7.iro.umontreal.ca>
+Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@elisa1.iro.umontreal.ca>
 Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@eos3.iro.umontreal.ca>
+Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@kepler2.iro.umontreal.ca>
 Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@kepler3.iro.umontreal.ca>
-Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@elisa1.iro.umontreal.ca>
+Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@ceylon.iro.umontreal.ca>
+Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@leto21.iro.umontreal.ca>
+Faruk Ahmed <faruk.ahmed.91@gmail.com> Faruk Ahmed <ahmedfar@leto23.iro.umontreal.ca>
 Fei Wang <fay96816@gmail.com> fay <fay96816@gmail.com>
 Francesco Visin <fvisin@gmail.com> Francesco <fvisin@users.noreply.github.com>
 Francesco Visin <fvisin@gmail.com> fvisin <fvisin@gmail.com>
@@ -81,6 +88,7 @@ Frederic Bastien <nouiz@nouiz.org> Frederic <nouiz@nouiz.org>
 Frederic Bastien <nouiz@nouiz.org> Frédéric Bastien <frederic.bastien@gmail.com>
 Frederic Bastien <nouiz@nouiz.org> theano-bot <frederic.bastien.1@umontreal.ca>
 Gennadiy Tupitsin <genichyar@genichyar.com> genichyar <genichyar@genichyar.com>
+Ghislain Antony Vaillant <ghisvail@gmail.com> Ghislain Antony Vaillant <ghisvail@users.noreply.github.com>
 Gokula Krishnan <gokul.uf@gmail.com> Gokul <gokul.uf@gmail.com>
 Grégoire Mesnil <gregoire.mesnil@gmail.com> Grégoire <gregoire.mesnil@laposte.net>
 Grégoire Mesnil <gregoire.mesnil@gmail.com> Grégoire <gregoire.mesnil@gmail.com>
@@ -90,6 +98,7 @@ Guillaume Desjardins <guillaume.desjardins@gmail.com> desjagui@atchoum.iro.umont
 Guillaume Desjardins <guillaume.desjardins@gmail.com> desjagui@opale.iro.umontreal.ca <desjagui@opale.iro.umontreal.ca>
 Guillaume Desjardins <guillaume.desjardins@gmail.com> gdesjardins <devnull@localhost>
 Guillaume Desjardins <guillaume.desjardins@gmail.com> tutorial/debug_faq.txt <devnull@localhost>
+gw0 [http://gw.tnode.com/] <gw.2015@tnode.com> gw0 [http://gw.tnode.com/] <gw.2016@tnode.com>
 Hani Almousli <hani.mousli@gmail.com> Hani <hani.mousli@gmail.com>
 Hani Almousli <hani.mousli@gmail.com> HaniAlmousli <hani.mousli@gmail.com>
 Huy Nguyen <huy@huyng.com> huyng <huy@huyng.com>
@@ -118,6 +127,8 @@ Jeremiah Lowin <jlowin@lowindata.com> Jeremiah Lowin <jlowin@iHal.local>
 Jeremie Tanguay <tanguaj@iro.umontreal.ca> Tanjay94 <you@yourdomain.example.com>
 Jeremie Tanguay <tanguaj@iro.umontreal.ca> Jeremie Tanguay <tanguaj@bart4.iro.umontreal.ca>
 Jesse Livezey <jesse.livezey@berkeley.edu> JesseLivezey <jesse.livezey@gmail.com>
+João Victor Tozatti Risso <joaovictortr@gmail.com> João Victor Risso <joaovictor.risso@gmail.com>
+João Victor Tozatti Risso <joaovictortr@gmail.com> João Victor Tozatti Risso <joaovictor.risso@gmail.com>
 John Salvatier <jsalvatier@gmail.com> jsalvatier <jsalvatier@gmail.com>
 John Salvatier <jsalvatier@gmail.com> john salvatier <jsalvatier@gmail.com>
 John Schulman <john.d.schulman@gmail.com> joschu <john.d.schulman@gmail.com>
@@ -156,6 +167,7 @@ Markus Roth <markus.roth@herr-biber.de> Markus Roth <mail@rothmark.us>
 Mathieu Germain <mathieu.germain@gmail.com> Mathieu Germain <mathieu.germain2@usherbrooke.ca>
 Mehdi Mirza <memirzamo@gmail.com> Mehdi Mirza <memimo@users.noreply.github.com>
 Mehdi Mirza <memirzamo@gmail.com> memimo <memirzamo@gmail.com>
+Mohammed Affan <affanv14@gmail.com> affanv14 <affanv14@gmail.com>
 Moslem Kazemi <moslemk@gmail.com> Moslem Kazemi <moslemk@users.noreply.github.com>
 Moslem Kazemi <moslemk@gmail.com> Mo <moslemk@gmail.com>
 Nan Rosemary Ke <rosemary.ke@west.cmu.edu> nke001 <rosemary.nan.ke@gmail.com>
@@ -195,6 +207,7 @@ Razvan Pascanu <r.pascanu@gmail.com> Razvan Pascanu <rman@rman-Dell-System-XPS-L
 Razvan Pascanu <r.pascanu@gmail.com> Razvan Pascanu <rman@rman-pad.(none)>
 Razvan Pascanu <r.pascanu@gmail.com> pascanur@simplet.iro.umontreal.ca <pascanur@simplet.iro.umontreal.ca>
 Razvan Pascanu <r.pascanu@gmail.com> rman@rpad <rman@rpad>
+Reyhane Askari <r.askari.hemmat@gmail.com> Reyhane Askari <ReyhaneAskari@users.noreply.github.com>
 Roy Xue <xljroy@gmail.com> Lijun Xue <xljroy@gmail.com>
 Ruslana Makovetsky <ruslana@cim.mcgill.ca> ruslanagit <ruslana@cim.mcgill.ca>
 Sander Dieleman <sanderdieleman@gmail.com> benanne <sanderdieleman@gmail.com>
@@ -206,9 +219,14 @@ Simon Lefrancois <simon.lefrancois@umontreal.ca> slefrancois <simon.lefrancois@u
 Simon Lefrancois <simon.lefrancois@umontreal.ca> Simon Lefrancois <lefransi@iro.umontreal.ca>
 Sina Honari <honaris@iro.umontreal.ca> SinaHonari <sina2222@gmail.com>
 Sina Honari <honaris@iro.umontreal.ca> Sina Honari <honaris@eos21.iro.umontreal.ca>
+Sina Honari <honaris@iro.umontreal.ca> Sina Honari <sina.honari@gmail.com>
 Søren Kaae Sønderby <skaaesonderby@gmail.com> skaae <skaaesonderby@gmail.com>
 Steven Bocco <stevenbocco@gmail.com> notoraptor <stevenbocco@gmail.com>
 Steven Bocco <stevenbocco@gmail.com> notoraptor <notoraptor@users.noreply.github.com>
+Steven Bocco <stevenbocco@gmail.com> Seton Steven Bocco <boccoset@elisa1.iro.umontreal.ca>
+Steven Bocco <stevenbocco@gmail.com> Seton Steven Bocco <boccoset@leto01.iro.umontreal.ca>
+Steven Bocco <stevenbocco@gmail.com> Seton Steven Bocco <boccoset@leto15.iro.umontreal.ca>
+Steven Bocco <stevenbocco@gmail.com> Seton Steven Bocco <boccoset@leto51.iro.umontreal.ca>
 Steven Pigeon <pigeon@iro.umontreal.ca> steven-pigeon <pigeon@iro.umontreal.ca>
 Thomas George <tfjgeorge@gmail.com> Thomas George <georgeth@helios1.helios>
 Valentin Bisson <valentin.bisson@umontreal.ca> onze <onzeonline@gmail.com>

HISTORY.txt

@@ -5,6 +5,254 @@
 Old Release Notes
 =================
 
+Theano 0.9.0 (20th of March, 2017)
+==================================
+
+This is a final release of Theano, version ``0.9.0``, with a lot of
+new features, interface changes, improvements and bug fixes.
+
+We recommend that everybody update to this version.
+
+Highlights (since 0.8.0):
+ - Better Python 3.5 support
+ - Better numpy 1.12 support
+ - Conda packages for Mac, Linux and Windows
+ - Support newer Mac and Windows versions
+ - More Windows integration:
+
+   - Theano scripts (``theano-cache`` and ``theano-nose``) now works on Windows
+   - Better support for Windows end-lines into C codes
+   - Support for space in paths on Windows
+
+ - Scan improvements:
+
+   - More scan optimizations, with faster compilation and gradient computation
+   - Support for checkpoint in scan (trade off between speed and memory usage, useful for long sequences)
+   - Fixed broadcast checking in scan
+
+ - Graphs improvements:
+
+   - More numerical stability by default for some graphs
+   - Better handling of corner cases for theano functions and graph optimizations
+   - More graph optimizations with faster compilation and execution
+   - smaller and more readable graph
+
+ - New GPU back-end:
+
+   - Removed warp-synchronous programming to get good results with newer CUDA drivers
+   - More pooling support on GPU when cuDNN isn't available
+   - Full support of ignore_border option for pooling
+   - Inplace storage for shared variables
+   - float16 storage
+   - Using PCI bus ID of graphic cards for a better mapping between theano device number and nvidia-smi number
+   - Fixed offset error in ``GpuIncSubtensor``
+
+ - Less C code compilation
+ - Added support for bool dtype
+ - Updated and more complete documentation
+ - Bug fixes related to merge optimizer and shape inference
+ - Lot of other bug fixes, crashes fixes and warning improvements
+
+A total of 123 people contributed to this release since 0.8.0, see list below.
+
+Interface changes:
+ - Merged ``CumsumOp/CumprodOp`` into ``CumOp``
+ - In MRG module:
+
+   - Replaced method ``multinomial_wo_replacement()`` with new method ``choice()``
+   - Random generator now tries to infer the broadcast pattern of its output
+
+ - New pooling interface
+ - Pooling parameters can change at run time
+ - Moved ``softsign`` out of sandbox to ``theano.tensor.nnet.softsign``
+ - Using floatX dtype when converting empty list/tuple
+ - ``Roll`` make the shift be modulo the size of the axis we roll on
+ - ``round()`` default to the same as NumPy: half_to_even
+
+Convolution updates:
+ - Support of full and half modes for 2D and 3D convolutions including in ``conv3d2d``
+ - Allowed pooling of empty batch
+ - Implement ``conv2d_transpose`` convenience function
+ - Multi-cores convolution and pooling on CPU
+ - New abstract 3d convolution interface similar to the 2d convolution interface
+ - Dilated convolution
+
+
+GPU:
+ - cuDNN: support versoin 5.1 and wrap batch normalization (2d and 3d) and RNN functions
+ - Multiple-GPU, synchrone update (via platoon, use NCCL)
+ - Gemv(matrix-vector product) speed up for special shape
+ - cublas gemv workaround when we reduce on an axis with a dimensions size of 0
+ - Warn user that some cuDNN algorithms may produce unexpected results in certain environments
+   for convolution backward filter operations
+ - ``GPUMultinomialFromUniform`` op now supports multiple dtypes
+ - Support for ``MaxAndArgMax`` for some axis combination
+ - Support for solve (using cusolver), erfinv and erfcinv
+ - Implemented ``GpuAdvancedSubtensor``
+
+New features:
+ - ``OpFromGraph`` now allows gradient overriding for every input
+ - Added Abstract Ops for batch normalization that use cuDNN when available and pure Theano CPU/GPU alternatives otherwise
+ - Added gradient of solve, tensorinv (CPU), tensorsolve (CPU), searchsorted (CPU), DownsampleFactorMaxGradGrad (CPU)
+ - Added Multinomial Without Replacement
+ - Allowed partial evaluation of compiled function
+ - More Rop support
+ - Indexing support ellipsis: ``a[..., 3]```, ``a[1,...,3]``
+ - Added ``theano.tensor.{tensor5,dtensor5, ...}``
+ - compiledir_format support device
+ - Added New Theano flag ``conv.assert_shape`` to check user-provided shapes at runtime (for debugging)
+ - Added new Theano flag ``cmodule.age_thresh_use``
+ - Added new Theano flag ``cuda.enabled``
+ - Added new Theano flag ``nvcc.cudafe`` to enable faster compilation and import with old CUDA back-end
+ - Added new Theano flag ``print_global_stats`` to print some global statistics (time spent) at the end
+ - Added new Theano flag ``profiling.ignore_first_call``, useful to profile the new gpu back-end
+ - remove ProfileMode (use Theano flag ``profile=True`` instead)
+
+
+Others:
+ - Split op now has C code for CPU and GPU
+ - ``theano-cache list`` now includes compilation times
+ - Speed up argmax only on GPU (without also needing the max)
+ - More stack trace in error messages
+ - Speed up cholesky grad
+ - ``log(sum(exp(...)))`` now get stability optimized
+
+
+Other more detailed changes:
+ - Added Jenkins (gpu tests run on pull requests in addition to daily buildbot)
+ - Removed old benchmark directory and other old files not used anymore
+ - Use of 64-bit indexing in sparse ops to allow matrix with more then 2\ :sup:`31`\ -1 elements
+ - Allowed more then one output to be an destructive inplace
+ - More support of negative axis
+ - Added the keepdims parameter to the norm function
+ - Make scan gradient more deterministic
+
+Commiters since 0.8.0:
+ - Frederic Bastien
+ - Arnaud Bergeron
+ - Pascal Lamblin
+ - Steven Bocco
+ - Ramana Subramanyam
+ - Simon Lefrancois
+ - Gijs van Tulder
+ - Benjamin Scellier
+ - khaotik
+ - Chiheb Trabelsi
+ - Chinnadhurai Sankar
+ - Cesar Laurent
+ - Reyhane Askari
+ - Mohammad Pezeshki
+ - Alexander Matyasko
+ - Alexandre de Brebisson
+ - Mathieu Germain
+ - Nan Rosemary Ke
+ - Pierre Luc Carrier
+ - Olivier Mastropietro
+ - Thomas George
+ - Saizheng Zhang
+ - Iulian Vlad Serban
+ - Francesco Visin
+ - Caglar
+ - Faruk Ahmed
+ - Harm de Vries
+ - Samira Shabanian
+ - Vincent Dumoulin
+ - Nicolas Ballas
+ - Jakub Sygnowski
+ - Jan Schlüter
+ - Samira Ebrahimi Kahou
+ - Mikhail Korobov
+ - Fei Wang
+ - Kv Manohar
+ - Jesse Livezey
+ - Kelvin Xu
+ - Matt Graham
+ - Ruslana Makovetsky
+ - Sina Honari
+ - Bryn Keller
+ - Ciyong Chen
+ - Vitaliy Kurlin
+ - Zhouhan LIN
+ - Gokula Krishnan
+ - Kumar Krishna Agrawal
+ - Ozan Çağlayan
+ - Vincent Michalski
+ - affanv14
+ - Amjad Almahairi
+ - Ray Donnelly
+ - Tim Cooijmans
+ - happygds
+ - mockingjamie
+ - Christos Tsirigotis
+ - Florian Bordes
+ - Ilya Kulikov
+ - RadhikaG
+ - Taesup (TS) Kim
+ - Ying Zhang
+ - Anton Chechetka
+ - Karthik Karanth
+ - Kirill Bobyrev
+ - Rebecca N. Palmer
+ - Yang Zhang
+ - Yaroslav Ganin
+ - Jonas Degrave
+ - Liwei Cai
+ - Lucas Beyer
+ - Michael Harradon
+ - Morgan Stuart
+ - Tim Gasper
+ - Xavier Bouthillier
+ - p
+ - texot
+ - Andrés Gottlieb
+ - Ben Poole
+ - Bhavishya Pohani
+ - Carl Thomé
+ - David Bau
+ - Dimitar Dimitrov
+ - Evelyn Mitchell
+ - Fei Zhan
+ - Fuchai
+ - Fábio Perez
+ - Gennadiy Tupitsin
+ - Gilles Louppe
+ - Greg Ciccarelli
+ - He
+ - Huan Zhang
+ - Kaixhin
+ - Kevin Keraudren
+ - Maltimore
+ - Marc-Alexandre Cote
+ - Marco
+ - Marius F. Killinger
+ - Martin Drawitsch
+ - Maxim Kochurov
+ - Micah Bojrab
+ - Neil
+ - Nizar Assaf
+ - Rithesh Kumar
+ - Rizky Luthfianto
+ - Robin Millette
+ - Roman Ring
+ - Sander Dieleman
+ - Sebastin Santy
+ - Shawn Tan
+ - Wazeer Zulfikar
+ - Wojciech Głogowski
+ - Yann N. Dauphin
+ - gw0 [http://gw.tnode.com/]
+ - hexahedria
+ - hsintone
+ - jakirkham
+ - joncrall
+ - root
+ - superantichrist
+ - tillahoffmann
+ - valtron
+ - wazeerzulfikar
+ - you-n-g
+
+
 Theano 0.9.0rc4 (13th of March, 2017)
 =====================================
 

doc/conf.py

@@ -72,9 +72,9 @@ copyright = '2008--2017, LISA lab'
 # other places throughout the built documents.
 #
 # The short X.Y version.
-version = '0.9'
+version = '0.10'
 # The full version, including alpha/beta/rc tags.
-release = '0.9.0'
+release = '0.10.0beta1'
 
 # There are two options for replacing |today|: either, you set today to some
 # non-false value, then it is used:

doc/index.txt

@@ -21,6 +21,8 @@ learning/machine learning <https://mila.umontreal.ca/en/cours/>`_ classes).
 News
 ====
 
+* 2017/08/09: Release of Theano 0.10.0beta1, many improvements and bugfixes, release candidate to coming.
+
 * Removed support for the old (device=gpu) backend.  Use the new
   backend (device=cuda) for gpu computing.  See `Converting to the new
   gpu back end(gpuarray)

doc/install_generic.inc

@@ -56,12 +56,12 @@ libgpuarray
 :::::::::::
 
 For the stable version of Theano you need a specific version of libgpuarray,
-that has been tagged ``v0.6.5``.
+that has been tagged ``v0.6.9``.
 Download it with::
 
     git clone https://github.com/Theano/libgpuarray.git
     cd libgpuarray
-    git checkout tags/v0.6.5 -b v0.6.5
+    git checkout tags/v0.6.5 -b v0.6.9
 
 and then follow the `Step-by-step instructions <http://deeplearning.net/software/libgpuarray/installation.html#step-by-step-install>`__.
 

doc/introduction.txt

@@ -165,11 +165,11 @@ Note: There is no short term plan to support multi-node computation.
 Theano Vision State
 ===================
 
-Here is the state of that vision as of March 20th, 2017 (after Theano 0.9.0):
+Here is the state of that vision as of August 9th, 2017 (after Theano 0.10.0beta1):
 
 * We support tensors using the `numpy.ndarray` object and we support many operations on them.
 * We support sparse types by using the `scipy.{csc,csr,bsr}_matrix` object and support some operations on them.
-* We have implementing/wrapping more advanced linear algebra operations. Still many more possible.
+* We have implementing/wrapping more advanced linear algebra operations. Still more possible.
 * We have basic support for the creation of new operations from graphs at runtime. It supports well gradient overload
   for every input and inlining at the start of compilation. We don't cover well the case when it is not inlined.
 * We have many graph transformations that cover the 4 categories listed above.

setup.py

@@ -53,7 +53,7 @@ PLATFORMS           = ["Windows", "Linux", "Solaris", "Mac OS-X", "Unix"]
 MAJOR               = 0
 MINOR               = 10
 MICRO               = 0
-SUFFIX              = "dev1"  # Should be blank except for rc's, betas, etc.
+SUFFIX              = "beta1"  # Should be blank except for rc's, betas, etc.
 ISRELEASED          = False
 
 VERSION             = '%d.%d.%d%s' % (MAJOR, MINOR, MICRO, SUFFIX)