提交 25e2704e authored 作者: nouiz's avatar nouiz

Merge pull request #6 from dwf/theano_vision

Spelling + spacing fixes
...@@ -140,66 +140,68 @@ A PDF version of the online documentation may be found `here ...@@ -140,66 +140,68 @@ A PDF version of the online documentation may be found `here
Theano Vision Theano Vision
============= =============
This is the vision we have for Theano. This is to help people what to This is the vision we have for Theano. This is give people an idea of what to
expect in the futur for Theano, but we don't promise to implement all expect in the future of Theano, but we can't promise to implement all
that. This also should help you to understand where Theano fix related of it. This should also help you to understand where Theano fits in relation
to all other computational tools. to other computational tools.
* Support tensor and sparse operation * Support tensor and sparse operations
* Support linear algebra operation * Support linear algebra operations
* Graph Transformation * Graph Transformations
* Differentiation/higher order differentiation * Differentiation/higher order differentiation
* R operation * 'R' and 'L' differential operators
* Speed/memory optimization * Speed/memory optimizations
* Numeriacal stability optimization * Numerical stability optimizations
* Have an OpenCL back-end (for GPU, SIMD and multi-core) * Have an OpenCL backend (for GPU, SIMD and multi-core)
* Lazy evaluation * Lazy evaluation
* Loop * Loop
* Parallel execution (SIMD, multi-core, multi-node on cluster, * Parallel execution (SIMD, multi-core, multi-node on cluster,
multi-node distributed) multi-node distributed)
* Support all numpy/scipy functionality * Support all NumPy/basic SciPy functionality
* Easy wrapping of library function in Theano * Easy wrapping of library functions in Theano
Note: There is no short term plan to work to make Theano work in multi-node in one Theano function. Note: There is no short term plan to enable multi-node computation in one
Theano function.
Theano Vision State Theano Vision State
=================== ===================
Here is the state of that vision as of 24 October 2011 (after Theano release 0.4.1): Here is the state of that vision as of 24 October 2011 (after Theano release
0.4.1):
* We support tensor by using the numpy.ndarray object and we have operations on them. * We support tensors using the `numpy.ndarray` object and we support many operations on them.
* We support sparse by using the scipy.{csc,csr}_matrix object and have some operation on them (More are comming). * We support sparse types by using the `scipy.{csc,csr}_matrix` object and support some operations on them (more are coming).
* We have a start of more advanced linear algebra operations. * We have started implementing/wrapping more advanced linear algebra operations.
* We have many graph transformation that cover the 4 categories. * We have many graph transformations that cover the 4 categories listed above.
* We can improve the graph transformation with better storage optimization * We can improve the graph transformation with better storage optimization
and instruction selection and instruction selection.
* Similar to auto-tuning during the optimization phase, but this * Similar to auto-tuning during the optimization phase, but this
don't apply to only 1 op. doesn't apply to only 1 op.
* Example of use: Determine if we should move computation to the * Example of use: Determine if we should move computation to the
gpu or not depending of the input size. GPU or not depending on the input size.
* Possible implementation note: allow Theano Variable in the env to * Possible implementation note: allow Theano Variable in the env to
have more then 1 owner. have more then 1 owner.
* We have a CUDA back-end for tensor of float32 only. * We have a CUDA backend for tensors of type `float32` only.
* Make a generic GPU nd array(GPU tensor) (started in the * Efforts have begun towards a generic GPU ndarray (GPU tensor) (started in the
`compyte <https://github.com/inducer/compyte/wiki>`_ project) `compyte <https://github.com/inducer/compyte/wiki>`_ project)
* Move GPU backend outside of Theano(on top of PyCUDA/PyOpenCL) * Move GPU backend outside of Theano (on top of PyCUDA/PyOpenCL)
* Will allow GPU to work on Windows and use an OpenCL backend on CPU. * Will allow GPU to work on Windows and use an OpenCL backend on CPU.
* Loop work, but not all related optimization done. * Loops work, but not all related optimizations are currently done.
* The cvm linker allow lazy evaluation. It work but some work still needed * The cvm linker allows lazy evaluation. It works, but some work is still
to enable it by default. needed before enabling it by default.
* All test pass with linker=cvm? * All tests pass with linker=cvm?
* How to have DEBUG_MODE check it? Now DebugMode check it non lazily. * How to have `DEBUG_MODE` check it? Right now, DebugMode checks the computation non-lazily.
* The profiler using by cvm is less complete then PROFILE_MODE. * The profiler used by cvm is less complete than `PROFILE_MODE`.
* SIMD parallism on the cpu come from the compiler * SIMD parallelism on the CPU comes from the compiler.
* Multi-core parallism is only supported for gemv, gemm if the external * Multi-core parallelism is only supported for gemv and gemm, and only
implementation of it implement it. if the external BLAS implementation supports it.
* No muli-node implementation in one Theano experiment. * No muli-node implementation in one Theano experiment.
* Many, but not all numpy function/alias implemented. * Many, but not all NumPy functions/aliases are implemented.
* http://trac-hg.assembla.com/theano/ticket/781 * http://trac-hg.assembla.com/theano/ticket/781
* Wrapping an existing python function in easy, but better documentation of * Wrapping an existing Python function in easy, but better documentation of
it would make it even easier. it would make it even easier.
* We need to find a way to separate the Shared variable data memory * We need to find a way to separate the shared variable memory
storage location vs object type(tensor, sparse, dtype, broadcast storage location from its object type (tensor, sparse, dtype, broadcast
flags). flags).
......
Markdown 格式
0%
您添加了 0 到此讨论。请谨慎行事。
请先完成此评论的编辑!
注册 或者 后发表评论