Skip to content
项目
群组
代码片段
帮助
当前项目
正在载入...
登录 / 注册
切换导航面板
P
pytensor
项目
项目
详情
活动
周期分析
仓库
仓库
文件
提交
分支
标签
贡献者
图表
比较
统计图
议题
0
议题
0
列表
看板
标记
里程碑
合并请求
0
合并请求
0
CI / CD
CI / CD
流水线
作业
日程
统计图
Wiki
Wiki
代码片段
代码片段
成员
成员
折叠边栏
关闭边栏
活动
图像
聊天
创建新问题
作业
提交
问题看板
Open sidebar
testgroup
pytensor
Commits
e1dc7a29
提交
e1dc7a29
authored
8月 20, 2014
作者:
Pascal Lamblin
浏览文件
操作
浏览文件
下载
电子邮件补丁
差异文件
fix syntax
上级
adfda404
隐藏空白字符变更
内嵌
并排
正在显示
1 个修改的文件
包含
38 行增加
和
39 行删除
+38
-39
presentation.tex
doc/omlw2014/presentation.tex
+38
-39
没有找到文件。
doc/omlw2014/presentation.tex
浏览文件 @
e1dc7a29
...
@@ -103,69 +103,68 @@ Montréal, Canada \newline
...
@@ -103,69 +103,68 @@ Montréal, Canada \newline
\end{frame}
\end{frame}
\begin{frame}
{
Why scripting for GPUs?
}
\begin{frame}
{
Why scripting for GPUs?
}
\begin{bf}
They Complement each other
\end{bf}
\begin{bf}
They Complement each other
\end{bf}
GPUs are everything that scripting/high level languages are not
GPUs are everything that scripting/high level languages are not
\begin{itemize}
\begin{itemize}
\item
Highly parallel
\item
Highly parallel
\item
Very architecture-sensitive
\item
Very architecture-sensitive
\item
Built for maximum FP/memory throughput
\item
Built for maximum FP/memory throughput
\item
So hard to program that meta-programming is easier.
\item
So hard to program that meta-programming is easier.
\end{itemize}
\end{itemize}
\end{itemize}
\begin{bf}
Best of both:
\end{bf}
easy scripted development invokes GPU kernel.
\begin{bf}
Best of both:
\end{bf}
easy scripted development invokes GPU kernel.
\begin{bf}
Theano C code generation removes overhead
\end{bf}
from
\begin{bf}
Theano C code generation removes overhead
\end{bf}
from
function call between Python and C, by launching many C functions at once.
function call between Python and C, by launching many C functions at once.
\end{frame}
\end{frame}
\begin{frame}
{
Theano
}
\begin{frame}
{
Theano
}
High-level domain-specific language tailored to numeric computation.
High-level domain-specific language tailored to numeric computation.
\begin{itemize}
\item
Syntax as close to NumPy as possible
\item
Compiles most common expressions to C for CPU and GPU
\item
Limited expressivity means lots of opportunities for expression-level optimizations
\begin{itemize}
\item
No subroutines -> global optimization
\item
Strongly typed -> compiles to machine instructions
\item
Array oriented -> easy parallelism
\item
Support for looping and branching in expressions
\end{itemize}
\item
Expression substitution optimizations automatically draw
on many back-end technologies for best performance.
\begin{itemize}
\begin{itemize}
\item
BLAS, SciPy, Cython, CUDA
\item
Syntax as close to NumPy as possible
\item
Slower fallbacks always available
\item
Compiles most common expressions to C for CPU and GPU
\end{itemize}
\item
Limited expressivity means lots of opportunities for expression-level optimizations
\item
Automatic differentiation and R op
\begin{itemize}
\item
No subroutines -> global optimization
\item
Strongly typed -> compiles to machine instructions
\item
Array oriented -> easy parallelism
\item
Support for looping and branching in expressions
\end{itemize}
\item
Expression substitution optimizations automatically draw
on many back-end technologies for best performance.
\begin{itemize}
\item
BLAS, SciPy, Cython, CUDA
\item
Slower fallbacks always available
\end{itemize}
\item
Automatic differentiation and R op
\item
Sparse matrices
\item
Sparse matrices
\end{itemize}
\end{itemize}
\end{frame}
\end{frame}
\begin{frame}
{
Pylearn2
}
\begin{frame}
{
Pylearn2
}
Machine Learning library aimed at researchers
Machine Learning library aimed at researchers
\begin{itemize}
\item
Built on top of Theano, for fast execution and use of GPU
\item
Easy to try variants of implemented algorithms, and to extend them (using Theano)
\item
Contains a collection of:
\begin{itemize}
\begin{itemize}
\item
Training Algorithms (i.e., Stochastic and Batch GD, model-specific rules)
\item
Built on top of Theano, for fast execution and use of GPU
\item
Costs and Estimation Criteria, supervised and unsupervised (NLL, Score Matching, NCE, ...)
\item
Easy to try variants of implemented algorithms, and to extend them (using Theano)
\item
Models (NNets, ConvNets, RBMs, k-means, PCA, SVMs, ...)
\item
Contains a collection of:
\item
Datasets (MNIST, CIFAR-10) and preprocessors (LCN, ZCA)
\begin{itemize}
\item
Training Algorithms (i.e., Stochastic and Batch GD, model-specific rules)
\item
Costs and Estimation Criteria, supervised and unsupervised (NLL, Score Matching, NCE)
\item
Models (NNets, ConvNets, RBMs, k-means, PCA, SVMs)
\item
Datasets (MNIST, CIFAR-10) and preprocessors (LCN, ZCA)
\end{itemize}
\item
Experiments can be specified through a YAML config file, or by a Python script
\item
Scripts for visualizing weights, plot monitored values during training
\end{itemize}
\end{itemize}
\item
Experiments can be specified through a YAML config file, or by a Python script
\item
Scripts for visualizing weights, plot monitored values during training
\end{itemize}
\end{frame}
\end{frame}
...
...
编写
预览
Markdown
格式
0%
重试
或
添加新文件
添加附件
取消
您添加了
0
人
到此讨论。请谨慎行事。
请先完成此评论的编辑!
取消
请
注册
或者
登录
后发表评论