AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search

May 18, 2018

Linnan Wang, Yiyang Zhao, Yuu Jinnai

May 18, 2018

Linnan Wang, Yiyang Zhao, Yuu Jinnai

**Click to Read Paper and Get Code**

Large Scale Artificial Neural Network Training Using Multi-GPUs

Nov 13, 2015

Linnan Wang, Wei Wu, Jianxiong Xiao, Yang Yi

This paper describes a method for accelerating large scale Artificial Neural Networks (ANN) training using multi-GPUs by reducing the forward and backward passes to matrix multiplication. We propose an out-of-core multi-GPU matrix multiplication and integrate the algorithm with the ANN training. The experiments demonstrate that our matrix multiplication algorithm achieves linear speedup on multiple inhomogeneous GPUs. The full paper of this project can be found at [1].
Nov 13, 2015

Linnan Wang, Wei Wu, Jianxiong Xiao, Yang Yi

* SC 15 Poster

**Click to Read Paper and Get Code**

Accelerating Deep Neural Network Training with Inconsistent Stochastic Gradient Descent

Mar 28, 2017

Linnan Wang, Yi Yang, Martin Renqiang Min, Srimat Chakradhar

Mar 28, 2017

Linnan Wang, Yi Yang, Martin Renqiang Min, Srimat Chakradhar

* The patent of ISGD belongs to NEC Labs

**Click to Read Paper and Get Code**

Sample-Efficient Neural Architecture Search by Learning Action Space

Jun 17, 2019

Linnan Wang, Saining Xie, Teng Li, Rodrigo Fonseca, Yuandong Tian

Jun 17, 2019

Linnan Wang, Saining Xie, Teng Li, Rodrigo Fonseca, Yuandong Tian

**Click to Read Paper and Get Code**

Simple and Efficient Parallelization for Probabilistic Temporal Tensor Factorization

Nov 11, 2016

Guangxi Li, Zenglin Xu, Linnan Wang, Jinmian Ye, Irwin King, Michael Lyu

Nov 11, 2016

Guangxi Li, Zenglin Xu, Linnan Wang, Jinmian Ye, Irwin King, Michael Lyu

**Click to Read Paper and Get Code**

Learning Compact Recurrent Neural Networks with Block-Term Tensor Decomposition

May 11, 2018

Jinmian Ye, Linnan Wang, Guangxi Li, Di Chen, Shandian Zhe, Xinqi Chu, Zenglin Xu

May 11, 2018

Jinmian Ye, Linnan Wang, Guangxi Li, Di Chen, Shandian Zhe, Xinqi Chu, Zenglin Xu

* CVPR2018

**Click to Read Paper and Get Code**

SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks

Jan 13, 2018

Linnan Wang, Jinmian Ye, Yiyang Zhao, Wei Wu, Ang Li, Shuaiwen Leon Song, Zenglin Xu, Tim Kraska

Jan 13, 2018

Linnan Wang, Jinmian Ye, Yiyang Zhao, Wei Wu, Ang Li, Shuaiwen Leon Song, Zenglin Xu, Tim Kraska

* PPoPP '2018: 23nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

**Click to Read Paper and Get Code**