Get our free extension to see links to code for papers anywhere online!


Evolino for recurrent support vector machines

Add code

Dec 15, 2005
Juergen Schmidhuber, Matteo Gagliolo, Daan Wierstra, Faustino Gomez


Share this with someone who'll enjoy it:


Traditional Support Vector Machines (SVMs) need pre-wired finite time windows to predict and classify time series. They do not have an internal state necessary to deal with sequences involving arbitrary long-term dependencies. Here we introduce a new class of recurrent, truly sequential SVM-like devices with internal adaptive states, trained by a novel method called EVOlution of systems with KErnel-based outputs (Evoke), an instance of the recent Evolino class of methods. Evoke evolves recurrent neural networks to detect and represent temporal dependencies while using quadratic programming/support vector regression to produce precise outputs. Evoke is the first SVM-based mechanism learning to classify a context-sensitive language. It also outperforms recent state-of-the-art gradient-based recurrent neural networks (RNNs) on various time series prediction tasks.

* 10 pages, 2 figures 


   Access Paper Source



Share this with someone who'll enjoy it: