Skip to content
/ RPSnet Public

Official Implementation of "Random Path Selection for Incremental Learning" paper. NeurIPS 2019

Notifications You must be signed in to change notification settings

brjathu/RPSnet

Repository files navigation

RPSnet for Incremental Learning (NeurIPS'19)

Official Implementation of "Random Path Selection for Incremental Learning" (NeurIPS 2019) (paper link).

This code provides an implementation for RPSnet : Random Path Selection network for incremental learning (accepted in Nerual Information Processing Systems, Vancouver, 2019). This repository is implemented with pytorch and the scripts are written to run the experiments on multiple GPUs.

Introduction

Incremental life-long learning is the main challenge towards the long-standing goal of Artificial General Intelligence. In real-life settings, learning tasks arrive in a sequence and machine learning models must continually learn to increment already acquired knowledge. Existing incremental learning approaches, fall well below the state-of-the-art cumulative models that use all training classes at once. In this paper, we propose a random path selection algorithm, called RPS-Net, that progressively chooses optimal paths for the new tasks while encouraging parameter sharing and reuse. Our approach avoids the overhead introduced by computationally expensive evolutionary and reinforcement learning based path selection strategies while achieving considerable performance gains. As an added novelty, the proposed model integrates knowledge distillation and retrospection along with the path selection strategy to overcome catastrophic forgetting. In order to maintain an equilibrium between previous and newly acquired knowledge, we propose a simple controller to dynamically balance the model plasticity. Through extensive experiments, we demonstrate that the proposed method surpasses the state-of-the-art performance on incremental learning and by utilizing parallel computation this method can run in constant time with nearly the same efficiency as a conventional deep convolutional neural network.

(a) RPS network architecture



(b) Random path selection algorithm

Usage

step 1 : Install dependencies

conda install -c pytorch pytorch
conda install -c pytorch torchvision 
conda install -c conda-forge matplotlib
conda install -c conda-forge pillow

step 2 : Clone the repository

git clone https://github.com/brjathu/RPSnet.git
cd RPSnet

Training

The algorithm requires N GPUs in parallel for random path selection. The script uses N=8 with a DGX machine.

./CIFAR100.sh

If you are training on single GPU change the CIFAR100.sh as well as other running scripts to use only one GPU (comment out the rest).

If you are training on for a specific task, then run,

python3 cifar.py TASK_NUM TEST_CASE

You can use the pre-trained models on CIFAR100 and ILSVRC.

To test with several other datasets (ILSVRC, MNSIT etc) run the corresponding files imagenet.py or mnist.py.

If you need to change the settings (Eg. Number of tasks), run the python3 prepare/generate_cifar100_labels.py with corresponding settings.

for ILSVRC, download the pickle file meta_ILSVRC.pkl contains file names and labels. Place it inside prepare and run python3 prepare/generate_ILSVRC_labels.py

Supported Datasets

  • CIFAR100
  • ILSVRC
  • CIFAR10
  • SVHN
  • MNIST

Performance

(c) Performance on CIFAR100 with 10 classes per task



(d) Performance on CIFAR100 with 20 classes per task



(e) Performance on CIFAR100 with 50 classes per task



(f) Performance on Imagenet 100 classes with 10 classes per task

Reproducing iCaRL results

Although the last classiciation is not same as in iCaRL (uses examplar based nigherest neighbour), by setting M=1, J=10 we can get almost the same basline results as iCaRL.

Citation

@article{rajasegaran2019random,
  title={Random Path Selection for Incremental Learning},
  author={Rajasegaran, Jathushan and Hayat, Munawar and Khan, Salman and Khan, Fahad Shahbaz and Shao, Ling},
  journal={Advances in Neural Information Processing Systems},
  year={2019}
}

We credit

We have used this as the pathnet implementation. We thank and credit the contributors of this repository.

Contact

Jathushan Rajasegaran - [email protected] or [email protected]
Discussions, suggestions and questions are welcome!

About

Official Implementation of "Random Path Selection for Incremental Learning" paper. NeurIPS 2019

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published