Datasets

As you get familiar with Machine Learning and Neural Networks you will want to use datasets that have been provided by academia, industry, government, and even other users of Caffe2. Many of these datasets have already been trained with Caffe and/or Caffe2, so you can jump right in and start using these pre-trained models. You can also fine-tune or even do “mashups” with pre-trained models by adding additional data, models, parameters, or combinations thereof to train a new custom model for your experiments. If you think you’ve found something great, then don’t hesitate to share! This is an Open Source project and we really hope to foster innovation and collaboration.

For further info on datasets and how to prepare them take a look at the Models and Datasets tutorial. You can also check out a Caffe2 Python tutorial that downloads MNIST handwriting dataset, unzips it, calls a Caffe2 provided binary that will extract/transform/load (ETL) the data into a database of key value pairs (KVPs) - in this case it uses LevelDB to store the images. The tutorial goes on to show how the dataset is used to train a neural network that can be used to identify handwriting of numbers. This tutorial is also available as a Juypter notebook.

You may also want to check out the pre-trained models at Caffe2’s Model Zoo! You might find examples there where these datasets have been used to train models, be able to draw from their project’s open source code, and be informed of dataset-specific best practices for training models.

Name	Type	Download
AlexNet-Places205
AN4: 948 training and 130 test utterances
BSDS (300/500): 12k labeled segmentations		images segmentations
Celeb-A: 200k+ celebrity images, 10k+ identities
CIFAR-10: 60k tiny (32x32) tagged images
COCO: A large image dataset designed for object detection, segmentation, and caption generation.
CompCars: 136k+ car images & 1716 car models
Oxford 102 Flowers: 102 flower categories		images segmentations
ImageNet: 14,197,122 images, 21841 synsets indexed
ImageNet ILSVRC: Competition datasets
Iris
LSUN Scenes millions of indoor/outdoor building scenes
LSUN Room Layout 4000 indoor scenes
MNIST 60k handwriting training set, 10k test images
Multi-Salient-Object (MSO) 1224 tagged salient object images
OUI-Adience Face Image 26,580 age & gender labeled images
PASCAL VOC 2012 11,530 images w/ 27,450 ROI annotated objects and 6,929 segmentations
PCAP Network captures of regular internet traffic and attack scenario traffic
Penn Treebank (PTB) statistical language modeling
UCF11/YouTube Action 11 action categories: basketball shooting, biking/cycling, diving, golf swinging, horse back riding, soccer juggling, swinging, tennis swinging, trampoline jumping, volleyball spiking, and walking with a dog
UCI Datasets
US Census: demographic data
VGG-Face millions of faces
LibriSpeech 1000 hours free speech recognition traning dataset