Transfer Learning

The single most useful idea in applied deep learning: take a network already trained on 1.2 million ImageNet photos and adapt it.

Chop off the final classification layer, attach a fresh one for your categories, and train just that on your data. Then, optionally, unfreeze the whole network and fine-tune it — with a much smaller learning rate on the early layers.