Introduction to deep learning

Libraries

What we use:

• PyTorch

• PyTorch lightning

Other options:

• Tensorflow + Keras

Models

• use: torchvision.models

Examples:

• ResNet-50

Optimiser

• use: torch.optim

Examples:

• Adam

• SGD

Learning rate scheduler / annealer

Augmentation

• use: torchvision.transforms

Examples:

• Flip

• Rotate

Sampler

Examples:

• Batch Sampler

Dropout

Early stopping

Metrics

• use: torchmetrics or torcheval.metrics

• Source: Metrics reloaded: Recommendations for image analysis validation - https://arxiv.org/abs/2206.01653

Examples:

• F1 score

• Accuracy