⚡ AI Tool

Batch Size Optimizer

Calculate the maximum safe batch size for your GPU, accounting for model size, optimizer states, activations, and mixed-precision settings — with gradient accumulation to hit your effective batch target.

Hardware & Model

GPU

Model Size (billion parameters)

Precision

Optimizer

Sequence Length (tokens)

Number of GPUs

Target Effective Batch Size

—

Optimal Per-GPU Batch Size

VRAM Usage —

—

Weights

—

Optimizer

—

Activations

—

Total VRAM

—

Grad Accum Steps

—

Effective Batch

Batch Size vs Memory Usage

Tips for This Configuration