CrashBench

Stress a vision AI in field conditions

The field is not the training set. Rain, night, compression and haphazard framing bring down models that are excellent in the lab.

How it works

flux-dev2 creditsWeather overlay
flux-devweather-stressweatherbrightness

How it works

CrashBench generates a base then derives a spectrum of degraded conditions, for free, on the deterministic side. You cover the worst case without blowing the budget.

Each variant is labelled: you know exactly which stress combination brought the model down.

Key points

  • Weather, compression, brightness, angle in one dataset.
  • Free variants: cover broadly at no extra cost.
  • Every failure is traceable to its stress combination.