Reproducing a Transformer Baseline

Abstract

A faithful reproduction of a published transformer baseline with validated benchmarks.

We rebuilt the baseline from scratch, validated the reported metrics and documented every experiment for defense.