Source Alignment Forum · Published · Open the original ↗
Lab notes
Minimum required pacing: finish aligning it before you train the next one
Let's say we coordinate to pace the frontier, but we don't coordinate on an outright pause. What should the standard of pacing be?
My proposal for a minimum requirement: a lab cannot train the next generation of models (in terms of capabilities) until they have adequately [1] resolved all significant alignment issues in the present generation of models.
You don't launch a jet that goes at Mach 3 before you've figured out why your Mach 2 jet keeps crashing [2] . With any other kind of dangerous technology, we wouldn't accept "shrug and move on".
This proposal may appeal to many prosaic-alignment optimists and pessimists, because they usually differ on how easy it would be to fix current alignment issues with current techniques.
The opening of the post, quoted unchanged from Alignment Forum. The full text continues at the source.