That's what "alignment" used to mean until about a year ago; the term has since been hijacked to extend to making LLMs polite and obedient. This leads to confusion and people asking "what's the big deal with the 'alignment' thing?". The big deal is with "avoiding getting casually extincted by a powerful enough AI" kind of alignment. The "reliably preventing LLMs from saying undesired things" is much lesser issue (though probably a small part of the big problem).