Because the prime factorization of $2024$ is $2^3 \cdot 11 \cdot 23$, it follows that $n!$ is a multiple of $2024$ if and only if $n \ge 23$. Therefore $23$ is the least value of $n$ such that $n!$ is a multiple of $2024$.