There are $2023$ people sitting at a round table. Each person is either a knave or a knight. Knights always speak the truth and knaves always lie. The first person says: "There is at least one knave at this table." The person to the left says: "There is at least one knight at this table." The third one says: "There are at least two knaves at this table." The fourth says: "There are at least two knights at this table." This continues, until the last person at the table says: "There are at least $1012$ knaves at this table." The first person, who has already made a statement, now says: "There are at least $1012$ knights at this table."
How many knaves are sitting at the table?
A) $505$ B) $506$ C) $1011$ D) $1012$ E) $1507$