Yes, but people underestimate what that involves. Serious players would study previous games for weaknesses, looking for subject areas that include unpublished knowledge that isn’t in the training set.
Casual talk about “passing the Turing Test” sets a much lower bar.