The correct answer is C. didn't go.
The sentence is in the past tense, so we need to use a past tense verb. The other options are not in the past tense.
A. hadn't gone is the past perfect tense. This tense is used to talk about something that happened before another event in the past. In this sentence, there is no other event in the past, so we don't need to use the past perfect tense.
B. haven't gone is the present perfect tense. This tense is used to talk about something that has happened up to the present moment. In this sentence, the speaker is talking about something that happened in the past, so we don't need to use the present perfect tense.
D. don't go is the simple present tense. This tense is used to talk about something that happens regularly or repeatedly. In this sentence, the speaker is talking about something that happened once, so we don't need to use the simple present tense.