According to Practical English Usage, by Michael Swan,
“the prepositions of place, not direction, are used after go/come …ing.
I went swimming in the river. (NOT *I went swimming to the river.)
She went shopping at Harrods. (NOT *… to Harrods.)”
Can we say “We went hiking to the mountains”?