I believe the significance of the story is more important than the evidence for the event.
For the storyteller or evangelist, the gifts are foreshadowing the end of the story and combining kingship, priesthood, and martyrdom in his future.
The claim of the magi validates the identity of Jesus.
Being Gentiles expands the mission to all of humanity.
Whether or not magi actually visited Mary and Joseph, for Matthew and his community, Jesus was the predicted Messiah, descendant of David, who would fulfill the promise to Abraham that his descendants would be a blessing to all the nations. His death would be part of achieving that promise.