Even though Harry cannot explain what happened, and though he truly did nothing wrong, Vernon punishes him severely for the strange circumstances that unfold around him. It is worth noting that Harry’s ability to talk to snakes is a crucial detail in the second book in the series,
Harry Potter and the Chamber of Secrets.