Even though they had loosened up on the rules (due mostly to the fact that his godfather, Sirius Black was a convicted murderer), the Dursleys were still paranoid about any sort of magic at all, and Harry felt it was best not to rile them at this moment in time.