Since moving to a new role that allows working from home nearly 100% of the time (still have a dedicated office space if I need it), I honestly feel there is no downside other than having to not appear to be gloating or flaunting the fact that I can work from home when talking to others who cannot.