I have never tried it, BUT, the high fat content of the butter/cream is what keeps the sauce from breaking as long as the heat is not too high.I like olive oil as well, but do not think it would work or be a particularly good flavor profile for this application.I have added some cheddar, gouda, and other types of cheese in small amounts to this type of mac & cheese...but even doing that if not watch