That introduces latency and signaling issues, and I would not be surprised if there is a restriction on what sort of modules you can use (i.e. you may only be able to use one double-sided DIMM with two single-sided DIMMs in each channel if you want to populate all six slots).