20130007774DATA PARALLEL COMPUTING ON MULTIPLE PROCESSORS - A method and an apparatus that allocate one or more physical compute devices such as CPUs or GPUs attached to a host processing unit running an application for executing one or more threads of the application are described.