compositor: Implement subimage rectangle rendering for quad layers.