As an addition to my original question, could I use the Quadro M5000 (instead of the TITAN X) as an extra card to avoid driver issues with GTX GPUs?
Yes, you can use the Quadro M5000.
EDIT:
You should also consider the Quadro P5000 instead of the M5000 since the P5000 is based on the Pascal architecture. 