Slurm decides what runs where. Your research jobs go to the jobs partition, and the models run as a job of their own in the admin-only serve partition, which is why a job pauses them while the cluster has two Sparks. See Slurm jobs.
Slurm’s REST API (slurmrestd) is what lets an agent submit jobs as you through mcp.c4e.ai.