Organizing devices and users into groups for policy application
I would start by addressing the failures during the Autopilot provisioning process first. Skipping ESP is not the solution for failures. As for the question around office assignment is concerned, you cannot create a group the way you want dynamically using native functionality in Entra. Although I don’t really understand the approach here. If you want office to install after a user logs in then just assign to a user based group. If you are concerned about devices other than autopilot provisioned receiving the policy then just use a device filter and scope the to autopilot enrolled profile assigned devices.