Are templates specific to a workspace?

No, templates are available across all of your workspaces in the app. Any template that you add can be used by any window in any workspace in the app.