Ok, I’ve figured it out.
For anyone else searching, with the Startup.cs code I already have, you just need to add the following tag to your API controllers:
[Authorize(AuthenticationSchemes = JwtBearerDefaults.AuthenticationScheme)]
And continue to use just Authorize for MVC controllers