How to let customer support team manage certain aspects of users?

How can I grant the customer support team access to reset passwords for individual users without giving them admin access to

You can use the delegated admin extension. This would allow you to give the customer support team some management options (including password reset) without giving full access to your Auth0 account.

See this table for the available user actions that can be performed through the extension. In addition, using the extension hooks mechanism you could further restrict the actions that could be done through the extension in an extensible way.