401 on API call right after token refresh - clock skew?

Token refresh hits /oauth/token successfully. Immediate GET to /api/v2/users/me returns 401.

Clock on the server is 2 minutes ahead of the token issuer. Token is valid but rejected.

Is there a way to force the SDK to handle the skew or do I have to fix the server time?