Go to Windows 10 Settings > System > Sound > App Volume and device preferences. Find your app, and then select headphones as your Output and input device. You can also set up the volume level.

That is not all; people fail to make out if the microphone On Windows 11/10 is even working ... it doesn’t tell you how you actually sound. Read: How to set up Preferred Speaker & Microphone ...