Note: This has nothing to do with SharePoint or Solutions Architecture. :)
The problem with the new Xbox One Headset Adapter is that it simply does not work with a standard TRRS 4-pole (3 ring) 3.5mm male to male cable or standard 3.5mm stereo auxiliary cable.
Now plug it into the 2.5mm adapter that came with the Xbox One headset adapter and all should work. However you may want to turn down the adapter game volume so you only get voice through the adapter and not game audio, since you get that through the optical surround sound adapter. Also note that this is mono, not stereo so you could alternatively modify a TRRS 4-pole cable to provide that stereo headset sound you’ll never use.