Ensure that you enter player ID from Xbox gamertag. As player IDs from other interfaces are not applicable to use. Or else search your playmate using his Microsoft account. Then, click ‘Add Friend’, next to his name. Now, he has been added as friend to play game.