Refund confusion

So I was making a larger order on Alibaba and the seller made a custom order for me but it added a processing fee so I just bought it through the original post from the company he works for and sent him the order number for confirmation. He then gets frustrated with me for having him make an order for me just to buy the original post. I figured maybe then he doesn't get commission since I did that so I refunded it and tried to explain to him the custom order he sent adds a processing fee. While trying to explain to him I refunded it and how the custom order adds a processing fee he kept saying we received the money and how the I pay for alibaba and that fee is them so I'm just very confused at the moment.