Its the airlines fault
The airlines should install seat locks on the back of each seat. The person seated behind you must release the lock for you to recline your seat. This would eliminate the issue. You must ask nicely to recline but if the person behind wants to use his tray then you cannot invade his space.