This paper enhances the fully decentralized cooperative multi-agent reinforcement learning from a context modeling perspective.