milestone Next-generation Communication Network next-generation communication system description Artificial Intelligence artificial intelligence description Deep Learning deep learning description Deep Reinforcement Learning deep reinforcement learning description Multi-Agent System multi-agent system description Convex Optimization Convex optimization is a subfield of optimization focusing on minimizing convex functions over convex sets. scenario Mobile Edge Computing Mobile Edge Computing effectively brings computation and storage capabilities closer to the end user, which significantly reduces latency and enhances performance. Integrated Sensing and Communication Integrated Sensing and Communication is a key technology for 6G networks, which merges sensing and communication functionalities in a single system. Satellite Communication Satellite communication systems are key technologies for global connectivity, enabling data transmission over far distances. framework Multi-Agent Deep Reinforcement Learning To optimize key factors of communication systems in decentralized manner, we propose multi-agent deep reinforcement learning framework. Single-Agent Deep Reinforcement Learning To optimize key factors of communication systems in centralized manner, we propose single-agent deep reinforcement learning framework.