Natural Policy Gradient for Average Reward Non-Stationary Reinforcement Learning.

Guannan Qu

Neharika Jali Eshika Pathak Pranay Sharma Guannan Qu Gauri Joshi Natural Policy Gradient for Average Reward Non-Stationary Reinforcement Learning. 2026 2026 Trans. Mach. Learn. Res. https://openreview.net/forum?id=hBJYNAYtoo db/journals/tmlr/tmlr2026.html#JaliPSQJ26 streams/journals/tmlr

Xingyu Xu 0001 Ziyi Zhang Yorie Nakahira Guannan Qu Yuejie Chi Polynomial Convergence of Riemannian Diffusion Models. 2026 January abs/2601.02499 CoRR https://doi.org/10.48550/arXiv.2601.02499 db/journals/corr/corr2601.html#abs-2601-02499 streams/journals/corr

Muhammed Ustaomeroglu Guannan Qu BLOCK-EM: Preventing Emergent Misalignment by Blocking Causal Features. 2026 February abs/2602.00767 CoRR https://doi.org/10.48550/arXiv.2602.00767 db/journals/corr/corr2602.html#abs-2602-00767 streams/journals/corr

Ziyi Zhang Xiyu Deng Guannan Qu Yorie Nakahira UAVGENT: A Language-Guided Distributed Control Framework. 2026 February abs/2602.13212 CoRR https://doi.org/10.48550/arXiv.2602.13212 db/journals/corr/corr2602.html#abs-2602-13212 streams/journals/corr

Luyao Wang Zhiqi Jiang Guannan Qu Digital Business Model Innovation in Complex Environments: A Knowledge System Perspective. 379 2025 13 Syst. 5 https://doi.org/10.3390/systems13050379 db/journals/systems/systems13.html#WangJQ25 streams/journals/systems

Ziyi Zhang Yorie Nakahira Guannan Qu Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Information. 2025 2025 Trans. Mach. Learn. Res. https://openreview.net/forum?id=uObs1YwXjQ db/journals/tmlr/tmlr2025.html#ZhangNQ25

Ziyi Zhang Guannan Qu Yorie Nakahira Fast Bandit-based Policy Adaptation in Diverse Environments. 2458-2464 2025 ACC https://doi.org/10.23919/ACC63710.2025.11107697 conf/amcc/2025 db/conf/amcc/acc2025.html#ZhangQN25 streams/conf/amcc Guannan Qu Structure-Exploiting Reinforcement Learning for Networked Systems. 4776-4784 2025 ACC https://doi.org/10.23919/ACC63710.2025.11107771 conf/amcc/2025 db/conf/amcc/acc2025.html#Qu25 streams/conf/amcc Chaoyi Pan Zeji Yi Guanya Shi Guannan Qu Sampling-Based Methods for Optimal Control: Theory, Algorithms, and Applications. 3775-3793 2025 CDC https://doi.org/10.1109/CDC57313.2025.11312983 conf/cdc/2025 db/conf/cdc/cdc2025.html#PanYSQ25 streams/conf/cdc Muhammed Ustaomeroglu Guannan Qu A Theoretical Study of (Hyper) Self-Attention through the Lens of Interactions: Representation, Training, Generalization. 2025 ICML https://proceedings.mlr.press/v267/ustaomeroglu25a.html https://openreview.net/forum?id=wQvR1LHboD conf/icml/2025 db/conf/icml/icml2025.html#UstaomerogluQ25 Haoru Xue Chaoyi Pan Zeji Yi Guannan Qu Guanya Shi Full-Order Sampling-Based MPC for Torque-Level Locomotion Control via Diffusion-Style Annealing. 4974-4981 2025 ICRA https://doi.org/10.1109/ICRA55743.2025.11127320 conf/icra/2025 db/conf/icra/icra2025.html#XuePYQS25 streams/conf/icra Ziyi Zhang Yorie Nakahira Guannan Qu Learning to Stabilize Unknown LTI Systems on a Single Trajectory under Stochastic Noise. 4889-4919 2025 UAI https://proceedings.mlr.press/v286/zhang25b.html conf/uai/2025 db/conf/uai/uai2025.html#ZhangNQ25 streams/conf/uai

Tairan He Jiawei Gao Wenli Xiao Yuanhang Zhang Zi Wang Jiashun Wang Zhengyi Luo 0002 Guanqi He Nikhil Sobanbab Chaoyi Pan Zeji Yi Guannan Qu Kris Kitani Jessica K. Hodgins Linxi Fan Yuke Zhu Changliu Liu Guanya Shi ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills. 2025 February abs/2502.01143 CoRR https://doi.org/10.48550/arXiv.2502.01143 db/journals/corr/corr2502.html#abs-2502-01143 streams/journals/corr

John Z. Zhang Taylor A. Howell Zeji Yi Chaoyi Pan Guanya Shi Guannan Qu Tom Erez Yuval Tassa Zachary Manchester Whole-Body Model-Predictive Control of Legged Robots with MuJoCo. 2025 March abs/2503.04613 CoRR https://doi.org/10.48550/arXiv.2503.04613 db/journals/corr/corr2503.html#abs-2503-04613 streams/journals/corr

Ziyi Zhang Yorie Nakahira Guannan Qu Stabilizing Linear Systems under Partial Observability: Sample Complexity and Fundamental Limits. 2025 March abs/2503.16756 CoRR https://doi.org/10.48550/arXiv.2503.16756 db/journals/corr/corr2503.html#abs-2503-16756 streams/journals/corr

Neharika Jali Eshika Pathak Pranay Sharma Guannan Qu Gauri Joshi Natural Policy Gradient for Average Reward Non-Stationary RL. 2025 April abs/2504.16415 CoRR https://doi.org/10.48550/arXiv.2504.16415 db/journals/corr/corr2504.html#abs-2504-16415 streams/journals/corr

Alex DeWeese Guannan Qu Thinking Beyond Visibility: A Near-Optimal Policy Framework for Locally Interdependent Multi-Agent MDPs. 2025 June abs/2506.04215 CoRR https://doi.org/10.48550/arXiv.2506.04215 db/journals/corr/corr2506.html#abs-2506-04215 streams/journals/corr

Muhammed Ustaomeroglu Guannan Qu A Theoretical Study of (Hyper) Self-Attention through the Lens of Interactions: Representation, Training, Generalization. 2025 June abs/2506.06179 CoRR https://doi.org/10.48550/arXiv.2506.06179 db/journals/corr/corr2506.html#abs-2506-06179 streams/journals/corr

Geng Sun 0001 Chenbang Liu Jiahui Li 0002 Guannan Qu Shuang Liang 0003 Jiacheng Wang 0001 Changyuan Zhao Dusit Niyato Recovery of UAV Swarm-enabled Collaborative Beamforming in Low-altitude Wireless Networks under Wind Field Disturbances. 2025 July abs/2507.08507 CoRR https://doi.org/10.48550/arXiv.2507.08507 db/journals/corr/corr2507.html#abs-2507-08507 streams/journals/corr

Muhammed Ustaomeroglu Baris Askin Gauri Joshi Carlee Joe-Wong Guannan Qu Language Model Planning from an Information Theoretic Perspective. 2025 September abs/2509.25260 CoRR https://doi.org/10.48550/arXiv.2509.25260 db/journals/corr/corr2509.html#abs-2509-25260 streams/journals/corr

Ozan Baris Mulayim Elias N. Pergantis Levi D. Reyes Premer Bingqing Chen Guannan Qu Kevin J. Kircher Mario Bergés Comparative Field Deployment of Reinforcement Learning and Model Predictive Control for Residential HVAC. 2025 October abs/2510.01475 CoRR https://doi.org/10.48550/arXiv.2510.01475 db/journals/corr/corr2510.html#abs-2510-01475 streams/journals/corr

Shimiao Li Guannan Qu Bryan Hooi Vyas Sekar Soummya Kar Lawrence T. Pileggi Cyber-Resilient System Identification for Power Grid through Bayesian Integration. 2025 October abs/2510.14043 CoRR https://doi.org/10.48550/arXiv.2510.14043 db/journals/corr/corr2510.html#abs-2510-14043 streams/journals/corr

Qinghua Ma Reetam Sen Biswas Denis Osipov Guannan Qu Soummya Kar Shimiao Li Multi-Period Sparse Optimization for Proactive Grid Blackout Diagnosis. 2025 October abs/2510.14045 CoRR https://doi.org/10.48550/arXiv.2510.14045 db/journals/corr/corr2510.html#abs-2510-14045 streams/journals/corr

Vidur Sinha Muhammed Ustaomeroglu Guannan Qu Transformer-Based Scalable Multi-Agent Reinforcement Learning for Networked Systems with Long-Range Interactions. 2025 November abs/2511.13103 CoRR https://doi.org/10.48550/arXiv.2511.13103 db/journals/corr/corr2511.html#abs-2511-13103 streams/journals/corr

Chaoyi Pan Giri Anantharaman Nai-Chieh Huang Claire Jin Daniel Pfrommer Chenyang Yuan 0001 Frank Permenter Guannan Qu Nicholas Boffi Guanya Shi Max Simchowitz Much Ado About Noising: Dispelling the Myths of Generative Robotic Control. 2025 December abs/2512.01809 CoRR https://doi.org/10.48550/arXiv.2512.01809 db/journals/corr/corr2512.html#abs-2512-01809 streams/journals/corr

Jueming Hu Zhe Xu 0005 Weichang Wang Guannan Qu Yutian Pang Yongming Liu Decentralized graph-based multi-agent reinforcement learning using reward machines. 126974 2024 January 564 Neurocomputing https://doi.org/10.1016/j.neucom.2023.126974 db/journals/ijon/ijon564.html#HuXWQPL24

Jie Feng 0006 Yuanyuan Shi Guannan Qu Steven H. Low Anima Anandkumar Adam Wierman Stability Constrained Reinforcement Learning for Decentralized Real-Time Voltage Control. 1370-1381 2024 September 11 IEEE Trans. Control. Netw. Syst. 3 https://doi.org/10.1109/TCNS.2023.3338240 db/journals/tcns/tcns11.html#FengSQLAW24 streams/journals/tcns

Neharika Jali Guannan Qu Weina Wang 0001 Gauri Joshi Efficient Reinforcement Learning for Routing Jobs in Heterogeneous Queueing Systems. 4177-4185 2024 AISTATS https://proceedings.mlr.press/v238/jali24a.html conf/aistats/2024 db/conf/aistats/aistats2024.html#JaliQ0J24 Eric Xu Guannan Qu Stability and Regret Bounds on Distributed Truncated Predictive Control for Networked Dynamical Systems. 2604-2611 2024 ACC https://doi.org/10.23919/ACC60939.2024.10644979 conf/amcc/2024 db/conf/amcc/acc2024.html#XuQ24 streams/conf/amcc Alex DeWeese Guannan Qu Locally Interdependent Multi-Agent MDP: Theoretical Framework for Decentralized Agents with Dynamic Dependencies. 2024 ICML https://proceedings.mlr.press/v235/deweese24a.html https://openreview.net/forum?id=iYYA5zDoCm conf/icml/2024 db/conf/icml/icml2024.html#DeWeeseQ24 10687-10709 Junxuan Shen Adam Wierman Guannan Qu Combining model-based controller and ML advice via convex reparameterization. 679-693 2024 L4DC https://proceedings.mlr.press/v242/shen24a.html conf/l4dc/2024 db/conf/l4dc/l4dc2024.html#ShenWQ24 Zeji Yi Chaoyi Pan Guanqi He Guannan Qu Guanya Shi CoVO-MPC: Theoretical analysis of sampling-based MPC and optimal covariance design. 1122-1135 2024 L4DC https://proceedings.mlr.press/v242/yi24b.html conf/l4dc/2024 db/conf/l4dc/l4dc2024.html#YiPHQS24 Chaoyi Pan Zeji Yi Guanya Shi Guannan Qu Model-based Diffusion for Trajectory Optimization. 2024 NeurIPS http://papers.nips.cc/paper_files/paper/2024/hash/6a5c38a730b17f3827c09cf6b192be04-Abstract-Conference.html conf/nips/2024 db/conf/nips/neurips2024.html#PanYSQ24

Zeji Yi Chaoyi Pan Guanqi He Guannan Qu Guanya Shi CoVO-MPC: Theoretical Analysis of Sampling-based MPC and Optimal Covariance Design. 2024 abs/2401.07369 CoRR https://doi.org/10.48550/arXiv.2401.07369 db/journals/corr/corr2401.html#abs-2401-07369

Neharika Jali Guannan Qu Weina Wang 0001 Gauri Joshi Efficient Reinforcement Learning for Routing Jobs in Heterogeneous Queueing Systems. 2024 abs/2402.01147 CoRR https://doi.org/10.48550/arXiv.2402.01147 db/journals/corr/corr2402.html#abs-2402-01147

Emile Anand Guannan Qu Efficient Reinforcement Learning for Global Decision Making in the Presence of Local Agents at Scale. 2024 abs/2403.00222 CoRR https://doi.org/10.48550/arXiv.2403.00222 db/journals/corr/corr2403.html#abs-2403-00222

Ziyi Zhang Yorie Nakahira Guannan Qu Learning to Stabilize Unknown LTI Systems on a Single Trajectory under Stochastic Noise. 2024 abs/2406.00234 CoRR https://doi.org/10.48550/arXiv.2406.00234 db/journals/corr/corr2406.html#abs-2406-00234

Alex DeWeese Guannan Qu Locally Interdependent Multi-Agent MDP: Theoretical Framework for Decentralized Agents with Dynamic Dependencies. 2024 abs/2406.06823 CoRR https://doi.org/10.48550/arXiv.2406.06823 db/journals/corr/corr2406.html#abs-2406-06823

Chaoyi Pan Zeji Yi Guanya Shi Guannan Qu Model-Based Diffusion for Trajectory Optimization. 2024 abs/2407.01573 CoRR https://doi.org/10.48550/arXiv.2407.01573 db/journals/corr/corr2407.html#abs-2407-01573 streams/journals/corr

Ziyi Zhang Yorie Nakahira Guannan Qu Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Information. 2024 abs/2409.08434 CoRR https://doi.org/10.48550/arXiv.2409.08434 db/journals/corr/corr2409.html#abs-2409-08434 streams/journals/corr

Haoru Xue Chaoyi Pan Zeji Yi Guannan Qu Guanya Shi Full-Order Sampling-Based MPC for Torque-Level Locomotion Control via Diffusion-Style Annealing. 2024 abs/2409.15610 CoRR https://doi.org/10.48550/arXiv.2409.15610 db/journals/corr/corr2409.html#abs-2409-15610 streams/journals/corr

Emile Anand Ishani Karmarkar Guannan Qu Mean-Field Sampling for Cooperative Multi-Agent Reinforcement Learning. 2024 abs/2412.00661 CoRR https://doi.org/10.48550/arXiv.2412.00661 db/journals/corr/corr2412.html#abs-2412-00661 streams/journals/corr

Yizhou Zhang Guannan Qu Pan Xu 0002 Yiheng Lin 0001 Zaiwei Chen Adam Wierman Global Convergence of Localized Policy Iteration in Networked Multi-Agent Reinforcement Learning. 13:1-13:51 2023 March 7 Proc. ACM Meas. Anal. Comput. Syst. 1 https://doi.org/10.1145/3579443 db/journals/pomacs/pomacs7.html#ZhangQXLCW23

Sungho Shin Yiheng Lin 0001 Guannan Qu Adam Wierman Mihai Anitescu Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems. 1113-1135 2023 June 61 SIAM J. Control. Optim. 3 https://doi.org/10.1137/22m1489836 db/journals/siamco/siamco61.html#ShinLQWA23

Sahin Lale Yuanyuan Shi Guannan Qu Kamyar Azizzadenesheli Adam Wierman Anima Anandkumar KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Discrete-Time Systems. 1334-1341 2023 CDC https://doi.org/10.1109/CDC49753.2023.10384011 conf/cdc/2023 db/conf/cdc/cdc2023.html#LaleSQAWA23 Eric Xu Guannan Qu Natural Policy Gradient Preserves Spatial Decay Properties for Control of Networked Dynamical Systems. 4486-4493 2023 CDC https://doi.org/10.1109/CDC49753.2023.10383735 conf/cdc/2023 db/conf/cdc/cdc2023.html#XuQ23 Songyuan Zhang Yumeng Xiu Guannan Qu Chuchu Fan Compositional Neural Certificates for Networked Dynamical Systems. 272-285 2023 L4DC https://proceedings.mlr.press/v211/zhang23a.html conf/l4dc/2023 db/conf/l4dc/l4dc2023.html#ZhangXQF23 Yizhou Zhang Guannan Qu Pan Xu 0002 Yiheng Lin 0001 Zaiwei Chen Adam Wierman Global Convergence of Localized Policy Iteration in Networked Multi-Agent Reinforcement Learning. 83-84 2023 SIGMETRICS (Abstracts) https://doi.org/10.1145/3578338.3593545 conf/sigmetrics/2023 db/conf/sigmetrics/sigmetrics2023.html#ZhangQ0LCW23

Songyuan Zhang Yumeng Xiu Guannan Qu Chuchu Fan Compositional Neural Certificates for Networked Dynamical Systems. 2023 abs/2303.14564 CoRR https://doi.org/10.48550/arXiv.2303.14564 db/journals/corr/corr2303.html#abs-2303-14564

Eric Xu Guannan Qu Stability and Regret bounds on Distributed Truncated Predictive Control for Networked Dynamical Systems. 2023 abs/2310.06194 CoRR https://doi.org/10.48550/arXiv.2310.06194 db/journals/corr/corr2310.html#abs-2310-06194

Han Xu Jialin Zheng Guannan Qu A Scalable Network-Aware Multi-Agent Reinforcement Learning Framework for Decentralized Inverter-based Voltage Control. 2023 abs/2312.04371 CoRR https://doi.org/10.48550/arXiv.2312.04371 db/journals/corr/corr2312.html#abs-2312-04371

Shuang Liang 0003 Zhiyi Fang Geng Sun 0001 Guannan Qu Biogeography-based optimization with adaptive migration and adaptive mutation with its application in sidelobe reduction of antenna arrays. 108772 2022 121 Appl. Soft Comput. https://doi.org/10.1016/j.asoc.2022.108772 https://www.wikidata.org/entity/Q113879616 db/journals/asc/asc121.html#LiangFSQ22

Guannan Qu Adam Wierman Na Li 0002 Scalable Reinforcement Learning for Multiagent Networked Systems. 3601-3628 2022 November 70 Oper. Res. 6 https://doi.org/10.1287/opre.2021.2226 db/journals/ior/ior70.html#QuWL22

Tongxin Li 0001 Ruixiao Yang Guannan Qu Guanya Shi Chenkai Yu Adam Wierman Steven H. Low Robustness and Consistency in Linear Quadratic Control with Untrusted Predictions. 18:1-18:35 2022 6 Proc. ACM Meas. Anal. Comput. Syst. 1 https://doi.org/10.1145/3508038 db/journals/pomacs/pomacs6.html#LiYQSYWL22

Xin Chen 0036 Guannan Qu Yujie Tang 0002 Steven H. Low Na Li 0002 Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges. 2935-2958 2022 13 IEEE Trans. Smart Grid 4 https://doi.org/10.1109/TSG.2022.3154718 db/journals/tsg/tsg13.html#ChenQTLL22

Yang Hu Adam Wierman Guannan Qu On the Sample Complexity of Stabilizing LTI Systems on a Single Trajectory (Extended Abstract). 1-2 2022 Allerton https://doi.org/10.1109/Allerton49937.2022.9929403 conf/allerton/2022 db/conf/allerton/allerton2022.html#HuWQ22 Yuanyuan Shi Guannan Qu Steven H. Low Anima Anandkumar Adam Wierman Stability Constrained Reinforcement Learning for Real-Time Voltage Control. 2715-2721 2022 ACC https://doi.org/10.23919/ACC53348.2022.9867476 conf/amcc/2022 db/conf/amcc/amcc2022.html#ShiQLAW22 Yiheng Lin 0001 Judy Gan Guannan Qu Yash Kanoria Adam Wierman Decentralized Online Convex Optimization in Networked Systems. 13356-13393 2022 ICML https://proceedings.mlr.press/v162/lin22c.html conf/icml/2022 db/conf/icml/icml2022.html#LinGQKW22 Yang Hu Adam Wierman Guannan Qu On the Sample Complexity of Stabilizing LTI Systems on a Single Trajectory. 2022 conf/nips/2022 NeurIPS http://papers.nips.cc/paper_files/paper/2022/hash/6ca5d2665de83394f437dad0c3746907-Abstract-Conference.html db/conf/nips/neurips2022.html#HuWQ22 Yiheng Lin 0001 Yang Hu Guannan Qu Tongxin Li 0001 Adam Wierman Bounded-Regret MPC via Perturbation Analysis: Prediction Error, Constraints, and Nonlinearity. 2022 conf/nips/2022 NeurIPS http://papers.nips.cc/paper_files/paper/2022/hash/eadeef7c51ad86989cc3b311cb49ec89-Abstract-Conference.html db/conf/nips/neurips2022.html#LinHQLW22 Tongxin Li 0001 Ruixiao Yang Guannan Qu Guanya Shi Chenkai Yu Adam Wierman Steven H. Low Robustness and Consistency in Linear Quadratic Control with Untrusted Predictions. 107-108 2022 SIGMETRICS (Abstracts) https://doi.org/10.1145/3489048.3522658 conf/sigmetrics/2022 db/conf/sigmetrics/sigmetrics2022.html#LiYQSYWL22

Yang Hu Adam Wierman Guannan Qu On the Sample Complexity of Stabilizing LTI Systems on a Single Trajectory. 2022 abs/2202.07187 CoRR https://arxiv.org/abs/2202.07187 db/journals/corr/corr2202.html#abs-2202-07187

Sungho Shin Yiheng Lin 0001 Guannan Qu Adam Wierman Mihai Anitescu Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems. 2022 abs/2204.05551 CoRR https://doi.org/10.48550/arXiv.2204.05551 db/journals/corr/corr2204.html#abs-2204-05551

Tongxin Li 0001 Ruixiao Yang Guannan Qu Yiheng Lin 0001 Steven H. Low Adam Wierman Equipping Black-Box Policies with Model-Based Advice for Stable Nonlinear Control. 2022 abs/2206.01341 CoRR https://doi.org/10.48550/arXiv.2206.01341 db/journals/corr/corr2206.html#abs-2206-01341

Sahin Lale Yuanyuan Shi Guannan Qu Kamyar Azizzadenesheli Adam Wierman Anima Anandkumar KCRL: Krasovskii-Constrained Reinforcement Learning with Guaranteed Stability in Nonlinear Dynamical Systems. 2022 abs/2206.01704 CoRR https://doi.org/10.48550/arXiv.2206.01704 db/journals/corr/corr2206.html#abs-2206-01704

Jie Feng 0006 Yuanyuan Shi Guannan Qu Steven H. Low Anima Anandkumar Adam Wierman Stability Constrained Reinforcement Learning for Real-Time Voltage Control in Distribution Systems. 2022 abs/2209.07669 CoRR https://doi.org/10.48550/arXiv.2209.07669 db/journals/corr/corr2209.html#abs-2209-07669

Yizhou Zhang Guannan Qu Pan Xu 0002 Yiheng Lin 0001 Zaiwei Chen Adam Wierman Global Convergence of Localized Policy Iteration in Networked Multi-Agent Reinforcement Learning. 2022 abs/2211.17116 CoRR https://doi.org/10.48550/arXiv.2211.17116 db/journals/corr/corr2211.html#abs-2211-17116

Jin Chen Luyao Wang Guannan Qu Explicating the business model from a knowledge-based view: nature, structure, imitability and competitive advantage erosion. 23-47 2021 25 J. Knowl. Manag. 1 https://doi.org/10.1108/JKM-02-2020-0159 db/journals/jkm/jkm25.html#ChenWQ21

Yingying Li 0005 Guannan Qu Na Li 0002 Online Optimization With Predictions and Switching Costs: Fast Algorithms and the Fundamental Limit. 4761-4768 2021 66 IEEE Trans. Autom. Control. 10 https://doi.org/10.1109/TAC.2020.3040249 db/journals/tac/tac66.html#LiQL21

Guannan Qu Chenkai Yu Steven H. Low Adam Wierman Exploiting Linear Models for Model-Free Nonlinear Control: A Provably Convergent Policy Gradient Approach. 6539-6546 2021 CDC https://doi.org/10.1109/CDC45484.2021.9683735 conf/cdc/2021 db/conf/cdc/cdc2021.html#QuYLW21 Guannan Qu Yuanyuan Shi Sahin Lale Anima Anandkumar Adam Wierman Stable Online Control of Linear Time-Varying Systems. 742-753 2021 L4DC http://proceedings.mlr.press/v144/qu21a.html conf/l4dc/2021 db/conf/l4dc/l4dc2021.html#QuSLAW21 Yiheng Lin 0001 Yang Hu Guanya Shi Haoyuan Sun Guannan Qu Adam Wierman Perturbation-based Regret Analysis of Predictive Control in Linear Time Varying Systems. 5174-5185 2021 NeurIPS https://proceedings.neurips.cc/paper/2021/hash/298f587406c914fad5373bb689300433-Abstract.html conf/nips/2021 db/conf/nips/neurips2021.html#LinHSSQW21 Yiheng Lin 0001 Guannan Qu Longbo Huang Adam Wierman Multi-Agent Reinforcement Learning in Stochastic Networked Systems. 7825-7837 2021 NeurIPS https://proceedings.neurips.cc/paper/2021/hash/412604be30f701b1b1e3124c252065e6-Abstract.html conf/nips/2021 db/conf/nips/neurips2021.html#LinQHW21

Xin Chen 0036 Guannan Qu Yujie Tang 0002 Steven H. Low Na Li 0002 Reinforcement Learning for Decision-Making and Control in Power Systems: Tutorial, Review, and Vision. 2021 abs/2102.01168 CoRR https://arxiv.org/abs/2102.01168 db/journals/corr/corr2102.html#abs-2102-01168

Guannan Qu Yuanyuan Shi Sahin Lale Anima Anandkumar Adam Wierman Stable Online Control of Linear Time-Varying Systems. 2021 abs/2104.14134 CoRR https://arxiv.org/abs/2104.14134 db/journals/corr/corr2104.html#abs-2104-14134

Tongxin Li 0001 Ruixiao Yang Guannan Qu Guanya Shi Chenkai Yu Adam Wierman Steven H. Low Robustness and Consistency in Linear Quadratic Control with Predictions. 2021 abs/2106.09659 CoRR https://arxiv.org/abs/2106.09659 db/journals/corr/corr2106.html#abs-2106-09659

Yiheng Lin 0001 Yang Hu Haoyuan Sun Guanya Shi Guannan Qu Adam Wierman Perturbation-based Regret Analysis of Predictive Control in Linear Time Varying Systems. 2021 abs/2106.10497 CoRR https://arxiv.org/abs/2106.10497 db/journals/corr/corr2106.html#abs-2106-10497

Yuanyuan Shi Guannan Qu Steven H. Low Anima Anandkumar Adam Wierman Stability Constrained Reinforcement Learning for Real-Time Voltage Control. 2021 abs/2109.14854 CoRR https://arxiv.org/abs/2109.14854 db/journals/corr/corr2109.html#abs-2109-14854

Jueming Hu Zhe Xu 0005 Weichang Wang Guannan Qu Yutian Pang Yongming Liu Decentralized Graph-Based Multi-Agent Reinforcement Learning Using Reward Machines. 2021 abs/2110.00096 CoRR https://arxiv.org/abs/2110.00096 db/journals/corr/corr2110.html#abs-2110-00096

Shuang Liang 0003 Zhiyi Fang Geng Sun 0001 Yanheng Liu 0001 Guannan Qu Ying Zhang 0007 Sidelobe Reductions of Antenna Arrays via an Improved Chicken Swarm Optimization Approach. 37664-37683 2020 8 IEEE Access https://doi.org/10.1109/ACCESS.2020.2976127 db/journals/access/access8.html#LiangFSLQZ20

Shuang Liang 0003 Zhiyi Fang Geng Sun 0001 Yanheng Liu 0001 Guannan Qu Suhanya Jayaprakasam Ying Zhang 0007 A joint optimization approach for distributed collaborative beamforming in mobile wireless sensor networks. 102216 2020 106 Ad Hoc Networks https://doi.org/10.1016/j.adhoc.2020.102216 db/journals/adhoc/adhoc106.html#LiangFSLQJZ20

Yujie Tang 0002 Guannan Qu Na Li 0002 Semi-global exponential stability of augmented primal-dual gradient dynamics for constrained convex optimization. 104754 2020 144 Syst. Control. Lett. https://doi.org/10.1016/j.sysconle.2020.104754 https://www.wikidata.org/entity/Q115566759 db/journals/scl/scl144.html#TangQL20

Guannan Qu Na Li 0002 Accelerated Distributed Nesterov Gradient Descent. 2566-2581 2020 65 IEEE Trans. Autom. Control. 6 https://doi.org/10.1109/TAC.2019.2937496 db/journals/tac/tac65.html#QuL20

Sindri Magnússon Guannan Qu Na Li 0002 Distributed Optimal Voltage Control With Asynchronous and Delayed Communication. 3469-3482 2020 11 IEEE Trans. Smart Grid 4 https://doi.org/10.1109/TSG.2020.2970768 db/journals/tsg/tsg11.html#MagnussonQL20

Guannan Qu Adam Wierman Finite-Time Analysis of Asynchronous Stochastic Approximation and $Q$-Learning. 3185-3205 2020 COLT http://proceedings.mlr.press/v125/qu20a.html conf/colt/2020 db/conf/colt/colt2020.html#QuW20 Niloy Patari Anurag K. Srivastava 0001 Guannan Qu Na Li 0002 Distributed Optimal Voltage Control for Three Phase Unbalanced Distribution Systems with DERs. 1-8 2020 IAS https://doi.org/10.1109/IAS44978.2020.9334886 conf/iasam/2020 db/conf/iasam/iasam2020.html#PatariSQL20 Guannan Qu Adam Wierman Na Li 0002 Scalable Reinforcement Learning of Localized Policies for Multi-Agent Networked Systems. 256-266 2020 L4DC http://proceedings.mlr.press/v120/qu20a.html conf/l4dc/2020 db/conf/l4dc/l4dc2020.html#QuW020 Guannan Qu Yiheng Lin 0001 Adam Wierman Na Li 0002 Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward. 2020 NeurIPS https://proceedings.neurips.cc/paper/2020/hash/168efc366c449fab9c2843e9b54e2a18-Abstract.html conf/nips/2020 db/conf/nips/neurips2020.html#QuLW020 Andreas Venzke Guannan Qu Steven H. Low Spyros Chatzivasileiadis Learning Optimal Power Flow: Worst-Case Guarantees for Neural Networks. 1-7 2020 SmartGridComm https://doi.org/10.1109/SmartGridComm47815.2020.9302963 conf/smartgridcomm/2020 db/conf/smartgridcomm/smartgridcomm2020.html#VenzkeQLC20

Guannan Qu Adam Wierman Finite-Time Analysis of Asynchronous Stochastic Approximation and Q-Learning. 2020 abs/2002.00260 CoRR https://arxiv.org/abs/2002.00260 db/journals/corr/corr2002.html#abs-2002-00260

Yiheng Lin 0001 Guannan Qu Longbo Huang Adam Wierman Distributed Reinforcement Learning in Multi-Agent Networked Systems. 2020 abs/2006.06555 CoRR https://arxiv.org/abs/2006.06555 db/journals/corr/corr2006.html#abs-2006-06555

Guannan Qu Yiheng Lin 0001 Adam Wierman Na Li 0002 Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward. 2020 abs/2006.06626 CoRR https://arxiv.org/abs/2006.06626 db/journals/corr/corr2006.html#abs-2006-06626

Guannan Qu Chenkai Yu Steven H. Low Adam Wierman Combining Model-Based and Model-Free Methods for Nonlinear Control: A Provably Convergent Policy Gradient Approach. 2020 abs/2006.07476 CoRR https://arxiv.org/abs/2006.07476 db/journals/corr/corr2006.html#abs-2006-07476

Andreas Venzke Guannan Qu Steven H. Low Spyros Chatzivasileiadis Learning Optimal Power Flow: Worst-Case Guarantees for Neural Networks. 2020 abs/2006.11029 CoRR https://arxiv.org/abs/2006.11029 db/journals/corr/corr2006.html#abs-2006-11029

Shuang Liang 0003 Zhiyi Fang Geng Sun 0001 Yanheng Liu 0001 Xiaohui Zhao 0004 Guannan Qu Ying Zhang 0007 Victor C. M. Leung JSSA: Joint Sidelobe Suppression Approach for Collaborative Beamforming in Wireless Sensor Networks. 151803-151817 2019 7 IEEE Access https://doi.org/10.1109/ACCESS.2019.2948091 db/journals/access/access7.html#LiangFSLZQZL19

Guannan Qu Dave Brown Na Li 0002 Distributed greedy algorithm for multi-agent task assignment problem with submodular utility functions. 206-215 2019 105 Autom. https://doi.org/10.1016/j.automatica.2019.03.007 https://www.wikidata.org/entity/Q128055408 db/journals/automatica/automatica105.html#QuBL19

Guannan Qu Na Li 0002 On the Exponential Stability of Primal-Dual Gradient Dynamics. 43-48 2019 3 IEEE Control. Syst. Lett. 1 https://doi.org/10.1109/LCSYS.2018.2851375 https://www.wikidata.org/entity/Q115534953 db/journals/csysl/csysl3.html#QuL19

Sindri Magnússon Guannan Qu Carlo Fischione Na Li 0002 Voltage Control Using Limited Communication. 993-1003 2019 6 IEEE Trans. Control. Netw. Syst. 3 https://doi.org/10.1109/TCNS.2019.2905091 db/journals/tcns/tcns6.html#MagnussonQF019

Xiaoqi Tan Guannan Qu Bo Sun 0004 Na Li 0002 Danny H. K. Tsang Optimal Scheduling of Battery Charging Station Serving Electric Vehicles Based on Battery Swapping. 1372-1384 2019 10 IEEE Trans. Smart Grid 2 https://doi.org/10.1109/TSG.2017.2764484 db/journals/tsg/tsg10.html#TanQSLT19

Sindri Magnússon Guannan Qu Na Li 0002 Distributed Voltage Control with Communication Delays. 3895-3900 2019 ACC https://doi.org/10.23919/ACC.2019.8815181 conf/amcc/2019 db/conf/amcc/acc2019.html#MagnussonQ019 Guannan Qu Na Li 0002 Exploiting Fast Decaying and Locality in Multi-Agent MDP with Tree Dependence Structure. 6479-6486 2019 CDC https://doi.org/10.1109/CDC40024.2019.9029635 conf/cdc/2019 db/conf/cdc/cdc2019.html#Qu019

Sindri Magnússon Guannan Qu Na Li 0002 Distributed Voltage Control with Communication Delays. 2019 abs/1903.01065 CoRR http://arxiv.org/abs/1903.01065 db/journals/corr/corr1903.html#abs-1903-01065

Yujie Tang 0002 Guannan Qu Na Li 0002 Semi-Global Exponential Stability of Primal-Dual Gradient Dynamics for Constrained Convex Optimization. 2019 abs/1903.09580 CoRR http://arxiv.org/abs/1903.09580 db/journals/corr/corr1903.html#abs-1903-09580

Guannan Qu Na Li 0002 Exploiting Fast Decaying and Locality in Multi-Agent MDP with Tree Dependence Structure. 2019 abs/1909.06900 CoRR http://arxiv.org/abs/1909.06900 db/journals/corr/corr1909.html#abs-1909-06900

Guannan Qu Adam Wierman Na Li 0002 Scalable Reinforcement Learning of Localized Policies for Multi-Agent Networked Systems. 2019 abs/1912.02906 CoRR http://arxiv.org/abs/1912.02906 db/journals/corr/corr1912.html#abs-1912-02906

Shuaibing Lu Zhiyi Fang Jie Wu 0001 Guannan Qu Elastic Scheduling for Scaling Virtual Clusters in Cloud Data Center Networks. 13632-13643 2018 6 IEEE Access https://doi.org/10.1109/ACCESS.2018.2814565 https://www.wikidata.org/entity/Q130183995 db/journals/access/access6.html#LuFWQ18

Guannan Qu Na Li 0002 Harnessing Smoothness to Accelerate Distributed Optimization. 1245-1260 2018 5 IEEE Trans. Control. Netw. Syst. 3 https://doi.org/10.1109/TCNS.2017.2698261 db/journals/tcns/tcns5.html#QuL18

Yingying Li 0005 Guannan Qu Na Li 0002 Using Predictions in Online Optimization with Switching Costs: A Fast Algorithm and A Fundamental Limit. 3008-3013 2018 ACC https://doi.org/10.23919/ACC.2018.8431296 conf/amcc/2018 db/conf/amcc/acc2018.html#LiQL18

Jie Cao 0005 Zhiyi Fang Guannan Qu Hongyu Sun 0005 Dan Zhang An accurate traffic classification model based on support vector machines. 2017 27 Int. J. Netw. Manag. 1 https://doi.org/10.1002/nem.1962 db/journals/ijnm/ijnm27.html#CaoFQSZ17

Guannan Qu Na Li 0002 Accelerated distributed Nesterov Gradient Descent for convex and smooth functions. 2260-2267 2017 CDC https://doi.org/10.1109/CDC.2017.8263979 conf/cdc/2017 db/conf/cdc/cdc2017.html#QuL17 Jianfei Zhang 0001 Weiwu Ren Guannan Qu An Improved Interconnection Network for Data Center Based on BCube Structure. 601-607 2017 GSKI (1) https://doi.org/10.1007/978-981-13-0893-2_62 conf/gski/2017-1 db/conf/gski/gski2017-1.html#ZhangRQ17 Jianfei Zhang 0001 Weiwu Ren Guannan Qu Constructing Algorithm of MLMS Data Center Network. 629-636 2017 GSKI (1) https://doi.org/10.1007/978-981-13-0893-2_65 conf/gski/2017-1 db/conf/gski/gski2017-1.html#ZhangRQ17a Shuaibing Lu Zhiyi Fang Jie Wu 0001 Guannan Qu Elastic scaling of virtual clusters in cloud data center networks. 1-8 2017 IPCCC https://doi.org/10.1109/PCCC.2017.8280437 https://doi.ieeecomputersociety.org/10.1109/PCCC.2017.8280437 conf/ipccc/2017 db/conf/ipccc/ipccc2017.html#LuFWQ17 Guannan Qu Na Li 0002 Accelerated Distributed Nesterov Gradient Descent for smooth and strongly convex functions. 209-216 2016 Allerton https://doi.org/10.1109/ALLERTON.2016.7852231 conf/allerton/2016 db/conf/allerton/allerton2016.html#QuL16 Guannan Qu Na Li 0002 Harnessing smoothness to accelerate distributed optimization. 159-166 2016 CDC https://doi.org/10.1109/CDC.2016.7798263 conf/cdc/2016 db/conf/cdc/cdc2016.html#QuL16

Zhiyi Fang Shuaibing Lu Guannan Qu Jianfei Zhang 0001 S. Q. Zheng 0001 Implementing High Throughput Contention-Tolerant Crossbar Switch. 791-796 2015 10 J. Commun. 10 https://doi.org/10.12720/jcm.10.10.791-796 db/journals/jcm/jcm10.html#FangLQZZ15

Jie Cao 0005 Zhiyi Fang Dan Zhang Guannan Qu Network Traffic Classification Using Feature Selection and Parameter Optimization. 828-835 2015 10 J. Commun. 10 https://doi.org/10.12720/jcm.10.10.828-835 db/journals/jcm/jcm10.html#CaoFZQ15

Guannan Qu Zhiyi Fang Jianfei Zhang 0001 Si-Qing Zheng Switch-Centric Data Center Network Structures Based on Hypergraphs and Combinatorial Block Designs. 1154-1164 2015 26 IEEE Trans. Parallel Distributed Syst. 4 https://doi.org/10.1109/TPDS.2014.2318697 http://doi.ieeecomputersociety.org/10.1109/TPDS.2014.2318697 db/journals/tpds/tpds26.html#QuFZZ15

Shuaibing Lu Zhiyi Fang Guannan Qu Song Gao 0003 ETBAC-Based Model in Media Oriented System Transport Network. 504-511 2015 CIT/IUCC/DASC/PICom https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.72 conf/IEEEcit/2015 db/conf/IEEEcit/cit-iucc-dasc-picom2015.html#LuFQG15 Na Li 0002 Guannan Qu Munther A. Dahleh Real-time decentralized voltage control in distribution networks. 582-588 2014 Allerton https://doi.org/10.1109/ALLERTON.2014.7028508 conf/allerton/2014 db/conf/allerton/allerton2014.html#LiQD14

Hyung Jae Chang Guannan Qu S. Q. Zheng 0001 A high-performance switch architecture based on mesh of trees. 1543-1561 2013 26 Int. J. Commun. Syst. 12 https://doi.org/10.1002/dac.2328 db/journals/ijcomsys/ijcomsys26.html#ChangQZ13

Jianfei Zhang 0001 Zhiyi Fang Guannan Qu Si-Qing Zheng A new class of data center network structures. 2852-2858 2013 GLOBECOM https://doi.org/10.1109/GLOCOM.2013.6831507 conf/globecom/2013 db/conf/globecom/globecom2013.html#ZhangFQZ13 Jie Mei Siming Yan Guannan Qu Dawei He Thomas G. Habetler Design considerations for non-intrusive load monitoring hardware platforms in smart building. 1-6 2013 IAS https://doi.org/10.1109/IAS.2013.6682581 conf/iasam/2013 db/conf/iasam/iasam2013.html#MeiYQHH13 Guannan Qu Jie Mei Dawei He Short-term wind power forecasting based on numerical weather prediction adjustment. 453-457 2013 INDIN https://doi.org/10.1109/INDIN.2013.6622927 conf/indin/2013 db/conf/indin/indin2013.html#QuMH13

Guannan Qu Hyung Jae Chang Jianping Wang 0001 Zhiyi Fang S. Q. Zheng 0001 Contention-tolerant crossbar packet switches. 168-184 2011 24 Int. J. Commun. Syst. 2 https://doi.org/10.1002/dac.1147 db/journals/ijcomsys/ijcomsys24.html#QuCWFZ11

Guannan Qu Hyung Jae Chang Jianping Wang 0001 Zhiyi Fang Si-Qing Zheng Queueing Analysis of Multi-Layer Contention-Tolerant Crossbar Switch. 972-974 2010 14 IEEE Commun. Lett. 10 https://doi.org/10.1109/LCOMM.2010.081910.100036 db/journals/icl/icl14.html#QuCWFZ10

Hyung Jae Chang Guannan Qu Jianping Wang 0001 S. Q. Zheng 0001 Making Contention-Tolerant Crossbar Switch Scalable. 1-6 2010 GLOBECOM https://doi.org/10.1109/GLOCOM.2010.5684327 conf/globecom/2010 db/conf/globecom/globecom2010.html#ChangQWZ10 Guannan Qu Hyung Jae Chang Jianping Wang 0001 Zhiyi Fang Si-Qing Zheng Designing fully distributed scheduling algorithms for contention-tolerant crossbar switches. 69-74 2010 HPSR https://doi.org/10.1109/HPSR.2010.5580265 conf/hpsr/2010 db/conf/hpsr/hpsr2010.html#QuCWFZ10 Guannan Qu Hyung Jae Chang Jianping Wang 0001 Zhiyi Fang S. Q. Zheng 0001 Contention-Tolerant Crossbar Packet Switches without and with Speedup. 1-6 2010 ICC https://doi.org/10.1109/ICC.2010.5502013 conf/icc/2010 db/conf/icc/icc2010.html#QuCWFZ10 Yanping Wang Bo Sun Guannan Qu CSCW-based supply chain performance analysis system. 526-529 2010 NCM https://ieeexplore.ieee.org/document/5572421/ conf/ncm/2010 db/conf/ncm/ncm2010.html#WangSQ10 Xiaonan Liu Zhiyi Fang Guannan Qu Hongjun Yang Tong Pan A Framework of Agent-Based Collaborative Intelligent Transport System. 424-428 2007 CSCWD https://doi.org/10.1109/CSCWD.2007.4281473 conf/cscwd/2007 db/conf/cscwd/cscwd2007.html#LiuFQYP07 Guannan Qu Zhiyi Fang Chao Zhang A Framework of Agent-Based Supply Chain Performance Analysis System. 57-66 2006 BASYS https://doi.org/10.1007/978-0-387-36594-7_7 conf/ifip5-3/2006 db/conf/ifip5-3/basys2006.html#QuFZ06 Emile Anand Anima Anandkumar Giri Anantharaman Mihai Anitescu Baris Askin Kamyar Azizzadenesheli Mario BergesMario Bergés Reetam Sen Biswas Nicholas Boffi Dave Brown Jie Cao 0005 Hyung Jae Chang Spyros Chatzivasileiadis Bingqing Chen Jin Chen Xin Chen 0036 Zaiwei Chen Yuejie Chi Munther A. Dahleh Xiyu Deng Alex DeWeese Tom Erez Chuchu Fan Linxi Fan Zhiyi Fang Jie Feng 0006 Carlo Fischione Judy Gan Jiawei Gao Song Gao 0003 Thomas G. Habetler Dawei He Guanqi He Tairan He Jessica K. Hodgins Bryan Hooi Taylor A. Howell Jueming Hu Yang Hu Longbo Huang Nai-Chieh Huang Neharika Jali Suhanya Jayaprakasam Zhiqi Jiang Claire Jin Carlee Joe-Wong Gauri Joshi Yashodhan KanoriaYash Kanoria Soummya Kar Ishani Karmarkar Kevin J. Kircher Kris Makoto KitaniKris Kitani Sahin Lale Victor C. M. Leung Jiahui Li 0002 Na Li 0002 Shimiao Li Tongxin Li 0001 Yingying Li 0005 Shuang Liang 0003 Yiheng Lin 0001 Changliu Liu Chenbang Liu Xiaonan Liu Yanheng Liu 0001 Yongming Liu Steven H. Low Shuaibing Lu Zhengyi Luo 0002 Qinghua Ma Sindri Magnússon Zachary Manchester Jie Mei Ozan Baris Mulayim Yorie Nakahira Dusit Niyato Denis Osipov Chaoyi Pan Tong Pan Yutian Pang Niloy Patari Eshika Pathak Elias PergantisElias N. Pergantis Frank Permenter Daniel Pfrommer Lawrence T. Pileggi Levi D. Reyes Premer Weiwu Ren Vyas Sekar Pranay Sharma Junxuan Shen Guanya Shi Yuanyuan Shi Sungho Shin Max Simchowitz Vidur Sinha Nikhil Sobanbab Anurag Srivastava 0001Anurag K. Srivastava 0001 Bo Sun Bo Sun 0004 Geng Sun 0001 Haoyuan Sun Hongyu Sun 0005 Xiaoqi Tan Yujie Tang 0002 Yuval Tassa Danny H. K. Tsang Muhammed Ustaomeroglu Andreas Venzke Jiacheng Wang 0001 Jianping Wang 0001 Jiashun Wang Luyao Wang Weichang Wang Weina Wang 0001 Yanping Wang Zi Wang Adam Wierman Jie Wu 0001 Wenli Xiao Yumeng Xiu Eric Xu Han Xu Pan Xu 0002 Xingyu Xu 0001 Zhe Xu 0005 Haoru Xue Siming Yan Hongjun Yang Ruixiao Yang Zeji Yi Chenkai Yu Chenyang Yuan 0001 Chao Zhang Dan Zhang Jianfei Zhang 0001 John Z. Zhang Songyuan Zhang Ying Zhang 0007 Yizhou Zhang Yuanhang Zhang Ziyi Zhang Changyuan Zhao Xiaohui Zhao 0004 Jialin Zheng Si-Qing ZhengS. Q. Zheng 0001 Yuke Zhu