Computer Science · AI Planning & Decision-Making

Learning-guided planning for intelligent agents.

Sequential Decision-Making · Reinforcement Learning · Multi-Agent Planning

I am an M.S. graduate in Computer Science and Engineering from National Chung Hsing University, Taiwan, advised by Prof. Pi-Chung Wang. My research focuses on learning-guided planning: using learned policies and value functions to make explicit search effective in large, state-dependent action spaces. I use mobile charging and resource-allocation problems as structured testbeds for studying planning under computational budgets, hierarchical decisions, and generalization across problem instances.

My current research is moving toward coordinated multi-agent planning. For my PhD, I want to study how agents can learn internal representations and world models for abstraction, reasoning about possible futures, and long-horizon planning under uncertainty. My broader goal is to develop agents that use these capabilities flexibly across tasks. I am applying to PhD programs for Fall 2027.

Liang-Ching Tao standing beside a river.

Selected research

01

Ongoing · Sep. 2026–present

Learning-Guided Search for Multi-Agent Planning

I am extending LP-BTS to coordinated multi-agent planning, using multi-charger scheduling as a structured testbed. The central question is how learned proposal policies and structured action representations can make search over interacting agents’ decisions tractable. Current work focuses on representing compatible joint actions, reducing the candidate space, and allocating limited search budgets to evaluate future interactions.

02

arXiv preprint · Sep. 2026

Learning-Guided Planning in Large Dynamic Action Spaces: Budgeted Tree Search for One-to-Many Mobile Charging

LP-BTS studies planning when the available actions are numerous, structured, and rebuilt as the state changes. A graph proposal policy first scores candidate stops and narrows search to a small set of candidate actions. A learned value critic estimates the promise of partial plans, and budgeted PUCT—a tree-search rule with a fixed simulation budget—compares simulated action sequences before an action is chosen. Mobile charging is the current testbed for the broader question: how can learning focus limited computation while explicit search evaluates future consequences?

Matched RL comparison: against a trained, source-derived deep reinforcement learning baseline, LP-BTS improves survival by 12.29 percentage points and alive-AUC by 4.60 percentage points, while reducing travel distance by 53.9% (53,015 m vs. 114,933 m).Sealed 30-scenario evaluation. The trained comparator is reconstructed from its source method under the paper’s common-physics protocol.

Three-step schematic. Step one: candidate charging stops induced by the geometry of the live sensors. Step two: the graph policy narrows them to thirty-two sampled stops. Step three: budgeted tree search commits one stop, whose charging radius covers the recipient set the charger then serves.
One LP-BTS decision, schematic. Candidate stops are recomputed from the live sensor geometry, the learned policy samples a small planning support, and budgeted search commits a single stop. Full definitions in the preprint ↗
03

Master’s thesis · arXiv preprint · 2025–2026

HQARRF: Hierarchical Q-learning and Force-aware Routing for Multi-Charger Scheduling

HQARRF uses multi-charger scheduling as a testbed for hierarchical coordination. A gated Q-learning upper level redirects service toward high-risk, under-served regions, while a force-aware lower-level ranker handles local routing and charging decisions—separating strategic allocation from fast structured action selection.

Robustness across 27 settings: HQARRF achieves the highest mean survival in 26 of 27 evaluated parameter settings. Across the grid, it improves survival by an average of 20.7 percentage points over the mean of five baselines and by an average of 9.2 percentage points over the strongest baseline at each setting.Averages are computed across the paper’s 27-parameter evaluation grid.

Top-down schematic after Fig. 1 of the paper: sensors grouped into candidate clusters with docking points, a base station at the centre, chargers at their selected clusters, and one charger redirected by the upper level toward an under-served region.
The t = 0 deployment of Fig. 1 of the paper, restyled for the site. Decisions are made over docking points: the lower level ranks them with the ARR-F score; the upper level can redirect a charger to an under-served zone.

Papers and presentations

I am the first author of all works listed below. Status labels distinguish public preprints, accepted oral/poster presentations, and previously presented work. One-page conference abstracts are linked where available; full manuscripts are available on request where permitted.

  1. PreprintarXiv · Sep. 2026

    “Learning-Guided Planning in Large Dynamic Action Spaces: Budgeted Tree Search for One-to-Many Mobile Charging”

    Liang-Ching Tao, Pi-Chung Wang

    arXiv:2609.17429 · Machine Learning / Artificial Intelligence

    Three-step schematic. Step one: candidate charging stops induced by the geometry of the live sensors. Step two: the graph policy narrows them to thirty-two sampled stops. Step three: budgeted tree search commits one stop, whose charging radius covers the recipient set the charger then serves.
    One LP-BTS decision: a learned graph policy narrows a dynamic candidate set, then budgeted search compares simulated action sequences before committing a charging stop.
  2. PreprintPosterarXiv · MAMM 2026

    “HQARRF: Hierarchical Q-learning and Force-aware Routing for Multi-Charger Scheduling in Wireless Rechargeable Sensor Networks”

    Liang-Ching Tao, Pi-Chung Wang

    arXiv:2609.13901 · accepted for poster presentation at MAMM 2026 · Sun Moon Lake, Taiwan · Nov. 5–7, 2026

    Top-down schematic after Fig. 1 of the paper: candidate clusters with docking points, chargers at their selected clusters, and one charger redirected toward an under-served region.
    The hierarchical scheduler separates regional redirection from local action ranking.
  3. OralAccepted for oral presentation

    “Adaptive Charging Threshold and Detour Scheduling for Wireless Rechargeable Sensor Networks via Deep Reinforcement Learning”

    Liang-Ching Tao, Wei-Cheng Tai, Pi-Chung Wang

    MAMM 2026 · Sun Moon Lake, Taiwan · Nov. 5–7, 2026

    Two panels. Left, the system model of Fig. 1 of the paper: clusters reporting to a central base station over a multi-hop tree, with one charger idle, one departing for target cluster A, and one charging. Right, the detour decision of Fig. 2: a corridor around the direct path, candidate cluster B inside it with state of charge below its threshold, and a cluster outside the corridor that is never a candidate.
    A threshold agent adjusts request timing while a route agent chooses between direct travel and a constrained detour.

    Accepted for oral presentation at MAMM 2026. An extended journal version is in preparation; full manuscript available on request.

  4. PosterAccepted for poster presentation

    “DTSC: A Dual-Tier Sector-Based Cooperative Mobile Charging Scheme for Wireless Rechargeable Sensor Networks”

    Liang-Ching Tao, Po-Cheng Fu, Pi-Chung Wang

    MAMM 2026 · Sun Moon Lake, Taiwan · Nov. 5–7, 2026

    Schematic after Fig. 1 of the paper: one consumption-balanced sector split into an inner and an outer tier; the inner charger tours its anchors and returns to the base station, the outer charger tours the outer anchors and is refuelled by contact at a rendezvous point on the tier boundary.
    A two-tier charging architecture coordinates inner and outer service routes through a rendezvous point.

    Accepted for poster presentation at MAMM 2026. An extended journal version is in preparation; full manuscript available on request.

  5. PosterAccepted for poster presentation

    “CHASE: A Corridor-Heuristic Charging Scheduler for Ground and Aerial Vehicles in Wireless Rechargeable Sensor Networks”

    Liang-Ching Tao, Wei-Chen Lin, Pi-Chung Wang

    MAMM 2026 · Sun Moon Lake, Taiwan · Nov. 5–7, 2026

    Schematic after Figs. 1 to 3 of the paper: a circular field cut into load-balanced clusters with one ground vehicle each, an inner zone served by base-anchored UAVs, one vehicle leg toward the most urgent request with its corridor, and a carried UAV released to a peripheral node and recovered at a rendezvous on the path.
    Ground-vehicle routing is coupled with corridor-based opportunistic service and carried-UAV missions.

    Accepted for poster presentation at MAMM 2026. An extended journal version is in preparation; full manuscript available on request.

  6. PresentedPoster presented, Aug. 2026

    “A Hierarchical Q-learning and Force-aware Routing Approach for Multi-Charger Scheduling in Wireless Rechargeable Sensor Networks” (in Chinese)

    一種結合階層式 Q 學習與力場感知路由之無線可充電感測網路多充電車排程方法

    Liang-Ching Tao, Pi-Chung Wang

    2026 MC&WASN Conference · National Chung Hsing University, Taiwan · Aug. 24–25, 2026

From structured decision-making to learning internal models for planning.

  1. 01Completed foundationStructured decisions

    Coupled routing, charging, and allocation as a testbed for sequential decision-making.

  2. 02Completed workHierarchical decision-making

    Strategic reinforcement learning with electrostatic-inspired, force-aware routing for local decisions.

  3. 03Completed workLearning-guided search

    Policy- and value-guided budgeted PUCT in large dynamic action spaces.

  4. 04Ongoing extensionCoordinated multi-agent planning

    Tractable search over interacting decisions, using multi-charger scheduling as the current testbed.

  5. 05PhD directionLearning internal models for planning

    Toward learned world models, state/action abstractions, and long-horizon decision-making under uncertainty.

Research perspective

Completed work. LP-BTS asks how a planner can reason ahead when its available actions are numerous and change with the state. Its graph policy identifies promising candidates, its learned value critic evaluates partial futures, and budgeted search compares those futures before commitment. This work examines how learned policies and value estimates can focus limited search on promising actions in large, state-dependent action spaces.

Ongoing work. I am extending this framework toward coordinated multi-agent planning with several chargers. The immediate questions are how to represent compatible choices consistently, reduce the number of choices worth searching, and allocate a limited lookahead budget over their future interactions.

PhD direction. I want to study how agents can learn internal representations and world models that support abstraction, reasoning about possible futures, and long-horizon decision-making. I am particularly interested in how these learned models can support hierarchical planning: decomposing goals, evaluating alternative courses of action, and revising plans as new information becomes available. My longer-term aim is to develop agents that can use these capabilities flexibly across tasks and coordinate with other agents under uncertainty.