I am lost! Where is the line? A Bug's Life, Walt Disney (1998). research
@ MapleCG
Go to the ant, thou sluggard; consider her ways, and be wise: Which having no guide, overseer, or ruler, Provideth 
her meat in the summer, and gathereth her food in the harvest. Proverbs 6:6-8. _____
papers
_____
It may be that. You never can tell with bees. Winnie the Pooh by A.A. Milne (1926). -->
cfp
| aug 1, 2011 |
OASIS-TAOSF-RI-CMU [ homee ] * foto * teach +++
MapleCG
= {member}
OASIS, TAOSF, RI, CMU | cv || K10-PROSPECT-RI-CMU LOW, BRYAN KIAN HSIANG |劉謙雄|
Assistant Professor > CS > NUS
Ph.D. > ECE ◊ RI > CMU
MapleCG > CS > NUS
lowkhATcompDOTnusDOTeduDOTsg


@
research
MapleCG
Multi-Agent Planning, Learning, and Coordination Group (MapleCG)

_____| c     u     r     r     e     n     t |____________
+ Environmental Boundary Tracking & Estimation with Multiple Robots
(Collaborators: John M. Dolan, CMU; Steve Chien, JPL, Caltech)
+ Human-Robot Teams for Sensing Indoor Environmental Quality
+ Decision-Theoretic Planning under Uncertainty for
Active Multi-Camera Surveillance
+ SMART: Future Urban Mobility
(MIT Collaborators: Daniela Rus, Emilio Frazzoli, Patrick Jaillet)
+ Active Markov-Based Robotic Exploration & Mapping for Environmental Sensing

_______________| p     a     s     t |________
+ Multi-Robot Adaptive Sampling for
Environmental Sensing & Monitoring
+ Distributed Layered Architecture for
Self-Organizing Mobile Sensor Networks
+ Action Selection Mechanism for Multi-Robot Tasks
+ Integrated Robot Planning and Control

ACTIVE MARKOV-BASED ROBOTIC EXPLORATION & MAPPING FOR ENVIRONMENTAL SENSING

PROJECT DURATION : Jan 2010 - Present

PROJECT AFFILIATION : Collaborative Multi-Robot Exploration of the Coastal Ocean (Collaborators: John M. Dolan, CMU; Gaurav S. Sukhatme, USC; Kanna Rajan, MBARI)

PROBLEM MOTIVATION
Research in multi-robot exploration and mapping has recently progressed from building occupancy grids to sampling spatially varying environmental fields (e.g., plankton density, pollutant concentration, temperature fields) that are characterized by continuous-valued, spatially correlated measurements. Exploration strategies for building occupancy grid maps usually operate under the assumptions of (a) discrete, (b) independent cell occupancies, which impose, respectively, the following limitations for learning environmental field maps: these strategies (a) cannot be fully informed by the continuous field measurements and (b) cannot exploit the spatial correlation structure of an environmental field for selecting observation paths. As a result, occupancy grid mapping strategies are not capable of selecting the most informative observation paths for learning an environmental field map.
Furthermore, occupancy grid mapping strategies typically assume that range sensing is available. In contrast, many in situ environmental sensing applications permit only point-based sensing, thus making a high-resolution sampling of the entire field impractical in terms of resource costs (e.g., energy consumption, mission time). In practice, the resource cost constraints restrict the spatial coverage of the observation paths. Fortunately, the spatial correlation structure of an environmental field enables a map of the field (in particular, its unobserved areas) to be learned using the point-based observations taken along the resource-constrained paths. To learn this map, the field is represented using a rich class of Bayesian non-parametric models called the Gaussian process (GP). More importantly, the GP model allows an environmental field to be formally characterized and consequently provides formal measures of mapping uncertainty (e.g., based on mean-squared error [AAMAS-08] or entropy [ICAPS-09]) for directing a robot team to explore highly uncertain areas of the field.
How then does a robot team plan the most informative resource-constrained observation paths to minimize the mapping uncertainty of an environmental field? To address this, our ICAPS-09 work has proposed an information-theoretic multi-robot exploration strategy that selects non-myopic observation paths with maximum entropy. When this strategy is applied to sampling a GP-based field, it can be reduced to solving a non-Markovian, deterministic planning problem called the information-theoretic multi-robot adaptive sampling problem (iMASP). Due to the non-Markovian problem structure of iMASP, its state size grows exponentially with the length of planning horizon. To alleviate this computational difficulty, it can be solved approximately using an anytime heuristic search algorithm called Learning Real-Time A* or a greedy algorithm (i.e., by solving the myopic formulation of iMASP). However, they inherit iMASP's non-Markovian problem structure and consequently scale poorly with the length of history of observations. Hence, it becomes computationally impractical to use these non-Markovian path planning algorithms for in situ, real-time active sampling.

PROPOSED METHODOLOGY
To ease this computational burden, this work proposes a principled Markov-based approach to efficient information-theoretic path planning for active sampling of GP-based environmental fields, which we develop by assuming the Markov property in iMASP planning. To the probabilistic robotics community, such a move to achieve time efficiency is probably anticipated. However, the Markov property is often imposed without carefully considering or formally analyzing its consequence on the performance degradation while operating in non-Markovian environments. In particular, to what extent does the environmental field structure affect the performance degradation due to violation of the Markov assumption? Motivated by this lack of treatment, this work is novel in demonstrating both theoretically and empirically the extent of which the degradation of active sampling performance depends on the spatial correlation structure of an environmental field. An important practical consequence is that of establishing environmental field conditions under which the Markov-based approach performs well relative to the non-Markovian iMASP-based policy while enjoying significant computational gain over it.

PUBLICATIONS
  1. Active Markov Information-Theoretic Path Planning for Robotic Environmental Sensing.
    Kian Hsiang Low, John M. Dolan & Pradeep Khosla.
    In Proceedings of the 10th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS-11), pages 753-760, Taipei, Taiwan, May 2-6, 2011.
    [ 22.1% acceptance rate, Extended version with proofs ]

TAOSF


PROSPECT
MULTI-ROBOT ADAPTIVE SAMPLING FOR ENVIRONMENTAL SENSING & MONITORING

PROJECT DURATION : Jul 2005 - Mar 2010

PROJECT LAB : T-SAR

PROBLEM MOTIVATION
Recent research in multi-robot exploration and mapping has focused on sampling environmental fields, some of which typically feature a few small hotspots in a large region. Such a hotspot field often arises in two real-world applications: (1) planetary exploration such as geologic reconnaissance and prospecting for mineral deposits or natural gases, and (2) environment and ecological sensing such as precision agriculture, and monitoring of ocean phenomena (e.g., plankton bloom, anoxic zones), forest ecosystems, rare species, pollution (e.g., oil spill), or contamination (e.g., radiation leak). In particular, the hotspot field is characterized by continuous-valued, spatially correlated measurements with the hotspots exhibiting extreme measurements and much higher spatial variability than the rest of the field. With limited (e.g., point-based) robot sensing range, a complete coverage becomes impractical in terms of resource costs (e.g., resource consumption). So, to accurately map the field, the hotspots have to be sampled at a higher resolution.
The hotspot field discourages static sensor placement because a large number of sensors has to be positioned to detect and refine the sampling of hotspots. If these static sensors are not placed in any hotspot initially, they cannot reposition by themselves to locate one. In contrast, a robot team is capable of performing high-resolution hotspot sampling due to its mobility. Hence, it is desirable to build a mobile robot team that can actively explore to map a hotspot field.

PROPOSED METHODOLOGY
To learn a hotspot field map, the exploration strategy of the robot team has to plan the most informative resource-constrained observation paths that minimize the uncertainty of mapping the hotspot field. By representing the hotspot field using rich classes of Bayesian non-parametric models such as the Gaussian process or log-Gaussian process, formal measures of mapping uncertainty (e.g., based on mean-squared error [AAMAS-08] or entropy [ICAPS-09] criterion) can be defined and subsequently exploited by our proposed adaptive sampling algorithms for directing the robot team to explore highly uncertain areas of the field. In contrast to non-adaptive sampling strategies that only perform well with smoothly-varying fields, our non-myopic adaptive sampling algorithms can exploit clustering phenomena (i.e., hotspots) to plan observation paths that produce lower mapping uncertainty.

PUBLICATIONS
  1. Telesupervised Remote Surface Water Quality Sensing.
    Gregg Podnar, John M. Dolan, Kian Hsiang Low & Alberto Elfes.
    In Proceedings of the IEEE Aerospace Conference, Big Sky, MT, Mar 6-13, 2010.

  2. Multi-Robot Adaptive Exploration and Mapping for Environmental Sensing Applications.
    Kian Hsiang Low.
    Ph.D. Thesis, Technical Report CMU-ECE-2009-024, Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, Aug 2009.

  3. Information-Theoretic Approach to Efficient Adaptive Path Planning for Mobile Robotic Environmental Sensing.
    Kian Hsiang Low, John M. Dolan & Pradeep Khosla.
    In Proceedings of the 19th International Conference on Automated Planning and Scheduling (ICAPS-09), pages 233-240, Thessaloniki, Greece, Sep 19-23, 2009.
    [ 33.9% acceptance rate, Extended version with proofs ]
    Also appeared in IPSN-09 Workshop on Sensor Networks for Earth and Space Science Applications (ESSA-09), San Francisco, CA, Apr 16, 2009.
    Also orally presented in RSS-09 Workshop on Aquatic Robots and Ocean Sampling, Seattle, WA, Jun 29, 2009.

  4. Cooperative Aquatic Sensing using the Telesupervised Adaptive Ocean Sensor Fleet.
    John M. Dolan, Gregg W. Podnar, Stephen Stancliff, Kian Hsiang Low, Alberto Elfes, John Higinbotham, Jeffrey C. Hosler, Tiffany A. Moisan & John Moisan.
    In Proceedings of the SPIE Conference on Remote Sensing of the Ocean, Sea Ice, and Large Water Regions, volume 7473, Berlin, Germany, Aug 31 - Sep 3, 2009.

  5. Robot Boats as a Mobile Aquatic Sensor Network.
    Kian Hsiang Low, Gregg Podnar, Stephen Stancliff, John M. Dolan & Alberto Elfes.
    In Proceedings of the IPSN-09 Workshop on Sensor Networks for Earth and Space Science Applications (ESSA-09), San Francisco, CA, Apr 16, 2009.

  6. Adaptive Multi-Robot Wide-Area Exploration And Mapping.
    Kian Hsiang Low, John M. Dolan & Pradeep Khosla.
    In Proceedings of the 7th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS-08), pages 23-30, Estoril, Portugal, May 12-16, 2008.
    [ 22.2% acceptance rate ]
    Also presented as a poster in RSS-09 Workshop on Aquatic Robots and Ocean Sampling, Seattle, WA, Jun 29, 2009.

  7. Adaptive Sampling for Multi-Robot Wide-Area Exploration.
    Kian Hsiang Low, Geoffrey J. Gordon, John M. Dolan & Pradeep Khosla.
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'07), pages 755-760, Rome, Italy, Apr 10-14, 2007.

  8. Adaptive Sampling for Multi-Robot Wide Area Prospecting.
    Kian Hsiang Low, Geoffrey J. Gordon, John M. Dolan, and Pradeep Khosla.
    In Technical Report CMU-RI-TR-05-51, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, Oct 2005.
VIDEOS
  1. Adaptive cluster sampling (5.33MB)

  2. Simple random sampling (6.65MB)

  3. Raster scanning (13.5MB)
DISTRIBUTED LAYERED ARCHITECTURE FOR
SELF-ORGANIZING MOBILE SENSOR NETWORKS


PROJECT DURATION : Nov 2002 - Jun 2005

PROBLEM MOTIVATION
One of the fundamental issues that arises in a sensor network is coverage. Traditionally, network coverage is maximized by determining the optimal placement of static sensors in a centralized manner, which can be related to the class of art gallery problems. However, recent investigations in sensor network mobility reveal that mobile sensors can self-organize to provide better coverage than static placement. Existing applications have only utilized uninformed mobility (i.e., random motion or patrol). In contrast, our work here focuses on informed, intelligent mobility to further improve coverage. Our network coverage problem is motivated by the following constraints that discourage static sensor placement or uninformed mobility: (a) no prior information about the exact target locations, population densities or motion pattern, (b) limited sensory range, and (c) very large area to be observed. All these conditions may cause the sensors to be unable to cover the entire region of interest. Hence, fixed sensor locations or uninformed mobility will not be adequate in general. Rather, the sensors have to move dynamically in response to the motion and distribution of targets and other sensors to maximize coverage. Inspired by robotics, the above problem may be regarded as that of low-level motion control to coordinate the sensors' target tracking movements in the continuous workspace. Alternatively, it can be cast as a high-level task allocation problem by segmenting the workspace into discrete regions such that each region is assigned a group or coalition of sensors to track the targets within.

PROPOSED METHODOLOGY
This work presents a reactive layered multi-robot architecture for distributed mobile sensor network coverage in complex, dynamic environments. At the lower layer, each robot uses a reactive motion control strategy known as Cooperative Extended Kohonen Maps to coordinate their target tracking within a region without the need of communication. This strategy is also responsible for obstacle avoidance, robot separation to minimize task interference, and navigation between regions via beacons or checkpoints plotted by a motion planner. At the higher layer, the robots use a dynamic ant-based task allocation scheme to cooperatively self-organize their coalitions in a decentralized manner according to the target distributions across the regions. This scheme addresses the following issues, which distinguish it from the other task allocation mechanisms:
Task Allocation for Multi-Robot Tasks: Existing algorithms (e.g., auction-and behavior-based) assume a multi-robot task can be partitioned into single-robot tasks. But this may not be always possible or the multi-robot task can be more efficiently performed by coalitions of robots.
Coalition Formation for Minimalist Robots: Existing coalition formation schemes require complex planning, explicit negotiation, and precise estimation of coalitional cost. Hence, they do not perform well in dynamic, real-time scenarios.
Cooperation of Resource-Limited Robots: Robots with limited communication and sensing capabilities (i.e., partial observability) can only obtain local, uncertain information of the dynamic environment. With limited computational power, their cooperative strategies cannot involve complex planning or negotiations.

PUBLICATIONS
  1. Autonomic Mobile Sensor Network with Self-Coordinated Task Allocation and Execution.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews (Special Issue on Engineering Autonomic Systems), volume 36, issue 3, pages 315-327, May 2006.
    [ Andrew P. Sage Best Transactions Paper Award for the best paper published in IEEE Trans. SMC - Part A, B, and C in 2006 ]

  2. Task Allocation via Self-Organizing Swarm Coalitions in Distributed Mobile Sensor Network.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the 19th National Conference on Artificial Intelligence (AAAI-04), pages 28-33, San Jose, CA, Jul 25-29, 2004.
    [ 26.7% acceptance rate ]

  3. Reactive, Distributed Layered Architecture for Resource-Bounded Multi-Robot Cooperation: Application to Mobile Sensor Network Coverage.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'04), pages 3747-3752, New Orleans, LA, Apr 26 - May 1, 2004.
PRESENTATIONS
  1. Task Allocation via Self-Organizing Swarm Coalitions in Distributed Mobile Sensor Network.
    Kian Hsiang Low.
    Presented in 8th National IT Awareness Project Competition (NITA-04), National University of Singapore, Mar 13, 2004 (Overall Best Project, Postgraduate Category).
VIDEOS

Coverage of 30 targets (green) with 15 ant robots (white)
  1. Self-organization of swarm coalitions to unknown, time-varying target distribution after

  2. Robot switching to region of higher task demand (i.e., targets to robots ratio) @refer to the above publications for information on the region numbers
ACTION SELECTION MECHANISM FOR
MULTI-ROBOT TASKS


PROJECT DURATION : Sep 2002 - Nov 2002

PROBLEM MOTIVATION
A central issue in the design of behavior-based control architectures for autonomous mobile robots is the formulation of effective mechanisms to coordinate the behaviors. These mechanisms determine the policy of conflict resolution between behaviors, which involves behavioral cooperation and competition to select the most appropriate action. The actions are selected so as to optimize the achievement of the goals or behavioral objectives. Developing such an action selection methodology is non-trivial due to realistic constraints such as environmental complexity and unpredictability, and resource limitations, which include computational and cognitive capabilities of the robot, incomplete knowledge of the environment, and time constraints. As a result, action selection can never be absolutely optimal. Given these constraints, the action selection scheme should be able to choose actions that are good enough to satisfy multiple concurrent, possibly conflicting, behavioral objectives.

PROPOSED METHODOLOGY
Our motivation of the action selection mechanism is to develop a motion control strategy for autonomous non-holonomic mobile robots that can perform distributed multi-robot surveillance in unknown, dynamic, complex, and unpredictable environments. By implementing the action selection framework using an assemblage of self-organizing neural networks, it induces the following key features that significantly enhance the agent's action selection capability: self-organization of continuous state and action spaces to provide smooth, efficient and fine motion control, and action selection via the cooperation and competition of Extended Kohonen Maps to achieve more complex motion tasks: (1) negotiation of unforeseen concave and narrowly spaced obstacles, and (2) cooperative tracking of multiple mobile targets by a team of robots. Qualitative and quantitative comparisons for single- and multi-robot tasks show that our framework can provide better action selection than do potential fields method.

PUBLICATIONS
  1. An Ensemble of Cooperative Extended Kohonen Maps for Complex Robot Motion Tasks.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Neural Computation, volume 17, issue 6, pages 1411-1445, Jun 2005.

  2. Continuous-Spaced Action Selection for Single- and Multi-Robot Tasks Using Cooperative Extended Kohonen Maps.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the IEEE International Conference on Networking, Sensing and Control (ICNSC'04) (Invited Paper to Special Session on Visual Surveillance), pages 198-203, Taipei, Taiwan, Mar 21-23, 2004.

  3. Action Selection for Single- and Multi-Robot Tasks Using Cooperative Extended Kohonen Maps.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI-03), pages 1505-1506, Acapulco, Mexico, Aug 9-15, 2003.
    [ 27.6% acceptance rate ]

  4. Action Selection in Continuous State and Action Spaces by Cooperation and Competition of Extended Kohonen Maps.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the 2nd International Joint Conference on Autonomous Agents and MultiAgent Systems (AAMAS-03), pages 1056-1057, Melbourne, Australia, Jul 14-18, 2003.
VIDEOS
  1. Cooperative tracking of moving targets by robots using cooperative Extended Kohonen Maps (145KB)
INTEGRATED ROBOT PLANNING AND CONTROL

PROJECT DURATION : Jul 2001 - Sep 2002

PROBLEM MOTIVATION
Robot motion research has proceeded along two separate directions: high-level deliberative planning and low-level reactive control. Deliberative planning uses a world model to generate an optimal sequence of collision-free actions that can achieve a globally specified goal in a complex static environment. However, in a dynamic environment, unforeseen obstacles may obstruct the action sequence, and replanning to react to these situations can be too computationally expensive. On the other hand, reactive control directly couples sensed data to appropriate actions. It allows the robot to respond robustly and timely to unexpected obstacles and environmental changes but may be trapped by them.

PROPOSED METHODOLOGY
The problem of goal-directed, collision-free motion in a complex, unpredictable environment can be solved by tightly integrating high-level deliberative planning with low-level reactive control. This work presents two such architectures for a nonholonomic mobile robot. To achieve real-time performance, reactive control capabilities have to be fully realized so that the deliberative planner can be simplified. These architectures are enriched with reactive target reaching and obstacle avoidance modules. Their target reaching modules use indirect-mapping Extended Kohonen Map to provide finer and smoother motion control than direct-mapping methods. While one architecture fuses these modules indirectly via command fusion, the other one couples them directly using cooperative Extended Kohonen Maps, enabling the robot to negotiate unforeseen concave obstacles. The planner for both architectures use a slippery cells technique to decompose the free workspace into fewer cells, thus reducing search time. Any two points in the cell can still be traversed by reactive motion.

PUBLICATIONS
  1. Enhancing the Reactive Capabilities of Integrated Planning and Control with Cooperative Extended Kohonen Maps.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'03), pages 3428-3433, Taipei, Taiwan, May 12-17, 2003.

  2. A Hybrid Mobile Robot Architecture with Integrated Planning and Control.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the 1st International Joint Conference on Autonomous Agents and MultiAgent Systems (AAMAS-02), pages 219-226, Bologna, Italy, Jul 15-19, 2002.
    [ 26% acceptance rate ]

  3. Integrated Planning and Control of Mobile Robot with Self-Organizing Neural Network.
    Kian Hsiang Low, Wee Kheng Leow & Marcelo H. Ang, Jr.
    In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA'02), pages 3870-3875, Washington, DC, May 11-15, 2002.

  4. Integrated Robot Planning and Control with Extended Kohonen Maps.
    Kian Hsiang Low.
    Master's Thesis, Department of Computer Science, School of Computing, National University of Singapore, Jul 2002.
    [ Singapore Computer Society Prize for best M.Sc. Thesis 2002-2003 ]
VIDEOS
  1. Robot motion in an environment with unforeseen stationary obstacle using command fusion (1.21MB)

  2. Robot motion in an environment with unforeseen moving obstacle using command fusion (1.79MB)

  3. Robot motion in an environment that changes using command fusion (1.06MB)

  4. Robot motion in an environment with unforeseen stationary concave and narrowly spaced convex obstacles using cooperative Extended Kohonen Maps (1.11MB)

  5. Robot motion in an environment with unforeseen moving obstacles using cooperative Extended Kohonen Maps (0.88MB)