Hosam Hanna
ABSTRACT
In this paper, we address the problem of decision-making under uncertainty for the task selection problem. We consider an environment where an agent has to select tasks to execute in a way which maximizes his gain. The main motivation is the new challenging applications such as planetary rovers, e-commerce, combinatorial auction and vehicle routing where agents are with limited resources and have to distribute and execute a set of tasks under uncertainty. In the model proposed in this paper, we formulate the local task selection as a \textitMarkov Decision Process (MDP). In fact, the MDP allows agents to deal with two sources of uncertainty : (1) the uncertainty on the task allocation, and (2) the uncertainty on the consumption of resources required for executing each task. We will also show how an agent can improve his knowledge about the environment.
- M.R. Andersson and T.W Sandholm. Contract types for satisficing task allocation: 2 experimental results. In Proceedings of AAAI 1998 Spring Symposium: Satisficing Models, pages 1--7, Stanford University, CA, Mar 1998.Google Scholar
- Martin Andersson and Tuomas Sandholm. Time-quality tradeoffs in reallocative negotiation with combinatorial contract types. In Proceedings of AAAI 99, pages 3--10, jul 1999. Google ScholarDigital Library
- R. E. Bellman. Dynamic programming, princeton university press, princeton. 1957a. Google ScholarDigital Library
- R. E. Bellman. A markov decision process. journal of Mathematical Mechanics, pages 6:679--684, 1957b.Google Scholar
- Carig Boutilier, Moisés Goldszmidt, and Bikash Sabata. Sequential auction for the allocation of resources with complementarities. In Proceedings of IJCAI 99, Stockholm, volume 1, pages 527--534, 1999. Google ScholarDigital Library
- Maroua Bouzid, Hosam Hanna, and Abdel-Illah Mouaddib. Balancing Reactivity and Social Deliberation in Multi-Agent Systems, chapter Controlled Social Deliberation : Deliberation Levels in Theoretic-Decision Approaches for Task Allocation in Resource-Bounded Agents, pages 198--216. LNAI 2103. Springer-Verlag Berlin Heidelberg, 2001. Google ScholarDigital Library
- T. Estlin, A. Tobias, G. Rabideau, R. Castana, and E. Mjolsness. An integrated system for multi-rever scientific exploration. In Proceedings of AAAI 99, pages 613--613, 1999. Google ScholarDigital Library
- White D. J. Markov Decision Processes. West Sussesx, England : John Wiley & Sons, 1993.Google Scholar
- M. L. Puterman. Markov decision processes. Wiley, 1994.Google ScholarCross Ref
- M.H. Rothkopf, A. Pekec, and R.M. Harstad. Computationally manageable combinatorial auctions. Management Science, 44(8):1131--1147, 1998. Google ScholarDigital Library
- Tuomas Sandholm. emediator: A next generation electronic commerce server. In International Conference on Autonomous Agents (AGENTS), Barcelona, Spain, jun 1999. Google ScholarDigital Library
Index Terms
- Task selection problem under uncertainty as decision-making
Recommendations
Decision-making under uncertainty: beyond probabilities: Challenges and perspectives
AbstractThis position paper reflects on the state-of-the-art in decision-making under uncertainty. A classical assumption is that probabilities can sufficiently capture all uncertainty in a system. In this paper, the focus is on the uncertainty that goes ...
Adaptive decision making in agent-based simulation
In the context of adaptive and autonomous decision making, a computational model is needed to formalize and implement a practical goal deliberation mechanism that determines how goals can be evaluated, adopted, or rejected. Such a model is expected to ...
Decision Making under Uncertainty and Its Application
ICEE '10: Proceedings of the 2010 International Conference on E-Business and E-GovernmentDecision making under uncertainty has very popular application fields. This paper analyzes the difference of decision under risk and under uncertainty, and provides a simple axiom of the Choquet Expected Utility model where the capacity is a subject ...
Comments