research-article

A novel agent based control scheme for RTS games

Authors:

Deborah Richards,

Michael HitchensAuthors Info & Claims

IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System

Article No.: 7, Pages 1 - 9

https://doi.org/10.1145/2336727.2336734

Published: 21 July 2012 Publication History

Abstract

So far, the main focus of AI research around RTS games has been towards creating autonomous, virtual opponents to compete against human beings or other autonomous players. At the same time, popular commercial titles are increasing their emphasis on micro-management; neglecting development towards further autonomy. This paper proposes a simple reactive agent that is proficient in combat tasks. This agent will be the basis of individual units; forming the backbone of a multiagent system. Built on this is a novel control scheme that is designed to aid a human player; deferring all strategic decisions to the controller. Finally, the paper will show the results of experiments designed to evaluate the effectiveness of the proposed control scheme.

References

[1]

Chung, M., Buro, M., Schaeffer, J. "Monte Carlo Planning in RTS Games". In Proc. of the IEEE Symposium on Computer Intelligence and Games, Colchester, UK 2005

[2]

Churchill, D. and Buro, M., "Build Order Optimization in StarCraft", In AIIDE, Proceedings of the Seventh AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment Stanford, 2011.

Digital Library

[3]

Guy, S. J., Chhugani, J. Curtis, S., Dubey, P., Lin Ming, Manocha, D. "PLEdestrians: A Least-Effort Approach to Crowd Simulation". In Eurographics/ACM SIGGRAPH Symposium on Computer Animation (2010)

Digital Library

[4]

Hagelbäck, J, Johansson, S. J. "A Multi-Agent Potential Field-Based Bot for a Full RTS Game Scenario". In International Journal of Computer Games TechnologyVolume 2009 (2009), Article ID 91081

[5]

Hagelbäck, J., Johansson, S. J. "Using Multi-agent Potential Fields in Real-time Strategy Games". In Proc. of 7th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2008), Padgham, pp.631--638

Digital Library

[6]

Hart, P. E., Nilsson, N. J. and Raphael, B. (1968). "A Formal Basis for the Heuristic Determination of Minimum Cost Paths". IEEE Transactions on Systems Science and Cybernetics SSC4 4 (2): 100--107

[7]

Kaupp, T.; Makarenko, A; Durrant-Whyte H. "Human-robot communication for collaborative decision making - A probabilistic approach". In Robotics and Autonomous Systems, vol. 5, no. 58, 2010, pp. 444--456

Digital Library

[8]

Kuchera B. (2010). "300 actions a minute? Truly mastering StarCraft". Ars Technica Article, http://arstechnica.com/gaming/news/2010/07/excellence-of-execution-video-of-starcraft-mastery.ars (last accessed 29 March 2012)

[9]

M. Buro, Call for AI Research in RTS Games, Proceedings of the AAAI-04 workshop on AI in games, San Jose 2004, pp.139--142

[10]

Mccoy, J. and Mateas, M. "An Integrated Agent for Playing Real-Time Strategy Games". In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence (2008).

Digital Library

[11]

Remo C. (2010). "StarCraft II Designer Browder: We're Not Trying To Be Innovative". Gamasutra Article, http://www.gamasutra.com/view/news/28180/StarCraft_II_Designer_Browder_Were_Not_Trying_To_Be_Innovative. php (last accessed 29 March 2012)

[12]

Santos, M. and Martinho, C. "Wasp Like Scheduling for Unit Production in Real Time Strategy Games". In Seventh Artificial Intelligence and Interactive Digital Entertainment Conference 2011-10-09

[13]

Unity 3D Game Engine, by Unity3D, http://www.unity3d.com

[14]

Weber, B. G., Mateas, M., Jhala, A. "Building HumanLevel AI for Real-Time Strategy Games". In AAAI Fall Symposium on Advances in Cognitive Systems (ACS), November 2011.

[15]

Weber, B. G., Mawhorter, P., Mateas M., Jhala, A. "Reactive Planning Idioms for Multi-Scale Game AI". In Computational Intelligence and Games (CIG), 2010 IEEE Symposium, Aug. 2010, pp 18--21.

[16]

Weissgerber, K; Lamont, G. B.; Borghetti B. J. and Gilbert L. Peterson. "Determining Solution Space Characteristics for Real-Time Strategy Games and Characterizing Winning Strategies". In International Journal of Computer Games Technology, Volume 2011, Article ID 834026.

Digital Library

Cited By

Barambones JCano-Benito JSánchez-Rivero IImbert RRichoux F(2023)Multiagent Systems on Virtual Games: A Systematic Mapping StudyIEEE Transactions on Games10.1109/TG.2022.321415415:2(134-147)Online publication date: Jun-2023
https://doi.org/10.1109/TG.2022.3214154
Cabanag M(2014)Protocol EProceedings of the 2014 Conference on Interactive Entertainment10.1145/2677758.2677795(1-1)Online publication date: 2-Dec-2014
https://dl.acm.org/doi/10.1145/2677758.2677795

Index Terms

A novel agent based control scheme for RTS games
1. Computing methodologies
  1. Artificial intelligence
    1. Distributed artificial intelligence
      1. Intelligent agents
      2. Multi-agent systems
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Protocol E: An Implementation of a Novel, Agent Based, Control Scheme for Real Time Strategy Games
IE2014: Proceedings of the 2014 Conference on Interactive Entertainment

Contemporary real time strategy games (RTS) have given particular emphasis on micromanagement. Protocol E takes a different direction by adopting a novel agent based control scheme proposed in 2012. Protocol E is intended as a demonstration of the ...
A Scouting Strategy for Real-Time Strategy Games
IE2014: Proceedings of the 2014 Conference on Interactive Entertainment

Real-time strategy (RTS) is a sub-genre of strategy video games. RTS games are more realistic with dynamic and time-constraint game playing, by abandoning the turn-based rule of its ancestors. Playing with and against computer-controlled players is a ...
Hierarchical control of multi-agent reinforcement learning team in real-time strategy (RTS) games
Abstract
Coordinated control of multi-agent teams is an important task in many real-time strategy (RTS) games. In most prior work, micromanagement is the commonly used strategy whereby individual agents operate independently and make their own combat ...
Highlights
- A hierarchical Command and Control model of RL agents for Real-Time Strategy Game.
- The model enables the unit’s individual decisions while directed by a commander agent.
- A self-organizing neural network realizes the agents at ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

IE '12: Proceedings of The 8th Australasian Conference on Interactive Entertainment: Playing the System

July 2012

182 pages

ISBN:9781450314107

DOI:10.1145/2336727

Conference Chairs:
Daniel Cermak-Sassenrath
Auckland University of Technology
,
Charles Walker
Auckland University of Technology
,
Program Chair:
Chek Tien Tan
University of Technology, Sydney

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Auckland University of Technology
University of Technology, Sydney: University of Technology, Sydney

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 July 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IE '12

Sponsor:

University of Technology, Sydney

IE '12: The 8th Australasian Conference on Interactive Entertainment

July 21 - 22, 2012

Auckland, New Zealand

Acceptance Rates

Overall Acceptance Rate 64 of 148 submissions, 43%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
211
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Barambones JCano-Benito JSánchez-Rivero IImbert RRichoux F(2023)Multiagent Systems on Virtual Games: A Systematic Mapping StudyIEEE Transactions on Games10.1109/TG.2022.321415415:2(134-147)Online publication date: Jun-2023
https://doi.org/10.1109/TG.2022.3214154
Cabanag M(2014)Protocol EProceedings of the 2014 Conference on Interactive Entertainment10.1145/2677758.2677795(1-1)Online publication date: 2-Dec-2014
https://dl.acm.org/doi/10.1145/2677758.2677795

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten