Skill-based matchmaking
Skill-based matchmaking (SBMM), also referred to as matchmaking ranking, is a form of matchmaking dependent on the relative skill level of the players involved.
History
A common rating system in chess is the Elo rating system, developed by Arpad Elo. Former International Chess Federation president Florencio Campomanes described it as an "inseparable partner to high-level chess".[1] In 2006, Microsoft researchers proposed a skill-based rating system using Bayesian inference and deployed it on the Xbox Live network, then one of the largest deployments of a Bayesian inference algorithm.[2] The researchers were displeased with the ranking system in the beta of Halo 2 (2004).[3] By the time Halo 2 launched, it was using TrueSkill.[4]
The term skill-based matchmaking first appeared in a 2008 interview with game designer John Carmack in which he emphasized its importance in Quake Live (2010). Upon setting up an account with id Software, the game will ask the player for their skill level and judge accordingly depending on their performance from that point forward.[5] The presence—or lack thereof—of skill-based matchmaking became a point of contention. During the development of Dota 2 (2013), Valve Software believed that the barrier to entry could be solved with, among other things, skill-based matchmaking through its Steamworks service;[6] when Call of Duty: Black Ops (2010) developer Treyarch was asked why the game wouldn't include skill-based matchmaking unlike Halo 3 (2007), multiplayer design director David Vonderhaar said that speed was "more important than anything else".[7]
Description
Team-based, competitive games such as League of Legends (2009), Counter-Strike: Global Offensive (2012), Dota 2 (2013), and Overwatch (2016) benefit from skill-based matchmaking. In contrast, Call of Duty: Black Ops II (2012)—a game that primarily focuses on single-player accomplishments—does not benefit from skill-based matchmaking.[8] Treyarch, who developed Call of Duty: Black Ops II, consciously queued players exclusively using ping and latency, in a subversion of industry standards at the time.[9]
Queues
In skill-based matchmaking, queue design focuses on how to divide parties into appropriate skill groups. In contrast to StarCraft II (2010), which focuses on player-on-player action, Blizzard Entertainment's Heroes of the Storm (2015) is a team-based game. The Heroes of the Storm matchmaker aims to have players win at least half of the games that they play. The game's matchmaker also aims to pair coordinated teams with other coordinated teams in order to avoid an unfair communication advantage.[10] According to game director Ben Brode, Hearthstone (2014) maintains a separate pool of new players. Players remain in the pool until they win ten games or obtain two legendary minions. Riot Games, the developers of League of Legends, have utilized a so-called "Prisoner's Island" at times to separate toxic players.[11]
Player rating model
The skill rating of a player is their ability to win a match based on aggregate data. Various models have emerged to achieve this. Mark Glickman implemented skill volatility into the Glicko rating system.[12] In 2008, researchers at Microsoft extended TrueSkill for two-player games by describing a number for a player's ability to force draws.[13] Variability in map, character, and server effects have been considered in at least two research papers.[14][15] In 2016, two Cornell University graduates modeled skill rating as a vector of numbers, showing "substantial intransitivity".[16]
Reception
Skill-based matchmaking is a controversial practice. In Call of Duty: Warzone (2020), streamers of the game often seek out "bot lobbies"—lobbies with less-skilled players. The Washington Post compared the practice to "LeBron James looking to join pickup games at the local YMCA". Call of Duty: Warzone players who have spoken out against the game's use of skill-based matchmaking include 100 Thieves CEO Nadeshot, former professional Counter-Strike: Global Offensive player Shroud, and 100 Thieves co-owner CouRage. Competitive Call of Duty: Warzone player HusKerrs wrote that high-skilled players must "sweat or try hard" in order to create engaging content.[17] Streamer TimTheTatman refused to stream Call of Duty: Modern Warfare 2 (2022) upon discovering that it would implement skill-based matchmaking.[18]
In February 2023, Destiny 2 (2017) introduced skill-based matchmaking. Higher-skilled players subsequently discovered a way to enter lobbies with lower-skilled players, resulting in outcry from the community.[19]
References
Citations
- Elo 1986, p. x.
- Herbrich, Minka & Graepel 2007, p. 7.
- Perry, Douglass (October 28, 2005). "Live in the Next Generation: The TrueSkill System". IGN. Retrieved June 1, 2023.
- Makedonski, Brett (October 31, 2014). "Master Chief Collection's multiplayer ranking system is just like Halo 2's". Destructoid. Retrieved June 1, 2023.
- Chan, Norman (June 24, 2008). "Carmack frees Quake". GamesRadar+. Retrieved June 1, 2023.
- Biessener, Adam (October 13, 2010). "Valve's New Game Announced, Detailed: Dota 2". Game Informer. Retrieved June 1, 2023.
- Grant, Christopher (September 3, 2010). "Call of Duty: Black Ops multiplayer takes aim at cheaters, looks to recruit more players". Engadget. Retrieved June 1, 2023.
- Zook 2019, p. 36.
- Petitte, Omri (October 26, 2012). "Call of Duty: Black Ops 2 uses ping and latency "exclusively" for multiplayer matchmaking". PC Gamer. Retrieved June 1, 2023.
- Valenta, Nate (August 8, 2014). "Matchmaking Design in Heroes of the Storm". Blizzard Entertainment. Retrieved June 1, 2023.
- Zook 2019, p. 37.
- Glickman 2001, p. 673-689.
- Dangauthier et al. 2008, p. 931-938.
- Menke, Reese & Martinez 2006, p. 1.
- Chen et al. 2016, p. 1.
- Chen & Joachims 2016, p. 1.
- Davison, Ethan (May 27, 2022). "Video game developers want fair online games. Some players really don't". The Washington Post. Retrieved June 1, 2023.
- Winslow, Levi (October 27, 2022). "Call Of Duty: Modern Warfare 2 Fans Can't Believe They Have To Play In Fair Matches". Kotaku. Retrieved June 1, 2023.
- Kelly, Paul (February 15, 2023). "Destiny 2 PvP exploit sees skill-based matchmaking completely negated". PCGamesN. Retrieved June 1, 2023.
Works cited
- Chen, Shou; Joachims, Thorsten (2016). "Modeling intransitivity in matchup and comparison data" (PDF). WSDM. Retrieved June 1, 2023.
- Chen, Zhengxing; Sun, Yizhou; El-nasr, Magy; Nguyen, Truong-Huy (2016). "Player skill decomposition in multiplayer online battle arenas". Meaningful Play. Retrieved June 1, 2023.
- Dangauthier, Pierre; Herbrich, Ralf; Minka, Tom; Graepel, Thore (January 2008). "TrueSkill Through Time: Revisiting the History of Chess" (PDF). Advances in Neural Information Processing Systems. Retrieved June 1, 2023.
- Elo, Arpad (1986). The Rating of Chess Players, Past and Present. Arco. ISBN 0-668-04721-6.
- Glickman, Mark (2001). "Dynamic paired comparison models with stochastic variances" (PDF). Journal of Applied Statistics. Retrieved June 1, 2023.
- Herbrich, Ralf; Minka, Tom; Graepel, Thore (2007). "TrueSkill: A Bayesian Skill Rating System" (PDF). Advances in Neural Information Processing Systems. 20. Retrieved June 1, 2023.
- Menke, Joshua; Reese, Shane; Martinez, Tony (2006). "Hierarchical models for estimating individual ratings from group competitions". American Statistical Association. Retrieved June 1, 2023.
- Wallner, Günter, ed. (2019). Data Analytics Applications in Gaming and Entertainment. CRC Press. ISBN 9781000001860.
- Zook, Alex. "Chapter 3: Building Matchmaking Systems". In Wallner (2019).