Skill-based matchmaking

Skill-based matchmaking (SBMM), also referred to as matchmaking ranking, is a form of matchmaking dependent on the relative skill level of the players involved.

History

A common rating system in chess is the Elo rating system, developed by Arpad Elo. Former International Chess Federation president Florencio Campomanes described it as an "inseparable partner to high-level chess". In 2006, Microsoft researchers proposed a skill-based rating system using Bayesian inference and deployed it on the Xbox Live network, then one of the largest deployments of a Bayesian inference algorithm. The researchers were displeased with the ranking system in the beta of Halo 2 (2004). By the time Halo 2 launched, it was using TrueSkill.

The term skill-based matchmaking first appeared in a 2008 interview with game designer John Carmack in which he emphasized its importance in Quake Live (2010). Upon setting up an account with id Software, the game will ask the player for their skill level and judge accordingly depending on their performance from that point forward. The presence—or lack thereof—of skill-based matchmaking became a point of contention. During the development of Dota 2 (2013), Valve Software believed that the barrier to entry could be solved with, among other things, skill-based matchmaking through its Steamworks service; when Call of Duty: Black Ops (2010) developer Treyarch was asked why the game wouldn't include skill-based matchmaking unlike Halo 3 (2007), multiplayer design director David Vonderhaar said that speed was "more important than anything else".

Description

Team-based, competitive games such as League of Legends (2009), Counter-Strike: Global Offensive (2012), Dota 2 (2013), and Overwatch (2016) benefit from skill-based matchmaking. In contrast, Call of Duty: Black Ops II (2012)—a game that primarily focuses on single-player accomplishments—does not benefit from skill-based matchmaking. Treyarch, who developed Call of Duty: Black Ops II, consciously queued players exclusively using ping and latency, in a subversion of industry standards at the time.

Queues

In skill-based matchmaking, queue design focuses on how to divide parties into appropriate skill groups. In contrast to StarCraft II (2010), which focuses on player-on-player action, Blizzard Entertainment's Heroes of the Storm (2015) is a team-based game. The Heroes of the Storm matchmaker aims to have players win at least half of the games that they play. The game's matchmaker also aims to pair coordinated teams with other coordinated teams in order to avoid an unfair communication advantage. According to game director Ben Brode, Hearthstone (2014) maintains a separate pool of new players. Players remain in the pool until they win ten games or obtain two legendary minions.

Player rating model

The skill rating of a player is their ability to win a match based on aggregate data. Various models have emerged to achieve this. Mark Glickman implemented skill volatility into the Glicko rating system. In 2008, researchers at Microsoft extended TrueSkill for two-player games by describing a number for a player's ability to force draws. Variability in map, character, and server effects have been considered in at least two research papers. In 2016, two Cornell University graduates modeled skill rating as a vector of numbers, showing "substantial intransitivity".

Reception

Skill-based matchmaking is a controversial practice. In Call of Duty: Warzone (2020), streamers of the game often seek out "bot lobbies"—lobbies with less-skilled players. The Washington Post compared the practice to "LeBron James looking to join pickup games at the local YMCA". Call of Duty: Warzone players who have spoken out against the game's use of skill-based matchmaking include 100 Thieves CEO Nadeshot, former professional Counter-Strike: Global Offensive player Shroud, and 100 Thieves co-owner CouRage. Competitive Call of Duty: Warzone player HusKerrs wrote that high-skilled players must "sweat or try hard" in order to create engaging content. Streamer TimTheTatman refused to stream Call of Duty: Modern Warfare II (2022) upon discovering that it would implement skill-based matchmaking.

In February 2023, Destiny 2 (2017) introduced skill-based matchmaking. Higher-skilled players subsequently discovered a way to enter lobbies with lower-skilled players, resulting in outcry from the community.

References

Works cited

• Chen, Shou; Joachims, Thorsten (2016). "Modeling Intransitivity in Matchup and Comparison Data" (PDF). Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. pp. 227–236. doi:10.1145/2835776.2835787. ISBN 978-1-4503-3716-8. Retrieved June 1, 2023.
• Chen, Zhengxing; Sun, Yizhou; El-nasr, Magy; Nguyen, Truong-Huy (2016). "Player skill decomposition in multiplayer online battle arenas". Meaningful Play. arXiv:1702.06253. Retrieved June 1, 2023.
• Dangauthier, Pierre; Herbrich, Ralf; Minka, Tom; Graepel, Thore (January 2008). "TrueSkill Through Time: Revisiting the History of Chess" (PDF). Advances in Neural Information Processing Systems. Retrieved June 1, 2023.
• Elo, Arpad (1986). The Rating of Chess Players, Past and Present. Arco. ISBN 0-668-04721-6.
• Glickman, Mark (2001). "Dynamic paired comparison models with stochastic variances" (PDF). Journal of Applied Statistics. 28 (6): 673. Bibcode:2001JApSt..28..673G. doi:10.1080/02664760120059219. S2CID 16101322. Retrieved June 1, 2023.
• Herbrich, Ralf; Minka, Tom; Graepel, Thore (2007). "TrueSkill: A Bayesian Skill Rating System" (PDF). Advances in Neural Information Processing Systems. 20. Retrieved June 1, 2023.
• Menke, Joshua; Reese, Shane; Martinez, Tony (2006). "Hierarchical models for estimating individual ratings from group competitions". American Statistical Association. Retrieved June 1, 2023.
• Wallner, Günter, ed. (2019). Data Analytics Applications in Gaming and Entertainment. CRC Press. ISBN 9781000001860.
  • Zook, Alex. "Chapter 3: Building Matchmaking Systems". In Wallner (2019).