Kirb your enthusiasm!

WEBSITE HOSTED AT: www.3plusplus.net

"Pink isn't a color. It's a lifestyle." - Chumbalaya
"...generalship should be informing list building." - Sir Biscuit
"I buy models with my excess money" - Valkyrie whilst a waitress leans over him


Thursday, March 3, 2011

Fallacy in 40k Part 1: Mathhammer


Lately I felt the need to contribute to the 40k community a little more besides chatting around in 'the box' and replying now and then to mind baffling comments on Warseer. Then the issue arises: What can I contribute? I decided I can do some sort of series about common mistakes/misunderstanding/false assumptions or, as I like to call them, 'fallacies' regarding 40k and/or it's (online) community. I don't know exactly how many posts I can do on this, but looking around there is enough input for quite a few. This time I'm going to cover some major mistakes people make when they apply mathhamer, or alternatively, probability in 40k! So, here we go. In my opinion one can recognise four different groups of people 1) People who don't understand anything of it. 2) People who understand bits of it, but don't acknowledge that it is a useful tool. 3) People who understand bits of it and apply it a lot, often in wrong ways. 4) People who understand it pretty well and so know how and when to apply it. The first group is (getting) satisfied already by some basic mathhammer articles, the second group doesn't realise they belong in the first group and the fourth group don't need to be told more things about it. That leaves the third group for today. Almost every mistake comes forth from one thing: People only work with averages when they try to calculate things in 40k. Not comparing these averages with other averages (in the case of weapons for example) is another one. I'll look at the most glaring issues with actual examples now.

During games.
Oh my god, you are so lucky! That Terminator should have been dead!
This line should sound pretty familiar to almost anyone, although probably with some other kind of unit. What happens a lot: People figure that failing a 2+ armour save is a 1/6 chance. The average amount of wounds needing to be caused to kill a Terminator would be 6 then, no problems here. But that does not mean that it "should be dead" if somebody rolls for it! Why? Because you need to know what the chance is that somebody passes all 6 saves. It's not too difficult in this case, 5/6^6 x 100% = 33,5% (!)


Look at that number, that's a pretty high chance isn't it? It's roughly the same as failing a single 3+ armour save... Yet a lot of people don't realise things like these and might find themselves complaining a lot during games about dice rolls. One could take a more complicated example, the chance to fail 4 out of 5 armour saves with a marine squad (3+ save), what's the chance of this happening? It's 1/3^4 x 2/3 x 5nCr4 x 100% = 4%. Now this number isn't nearly as high, but can you call it bad luck? Not really; it's still a significant, at least when you realise that failing all 5 or 3 of them are also below average... and even more when realise you roll for these kind of situations a lot during games. They happen and it's completely logical, shocking isn't it?

Above all people should realise one thing: In most situations the chance of not rolling the average result is way higher than rolling it.

Example: Passing exactly 6 out of 9 Marine armour saves is a lower chance than getting a different result. (27,3% chance that you roll the average in this case)

Overall: Think before you whine, is it justified or are you being unreasonable maybe? When you blame the dice for your loss you not only take away a bit from your opponent his achievement, but you're also lying to yourselves ultimately. (if you blamed the dice unrighteously at least)

During theoryhammer.
Person A: A Storm Raven just isn't that hard to kill with its Av12
Person B: Bullshit, a missile launcher only has a 7,4% to destroy a flat-out Raven!
Person A might not have a clue about mathhammer, but at least he's not drawing conclusions on a number which is meaningless in a vacuum, which person B is guilty off.

The problem is here: What does that 7,4% chance mean? Is it high or is it low? Person B uses it in such a way that it looks really low...righteously so? There is no clear answer to this and that is okay, I'm only here to point out what goes wrong here.

The problem is that the number 7,4% is useless without reference. Now, the guy could have compared that number with other examples himself but I doubt it... My internal alarm went of right away, I 'know' that 7,4% in this case are relatively high odds. How do I prove this? Let's look at some other numbers. I'll list the chances of a single Missile Launcher destroying other vehicles in cover against their front armour (double the chances if you want the odds of getting immobilised being included, same for getting results without cover):
  • Rhino – 5,55%
  • Chimera – 3,7%
  • Ork Truck – 12,0%
Now the worst part, what do these numbers mean? Does this mean the Raven is relatively easy to kill? I mean Rhinos get killed by Missile Launchers too! And there arrives another problem with mathhammer: it's just mathhammer in the end. It's hard to argue how well one could stay out of range of such weaponry with the Raven for example.

Another example:
Howling Banshees are excellent Marine killers, they kill 10,1 on the charge with Doom support!
How hard is it to get such a charge of with them? How easy is it to get Doom support? Point investment? This line is false by the way, they aren't excellent at anything.

In the end my point is: Please think before you decide to try and back up your opinion with numbers. Be honest and make sure they are relevant, you help nobody when you deceive people with useless statistics. To the people on the receiving end: Don't be afraid to question the usefulness of numbers when someone uses them.

Now it may seem that I think mathhammer is pretty much useless, which isn't true. Far from that actually, but I'll cover that in a future article.

Thoughts?

Comments (27)

Loading... Logging you in...
  • Logged in as
"Overall: Think before you whine, is it justified or are you being unreasonable maybe? When you blame the dice for your loss you not only take away a bit from your opponent his achievement, but you're also lying to yourselves ultimately. (if you blamed the dice unrighteously at least)"

I wrote an article on just this subject,
http://www.houseofpaincakes.com/2011/02/its-easy-...
well said!
Thrungrom's avatar

Thrungrom · 735 weeks ago

mmmmm math-hammer versus the dice gods (or daemons)... the dice gods (or daemons) always win
My terminators always dies on 3 armour saves !!!

No seriously math-hammer is good to make the right decision, the dices dictates the outcome.
Bad players fail on the wrong decisions, good or great players can have bad luck with the dices.

U need 3 or 4 Grey Hunters to break (or kill) an IG squad that doesn't mean 10 guardsman kill 3 or 4 Grey Hunters in CC. (now that's a bad example).

I just mean, u have to vision maths in ur brain. WS, S + special rules versus WS, T + special rules. If u can predict that, u can eliminate the bad decisions and leave it to the dice gods (or daemons)
Ah the Eldar Codex, where you can sum up so many units with 'Well, at least they aren't Swooping Hawks'.

I like mathhammer to a point. It can make for an interesting discussion, and give you an idea of how to hedge your bets with certain actions and match-ups. What I hate are the people who take it to an almost mythical canon state where anything that runs counter to the sliver of percentages is downgraded to an almost non-existent state, which would be understandable if you are talking about chances of a third or a half, but when you are talking 1/20 versus 1/21, it just gets silly. As Berra said, 'Lady, I made it to the top by never overthinking nothing' [sic].
2 replies · active 735 weeks ago
Dave Sinn's avatar

Dave Sinn · 735 weeks ago

There are a heck of a lot of people that know very little about statistics. Hopefully they read this.
I like mathhammer. A lot.

It informs all my choices.

However, I play Blood Bowl online. Basically your turn ends as soon as you fail a roll.
"The best-laid plans of mice and men, Often go awry"

The more you see the 'impossible' happen [or should that be improbable?]
and the 'automatic' not come to pass
the more you realise 'should' doesn't equate to 'will'

I think that it is a little bit like what MVB is saying about social contracts. Don't expect the dice to be obliged to you or your stacking of the odds. I think that is where our offence at failing comes from.
It should've!
I'm unlucky!
You're lucky!
Etc.

Stack the odds as best you can, both with list building and tabletop effort, but realise that it is not chess and doesn't have prescribed actions occuring.
2 replies · active 735 weeks ago
There's also a HUUUUGE perception bias in the online BB community. So many people think those dice are rigged. I like to joke that they are. Makes me giggle when people agree. :D
Yesterday, some guy had three dead Orcs from one game. Which is very unlikely.
However, when you combine it with the thousands of games played, has it occurred within a reasonable deviation of what it should? I feel that it probably has not.

The thing is, that emotional investment is made into those dudes and the team as a whole. That definitely colours the perception.

As you say, people also employ faux-science on these kinds of things.

Vindicators are pure pwnage because I've seen X
Dwarf teams get better damage rolls because I've seen Y

Now BB could be rigged - I don't know. More likely is what you and I are talking about
:)
Statistics are often misunderstood because most people fail to grasp the difference between an average value and the probability of a given outcome. As the author rightly pointed out in his article, while it takes on average 6 wounds to down a Terminator, a mere 4 wounds has nonetheless a 55% chance of killing him.
Mathhammer is useful in small, closed systems like when one unit is facing another unit and you have to decide whether to rapid fire or assault, or counting weapons to make sure you have enough firepower to fill a given role. Even then, people have to realize that probability necessarily deviates from the mean, and a likely outcome is not the same as a certain outcome.

I think the most amusing outcome of mathhammer is when someone decides that a certain weapon can only be effective if bought in numbers large enough to "guarantee" the desired result.
Very good post, nice to see some thoughts from you out othe chatbawks son :) x
Probability is expressed as a decimal like 0.9 not as a percentage.

Polynomial theorem is great for mathhammer.
3 replies · active 735 weeks ago
Yeah but people don't understand probability when you do it that way >_> They'll prolly think 0.9% and be like "Wut?"

T.T
People fail math for a reason. You'd think gamer nerds would be smart...you would...but ya.
abortedsoul's avatar

abortedsoul · 735 weeks ago

They are only half as smart as they are cocky and condescending. Ahem.
Nice article Zjoe. It's a good basic intro into basic mathhammer. Problem about writing about this is it's something a LOT of people have spoken about previously. I'd refer to GMort. And me :P

Good read.
1 reply · active 735 weeks ago
Well the math itself is rather basic, which is indeed already covered in other articles... but the point of view is different in the sense that I'm pointing people at actual mistakes which happen. The mistakes they often make even after having read basic mathhammer articles...
I'm planning on doing an article on standard deviations and normal distributions as "Part 3" of my Mathhammer article. I liked this one just fine too.
I know this is likely a international fanbase issue, but every time you put a comma, as opposed to a period, in a percent screwed with my head for, like, a quarter second.

This said, I play a lot of strategy video games; enough to make me really suspicious about percents. It's not that I don't believe them, it's more that I don't trust them, as it always seems that when I REALLY need a certain number to come up, it normally ends up whatever number is least useful for me. I know, I'm just glossing over when things go well and remembering when they don't, but ugh.

The point about the average coming up far less then any option other then the average is well noted, though. I never considered that angle, before.
1 reply · active 735 weeks ago
Throw more dice

:)
Another failure often ignored by people even of group 4 (myself included, or at least I'd like to consider myself part of group 4) is the failure to figure out very significant values like the standard deviation (SD). This, at least with myself, is often the result of laziness.

Killing an average of 5 marines is great; when but when using that against a combat squad of 5 marines with a SD of 3.5 means you're fairly likely to either overkill (with no bonus) or under-kill (in fact at that level there's a greater than 16% chance of killing less than 3). If the SD was instead 1 the likelihood of killing at least 4 would be greater than 75%.

Knowing the SD will give you a much better idea of using what against what. The same 2 squads vs. a 10 man marine squad present a different situation. The SD of 3.5 has the chance to break a very large squad; this makes it great when you can afford the risk of doing very little. However when you need to knock the force down to approx. half strength the SD 1 option is more reliable.

Reliability often even comes at a cost. It's not necessarily always worth it, like spinefists on gants (which are more reliable vs things like guardsmen), On things that are less numerous and more important (thinking anti-tank or anti-elite fire power) the cost often is very worth paying for. In 5th a games momentum is often determined by what happens to a select few units (such as transports). Immobilizing that LR or rhino in the first round can often be the determining factor in what plays out in the midfield.
the main problem i have with most mathhammer guys is that they only think in terms on one unit versus one unit. they never factor in terrain, placement, or the rest of the armies. it should never come down to a one on one fight if you know what youre doing.
that howling banshees vs marines example. sure the banshees would mince the marines in CC, but how did they get there? did they walk across the table getting shot at by those marines? did they have a transport? would the banshees really even bother with assaulting a basic marine unit when they could probably murder them terminators that would otherwise threaten something important?
did the marines have a nearby demolisher ready to blash them to pieces?
1 reply · active less than 1 minute ago
Yeah, but the problem is that the anti-mathhammer crowd (aka, people who genuinely don't understand statistics) hand-wave away the statistics with vague talk of terrain and strategy. That stuff matters, it's entirely true; it's where player skill comes in. But the total summation of your army's inherent combat power is very important, because all the terrain and strategy in the world aren't going to save you from not being able to do enough damage to your opponent. "It doesn't matter how statistically awful my choices are, I'm awesome" only works until you run into someone who's as good or better than you are at the skill portion. Then you're running at a substantial disadvantage.
I totally agree that you need comparison to understand probabilities. That's why this graph compares many SM common anti-tank weapons: http://www.twinlinked.net/wp-content/uploads/2010...
1 reply · active 735 weeks ago
If anybody is interested I have a graph that compares, not just singular weapons, but weapon platforms against each other. IE: LRCrusader vs Rifleman Dread vs Baal Predators vs etc

Post a new comment

Comments by

Follow us on Facebook!

Related Posts Plugin for WordPress, Blogger...