Judging goalies is really hard, and my suggestion is you don’t try unless you’re willing to look foolish a lot. I was not a believer in John Gibson at the time Frederik Andersen was traded to the Leafs. I thought he was AHL-ish in the World Cup of Hockey, and I continued to doubt him for a time.

I was really wrong on that.

I did totally believe in Andersen, which is a consolation. The Ducks made the right choice for them, and the Leafs made an excellent trade. When does that ever happen?

One reason it’s hard to judge goalies is that the information from the AHL or junior leagues is terrible. All-Situations Save % is so swamped in team effects that when you’re trying to make a fine measure, you’re using a ruler printed on elastic to do it with. Not only that, the entire leagues themselves vary much more widely than does the NHL, so you don’t necessarily get similar quality of shots faced across teams.

Once goalies get in the NHL, life is easier on armchair analysts. You don’t have to scout every goalie visually for hours to form an impression, and frankly, knowing what to look for in doing that is a skill few people have. “He looks calm” is the level you get on television, and I’ve spent years trying to understand the position, and I’ve barely scratched the surface. But in the NHL there is more information, better data, and lots of it.

When I looked at how many good goalies their are, with an eye to assessing this tandem idea that everyone is confidently talking about, I posted this:

This gives you an idea of the spread of talent in each year, but it names no names. Let’s do that and see if the good, the bad and the replacement-level are who we think they are.

I went to Evolving Hockey and collected up the cumulative all-situations, score-adjusted results for all goalies who have at least 30 games played and 300 Fenwick against from the beginning of 2014 to November 12 of this year. For some goalies, it’s massive numbers of minutes, and for a few, it’s a little bit.

EH included a few stats on their goalie page that need to be defined first.

Sv%: this is the traditional percentage of Shots on Goal that don’t become goals measure
FSv%: Fenwick Save % is the percentage of all unblocked shots that either miss or are saved
xFSv%: Expected Fenwick Save %: Expected Goals models are built on Fenwick (unblocked shots), so this is the Fenwick Save % a league average goalie would have had under the Expected Goals model
dFSv%: This is the difference of the Fenwick Save % over Expected.
GSAx: This is the total goals saved over Expected.

Okay, onto the fun. It’s 95 players, so if you want a Google Sheets Format: You can view it here. You should be able to sort or filter that version, and this one won’t be useful on AMP pages at all.

Historical goalie performance 2013-present

John Gibson13-20ANA25092.0894.4193.490.9295.43
Jordan Binnington15-20STL4792.2994.4493.660.7813.14
Antti Raanta13-20CHI/NYR/ARI15991.9794.3293.720.636.04
Andrew Hammond13-18OTT/COL5692.2594.3893.820.5712.12
Philipp Grubauer13-20WSH/COL14792.0894.3693.810.5530.62
Juuse Saros15-20NSH8691.894.1793.610.5519.62
Alexandar Georgiev17-20NYR5091.5393.8593.290.5512.24
Carey Price13-20MTL32892.1394.2193.740.4763.04
Henrik Lundqvist13-20NYR35591.5593.8893.430.4567.47
Frederik Andersen13-20ANA/TOR33191.6994.1393.680.4562.43
Corey Crawford13-20CHI30491.9493.9693.520.4452.45
Cam Talbot13-20NYR/EDM/PHI/CGY29391.4493.7993.370.4249.48
Jaroslav Halak13-20STL/WSH/NYI/BOS27691.5493.8393.430.4144.68
Braden Holtby13-20WSH37691.6194.0493.670.3856.6
Jack Campbell13-20DAL/L.A4591.9394.33940.335.79
Ben Bishop13-20T.B/L.A/DAL33692.1594.3894.060.3241.17
Anton Khudobin13-20CAR/ANA/BOS/DAL17491.5693.9893.680.3120.73
Casey Desmith17-19PIT5091.7493.8293.510.315.87
Sergei Bobrovsky13-20CBJ/FLA35091.7993.9693.670.341.41
Marc-Andre Fleury13-20PIT/VGK34691.7493.9793.670.2940.32
Ondrej Pavelec13-18WPG/NYR16790.7593.3393.050.2717.64
Jonathan Quick13-20L.A32691.1793.8593.590.2632.86
Thomas Greiss13-20ARI/PIT/NYI21691.6293.9393.660.2622.12
Brian Elliott13-20STL/CGY/PHI24691.4793.8993.70.1816.64
Ryan Miller13-20BUF/STL/VAN/ANA26291.6593.8793.70.1718.37
Matt Murray15-20PIT17591.6493.7793.610.1611.17
Steve Mason13-18PHI/WPG23791.6893.8993.750.1513.5
Connor Hellebuyck15-20WPG22591.5993.8493.720.1311.56
Laurent Brossoit14-20EDM/WPG5490.6693.2893.160.132.61
Cory Schneider13-20N.J30491.5393.7693.640.1213.98
Eddie Lack13-18VAN/CAR/CGY/N.J14490.9693.693.480.126.6
Semyon Varlamov13-20COL/NYI30991.6993.9893.870.1115.04
Martin Jones13-20L.A/S.J30090.9993.5993.50.110.76
Kari Lehtonen13-18DAL26990.8293.5493.460.088.22
Mike Smith13-20ARI/CGY/EDM31891.1393.793.650.067.91
Curtis McElhinney13-20CBJ/TOR/CAR/T.B15591.393.6993.650.042.27
Mikko Koskinen18-20EDM6590.993.3793.360.010.31
Roberto Luongo13-19FLA/VAN29791.7693.993.91-0.01-1.46
Aaron Dell16-20S.J8090.7993.4293.44-0.02-0.5
Petr Mrazek13-20DET/PHI/CAR23391.193.5493.57-0.03-3.02
Tuukka Rask13-20BOS36791.994.1694.2-0.04-6
Evgeni Nabokov13-15NYI/T.B5190.1192.8692.94-0.08-1.41
Jacob Markstrom13-20FLA/VAN20891.0693.5193.58-0.08-6.52
Jonathan Bernier13-20TOR/ANA/COL/DET27391.2993.8793.96-0.09-9.97
Al Montoya13-18WPG/FLA/MTL/EDM10591.1793.6493.76-0.12-4.34
Darcy Kuemper13-20MIN/ARI/L.A19291.6994.0894.21-0.13-9.36
Robin Lehner13-20OTT/BUF/NYI/CHI25091.8793.9594.08-0.13-13.53
Jonas Hiller13-16ANA/CGY12890.7893.7393.87-0.14-7.14
Pekka Rinne13-20NSH34191.6793.8794.02-0.14-18.82
Michal Neuvirth13-19BUF/WSH/NYI/PHI13591.2193.5893.73-0.15-7.76
Karri Ramo13-16CGY11191.0793.6393.8-0.16-6.84
Carter Hutton13-20NSH/STL/BUF19791.493.7893.94-0.16-11.3
James Reimer13-20TOR/S.J/FLA/CAR24191.2893.6393.8-0.17-16.32
Jimmy Howard13-20DET2929193.3893.56-0.18-20.32
Anders Nilsson13-20NYI/EDM/STL/BUF/VAN/OTT14690.8993.4693.65-0.19-11.96
David Rittich16-20CGY8390.9693.5293.74-0.23-7.02
Scott Darling14-19CHI/CAR12690.9193.3793.62-0.24-11.66
Justin Peters13-17CAR/WSH/ARI3690.7793.5393.81-0.28-4.05
Peter Budaj13-19MTL/L.A/T.B9690.7993.5493.83-0.29-9.56
Carter Hart18-20PHI4291.2593.4593.76-0.31-5.09
Cam Ward13-19CAR/CHI27090.5193.293.53-0.32-34.05
Antti Niemi13-19S.J/DAL/FLA/MTL/PIT25190.6893.4393.76-0.33-31.76
Michael Hutchinson13-20WPG/FLA/TOR11790.6693.1793.53-0.36-15.24
Jake Allen14-20STL25491.0793.4793.83-0.36-33.62
Joonas Korpisalo15-20CBJ10490.5593.1393.51-0.37-15.36
Jhonas Enroth13-17BUF/DAL/L.A/TOR10090.8893.593.88-0.38-15.74
Craig Anderson13-20OTT30691.1393.5293.92-0.4-53.32
Joni Ortio13-16CGY3790.0693.1893.59-0.41-5.49
Andrei Vasilevskiy14-20T.B21891.893.8994.3-0.41-36.47
Louis Domingue14-19ARI/T.B12290.8193.4593.89-0.44-22.09
Chad Johnson13-19BOS/NYI/BUF/CGY/ANA/STL18290.6793.3593.79-0.44-29.49
Devan Dubnyk13-20EDM/NSH/ARI/MIN36291.6494.0494.49-0.45-64.2
Mackenzie Blackwood18-20N.J3491.293.794.16-0.46-6.24
Ben Scrivens13-16EDM/L.A/MTL11290.4893.2193.68-0.46-20.99
Calvin Pickard14-19COL/TOR/ARI/PHI10490.9493.4193.89-0.48-19.55
Mike Condon15-19MTL/OTT/PIT12990.5993.2993.79-0.5-24.8
Tristan Jarry16-20PIT3390.893.1593.73-0.57-6.7
Anton Forsberg14-18CBJ/CHI4590.2692.4993.08-0.59-9.32
Keith Kinkaid14-20N.J/MTL15390.6593.2893.88-0.59-36.18
Alex Stalock13-20S.J/MIN1199193.5794.16-0.6-25.2
Tim Thomas13-14DAL/FLA4890.9493.0993.75-0.66-12.27
Malcolm Subban14-20BOS/VGK4990.3792.9593.66-0.7-13.02
Reto Berra13-18CGY/COL/FLA/ANA7690.693.2693.96-0.71-18.3
Viktor Fasth13-15ANA/EDM3889.6292.7993.52-0.73-10.96
j-f Berube15-18NYI/CHI3489.9592.4793.28-0.81-9.67
Linus Ullmark15-20BUF7091.0593.2994.09-0.81-23.04
Ilya Bryzgalov13-15EDM/MIN/ANA4090.0593.0593.89-0.83-12.47
Ray Emery13-15PHI5990.0392.993.78-0.87-18.24
Jeff Zatkoff13-17PIT/L.A4890.8393.2794.14-0.88-14.71
Jonas Gustavsson13-17DET/BOS/EDM6590.6493.1694.08-0.92-20.83
Martin Brodeur13-15N.J/STL4690.1892.5693.78-1.22-18.38
Anders Lindback13-16T.B/BUF/DAL/ARI6890.1192.9694.2-1.24-32.29
Garret Sparks15-20TOR/VGK3889.9292.7694.04-1.28-19.53
Marek Mazanec13-17NSH3189.7992.9994.34-1.35-15.82
Niklas Backstrom13-16MIN/CGY4489.4192.2994.01-1.72-26.73

The table starts out sorted by Delta Fenwick Save %. The reason I use this measure is that it takes enough of the team defensive quality out of the picture to give you a better look at the goalie’s actual performance.

Save % can show you that Gibson is better than Niklas Backstrom without any help. It can show you that Marc-Andre Fleury is better than Mike Condon, too, but as you look at the players in the middle, you’ll start to see that more and more of them look better by one measure over the other to the point that the rankings lose their agreement almost totally. The closer you are to average, the more a team being generally good or bad, giving the goalie a better or worse chance to succeed shows up in simple Save %.

Look at Andrei Vasilevskiy, last year’s Vezina winner, and you see a goalie whose career is below league average. Some of that is that he was developed in the NHL and wasn’t immediately great, and he’s young yet, and will show better with more mature seasons under his belt. But like Ben Bishop before him, he’s helped immensely by the quality of the shots the Lightning allow.  Sort the list by Expected Save %, and see who has an easy life.

The Leafs can’t have a goalie that needs an easy life. They need Freddie. And when it’s time to go backup shopping, like, oh, a few months back, they need a backup who can handle a team that is not built for defence, but manages to be okay enough at it.

You likely noticed one name near the top of this list at first. Andrew Hammond. This isn’t a perfect way to produce this dataset, but he’s a nice lesson in not falling for short bits of results over multiple seasons strung together. Remember when that lesson was Connor Carrick? Did we learn it? Maybe not, but Hammond has been played enough in the NHL on his hot streaks that his overall numbers are misleadingly high. It’s likely Garret Sparks is lower than he should be for that reason too, but not to an extreme degree, I don’t think.

I included the GSAx column just so you can see what a long career can mean in impact. Or, in Gibson’s case, how facing Carlyle hockey for years while being elite can make you the best man on this list by that measure. The Leafs are busy doing that for Andersen too. He’ll be jostling Gibson for the top spot in no time.

That’s actually a drawback of using the Delta Fenwick measure. It won’t tell you who can handle a heavy workload, and who can’t. Gibson, Andersen, Crawford and Halak haven’t needed as many games played to top that ranking as some of the others.

Two really interesting names here are Alex Stalock and Keith Kinkaid. I don’t understand why either one has lasted as long as they have, but sometimes a team plays the only goalie in the system who is available. If you help Stalock out a lot with shot quality, he can look league average, though. The Leafs were right, in hindsight, not to ask him to stay when they ended up with him in a trade.

Okay, now it’s your turn: go forth and argue about goalies.