The ultimate faceoff between password lists
Yes, I'm still working on making the ultimate password list. And I don't mean the 16gb one I made by taking pretty much every word or word-looking string on the Internet when I was a kid; that was called ultimater dictionary. No; I mean one that is streamlined, sorted, and will make Nmap the bruteforce tool of the future!
First, a sidenote: JHaddix from Security Aegis posted a story mentioning my password lists and noted "I'd grab these lists if you dont already have them, who knows how long they will stay up." He makes a great point -- if I'm asked to remove these lists, I'll have no choice (for what it's worth, I don't see why I would; I cleared it with my ISP before hosting them). But, just in case, I wrapped everything up in a single tarball: skullsecurity-lists.tar.bz2. Weighing in at 132mb, it contains my whole collection of password lists. Feel free to grab it! If you want to pick and choose, as always, check out my password page.
So anyway, on the subject of generating awesome password lists, Brandon Enright from the Nmap team is trying to come up with an algorithm to rank the different words in the different lists. Meanwhile, I spent some time graphing potential password dictionaries' success against leaked password lists to see which one was best.
These are the dictionaries I used:
- John the ripper
- Myspace (Nmap's original)
- Phpbb (cracked by Brandon Enright)
- Rockyou.com (my favourite; not that I'm biased)
- Conficker (which I already knew would suck)
And I put them up against some of the best leaked password lists I've collected:
(Obviously, where there's overlap, I didn't count the password cracking its own list; it wouldn't really be fair to crack Rockyou.com passwords using the Rockyou.com list -- I did that in an earlier blog to measure coverage, though, if you want to check that out).
Because we want smaller lists, I used the top 1, 10, 50, 100, 200, 500, 1000, 2000, and 5000 passwords from each list, and measured how many of the original passwords it would crack. The best possible result, obviously, is to have points at {100,100}, {1000,1000}, etc. (dependent on the size of the target list). Naturally, that didn't happen anywhere, but it was close on a couple (the phpbb password list, for example, almost perfectly cracked Rockyou.com -- more because Rockyou.com is big than because phpbb is complete, but you get the picture).
Enough talk, here are the results (note: each graph represents a target, and the lines represent the dictionaries):








Conclusion
I think the conclusions here are:
- Rockyou.com and phpbb are the best lists (props to Brandon for cracking the phpbb passwords!)
- Conficker is a clear loser -- I wonder if Conficker would have done better if the authors spent more time generating its dictionary?
- No dictionary is perfect -- no dictionary won in every match. That's why we need to rank words and make the perfect one!
- OpenOffice.org 3 makes sexy graphs!
On the next episode of Skullsecurity.org..... why you need robots.txt if you're hosting dictionaries, especially German ones.


March 21st, 2010 at 13:50
Great job there !
Why don't you just make a torrent and distribute it more efficiently ?
-begood
March 21st, 2010 at 22:04
@begood Thanks! I'm not really a huge fan of torrents, I'd rather distribute it myself. I *should* have plenty of upspeed, but my provider (voinetworks.ca) is currently screwing me on bandwidth and won't return my messages.
March 22nd, 2010 at 08:25
my password is blueberries! Is that on your list?
#itsshakeandbakeandihelped!
May 22nd, 2010 at 03:33
do you already have compiled THE ultimate pw-list?
just took a mix of your rockyou/phpbb/john-list with a list of localized words (europea here), fired up hydra and hat a very nice time.
thanx for your inspirations
August 27th, 2010 at 10:40
Hash cracker is a web-service that allows you to encrypt your passwords
or crack your hashed passwords with MD5, SHA1 or NTLM algorithms.
You can also encode or decode texts with Base64 system.
http://www.hash-cracker.com
Video tutorial:
http://www.youtube.com/watch?v=JVxdQPdGXec
August 27th, 2010 at 10:43
So you're suggesting that people enter their passwords into your site? Sounds like a bad idea to me. :)
August 31st, 2010 at 16:35
Thanks for this, however the download looks to be 404 now.
August 31st, 2010 at 21:52
Sorry, it was starting to get too big my server to handle. I might put together a .torrent for it, though. Stay tuned!