Table filled in from the top 10m most popular web-sites.
- List Quality
- This list is prioritized on page rank vs traffic
- May include both inactive or redirected sites
- Does not reflect actual traffic or views
- Other lists that might be interesting:
- This list is prioritized on page rank vs traffic
https://s3-us-west-1.amazonaws.com/umbrella-static/index.html https://www.commoncrawl.org/ https://tranco-list.eu/
- Not that concerned if this list is exact
- Should provide good sampling of top sites
- Order really isn't important in this case
- This domain is decades old and not in the list!
- Don't get much traffic, but 10M+??
- Good performance test of a database table with 10M rows
- Cold load times take several seconds when paged out
- Well indexed but not performing as well as exepected
- Much larger tables have perfomed much better
- Appears like it is doing a full table-scan
- This database is running in a SQL Server under docker.
- Will load the same dataset into postgres for comparison.
- Started crawling the home page for the first 1M domains.
- Interested in stats on use of html5, proper html, etc..
- Started with the first 100K sites and expanding to first 1M.
- Observations
- Surprising number of domains without a proper html lang attr
- Surprising number of domains not using a proper HTML 5 doctype
- The domains are naked without fully qualified with hostname.
- Many domains don't have a dns entry for the naked domain.
- domain.com vs www.domain.com which should redirect.
- Suprising number of SSL errors on the naked domain
- Clients can't connect without dropping ssl verification
- With standard security checks clients will never get a redirect
- domains that redirect behind an invalid ssl cert
- this is super easy to fix/park to handle redirects.
- lost revenue with that much linking to get on this list
Selected Top Domains
skip report
# | Domain | Sort | Rank | Status | Flags |
---|---|---|---|---|---|
6501 | gourmettraveller.com.au | 7627 | 5.19 | 200 | HTML 5, English |
6502 | theadvocate.com | 7628 | 5.19 | 200 | HTML 5, English |
6503 | seventeen.com | 7629 | 5.19 | 200 | HTML 5, English |
6504 | papers.nips.cc | 7630 | 5.19 | 200 | HTML 5, English |
6505 | dom.spec.whatwg.org | 7631 | 5.19 | 200 | HTML 5, English |
6506 | chicagomanualofstyle.org | 7633 | 5.19 | 200 | HTML 5, English |
6507 | heavy.com | 7634 | 5.19 | 200 | HTML 5, English |
6508 | connect.garmin.com | 7635 | 5.19 | 200 | HTML 5, No Lang |
6509 | slatestarcodex.com | 7636 | 5.19 | 200 | HTML 5, English |
6510 | montgomerycountymd.gov | 7637 | 5.19 | 200 | HTML 5, English |
6511 | gap.com | 7638 | 5.19 | 200 | HTML 5, English |
6512 | rsa.com | 7639 | 5.19 | 200 | HTML 5, English |
6513 | tokyo-np.co.jp | 7640 | 5.19 | 200 | HTML 5 |
6514 | cozi.com | 7641 | 5.19 | 200 | HTML 5, English |
6515 | wikimedia.org | 7642 | 5.19 | 200 | HTML 5, English |
6516 | linux.com | 7643 | 5.19 | 200 | English |
6517 | liveauctioneers.com | 7644 | 5.19 | 200 | HTML 5, English |
6518 | thewirecutter.com | 7645 | 5.19 | 200 | HTML 5, English |
6519 | maps.google.co.jp | 7646 | 5.19 | 200 | HTML 5, English |
6520 | catholic.com | 7647 | 5.19 | 200 | HTML 5, No Lang |
6521 | perl.org | 7648 | 5.19 | 200 | HTML 5, English |
6522 | crn.com.au | 7649 | 5.19 | 200 | HTML 5, No Lang |
6523 | osxdaily.com | 7650 | 5.19 | 200 | English, Transitional |
6524 | ssir.org | 7651 | 5.19 | 200 | HTML 5, English |
6525 | support.metamask.io | 7652 | 5.19 | 200 | HTML 5, English |
6526 | xmlrpc.com | 7653 | 5.19 | 200 | No Lang |
6527 | apps.twitter.com | 7654 | 5.19 | 200 | HTML 5, No Lang |
6528 | usbr.gov | 7656 | 5.19 | 200 | English |
6529 | royalmint.com | 7657 | 5.19 | 200 | HTML 5, English |
6530 | sierraclub.org | 7658 | 5.19 | 200 | HTML 5, English |
6531 | delijn.be | 7659 | 5.19 | 200 | HTML 5, No Lang |
6532 | experience.sap.com | 7660 | 5.19 | 200 | HTML 5, English |
6533 | jupyter.org | 7662 | 5.19 | 200 | HTML 5, English |
6534 | fast.com | 7663 | 5.19 | 200 | No Lang, Strict |
6535 | pagar.me | 7665 | 5.19 | 200 | HTML 5 |
6536 | firebase.com | 7666 | 5.19 | 200 | HTML 5, English |
6537 | demandbase.com | 7667 | 5.19 | 200 | HTML 5, English |
6538 | wdet.org | 7668 | 5.19 | 200 | HTML 5, English |
6539 | suss.edu.sg | 7669 | 5.19 | 200 | HTML 5, English |
6540 | adminer.org | 7670 | 5.19 | 200 | English, Strict |
6541 | discover.com | 7671 | 5.19 | 200 | HTML 5, English |
6542 | cdjapan.co.jp | 7672 | 5.19 | 200 | HTML 5, English |
6543 | ina.fr | 7673 | 5.19 | 200 | HTML 5 |
6544 | unaids.org | 7674 | 5.19 | 200 | HTML 5, English |
6545 | kompas.com | 7675 | 5.19 | 200 | HTML 5, No Lang |
6546 | philips-hue.com | 7676 | 5.19 | 200 | HTML 5, English |
6547 | securityaffairs.co | 7677 | 5.19 | 200 | HTML 5, English |
6548 | askart.com | 7678 | 5.19 | 200 | HTML 5, English |
6549 | spreadshirt.com | 7679 | 5.19 | 200 | HTML 5, English |
6550 | getfedora.org | 7681 | 5.19 | 200 | HTML 5, No Lang |
6551 | maa.org | 7682 | 5.19 | 200 | HTML 5, English |
6552 | donaldjtrump.com | 7684 | 5.19 | 200 | HTML 5, English |
6553 | uaf.edu | 7685 | 5.19 | 200 | HTML 5, English |
6554 | maps.google.co.uk | 7686 | 5.19 | 200 | HTML 5, English |
6555 | takeda.com | 7687 | 5.19 | 200 | HTML 5, English |
6556 | allposters.com | 7688 | 5.19 | 200 | HTML 5, English |
6557 | energy.ca.gov | 7689 | 5.19 | 200 | HTML 5, English |
6558 | ia.net | 7690 | 5.19 | 200 | HTML 5, English |
6559 | google.com.ni | 7692 | 5.19 | 200 | HTML 5, English |
6560 | frenet.com.br | 7693 | 5.19 | 200 | HTML 5 |
6561 | comptroller.texas.gov | 7694 | 5.19 | 200 | HTML 5, English |
6562 | uni-ulm.de | 7695 | 5.19 | 200 | HTML 5 |
6563 | stopbullying.gov | 7696 | 5.19 | 200 | HTML 5, English |
6564 | m.tiktok.com | 7697 | 5.19 | 200 | HTML 5, English |
6565 | destructoid.com | 7698 | 5.19 | 200 | HTML 5, English |
6566 | iau.org | 7699 | 5.19 | 200 | HTML 5, No Lang |
6567 | weather.gc.ca | 7700 | 5.19 | 200 | HTML 5, English |
6568 | o2.cz | 7701 | 5.19 | 200 | HTML 5 |
6569 | popl.co | 7702 | 5.19 | 200 | HTML 5, English |
6570 | icc-cpi.int | 7703 | 5.19 | 200 | HTML 5, English |
6571 | thewoksoflife.com | 7706 | 5.19 | 200 | HTML 5, English |
6572 | deccanherald.com | 7707 | 5.19 | 200 | HTML 5, English |
6573 | nominet.uk | 7708 | 5.19 | 200 | HTML 5, English |
6574 | menards.com | 7709 | 5.19 | 200 | No Lang |
6575 | parcel2go.com | 7710 | 5.19 | 200 | HTML 5, English |
6576 | igvita.com | 7711 | 5.19 | 200 | HTML 5, English |
6577 | waltonbd.com | 7712 | 5.19 | 200 | HTML 5, English |
6578 | neurosciencenews.com | 7713 | 5.19 | 200 | HTML 5, English |
6579 | ralphlauren.com | 7714 | 5.19 | 200 | HTML 5, English |
6580 | jpn.nec.com | 7715 | 5.19 | 200 | HTML 5 |
6581 | gsmarena.com | 7716 | 5.19 | 200 | HTML 5, English |
6582 | getfirefox.com | 7717 | 5.19 | 200 | HTML 5, English |
6583 | current.com | 7718 | 5.19 | 200 | HTML 5, English |
6584 | universiteitleiden.nl | 7719 | 5.19 | 200 | HTML 5 |
6585 | pt.scribd.com | 7720 | 5.19 | 200 | HTML 5, English |
6586 | bellemaison.jp | 7721 | 5.19 | 200 | HTML 5 |
6587 | yugioh-world.com | 7724 | 5.19 | 200 | HTML 5, English |
6588 | chrisjdavis.org | 7726 | 5.19 | 200 | HTML 5, English |
6589 | cldup.com | 7727 | 5.19 | 200 | HTML 5, No Lang |
6590 | gallica.bnf.fr | 7728 | 5.19 | 200 | |
6591 | bemyeyes.com | 7730 | 5.19 | 200 | HTML 5, English |
6592 | telegraphindia.com | 7731 | 5.19 | 200 | HTML 5, English |
6593 | townandcountrymag.com | 7732 | 5.19 | 200 | HTML 5, English |
6594 | stem.org.uk | 7733 | 5.19 | 200 | HTML 5, English |
6595 | lloydsbank.com | 7734 | 5.19 | 200 | HTML 5, English |
6596 | literatureandlatte.com | 7735 | 5.19 | 200 | HTML 5, English |
6597 | cdlib.org | 7736 | 5.19 | 200 | HTML 5, English |
6598 | nctm.org | 7737 | 5.19 | 200 | HTML 5, English |
6599 | wipro.com | 7738 | 5.19 | 200 | HTML 5, English |
6600 | princeedwardisland.ca | 7739 | 5.19 | 200 | HTML 5, English |
Data from: Open PageRank