Table filled in from the top 10m most popular web-sites.
- List Quality
- This list is prioritized on page rank vs traffic
- May include both inactive or redirected sites
- Does not reflect actual traffic or views
- Other lists that might be interesting:
- This list is prioritized on page rank vs traffic
https://s3-us-west-1.amazonaws.com/umbrella-static/index.html https://www.commoncrawl.org/ https://tranco-list.eu/
- Not that concerned if this list is exact
- Should provide good sampling of top sites
- Order really isn't important in this case
- This domain is decades old and not in the list!
- Don't get much traffic, but 10M+??
- Good performance test of a database table with 10M rows
- Cold load times take several seconds when paged out
- Well indexed but not performing as well as exepected
- Much larger tables have perfomed much better
- Appears like it is doing a full table-scan
- This database is running in a SQL Server under docker.
- Will load the same dataset into postgres for comparison.
- Started crawling the home page for the first 1M domains.
- Interested in stats on use of html5, proper html, etc..
- Started with the first 100K sites and expanding to first 1M.
- Observations
- Surprising number of domains without a proper html lang attr
- Surprising number of domains not using a proper HTML 5 doctype
- The domains are naked without fully qualified with hostname.
- Many domains don't have a dns entry for the naked domain.
- domain.com vs www.domain.com which should redirect.
- Suprising number of SSL errors on the naked domain
- Clients can't connect without dropping ssl verification
- With standard security checks clients will never get a redirect
- domains that redirect behind an invalid ssl cert
- this is super easy to fix/park to handle redirects.
- lost revenue with that much linking to get on this list
Selected Top Domains
skip report
# | Domain | Sort | Rank | Status | Flags |
---|---|---|---|---|---|
18101 | iranintl.com | 21094 | 4.88 | 200 | HTML 5 |
18102 | fox23.com | 21095 | 4.88 | 200 | HTML 5, English |
18103 | espruino.com | 21096 | 4.88 | 200 | HTML 5, English |
18104 | productboard.com | 21097 | 4.88 | 200 | HTML 5, English |
18105 | gyldendal.no | 21098 | 4.88 | 200 | HTML 5 |
18106 | fantagraphics.com | 21099 | 4.88 | 200 | HTML 5, English |
18107 | heroarts.com | 21100 | 4.88 | 200 | HTML 5, English |
18108 | valant.io | 21101 | 4.88 | 200 | HTML 5, English |
18109 | nvidia.custhelp.com | 21102 | 4.88 | 200 | HTML 5, English |
18110 | bob.ippoli.to | 21103 | 4.88 | 200 | HTML 5, English |
18111 | pugixml.org | 21104 | 4.88 | 200 | HTML 5, No Lang |
18112 | architecture.about.com | 21105 | 4.88 | 200 | HTML 5, English |
18113 | charismamag.com | 21106 | 4.88 | 200 | HTML 5, English |
18114 | innogames.com | 21108 | 4.88 | 200 | HTML 5, English |
18115 | fujifilm-x.com | 21109 | 4.88 | 200 | HTML 5, English |
18116 | sos.iowa.gov | 21110 | 4.88 | 200 | HTML 5, English |
18117 | sabr.org | 21111 | 4.88 | 200 | HTML 5, English |
18118 | gut.bmj.com | 21113 | 4.88 | 200 | HTML 5, English |
18119 | ncl.com | 21114 | 4.88 | 200 | HTML 5, English |
18120 | townscript.com | 21115 | 4.88 | 200 | HTML 5, English |
18121 | joongang.co.kr | 21116 | 4.88 | 200 | HTML 5 |
18122 | visitor.r20.constantcontact.com | 21117 | 4.88 | 200 | No Lang |
18123 | autoanything.com | 21118 | 4.88 | 200 | HTML 5, English |
18124 | blog.nus.edu.sg | 21119 | 4.88 | 200 | HTML 5, English |
18125 | fullcalendar.io | 21120 | 4.88 | 200 | HTML 5, No Lang |
18126 | business.comcast.com | 21121 | 4.88 | 200 | HTML 5, English |
18127 | oeil.secure.europarl.europa.eu | 21122 | 4.88 | 200 | HTML 5, English |
18128 | web.uvic.ca | 21124 | 4.88 | 200 | HTML 5, English |
18129 | dartslive.com | 21125 | 4.88 | 200 | HTML 5, English |
18130 | autocar.co.uk | 21126 | 4.88 | 200 | HTML 5, English |
18131 | persnicketyplates.com | 21127 | 4.88 | 200 | HTML 5, English |
18132 | ischool.uw.edu | 21129 | 4.88 | 200 | HTML 5, English |
18133 | pwm.com.pl | 21130 | 4.88 | 200 | HTML 5 |
18134 | thethingsnetwork.org | 21131 | 4.88 | 200 | HTML 5, English |
18135 | visualcrossing.com | 21132 | 4.88 | 200 | HTML 5, English |
18136 | webapp1.dlib.indiana.edu | 21135 | 4.88 | 200 | No Lang |
18137 | chemnitz.de | 21136 | 4.88 | 200 | HTML 5 |
18138 | ocala.com | 21137 | 4.88 | 200 | HTML 5, English |
18139 | kansalliskirjasto.fi | 21139 | 4.88 | 200 | HTML 5 |
18140 | skyperfectv.co.jp | 21140 | 4.88 | 200 | HTML 5, No Lang |
18141 | isbank.com.tr | 21141 | 4.88 | 200 | HTML 5 |
18142 | mkm.ee | 21143 | 4.88 | 200 | HTML 5 |
18143 | rpsychologist.com | 21144 | 4.88 | 200 | HTML 5, No Lang |
18144 | nyhistory.org | 21146 | 4.88 | 200 | HTML 5, English |
18145 | facetwp.com | 21147 | 4.88 | 200 | HTML 5, English |
18146 | messynessychic.com | 21148 | 4.88 | 200 | HTML 5, English |
18147 | coppel.com | 21149 | 4.88 | 200 | HTML 5 |
18148 | abine.com | 21150 | 4.88 | 200 | HTML 5, English |
18149 | retailcustomerexperience.com | 21151 | 4.88 | 200 | HTML 5, English |
18150 | the-japan-news.com | 21152 | 4.88 | 200 | HTML 5, English |
18151 | wadny.com | 21153 | 4.88 | 200 | HTML 5, English |
18152 | maps.google.pl | 21154 | 4.88 | 200 | HTML 5, English |
18153 | relive.cc | 21155 | 4.88 | 200 | HTML 5, English |
18154 | freeradius.org | 21156 | 4.88 | 200 | HTML 5, No Lang |
18155 | railadvent.co.uk | 21157 | 4.88 | 200 | HTML 5, English |
18156 | havenly.com | 21158 | 4.88 | 200 | HTML 5, English |
18157 | vhemt.org | 21159 | 4.88 | 200 | No Lang, Transitional |
18158 | herbalife.com | 21160 | 4.88 | 200 | HTML 5, English |
18159 | smgstudio.com | 21162 | 4.88 | 200 | HTML 5, English |
18160 | ccc.de | 21163 | 4.88 | 200 | HTML 5, English |
18161 | dailyfinance.com | 21164 | 4.88 | 200 | HTML 5, English |
18162 | xdsoft.net | 21165 | 4.88 | 200 | HTML 5, English |
18163 | nelp.org | 21166 | 4.88 | 200 | HTML 5, English |
18164 | eshakti.com | 21167 | 4.88 | 200 | HTML 5, No Lang |
18165 | mnemosyne-proj.org | 21169 | 4.88 | 200 | HTML 5, English |
18166 | conseil-constitutionnel.fr | 21170 | 4.88 | 200 | HTML 5 |
18167 | befrienders.org | 21171 | 4.88 | 200 | HTML 5, English |
18168 | chicagounbound.uchicago.edu | 21172 | 4.88 | 200 | HTML 5, English |
18169 | esf.edu | 21173 | 4.88 | 200 | HTML 5, English |
18170 | partners.adobe.com | 21174 | 4.88 | 200 | HTML 5, No Lang |
18171 | orkin.com | 21175 | 4.88 | 200 | HTML 5, English |
18172 | storybook.js.org | 21176 | 4.88 | 200 | HTML 5, English |
18173 | workable.com | 21177 | 4.88 | 200 | HTML 5, English |
18174 | sympy.org | 21178 | 4.88 | 200 | No Lang |
18175 | hvg.hu | 21180 | 4.88 | 200 | HTML 5 |
18176 | filmmakermagazine.com | 21181 | 4.88 | 200 | HTML 5, English |
18177 | godrej.com | 21182 | 4.88 | 200 | HTML 5, No Lang |
18178 | zvv.ch | 21184 | 4.88 | 200 | HTML 5 |
18179 | dailynewsegypt.com | 21185 | 4.88 | 200 | HTML 5, English |
18180 | dynamed.com | 21187 | 4.88 | 200 | HTML 5, English |
18181 | kino-teatr.ru | 21188 | 4.88 | 200 | HTML 5, No Lang |
18182 | optoutprescreen.com | 21189 | 4.88 | 200 | HTML 5, English |
18183 | webs.uvigo.es | 21191 | 4.88 | 200 | HTML 5, No Lang |
18184 | beliebte-vornamen.de | 21192 | 4.88 | 200 | HTML 5 |
18185 | jsonrpc.org | 21193 | 4.88 | 200 | HTML 5, English |
18186 | marketrealist.com | 21194 | 4.88 | 200 | HTML 5, English |
18187 | invent.org | 21195 | 4.88 | 200 | HTML 5, English |
18188 | stoplight.io | 21196 | 4.87 | 200 | HTML 5, English |
18189 | vogue.pl | 21197 | 4.87 | 200 | HTML 5 |
18190 | cornellpress.cornell.edu | 21199 | 4.87 | 200 | HTML 5, English |
18191 | beyondmeat.com | 21200 | 4.87 | 200 | HTML 5, English |
18192 | supermicro.com | 21202 | 4.87 | 200 | HTML 5, English |
18193 | webberzone.com | 21203 | 4.87 | 200 | HTML 5, English |
18194 | debugbear.com | 21204 | 4.87 | 200 | HTML 5, English |
18195 | system76.com | 21205 | 4.87 | 200 | HTML 5, English |
18196 | ilmatieteenlaitos.fi | 21206 | 4.87 | 200 | HTML 5 |
18197 | zerotothree.org | 21207 | 4.87 | 200 | HTML 5, English |
18198 | healthywa.wa.gov.au | 21208 | 4.87 | 200 | English, Transitional |
18199 | uncut.co.uk | 21209 | 4.87 | 200 | English |
18200 | motionpictures.org | 21210 | 4.87 | 200 | HTML 5, English |
Data from: Open PageRank