Home·Top Domains
Question

Table filled in from the top 10m most popular web-sites.

  • List Quality
    • This list is prioritized on page rank vs traffic
      • May include both inactive or redirected sites
      • Does not reflect actual traffic or views
    • Other lists that might be interesting:

https://s3-us-west-1.amazonaws.com/umbrella-static/index.html https://www.commoncrawl.org/ https://tranco-list.eu/

  • Not that concerned if this list is exact
    • Should provide good sampling of top sites
    • Order really isn't important in this case
  • This domain is decades old and not in the list!
    • Don't get much traffic, but 10M+??
  • Good performance test of a database table with 10M rows
    • Cold load times take several seconds when paged out
    • Well indexed but not performing as well as exepected
      • Much larger tables have perfomed much better
      • Appears like it is doing a full table-scan
    • This database is running in a SQL Server under docker.
    • Will load the same dataset into postgres for comparison.
  • Started crawling the home page for the first 1M domains.
    • Interested in stats on use of html5, proper html, etc..
    • Started with the first 100K sites and expanding to first 1M.
  • Observations
    • Surprising number of domains without a proper html lang attr
    • Surprising number of domains not using a proper HTML 5 doctype
    • The domains are naked without fully qualified with hostname.
    • Many domains don't have a dns entry for the naked domain.
      • domain.com vs www.domain.com which should redirect.
    • Suprising number of SSL errors on the naked domain
      • Clients can't connect without dropping ssl verification
      • With standard security checks clients will never get a redirect
      • domains that redirect behind an invalid ssl cert
        • this is super easy to fix/park to handle redirects.
        • lost revenue with that much linking to get on this list

Selected Top Domains

Searching..
skip report
#DomainSortRankStatusFlags
4101petfinder.com48755.37200HTML 5, English
4102libcom.org48765.37200HTML 5, English
4103nato.int48775.37200HTML 5, No Lang
4104cjr.org48785.37200HTML 5, English
4105northjersey.com48795.37200HTML 5, English
4106bonanza.com48805.37200HTML 5, English
4107authy.com48815.37200HTML 5, English
4108kddi.com48825.37200HTML 5
4109aap.org48835.37200HTML 5, English
4110lsa.umich.edu48845.37200HTML 5, English
4111nysenate.gov48855.37200HTML 5, English
4112graphics.wsj.com48865.37200English
4113mobirise.com48885.37200HTML 5, English
4114peerj.com48895.37200HTML 5, English
4115tribe.net48905.37200HTML 5, English
4116books.google.ca48925.37200HTML 5, No Lang
4117id5.io48935.37200HTML 5, English
4118google.co.za48945.37200HTML 5, English
4119usefathom.com48955.37200HTML 5, English
4120tribuneindia.com48965.37200HTML 5, English
4121opensignal.com48975.37200HTML 5, English
4122ibiblio.org48985.37200HTML 5, English
4123swagger.io48995.37200HTML 5, No Lang
4124solarsystem.nasa.gov49005.37200HTML 5, English
4125blog.bufferapp.com49025.37200HTML 5, English
4126pay.weixin.qq.com49035.37200No Lang
4127fairmont.com49045.37200HTML 5, English
4128windowscentral.com49055.37200HTML 5, English
4129businesstoday.in49065.37200HTML 5, English
4130ssense.com49075.37200HTML 5, English
4131pinboard.in49085.37200HTML 5, No Lang
4132inquirer.com49095.37200HTML 5, English
4133leevalley.com49105.37200HTML 5, English
4134uq.edu.au49115.37200HTML 5, English
4135korg.com49125.37200HTML 5, English
4136abebooks.com49145.37200HTML 5, English
4137mxtoolbox.com49165.37200HTML 5, English
4138wordreference.com49175.37200HTML 5, English
4139fareharbor.com49185.37200HTML 5, No Lang
4140linguee.com49205.37200HTML 5, No Lang
4141gsma.com49215.37200HTML 5, English
4142whatsmyip.org49225.37200HTML 5, English
4143jamendo.com49235.37200HTML 5, English
4144kqed.org49245.37200HTML 5, English
4145distractify.com49255.37200HTML 5, English
4146showpass.com49265.37200HTML 5, English
4147sc.com49275.37200No Lang, Transitional
4148ctrl.blog49295.37200HTML 5, English
4149footwearnews.com49305.37200HTML 5, English
4150www2.census.gov49315.37200No Lang
4151ca.news.yahoo.com49325.37200HTML 5, English
4152birmingham.ac.uk49335.37200HTML 5, English
4153desiringgod.org49345.37200HTML 5, English
4154diva-portal.org49355.37200HTML 5, English
4155dailycaller.com49375.37200HTML 5, English
4156turkiye.gov.tr49385.37200HTML 5
4157tubitv.com49395.37200HTML 5, English
4158gettyimages.co.uk49405.37200HTML 5, English
4159pinchofyum.com49415.37200HTML 5, English
4160ns.nl49425.37200HTML 5
4161cira.ca49435.37200HTML 5, English
4162reelgood.com49445.37200HTML 5, English
4163uio.no49455.37200HTML 5
4164auburn.edu49465.37200HTML 5, English
4165consumeraffairs.com49475.37200HTML 5, English
4166brunch.co.kr49495.37200HTML 5
4167enable-javascript.com49505.37200English
4168tastingtable.com49535.37200HTML 5, English
4169sandiegouniontribune.com49545.37200HTML 5, English
4170plurk.com49555.37200HTML 5, English
4171wnycstudios.org49565.36200HTML 5, English
4172mercadopago.com.ar49575.36200HTML 5
4173stats.oecd.org49585.36200HTML 5, English
4174mouser.com49595.36200HTML 5, English
4175bodybuilding.com49605.36200HTML 5, English
4176whois.domaintools.com49635.36200HTML 5, English
4177assetstore.unity.com49645.36200HTML 5, English
4178packetstormsecurity.com49655.36200HTML 5, No Lang
4179surveygizmo.com49665.36200No Lang
4180mercedes-benz.com49675.36200HTML 5, English
41819news.com49685.36200HTML 5, English
4182svea.com49695.36200HTML 5, English
4183logging.apache.org49715.36200HTML 5, English
4184fontawesome.io49725.36200HTML 5, English
4185doh.wa.gov49735.36200HTML 5, English
4186insidehook.com49745.36200HTML 5, English
4187pypi.python.org49755.36200HTML 5, English
4188en-gb.wordpress.org49765.36200HTML 5, English
4189appsheet.com49775.36200HTML 5, English
4190tampabay.com49785.36200HTML 5, English
4191openwrt.org49795.36200HTML 5, English
4192interviewmagazine.com49805.36200HTML 5, English
4193ussailing.org49815.36200HTML 5, English
4194floridatoday.com49825.36200HTML 5, English
4195nola.com49835.36200HTML 5, English
4196icollector.com49845.36200No Lang, Transitional
4197telstra.com.au49855.36200HTML 5, English
4198stellar.org49865.36200HTML 5, English
4199revolut.me49875.36200HTML 5, English
4200raygun.com49885.36200HTML 5, English
Data from: Open PageRank