Table filled in from the top 10m most popular web-sites.
- List Quality
- This list is prioritized on page rank vs traffic
- May include both inactive or redirected sites
- Does not reflect actual traffic or views
- Other lists that might be interesting:
- This list is prioritized on page rank vs traffic
https://s3-us-west-1.amazonaws.com/umbrella-static/index.html https://www.commoncrawl.org/ https://tranco-list.eu/
- Not that concerned if this list is exact
- Should provide good sampling of top sites
- Order really isn't important in this case
- This domain is decades old and not in the list!
- Don't get much traffic, but 10M+??
- Good performance test of a database table with 10M rows
- Cold load times take several seconds when paged out
- Well indexed but not performing as well as exepected
- Much larger tables have perfomed much better
- Appears like it is doing a full table-scan
- This database is running in a SQL Server under docker.
- Will load the same dataset into postgres for comparison.
- Started crawling the home page for the first 1M domains.
- Interested in stats on use of html5, proper html, etc..
- Started with the first 100K sites and expanding to first 1M.
- Observations
- Surprising number of domains without a proper html lang attr
- Surprising number of domains not using a proper HTML 5 doctype
- The domains are naked without fully qualified with hostname.
- Many domains don't have a dns entry for the naked domain.
- domain.com vs www.domain.com which should redirect.
- Suprising number of SSL errors on the naked domain
- Clients can't connect without dropping ssl verification
- With standard security checks clients will never get a redirect
- domains that redirect behind an invalid ssl cert
- this is super easy to fix/park to handle redirects.
- lost revenue with that much linking to get on this list
Selected Top Domains
skip report
# | Domain | Sort | Rank | Status | Flags |
---|---|---|---|---|---|
4101 | petfinder.com | 4875 | 5.37 | 200 | HTML 5, English |
4102 | libcom.org | 4876 | 5.37 | 200 | HTML 5, English |
4103 | nato.int | 4877 | 5.37 | 200 | HTML 5, No Lang |
4104 | cjr.org | 4878 | 5.37 | 200 | HTML 5, English |
4105 | northjersey.com | 4879 | 5.37 | 200 | HTML 5, English |
4106 | bonanza.com | 4880 | 5.37 | 200 | HTML 5, English |
4107 | authy.com | 4881 | 5.37 | 200 | HTML 5, English |
4108 | kddi.com | 4882 | 5.37 | 200 | HTML 5 |
4109 | aap.org | 4883 | 5.37 | 200 | HTML 5, English |
4110 | lsa.umich.edu | 4884 | 5.37 | 200 | HTML 5, English |
4111 | nysenate.gov | 4885 | 5.37 | 200 | HTML 5, English |
4112 | graphics.wsj.com | 4886 | 5.37 | 200 | English |
4113 | mobirise.com | 4888 | 5.37 | 200 | HTML 5, English |
4114 | peerj.com | 4889 | 5.37 | 200 | HTML 5, English |
4115 | tribe.net | 4890 | 5.37 | 200 | HTML 5, English |
4116 | books.google.ca | 4892 | 5.37 | 200 | HTML 5, No Lang |
4117 | id5.io | 4893 | 5.37 | 200 | HTML 5, English |
4118 | google.co.za | 4894 | 5.37 | 200 | HTML 5, English |
4119 | usefathom.com | 4895 | 5.37 | 200 | HTML 5, English |
4120 | tribuneindia.com | 4896 | 5.37 | 200 | HTML 5, English |
4121 | opensignal.com | 4897 | 5.37 | 200 | HTML 5, English |
4122 | ibiblio.org | 4898 | 5.37 | 200 | HTML 5, English |
4123 | swagger.io | 4899 | 5.37 | 200 | HTML 5, No Lang |
4124 | solarsystem.nasa.gov | 4900 | 5.37 | 200 | HTML 5, English |
4125 | blog.bufferapp.com | 4902 | 5.37 | 200 | HTML 5, English |
4126 | pay.weixin.qq.com | 4903 | 5.37 | 200 | No Lang |
4127 | fairmont.com | 4904 | 5.37 | 200 | HTML 5, English |
4128 | windowscentral.com | 4905 | 5.37 | 200 | HTML 5, English |
4129 | businesstoday.in | 4906 | 5.37 | 200 | HTML 5, English |
4130 | ssense.com | 4907 | 5.37 | 200 | HTML 5, English |
4131 | pinboard.in | 4908 | 5.37 | 200 | HTML 5, No Lang |
4132 | inquirer.com | 4909 | 5.37 | 200 | HTML 5, English |
4133 | leevalley.com | 4910 | 5.37 | 200 | HTML 5, English |
4134 | uq.edu.au | 4911 | 5.37 | 200 | HTML 5, English |
4135 | korg.com | 4912 | 5.37 | 200 | HTML 5, English |
4136 | abebooks.com | 4914 | 5.37 | 200 | HTML 5, English |
4137 | mxtoolbox.com | 4916 | 5.37 | 200 | HTML 5, English |
4138 | wordreference.com | 4917 | 5.37 | 200 | HTML 5, English |
4139 | fareharbor.com | 4918 | 5.37 | 200 | HTML 5, No Lang |
4140 | linguee.com | 4920 | 5.37 | 200 | HTML 5, No Lang |
4141 | gsma.com | 4921 | 5.37 | 200 | HTML 5, English |
4142 | whatsmyip.org | 4922 | 5.37 | 200 | HTML 5, English |
4143 | jamendo.com | 4923 | 5.37 | 200 | HTML 5, English |
4144 | kqed.org | 4924 | 5.37 | 200 | HTML 5, English |
4145 | distractify.com | 4925 | 5.37 | 200 | HTML 5, English |
4146 | showpass.com | 4926 | 5.37 | 200 | HTML 5, English |
4147 | sc.com | 4927 | 5.37 | 200 | No Lang, Transitional |
4148 | ctrl.blog | 4929 | 5.37 | 200 | HTML 5, English |
4149 | footwearnews.com | 4930 | 5.37 | 200 | HTML 5, English |
4150 | www2.census.gov | 4931 | 5.37 | 200 | No Lang |
4151 | ca.news.yahoo.com | 4932 | 5.37 | 200 | HTML 5, English |
4152 | birmingham.ac.uk | 4933 | 5.37 | 200 | HTML 5, English |
4153 | desiringgod.org | 4934 | 5.37 | 200 | HTML 5, English |
4154 | diva-portal.org | 4935 | 5.37 | 200 | HTML 5, English |
4155 | dailycaller.com | 4937 | 5.37 | 200 | HTML 5, English |
4156 | turkiye.gov.tr | 4938 | 5.37 | 200 | HTML 5 |
4157 | tubitv.com | 4939 | 5.37 | 200 | HTML 5, English |
4158 | gettyimages.co.uk | 4940 | 5.37 | 200 | HTML 5, English |
4159 | pinchofyum.com | 4941 | 5.37 | 200 | HTML 5, English |
4160 | ns.nl | 4942 | 5.37 | 200 | HTML 5 |
4161 | cira.ca | 4943 | 5.37 | 200 | HTML 5, English |
4162 | reelgood.com | 4944 | 5.37 | 200 | HTML 5, English |
4163 | uio.no | 4945 | 5.37 | 200 | HTML 5 |
4164 | auburn.edu | 4946 | 5.37 | 200 | HTML 5, English |
4165 | consumeraffairs.com | 4947 | 5.37 | 200 | HTML 5, English |
4166 | brunch.co.kr | 4949 | 5.37 | 200 | HTML 5 |
4167 | enable-javascript.com | 4950 | 5.37 | 200 | English |
4168 | tastingtable.com | 4953 | 5.37 | 200 | HTML 5, English |
4169 | sandiegouniontribune.com | 4954 | 5.37 | 200 | HTML 5, English |
4170 | plurk.com | 4955 | 5.37 | 200 | HTML 5, English |
4171 | wnycstudios.org | 4956 | 5.36 | 200 | HTML 5, English |
4172 | mercadopago.com.ar | 4957 | 5.36 | 200 | HTML 5 |
4173 | stats.oecd.org | 4958 | 5.36 | 200 | HTML 5, English |
4174 | mouser.com | 4959 | 5.36 | 200 | HTML 5, English |
4175 | bodybuilding.com | 4960 | 5.36 | 200 | HTML 5, English |
4176 | whois.domaintools.com | 4963 | 5.36 | 200 | HTML 5, English |
4177 | assetstore.unity.com | 4964 | 5.36 | 200 | HTML 5, English |
4178 | packetstormsecurity.com | 4965 | 5.36 | 200 | HTML 5, No Lang |
4179 | surveygizmo.com | 4966 | 5.36 | 200 | No Lang |
4180 | mercedes-benz.com | 4967 | 5.36 | 200 | HTML 5, English |
4181 | 9news.com | 4968 | 5.36 | 200 | HTML 5, English |
4182 | svea.com | 4969 | 5.36 | 200 | HTML 5, English |
4183 | logging.apache.org | 4971 | 5.36 | 200 | HTML 5, English |
4184 | fontawesome.io | 4972 | 5.36 | 200 | HTML 5, English |
4185 | doh.wa.gov | 4973 | 5.36 | 200 | HTML 5, English |
4186 | insidehook.com | 4974 | 5.36 | 200 | HTML 5, English |
4187 | pypi.python.org | 4975 | 5.36 | 200 | HTML 5, English |
4188 | en-gb.wordpress.org | 4976 | 5.36 | 200 | HTML 5, English |
4189 | appsheet.com | 4977 | 5.36 | 200 | HTML 5, English |
4190 | tampabay.com | 4978 | 5.36 | 200 | HTML 5, English |
4191 | openwrt.org | 4979 | 5.36 | 200 | HTML 5, English |
4192 | interviewmagazine.com | 4980 | 5.36 | 200 | HTML 5, English |
4193 | ussailing.org | 4981 | 5.36 | 200 | HTML 5, English |
4194 | floridatoday.com | 4982 | 5.36 | 200 | HTML 5, English |
4195 | nola.com | 4983 | 5.36 | 200 | HTML 5, English |
4196 | icollector.com | 4984 | 5.36 | 200 | No Lang, Transitional |
4197 | telstra.com.au | 4985 | 5.36 | 200 | HTML 5, English |
4198 | stellar.org | 4986 | 5.36 | 200 | HTML 5, English |
4199 | revolut.me | 4987 | 5.36 | 200 | HTML 5, English |
4200 | raygun.com | 4988 | 5.36 | 200 | HTML 5, English |
Data from: Open PageRank