Zipf's law

Zipf's law

all languages follow this law. The second most common word is used 1/2 as much as the most. The third word is used 1/3 the most, and so on and so on for all languages




 (/zɪf/) is an empirical law formulated using mathematical statistics that refers to the fact that many types of data studied in the physical and social sciences can be approximated with a Zipfian distribution, one of a family of related discrete power law probability distributions. Zipf distribution is related to the zeta distribution, but is not identical.

For example, Zipf's law states that given some corpus of natural language utterances, the frequency of any word is inversely proportional to its rank in the frequency table. Thus the most frequent word will occur approximately twice as often as the second most frequent word, three times as often as the third most frequent word, etc.: the rank-frequency distribution is an inverse relation. For example, in the Brown Corpus of American English text, the word the is the most frequently occurring word, and by itself accounts for nearly 7% of all word occurrences (69,971 out of slightly over 1 million). True to Zipf's Law, the second-place word of accounts for slightly over 3.5% of words (36,411 occurrences), followed by and (28,852). Only 135 vocabulary items are needed to account for half the Brown Corpus.[1]

Comments

Post a Comment

Amazon

Popular posts from this blog

Here's why the theory that Taylor Swift is a Illuminauti satanist clone absolutely checks out ;)

Image
See, Swift's uncanny resemblance to Zeena Schreck, former high priestess of the church of Satan, has been common knowledge on the internet for a while now. Rumors of a deeper connection have reached a fever pitch recently, based in part on the airtight theory that Swift is a clone of Schreck, who is the daughter of Church of Satan founder Anton LaVey.   The evidence is hard to shake off.  Schreck and Swift are both best represented by the serpent emoji and have blonde hair. Schreck's dad founded the Church of Satan, while Swift's (surrogate) father is a Merrill Lynch executive who owned a Christmas tree farm.  Obviosuly, the two women have too much in common to ignore, but their connection cannot merely exist on the surface. A close look at their life stories suggests an interwoven plot that all points to the truth — Swift's love for Lucifer is red, burning red.  Schreck was high priestess of the Church of Satan from 1985-1990, which is very...
Read more

WHO RECOMMENDS RESCHEDULING CANNABIS IN INTERNATIONAL LAW FOR FIRST TIME IN HISTORY

Image
he World Health Organization has suggested that cannabis should be downgraded, or "rescheduled," given the mounting evidence showing that the drug could prove beneficial in treating a number of health problems.   This marks a significant change in WHO's position, which for the last 60 years has said that cannabis should not be used in medicine, according to an article in the  BMJ . The WHO Expert Committee on Drug Dependence has recommended that cannabis resin and other marijuana products should be downgraded from a schedule IV to a schedule I drug under international law. Schedule IV is the strictest category outlined in the 1961 Single Convention on Narcotic Drugs Treaty, meaning that cannabis is currently treated in the same way as heroin, severely restricting scientists who want to investigate the plant in the search for potential therapies. The committee also recommended that THC—the main psychoactive ingredient in cannabis—should be designated as ...
Read more

The 48 Best Yoga Blogs of 2018

Image
The 48 Best Yoga Blogs of 2018 Since the 80s, the  ancient Indian discipline of yoga  has been taking the western world by storm. Existing in many forms today, the controversies, complexities and communities that surround  modern yoga  are excellently reflected in the blogosphere. We’re excited to continue the annual tradition of nominating the best yoga blogs on the web. This list celebrates what we all love about yoga today: the incredible diversity, the passion and hard work, and of course, the amazing yoga community. Along with a wealth of yoga pose and sequence guides, you’ll also find tips on Kundalini practice, Ayurveda advice, discussions on yoga politics, and even ideas for starting your own yoga blog. There are blogs in here that will make you laugh, make you cry, motivate you to change your life, and inspire you to change the world. Just like a really good yoga class, right? The broad range of topics you’ll find in these blogs reflect...
Read more