Zipf's law

Zipf's law

all languages follow this law. The second most common word is used 1/2 as much as the most. The third word is used 1/3 the most, and so on and so on for all languages




 (/zɪf/) is an empirical law formulated using mathematical statistics that refers to the fact that many types of data studied in the physical and social sciences can be approximated with a Zipfian distribution, one of a family of related discrete power law probability distributions. Zipf distribution is related to the zeta distribution, but is not identical.

For example, Zipf's law states that given some corpus of natural language utterances, the frequency of any word is inversely proportional to its rank in the frequency table. Thus the most frequent word will occur approximately twice as often as the second most frequent word, three times as often as the third most frequent word, etc.: the rank-frequency distribution is an inverse relation. For example, in the Brown Corpus of American English text, the word the is the most frequently occurring word, and by itself accounts for nearly 7% of all word occurrences (69,971 out of slightly over 1 million). True to Zipf's Law, the second-place word of accounts for slightly over 3.5% of words (36,411 occurrences), followed by and (28,852). Only 135 vocabulary items are needed to account for half the Brown Corpus.[1]

Comments

Post a Comment

Amazon

Popular posts from this blog

Here's why the theory that Taylor Swift is a Illuminauti satanist clone absolutely checks out ;)

Image
See, Swift's uncanny resemblance to Zeena Schreck, former high priestess of the church of Satan, has been common knowledge on the internet for a while now. Rumors of a deeper connection have reached a fever pitch recently, based in part on the airtight theory that Swift is a clone of Schreck, who is the daughter of Church of Satan founder Anton LaVey.   The evidence is hard to shake off.  Schreck and Swift are both best represented by the serpent emoji and have blonde hair. Schreck's dad founded the Church of Satan, while Swift's (surrogate) father is a Merrill Lynch executive who owned a Christmas tree farm.  Obviosuly, the two women have too much in common to ignore, but their connection cannot merely exist on the surface. A close look at their life stories suggests an interwoven plot that all points to the truth — Swift's love for Lucifer is red, burning red.  Schreck was high priestess of the Church of Satan from 1985-1990, which is very su
Read more

WHO RECOMMENDS RESCHEDULING CANNABIS IN INTERNATIONAL LAW FOR FIRST TIME IN HISTORY

Image
he World Health Organization has suggested that cannabis should be downgraded, or "rescheduled," given the mounting evidence showing that the drug could prove beneficial in treating a number of health problems.   This marks a significant change in WHO's position, which for the last 60 years has said that cannabis should not be used in medicine, according to an article in the  BMJ . The WHO Expert Committee on Drug Dependence has recommended that cannabis resin and other marijuana products should be downgraded from a schedule IV to a schedule I drug under international law. Schedule IV is the strictest category outlined in the 1961 Single Convention on Narcotic Drugs Treaty, meaning that cannabis is currently treated in the same way as heroin, severely restricting scientists who want to investigate the plant in the search for potential therapies. The committee also recommended that THC—the main psychoactive ingredient in cannabis—should be designated as a sch
Read more

Immortality - Raising The Chrism : The Pineal Gland And The 33 Vertebrae Points (Part 1)

Image
The Bible is a manual about physiological regeneration and astrology, written in code (SEE Gematria), providing us a path to enlightenment (atonement). 99% of the people believe the Bible is a historical book to be taken literally. It’s not, it’s about you and YOUR path to enlightenment. You are the Protagonist. No one’s coming to save you. All of these parables were written about and for you. The “Temple of God” is your body, not a building. Of course, if you believe we evolved from biological sludge 3 billion years ago, this doesn’t make any sense. Now, we’re never taught this information because the powers that be don’t want you to understand what you are. They like you confused, distracted and deceived which is why “you give them bread and circuses and they will never revolt (Juvenal).” For the past 500 years, it was the church’s role to mislead the masses. Now the “scientism” and “new age” community has gleefully taken over that role. I digress, but, regardless of wh
Read more