Posts by Tags

natural language processing

Understanding Perplexity in NLP

less than 1 minute read

Published:

When trying to understand the relationship between perplexity and entropy, I searched through many resources on the Internet, but none provided a detailed formula derivation and understanding. Therefore, I have written this article to document my thoughts.

perplexity

Understanding Perplexity in NLP

less than 1 minute read

Published:

When trying to understand the relationship between perplexity and entropy, I searched through many resources on the Internet, but none provided a detailed formula derivation and understanding. Therefore, I have written this article to document my thoughts.

probability theory