Understanding Perplexity in NLP
Published:
When trying to understand the relationship between perplexity and entropy, I searched through many resources on the Internet, but none provided a detailed formula derivation and understanding. Therefore, I have written this article to document my thoughts.