Ctrip Technology
Oct 13, 2022 · Artificial Intelligence
Chinese New Word Discovery: From Traditional Unsupervised Methods to CNN‑Based Deep Learning
The article examines the challenge of out‑of‑vocabulary terms in Chinese e‑commerce NLP, reviews classic unsupervised metrics such as frequency, cohesion and neighbor entropy, and proposes a lightweight fully‑convolutional network inspired by image‑segmentation techniques to automatically detect new words.
CNNNLPNew Word Discovery
0 likes · 10 min read