Tag

perplexity

0 views collected around this technical thread.

58 Tech

Mar 2, 2020 · Artificial Intelligence

Low-Quality Text Detection Using Unsupervised Language Model Perplexity

This article proposes a method to identify low-quality text in business data by training a large-scale unsupervised language model to compute sentence perplexity, converting the detection problem into a threshold decision, and details model design, challenges, optimizations, and online performance results.

BERTNLPlanguage model

0 likes · 13 min read

Low-Quality Text Detection Using Unsupervised Language Model Perplexity

58 Tech

Feb 20, 2019 · Artificial Intelligence

Building and Deploying Language Models for Text Quality Evaluation and Generation

This article explains the concepts, training pipeline, deployment formats, and practical applications of language models—particularly LSTM‑based models—for evaluating and generating text quality in a real‑world rental listing platform, highlighting data preparation, model training, and online serving techniques.

DeploymentLSTMTensorFlow

0 likes · 16 min read

Building and Deploying Language Models for Text Quality Evaluation and Generation