試験
通常
試験時間: 00:00問題時間: 00:00
問題一覧
問題 3 / 65
Which method reduces vocabulary size, addresses the rare-word problem, and makes unknown words easier to handle?
①Stemming and lemmatization (stemming/lemmatization)
②One-hot vector representation
③Dimensionality reduction (e.g., PCA) for embedding vectors
④Filter and delete words as-is.
⑤Subword segmentation (subword tokenization such as BPE and SentencePiece)