試験
通常
試験時間: 00:00問題時間: 00:00
問題一覧
問題 11 / 65
Which tokenization method is most suitable when processing Japanese, English, and French with the same model?
①Use a whole-word tokenizer.
②Use a subword tokenizer (such as SentencePiece or BPE).
③Use a character-level tokenizer.
④Split words using only morphological analysis.
⑤Compress the vocabulary using only stemming.