Unable to use token_stream

[elwin212]

Hi,

I followed your example:

use tantivy::tokenizer::*;
let tokenizer = tantivy_jieba::JiebaTokenizer {};
let mut token_stream = tokenizer.token_stream("测试");
assert_eq!(token_stream.next().unwrap().text, "测试");
assert!(token_stream.next().is_none());

but it gave me error in this line:
tokenizer.token_stream("测试");

The error msg is:

no method named `token_stream` found for struct `JiebaTokenizer` in the current scope
items from traits can only be used if the trait is in scope`

How can I fix that?

Many thanks

[jiegec]

Which versions of tantivy and tantivy-jieba are you using?

[elwin212]

This is my cargo.toml

[dependencies]
tantivy = "0.21.0"
tantivy-jieba = "0.10.0"

[jiegec]

This is my cargo.toml

[dependencies]
tantivy = "0.21.0"
tantivy-jieba = "0.10.0"

I could not reproduce your problem, it works here.