Base Classes#
- recwizard.BaseConfig
- recwizard.BaseTokenizer
BaseTokenizer
BaseTokenizer.__init__()
BaseTokenizer.load_from_dataset()
BaseTokenizer.unk_token()
BaseTokenizer.unk_token_id()
BaseTokenizer.vocab_size
BaseTokenizer.mergeEncoding()
BaseTokenizer.replace_special_tokens()
BaseTokenizer.encodes()
BaseTokenizer.preprocess()
BaseTokenizer.batch_encode_plus()
BaseTokenizer.encode_plus()
BaseTokenizer.process_entities()
BaseTokenizer.decode()
BaseTokenizer.get_init_kwargs()
BaseTokenizer.save_vocabulary()
BaseTokenizer.from_pretrained()
- recwizard.BaseModule
- recwizard.BasePipeline