Base Classes#
- recwizard.BaseConfig
- recwizard.BaseTokenizer
BaseTokenizerBaseTokenizer.__init__()BaseTokenizer.load_from_dataset()BaseTokenizer.unk_token()BaseTokenizer.unk_token_id()BaseTokenizer.vocab_sizeBaseTokenizer.mergeEncoding()BaseTokenizer.replace_special_tokens()BaseTokenizer.encodes()BaseTokenizer.preprocess()BaseTokenizer.batch_encode_plus()BaseTokenizer.encode_plus()BaseTokenizer.process_entities()BaseTokenizer.decode()BaseTokenizer.get_init_kwargs()BaseTokenizer.save_vocabulary()BaseTokenizer.from_pretrained()
- recwizard.BaseModule
- recwizard.BasePipeline