tokenizer

#1
by 010O11 - opened

when loaded in vllm > ValueError: Tokenizer class TokenizersBackend does not exist

  • replaced with tokenizer and tokenizer_config from original repo solved this....
Owner

Thank you ; I will check into this ASAP.

Sign up or log in to comment