Spaces:
Runtime error
Runtime error
Download transformers/utils/test_module/custom_tokenization_fast.py from chendl/compositional_test: direct link, hf CLI and curl.
- Browser
- Download file 193 Bytes
-
https://huggingface.co/spaces/chendl/compositional_test/resolve/main/transformers/utils/test_module/custom_tokenization_fast.py
- Command line
-
hf download hf://spaces/chendl/compositional_test/transformers/utils/test_module/custom_tokenization_fast.py
-
curl -L -o custom_tokenization_fast.py https://huggingface.co/spaces/chendl/compositional_test/resolve/main/transformers/utils/test_module/custom_tokenization_fast.py
193 Bytes
| from transformers import BertTokenizerFast | |
| from .custom_tokenization import CustomTokenizer | |
| class CustomTokenizerFast(BertTokenizerFast): | |
| slow_tokenizer_class = CustomTokenizer | |
| pass | |