Instructions to use LifuWang/DistillT5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LifuWang/DistillT5 with Transformers:
# Load model directly from transformers import AutoTokenizer, T5EncoderWithProjection tokenizer = AutoTokenizer.from_pretrained("LifuWang/DistillT5") model = T5EncoderWithProjection.from_pretrained("LifuWang/DistillT5") - Notebooks
- Google Colab
- Kaggle
Is it usable in ComfyUI?
#1
by ryg81 - opened
Hey, that's sound like crazy size reduction, but what's the use case? Can this be used in comfyui?
i just tried and it not work at all.
Hi there. Sorry for the late response. ComfyUI is available here. https://github.com/LifuWang-66/DistillT5ComfyUI
On that node I get issue: /ComfyUI/comfy/ops.py", line 220, in forward_comfy_cast_weights
weight, bias = cast_bias_weight(self, device=input.device, dtype=out_dtype)
^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'device'
Same issue:
AttributeError: 'NoneType' object has no attribute 'device'
