dmanningcoe's picture
Upload tinystories_lambda2000/model_cfg.yaml with huggingface_hub
4a8321c verified
Raw
History Blame Contribute Delete
164 Bytes
crosscoding_dims: !!python/tuple
- 1
- 17
d_model: 768
hidden_activation_cfg:
k_per_example: 20
hidden_activation_classname: BatchTopkActivation
hidden_dim: 1536