Missing values in 4B, 12B config.json
#56
by depasquale - opened
The 4B config is missing some values that are included in the 12B and 27B configs. The 4B and 12B configs are missing some values that are included in the 27B config.
Please ensure that the values specified in the config files are always present for differently sized models that use the same architecture. Otherwise developers have to waste hours of work on debugging and adding fallbacks.
i got same issue
Hi @depasquale ,
Welcome to Google Gemma family of open models, thanks for notifying us on the configuration discrepancy across the different variants. I have escalated your concern to internal team. Thanks for you support and understanding.
Thanks.