Skip to content

[WIP] Add nonlinearity between Down and Up weights, expose alpha hyperparameter#111

Draft
brian6091 wants to merge 15 commits into
cloneofsimo:developfrom
brian6091:nonlin
Draft

[WIP] Add nonlinearity between Down and Up weights, expose alpha hyperparameter#111
brian6091 wants to merge 15 commits into
cloneofsimo:developfrom
brian6091:nonlin

Revert to scale, remove alpha

f0485a3
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs