YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
🌊 Torrential Attention — torrential
Results
- Eval Loss: 5.9273
- Eval Perplexity: 375.13
- Parameters: 15,414,800
- Training Time: 1544s
Architecture
Torrential Attention Mechanism with five pillars:
- Sigmoid Flood Attention (unnormalized, pressure-driven)
- Position-Decay Budgets (cascading energy)
- Cross-Layer Flood Thresholds (dam-break phase transitions)
- Cross-Head Spillover (tributary merging)
- Differential Noise Cancellation
- Downloads last month
- 14
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support