Sentinel-AI is a neuroscience-inspired transformer that dynamically prunes and regrows attention heads. Guided by controller feedback and entropy-based pruning, it self-optimizes through biologically informed cycles—compressing, adapting, and evolving its architecture over time.
pytorch unet model-pruning colab-notebook transformer-architecture huggingface adaptive-transformers neural-network-controller
-
Updated
Nov 6, 2025 - Python