This model inherits from PreTrainedModel. Check out the superclass documentation for that generic techniques the MoE Mamba showcases improved performance and effectiveness by combining selective point out space https://kallumdvbc538238.digitollblog.com/29822559/5-essential-elements-for-mamba-paper