Same as title. If we could do that can we potentially do expert caching from ram to vram so it's faster? If not the router itself, can we train a small neural network that predicts the future experts? Sorry if it's a stupid question, I am trying to understand how MoEs work
