MiniCPM-V 4.7 Brings 35B Multimodal Power to Edge Devices
With the release of MiniCPM-V 4.7, ModelBest and the OpenBMB community have successfully shrunk a 35-billion parameter multimodal Mixture-of-Experts model to function on mobile hardware using just 3GB of memory. This technical leap allows smartphones and tablets to handle complex visual, document, and video analysis locally.

The 35B-A3B model utilizes a clever architecture where the majority of experts reside on SSD storage, loading into active memory only when required. By activating roughly 3 billion parameters per token, the system maintains high-level performance across STEM problem solving and chart interpretation without the heavy footprint typically required for such intelligence. A smaller 1B version is also available, specifically optimized for entry-level hardware.
Performance gains are driven by Lookahead Expert Scheduling, which predicts necessary experts for upcoming layers while the current layer is still processing. This technique, paired with layer-wise quantization, enables speeds exceeding 17 tokens per second on an iPad Pro M4. Furthermore, developers can leverage visual token compression up to 16x to balance speed and detail, with the model retaining a score of 90.9 on MMBench. To ensure sustained reliability, ModelBest introduced a Self-Replay Fine-Tuning method, integrating high-quality model-generated responses into the training cycle to prevent skill degradation.
Broad hardware compatibility is a central feature of this release. The model boasts Day-0 support from major silicon providers including Apple, NVIDIA, AMD, and Arm, alongside a wide range of specialized edge chip manufacturers via the FlagOS stack. All weights and code are now publicly accessible for developer deployment.
Comments (0)
No comments yet. Be the first!