Hackers News
Janus Pro 1B running 100% locally in-browser on WebGPU, powered by Transformers.js : LocalLLaMA

A few hours ago, DeepSeek released Janus Pro (1B & 7B), a multimodal LLM capable of visual understanding and image generation. So, I added support for the model to Transformers.js, meaning the model can now run 100% locally in the browser on WebGPU! I think this makes it the easiest way to run the model locally: simply visit a website! I hope you enjoy!
Important links:
– Online demo: https://huggingface.co/spaces/webml-community/janus-pro-webgpu
– ONNX model: https://huggingface.co/onnx-community/Janus-Pro-1B-ONNX
– Source code: https://github.com/huggingface/transformers.js-examples/tree/main/janus-pro-webgpu