Hugging Face's logo

Spaces:
Luigi
/
SmolVLM2-on-llama.cpp
Runtime error

App Files Community
SmolVLM2-on-llama.cpp / app.py

Commit History

show llama cpp version
9069c3e

Luigi commited on

inject verbose message to debug window
69c8775

Luigi commited on

add vebose mode switch
2881733

Luigi commited on

increase n_ctx to 8192
4decc4b

Luigi commited on

add ui component to allow user enabl or disable reset_clip per frame
5462ff3

Luigi commited on

add debug to show which weight files we’re using this run
a459bee

Luigi commited on

use all cpu cores
be5c239

Luigi commited on

show cpu count in debug message
b56b6ec

Luigi commited on

add q2_k precsion weights
07f3263

Luigi commited on

add rich debug message and dedicated display ui
34cd1e5

Luigi commited on

apply in-memory encoding instead of temp files
45c2159

Luigi commited on

avoid memory leak
238a95a

Luigi commited on

use more thread for inference
bd12f6b

Luigi commited on

remove interval ui doublon
bdd1478

Luigi commited on

bugifx on ui about model selection
e1ad065

Luigi commited on

increase interval default to 3s
c9c43a8

Luigi commited on

1. add more models,
5c50991

Luigi commited on

reduce ctx and max tokens for performance
76a0b57

Luigi commited on

minor update then add todos
65b3c3a

Luigi commited on

resize frame to 384 x384 resolution
c1d8038

Luigi commited on

add debug messages
36dacc6

Luigi commited on

switch to gradio implementation as streamlit + webrtc requires turn server
970f416

Luigi commited on

decouple inference from streaming
292fb3c

Luigi commited on

set default interval to 3s
2529cb3

Luigi commited on

slightly increase repeat_penalty to reduce token repetition
636baf9

Luigi commited on

bugfix on 'NoneType' object has no attribute 'caption'
7b7ed26

Luigi commited on

update
221e4b6

Luigi commited on

add debug
abec2c1

Luigi commited on

update
dd0d47d

Luigi commited on

initial commit
ca97f63

Luigi commited on