r/TracingInsights • u/TracingInsights • 2d ago
i finetuned LFM3-1.7B on f1 data and it's now available to test at https://tracinginsights.com/chat it runs fully in your browser with WebGPU. no api key, no account, ~1 GB download once
i finetuned LFM3-1.7B on f1 data and
it's now available to test at https://tracinginsights.com/chat
it runs fully in your browser with WebGPU.
no api key, no account, ~1 GB download once
first i optimized the system prompt with GEPA, then I SFT'd the base model on synthetic data and used several other techniques to optimize it further, alongside I wrote custom WebGPU kernels so it runs everywhere, and they turned out faster than llamacpp cuda kernels.
it should work on win, linus and android
if it doesn't work, share your phone model and I'll customize the kernels and make it work
haven't tested on apple devices cuz I don't have access to any, but lmk if it works on yours
try it here: tracinginsights.com/chat