Sorry, I am just gonne dump you some links from my bookmarks that were related and interesting to read, cause I am traveling and have to get up in a minute, but I’ve been interested in this topic for a while. All of the links discuss at least some usecases. For some reason microsoft is really into tiny models and made big breakthroughs there.

https://reddit.rtrace.io/r/LocalLLaMA/comments/1cdrw7p/what_are_the_potential_uses_of_small_less_than_3b/

https://github.com/microsoft/BitNet

https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/

https://news.microsoft.com/source/features/ai/the-phi-3-small-language-models-with-big-potential/

https://techcommunity.microsoft.com/blog/aiplatformblog/introducing-phi-4-microsoft’s-newest-small-language-model-specializing-in-comple/4357090

maybe drawio

I have no clue what I am looking at but it is absolutely mesmerizing.

I ran Linux with KDE on my phone for a while and it for sure needed EVEN MORE charging all the time even though most of the system is C, with a sprinkle of C++ and QT.

But that is probably due to other inefficiencies and lack of optimization (which is fine, make it work first, optimize later)

I’m using the fattest of java (Kotlin) on the fattest of frameworks (Spring boot) and it is still decently fast on a 5 year old raspberry pi. I can hit precise 50 μs timings with it.

Imagine doing it in fat python (as opposed to micropython) like all the hip kids.

They compile each benchmark solution as needed, following the CLBG guidelines, but they do not measure or report the energy consumed during the compilation step.

Time to write our own paper with regex and compiler flags.

Why?

(A super slimmed down flavour of) Java runs on fucking simcards.

WASM would be interesting as well, because lots of stuff can be compiled to it to run on the web

Wow! I didn’t know

It does need a server though. Either the centralized official one you can selfhost one.

a long runway that allows us to become profitable when needed

Switch to self-hosting headscale when they enshittify in an attempt to become profitable, duh

selfhosting Ghost

I guess they could embed it like a word from a different language, but I don’t know why base64 should be part of the pipeline.

Edit:

or maybe I am completely wrong

You’re right, I didn’t even think of that

GrayJay has a peertube plugin which works well.

I clear cookies in my browser on exit. Because I want to clear most cookies.

I have dedicated apps for services where I don’t want to log in every time, even when they have a web version, because of the above.

I know this can be done with firefox settings (at least on desktop) but thats a hassle.

Thats actually an interesting method to make AI not learn it.

fmhy and trying a couple options always worked out for me

I really like the yt channel of the people who delevoped Backpack Battles. They have a whole 2 year catalogue on godot.

Keep it up for other people to read and learm from