• 2 Posts
  • 52 Comments
Joined 1 year ago
cake
Cake day: August 5th, 2023

help-circle








  • Interesting take on LLMs, how are you so sure about that?

    I mean I get it, current image gen models seem clearly uncreative, but at least the unrestricted versions of Bing Chat/ChatGPT leave some room for the possibility of creativity/general intelligence in future sufficiently large LLMs, at least to me.

    So the question (again: to me) is not only “will LLM scale to (human level) general intelligence”, but also “will we find something better than RLHF/LLMs/etc. before?”.

    I’m not sure on either, but asses roughly a 2/3 probability to the first and given the first event and AGI in reach in the next 8 years a comparatively small chance for the second event.




    • I’ve did some distrohopping and in effect switched from Fedora to Fedora Silverblue (very enjoyable)
    • I’ve completely removed all centralized social media apart from YouTube (I’ll have to invest some more time in PeerTube before I can make the switch) from my life
    • In general I spend less time doom-scrolling and way more time actually reading interesting stuff (I’ve found LessWrong, a forum about the art of rationality/more rational thinking)
    • I have replaced all remaining proprietary software components on my desktop with open source ones (e.g. I now use FOSS frontends for Discord and Spotify, namely gtkcord4 and Spot), the only exceptions being the Nvidia driver (I hope that will change in 2024 with NVK) and some games (although 80% of my very limited gaming time is now spent in open source games like Beyond All Reason)
    • I got a tablet/ChromeBook convertible (Lenovo IdeaPad Duet 5 8GB) which I installed PostmarketOS on and am now daily driving Linux in school where everybody else is using iPads
    • I am in the process of finally building my own NAS/homeserver
    • On the negative side I spent way less of my free time programming than I would have liked to

    I do also have some goals and ambitions for this year:

    • Host all my stuff on my own server, this includes files (documents, photos, backups, media) as well as services like my website and automations
    • Write audio and camera drivers for my tablet
    • Learn some more Nim
    • Write more code than last year
    • Finally make the switch to Vim/NeoVim
    • Become independent from YouTube
    • If my iPhone happens to break, get a Linux phone as a daily driver
    • Gradually unsubscribe from (streaming) services like Spotify