• Shimitar@downonthestreet.eu
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I plugged in an NVIDIA gpu in my server and enabled ollama to use it, diligently updated my public wiki about it and now enjoying real time gpt: OSS model responses!

    I was amazed, time cut from 3-8 minutes down to seconds. I have a Intel Core7 with 48gb ram, but even an oldish gpu beats the crap out of it.

      • Shimitar@downonthestreet.eu
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        NVIDIA Corporation GA104GL [RTX A4000] (rev a1)

        From lspci

        It has 16gb of VRAM, not too much but enough to run gpt:OSS 20b and a few other models pretty nice.

        I noticed that it’s better to stick to a single model, I imagine that unload and reload the model in VRAM takes time.

    • mierdabird@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      In that same vein I got an AMD Pro V620 32GB off ebay and have been struggling to get it to POST on my x570 motherboard, but I finally tried it on my old ASUS b450-i with a Ryzen 5 2400GE and with a few BIOS setting changes it fired right up.

      Now I need to figure out what I’m doing wrong on the x570 board so I can run the V620 combined with my 9060XT for bigger models

  • Decronym@lemmy.decronym.xyzB
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:

    Fewer Letters More Letters
    AP WiFi Access Point
    CA (SSL) Certificate Authority
    DNS Domain Name Service/System
    Git Popular version control system, primarily for code
    IMAP Internet Message Access Protocol for email
    IP Internet Protocol
    SMTP Simple Mail Transfer Protocol
    SSL Secure Sockets Layer, for transparent encryption
    TLS Transport Layer Security, supersedes SSL
    VPN Virtual Private Network
    VPS Virtual Private Server (opposed to shared hosting)
    XMPP Extensible Messaging and Presence Protocol (‘Jabber’) for open instant messaging
    k8s Kubernetes container management package

    [Thread #142 for this comm, first seen 7th Mar 2026, 06:40] [FAQ] [Full list] [Contact] [Source code]

  • shark@lemmy.orgOP
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I’ll go first: I got XMPP (Prosody) setup for the family.
    Also, less this week (cheating a little), but I’ve setup all my services with SSL (self-hosted root CA), domain names, and (finally) a dashboard (Heimdall.)

    Edit: I can’t sepll.

    • smiletolerantly@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Nice, same! Was also really positively surprised by how great the Android app(s) for XMPP feel.

      Only thing not working yet for me is group chat creation. Oh well. Maybe this weekend.

      On the other hand though, voice and video calls have worked flawlessly.

      • shark@lemmy.orgOP
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        Nice, same! Was also really positively surprised by how great the Android app(s) for XMPP feel.

        We’re on iOS and I wish I could say the same. Looking at the Android apps makes me very jealous.

        Only thing not working yet for me is group chat creation. Oh well. Maybe this weekend.

        What server software are you using? I went with Prosody and it felt pretty easy to setup the muc module for groups, but, on the other hand, I haven’t gotten around to voice and video calls.

          • shark@lemmy.orgOP
            link
            fedilink
            English
            arrow-up
            0
            ·
            2 months ago

            No, not yet, that’s why I haven’t set it up yet. Hopefully its a this-week thing.

        • smiletolerantly@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          2 months ago

          Ah, too bad. IMO better clients would make it drastically easier to convince people to switch.

          Hm, I can create groups (also with muc), and the other members are added, but writing a message triggers “x left the group” for everyone. Dunno. Probably something trivial I overlooked. But honestly… Weather is too good today to be bothered 😄

          Ah, I already had a TURN/STUN coturn server set up for matrix and jitsi, so it was just a matter of telling prosody about that. So I cheated a little I guess 😄 Here is my full config for that, in the unlikely event that you’re using NixOS.

    • Eldaroth@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Nice, had my XMPP server now running for a couple of weeks, not many users on it so far though. But my highlight of the week was managing to get the slidge whatsapp bridge with Prosody running, so I at least don’t have to use the official app anymore for all those people who resist to get off of it.

  • Klox@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I’m redoing everything I have from scratch. This week I have FreeIPA set up from OpenTofu + Ansible configs, and enrolls most of my other servers against FreeIPA. I am still migrating TrueNAS to use FreeIPA’s Kerberos Realm for auth, and I need to chown a lot of files for the new UIDs and GIDs homed in FreeIPA. After that, I’m setting up FreeRadius for auth to switches, APs, and Wifi. And then after that, I’m back to overhauling my k8s stack. I have Talos VMs running but didn’t finish patching in Cilium. And after the real fun begins.

  • aksdb@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Finally took the time to setup Woodpecker CI to replace Drone. Also finally linked it not only to my self hosted gitea, but also to github, so I can automate a few builds there as well.

    In the process I also learned, that I can set up a whole bunch of pods in a single kube definition for podman/quadlets, which allows me to have a much cleaner setup. Previously I was only aware that you can define a single pod with multiple containers. It makes sense, but it never occurred to me before.

  • harsh3466@lemmy.ml
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    I got a test box set up with nixos and a config that runs all of my services. I wanted to test the declarative rebuild promise of it, so I:

    1. Filled the services with my some of my backed up data (a copy of the data, not the actual backup)
    2. Ran it for a few days using some of the services
    3. Backed up the data of the nixos test server, as well as the nixos config
    4. Reinstalled nixos on the test box, brought in the config, and rebuilt it.

    And it worked!!! All serviced came back with the data, all configuration was correct.

    I’m going to keep testing, and depending on how that goes I may switch my prod server and nas to nixos.

    • smiletolerantly@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Very cool!

      Re: the backup / restore of state in NixOS: I found myself writing the same things over and over again for each VM/service, so finally wrote this wrapper module (in action e.g. here for Jellyfin), which confgures both the backup services and timers, as well as adding a simple rsync-restore-jellyfin command to the system packages. In case you find this useful and don’t already have your own abstractions, or a sufficiently different use case 😄

  • sorghum@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    The nextcloud AIO instance that hadn’t been working since September suddenly started working after I updated it. This was all after their forums did fuck all to help except tell me to get gud. I knew the problem wasn’t on me or my config and I feel so vindicated

    • bobslaede@feddit.dk
      link
      fedilink
      English
      arrow-up
      0
      ·
      2 months ago

      Have you had a look at opencloud? Not many addons, but simple-ish cloud drive and docs and such. Does not use many resources.

      • sorghum@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        2 months ago

        I have an instance running, but haven’t had a ton of time to dedicate on getting it the way I need it. I need a calendar that is accessible anonymously via the web for people to know my availability. File server, CalDAV, and CardDAV I was able to get separate solutions for.

  • TheRagingGeek@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    This week I saw my 3 machine cluster flailing trying to stay online, digging around identified it as an issue with communication with my NAS. It was running NFS3 and so I swapped that to NFS4.1 and did some tuning and now my services have never been faster!

  • thelocalhostinger@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    2 months ago

    Decided to buy a raspberry pi, it arrived, I installed pihole on it and put it into my dad’s house, all in a few days. Biggest win: I just took action and did it, instead of researching, brainstorming and writing down stuff for weeks and then never execute.