The mouse did not survive interrogation.
Also mouse not pictured.
Fitting a NAS on top of my cupboard. Been reconsidering putting it there though, may hide it under a table somewhere instead.
I should note that I haven’t built the nas yet because of these space constraints.
At my first-ever tech job back in 2000, I was given a little Celeron desktop computer to do my work: mostly writing some ColdFusion and cutting up images in Photoshop. For the most part, the machine worked fine, except whenever I scrolled down on a webpage in Netscape, the box’s PC speaker would start screaming. I tried to ignore it, but I was in a small room with two other nerds and it was getting really annoying.
One day, my frustrated colleague decided it was time to investigate. As part of the process, he noticed that there was very little air coming out of the power supply fan port. “Must be a busted fan and that’s causing an overheating alarm” he declared. We unplugged the box, popped it onto my desk, and opened it up. The internals were pristine. No dust, nothing. The computer was practically brand new after all.
We were just about to crack open the power supply (not recommended, but we were getting desperate) when my colleague noticed that something was wedged inside the fan… it was the biggest (dead, thankfully) cockroach I have ever seen, at least 10cm long. For context, this was in Vancouver, Canada. Those just don’t exist there.
My colleague jammed his screwdriver in there to grind up the cockroach carcass, then plugged the box back in. After a shittone of dessicated cockroach guts spewed out the back, my little computer was operating normally.
As best we could guess, the monster crawled into the fan in Malaysia when as was assembled and somehow got pinned in there, died of starvation, and then stowed away to Canada.
And this is the way bioinvasor species spread - most of the time they don’t come delivered inside of PSUs but simple crates, which improves their survivability lol
I had a screen get burn in (forgot to turn it off, oops) removed it from the laptop, waited 3 days, put it back in and it was flawless again.
I had a laptop that refused ethernet and would only ever use wifi… When the ethernet was connected. No wifi unless that cord was connected. Confirmed it was, indeed, wifi by using a dummy connector.
Bought a 10tb hdd that refused to read anything at all, opened it for giggles/curiosity and found a piece of scotch tape stuck to one of the disks and one of 4 disks completely shattered. The disk was still factory sealed (by appearance, anyways; they still had the antitamper stickers)
Had a problem where my ports would suddenly close. At first I thought it was Telekom, then the modem, then the NAS.
After much investigation I discovered that restarting my router would solve it.
After some more weeks I discovered that the crawling bots were triggering some stateful tplink firewall that would close everything until rebooted.
So the router in the middle of the setup was the problem, not the edges.
I dunno if that counts or if it’s the weirdest cause I rarely have any issue, but one day, I wanted to deploy speedtest tracker via docker on my 1st NAS…
So I tried, but it didn’t work (I forgot the reason). So I try to check the logs, but it turns out my NAS was insanely slow.
When I rebooted it, it couldn’t stop beeping and telling me there was a hardware problem, so I tried everything I could do to fix it, but nothing worked, so I ended up reinstalling the whole OS
Keep in mind this was the cost to see I had a bad result at the speedtest lmao 😭
Btw, I also lost all my important files, yayyy!
Then you tell people about it on IRC and become known as “the dead mouse guy”.
But the maximum nickname length on the IRC server is limited, so you settle for “deadmau5” as your nick.
I thought that heatsink and fan was a spindle of CDs! I thought that was an interesting place to store them I hadn’t seen before…
Not selfhosting, but I remember standing in a server room with a hands’ width of water on the ground (and rising), and hastily shutting down servers where the water was already in the case. It were big towers (Compaq Proliant, if anyone remembers), and luckily the board, drives, and PSU were in the top part of the big tower cases, the drive bays at the bottom were empty.
We got all equipment out safely, and we did not get electrocuted, either. We left with the last equipment when the water level was approaching the knees.
Reminds me of a time at my old job. It was a small office and this was before “the cloud” was a buzzword, so we had a little server room running a few boxes for AD, Exchange, and the thick end of our thin clients.
This “server room” was basically a large closet behind my office, retrofitted with its own AC.
We had residential units on the higher floors of our building. Residents occasionally thought to themselves “you know what makes a great hanging rack? Sprinkler pipes!” Hijinks ensued.
That was a fun call to get at 10PM.
Shoutout to the facilities guy who immediately thought to run a makeshift tarp over the server rack, fashioned from trash bags. No permanent damage.
Did you try turning the faucet off first to stop the water from rising while you were working?
The “faucet” was water literally streaming in through the broken window during a thunderstorm. One of my coworkers went outside and shielded the window with a wooden board to reduce the flow.
I lost a raspberry pi for a couple months. Just couldn’t find the darn thing. It was working fine serving away.
Turns out it was in the basement. I forgot I moved it to be closer to my tilt Hydrometer.
To be fair, those things are really tiny!
Ooo, another bash mirror. Nice!
YEAH it’s bash.org
Oh, good thing you wrote this. I’m about to give one of my printers away and there’s still a pi inside
Cups?
OctoPrint (3d printer)
For a while, the windows machine I was using kept randomly becoming unresponsive (both via network, as well as the keyboard+mouse) and I just could not figure out why. Everytime it did, I’d have to force a shutdown by holding the power button until it shutoff, then press it again to start back up. Sometimes this happened while I wasn’t home, so it had to just stay offline until I was.
I got sick of having to do this; so I replaced the power button with a transistor and a RPI. The PI would ping the server every 5min; if it failed to get a response 3 times in a row, it would trigger the transistor for 10sec, release for 3sec, then press and release again; forcing a poweroff then starting the machine again. It’d also write these events to a log file. I think it was around twice a week ish.
Never did figure out what the cause of the lockup was; but it stopped when I replaced windows with Debian.
I just wrote a comment about a very similar setup! Glad I wasn’t the only one haha
Never did figure out what the cause of the lockup was
the mysteries of closed-source software
Using an RPi with a transistor almost seems professional… ITAPPMONROBOT
Yeah getting rid of windows solves many issues, LOL. I have always refused to run any server with windows, outside of being forced to at work. 😁
Had a zyxel nas that got unresponsive after 10-15days of uptime, thankfully it hat a scheduled shutdown/reboot setting. Runs since 2014 with a reboot every Mondy 3am.
I have a NAS that had a similar problem, every week or two it would stop responding. From the logs it was clear that the machine was running fine after going non-responsive, but either the NIC or something else network related was crashing. However, the logs weren’t capturing the exact issue. I wrote a script to ping Google every 10 minutes, write a bunch of debug data to disc if it failed, and then reboot.
And it has never happened in the year since. I have no idea what the root cause was, but sending those pings out seems to have fixed it.
Heh, my router is on one of those timer plug things. No matter how frozen, it will reboot.
I’ve got an extra and don’t know what to do with it. I feel like its bad to pull power unexpectedly once a week though. Especially with a single HDD storage setup. I’d like to setup a RAID config, but its a 28TB drive and additional drives would cost me about $$$$$$$.
Note to any future lemmings who find this thread troubleshooting the same symptom…
- Rule out unswitched (non-chipset, direct CPU lanes) PCI connectivity and power issues by testing without specific PCI components. Unstable PCI errors can be missed during post and present later after boot, and Windows is especially bad at handling it transparently. Common culprits include GPU sag, dubious riser extensions, and anemic PSUs
- If there is a “high bandwidth” feature toggle for RAM in your BIOS settings that is currently on, try turning it off
- If your system drive is an NVMe blade with a Phizon controller, check if the manufacturer software has a firmware update available.
- If the freeze is regular but not persistent, try turning the polling rate down on your mouse, and if it’s wired, try to make sure it’s plugged into one of the board’s SOC-hosted USB 2.0 ports
I also had a machine that would randomly crash on Windows, but not on Linux.
I’m pretty sure it was some sort of hardware failure, as it also sometimes failed to boot Linux. But if it booted Linux, it would be stable until I shut it down.
Sometimes Linux handles faults better than Windows
Typically dmesg shows error when the hardware is acting up
The mouse did not survive interrogation. Also mouse not pictured.
I thought it was the huge heat sink that looks like it extends past the side plane of the cover. Reminds me of something I did with a CoolAir Cosmos tower. I mounted two 300 cfm fans over each CPU and took the side panel, neatly cut out the area around the fans, then 3d printed a scoop, with a slot for filtration, to fit on the side panel and allow the fans to breathe.
for me it was the fact that the desktop case i used for the server had the power button on top and it was big enough to be pushed in, when my cat walked over it…
my cat currently loves hitting the “Sleep”-button on my keyboard every time he jumps on my table -.- at least i can wake it again, but it IS annoying. Haven’t had the time yet to reconfigure that button to instead run a soundfile of me scolding my cat lol.
I’ve had a mouse burn my generator coils while going in while running
One day, our internet just stopped working entirely. Our ISP was fine, router good, but no outside connection and I couldn’t access local devices. I have two Unraid servers. I took a quick glance at them, they were powered on, all looked ok. I decide to power cycle everything. Still no internet. Then I realize that I can still access Google from my phone when on WiFi… hmm. That would mean… an issue with pi-hole!
I begin to try to diagnose from my phone with a hotspot to my computer. I’m getting warmer but some things just aren’t making sense. I go back and stare at the server running pi-hole. Then it fucking hits me.
I have the pretty odd and totally not ideal home network. I have plans to upgrade everything but currently I have two wifi networks tied to the same WAN. One network is run off of access points so I can get Ethernet to odd areas of the property. The Unraid server hosting pi-hole was connected to an AP and the Ethernet cable I used didn’t have a clip, so it just barely unseated itself from it, breaking the connection. The router+pi-hole config meant also breaking the internet if anything happened to pi-hole or that server. I swapped it for a better cable and it all instantly started working.
Spent that weekend sorting out the network so it doesn’t happen again. It was definitely a head-scratcher.
It’s always dns at least half the time
I keep one Physical Pihole and one in a container, be sure yeah, this happens.
Pihole is cool, but fucked me over as well more than once (not the pihole itself but the host). It’s on its own hardware now, but I plan to add a second one to reduce the single point of failure.
Haven’t thought of that tbh. Would they both just share configuration? Curious how leasing would be split/shared between them. Off to research!
There’s some sync mode but I haven’t really looked into it yet.
Makes sense.
I’ve been running two piholes for a few years:
I let the router handle dhcp, while having it hand out each of the piholes IPs as DNS #1 and DNS #2. Those piholes settings are mirrored using Nebula-Sync, so any change made to one pihole gets copied over to the other automatically.
Both of those piholes are setup to wrap outbound DNS reqests in DOH as well, with the router blocking port 53 outbound. So all DNS traffic leaving the network has to be DOH/DOT or it just gets dropped. Currently using NextDNS and quad9 as my upstream DOH providers.
Oh sweet this is super helpful! Doesn’t seem too complicated. Thanks!
@Darkassassin07 Looks very useful. Also timely for me. I have a use case that requires multiple synched pi-holes. 👍🏼
Yep I’ve had it randomly stop working if it has to serve clients outside it’s subnet
I mean, would you want it to serve clients outside of your subnet? I guess maybe if you had something like a guest network. But I tend to take the “fuck it, you get basic service and nothing else” approach to things like guest networks.
Isn’t it a potential security issue to have your pihole serve things on any subnet, because it allows an improperly configured firewall to stab at your pihole? I think you can specify any additional subnets it will serve in the settings somewhere. But IIRC, the default behavior is to intentionally drop traffic from unknown subnets. But that’s just off the top of my head.
Optical or roller ball?
I have a strong suspicion that the answer is mammilion
That sounds like a lot. Is it more than a bajillion, or less?
Many cells
