Skip Navigation
101 comments

  • I only use the highest of grade when it comes to hardware

    Case: found in the trash

    Motherboard: some random Asus AM3 board I got as a hand-me down.

    CPU: AMD FX-8320E (8 core)

    RAM: 16GB

    Storage: 5x2tb hdds + 128gb SSD and a 32GB flash drive as a boot device

    That's it... My entire "homelab"

  • I have 5 servers in total. All except the iMac are running Alpine Linux.

    Internet

    Ziply fiber 100mb small business internet. 2 Asus AX82U Routers running in AiMesh.

    Rack

    Raising electronics 27U rack

    N3050 Nuc's

    One is running mailcow, dnsmasq, unbound and the other is mostly idle.

    iMac

    The iMac is setup by my 3d printers. I use it to do slicing and I run BlueBubbles on it for texting from Linux systems.

    Family Server

    Hardware

    • I7-7820x
    • Rosewill rackmount case
    • Corsair water cooler
    • 2 4tb drives
    • 2 240gb ssd
    • Gigabyte motherboard

    Mostly doing nothing, currently using it to mine Monero.

    Main Cow Server

    Hardware

    • R7-3900XT
    • Rosewill rackmount case
    • 3 18tb drives
    • 2 1tb nvme
    • Gigabyte motherboard

    Services

    • ZFS 36TB Pool
    • Secondary DNS Server
    • NFS (nas)
    • Samba (nas)
    • Libvirtd (virtual macines)
    • forgejo (git forge)
    • radicale (caldav/carddav)
    • nut (network ups tools)
    • caddy (web server)
    • turnserver
    • minetest server (open source blockgame)
    • miniflux (rss)
    • freshrss (rss)
    • akkoma (fedi)
    • conduit (matrix server)
    • syncthing (file syncing)
    • prosody (xmpp)
    • ergo (ircd)
    • agate (gemini)
    • chezdav (webdav server)
    • podman (running immich, isso, peertube, vpnstack)
    • immich (photo syncing)
    • isso (comments on my website)
    • matrix2051 (matrix to irc bridge)
    • peertube (federated youtube alternative)
    • soju (irc bouncer)
    • xmrig (Monero mining)
    • rss2email
    • vpnstack
      • gluetun
      • qbittorrent
      • prowlarr
      • sockd
      • sabnzbd

    • Why do you host FreshRSS and MiniFlux if you don't mind me asking?

      • I kind of prefer mini flux but I maintain the freshrss package in Alpine so I have an instance to test things.

    • An HP ML350p w/ 2x HT 8 core xeons (forget the model number) and 256GB DDR3 running Ubuntu and K3s as the primary application host
    • A pair of Raspberry Pi's (one 3, one 4) as anycast DNS resolvers
    • A random minipc I got for free from work running VyOS as by border router
    • A Brocade ICX 6610-48p as core switch

    Hardware is total overkill. Software wise everything is running in containers, deployed into kubernetes using helmfile, Jenkins and gitea

  • At home - Networking

    • 10Gbps internet via Sonic, a local ISP in the San Francisco Bay Area. It's only $40/month.
    • TP-Link Omada ER8411 10Gbps router
    • MikroTik CRS312-4C+8XG-RM 12-port 10Gbps switch
    • 2 x TP-Link Omada EAP670 access points with 2.5Gbps PoE injectors
    • TP-Link TL-SG1218MPE 16-port 1Gbps PoE switch for security cameras (3 x Dahua outdoor cams and 2 x Amcrest indoor cams). All cameras are on a separate VLAN that has no internet access.
    • SLZB-06 PoE Zigbee coordinator for home automation - all my light switches are Inovelli Blue Zigbee smart switches, plus I have a bunch of smart plugs. Aqara temperature sensors, buttons, door/window sensors, etc.

    Home server:

    • Intel Core i5-13500
    • Asus PRO WS W680M-ACE SE mATX motherboard
    • 64GB server DDR5 ECC RAM
    • 2 x 2TB Solidigm P44 Pro NVMe SSDs in ZFS mirror
    • 2 x 20TB Seagate Exos X20 in ZFS mirror for data storage
    • 14TB WD Purple Pro for security camera footage. Alerts SFTP'd to offsite server for secondary storage
    • Running Unraid, a bunch of Docker containers, a Windows Server 2022 VM for Blue Iris, and an LXC container for a Bo gbackup server.

    For things that need 100% reliability like emails, web hosting, DNS hosting, etc, I have a few VPSes "in the cloud". The one for my emails is an AMD EPYC, 16GB RAM, 100GB NVMe space, 10Gbps connection for $60/year at GreenCloudVPS in San Jose, and I have similar ones at HostHatch (but with 40Gbps instead of 10Gbps) in Los Angeles.

    I've got a bunch of other VPSes, mostly for https://dnstools.ws/ which is an open-source project I run. It lets you perform DNS lookup, pings, traceroutes, etc from nearly 30 locations around the world. Many of those are sponsored which means the company provides them for cheap/free in exchange for a backlink.

    This Lemmy server is on another GreenCloudVPS system - their ninth birthday special which has 9GB RAM and 99GB NVMe disk space for $99 every three years ($33/year).

  • A 13-year-old former gaming computer, with 30TB storage in raid6 that runs *arrs, sabnzbd, and plex. Everything managed by k3s except plex.

    Also, 3-node digital ocean k8s cluster which runs services that don't need direct access to the 30TB of storage, such as: grocy, jackett, nextcloud, a SOLID server, and soon a lemmy instance :)

    • The Lemmy instance might need access to large storage.

      • My instance's image cache is like 230GB. Plus a bunch more for the db. Can confirm storage is needed.

        (unrelated question 😶 - anyone running pictrs 0.5 on local storage happily?)

      • Thanks for the heads up.

        I plan on using digital ocean's Spaces (s3-alike) where possible and also it's intended to be a personal instance, at least to start - just for me to federate with others and subscribe to my communities. Given that, do you think it'll still use much disk (block device) storage?

        Might be time to familiarize myself with DO's disk pricing...

  • https://pixelfed.social/p/thejevans/664709222708438068

    EDIT:

    Server:

    • AMD 5900x
    • 64GB RAM
    • 2x10TB HDD
    • RTX 3080
    • LSI-9208i HBA
    • 2x SFP+ NIC
    • 2TB NVMe boot drive

    Proxmox hypervisor:

    • TrueNAS VM (HBA PCIe passthrough)
    • HomeAssistant VM
    • Debian 12 LXC as SSH entrypoint and Ansible controller
    • Debian 12 VM with Ansible controlled docker containers
    • Debian 12 VM (GPU PCIe passthrough) with Jellyfin and other services that use GPU
    • Debian 12 VM for other docker stuff not yet controlled by Ansible and not needing GPU

    Router: N6005 fanless mini PC, 2.5Gbit NICs, pfsense

    Switch Mikrotik CRS 8-port 2.5Gbit, 2-port SFP+

    • You play games on that server don't you. 😁

      • I have a Kasm setup with blender and CAD tools, I use the GPU for transcoding video in Immich and Jellyfin, and for facial recognition in Immich. I also have a CUDA dev environment on there as a playground.

        I upgraded my gaming PC to an AMD 7900 XTX, so I can finally be rid of Nvidia and their gaming and wayland driver issues on Linux.

  • i got the random Dell SFF optiplex with 16gb of upgraded ram and a i5-4690 sitting at the girlfriend's house because she's the only one with an ISP that still allows public ip's.
    It runs Minecraft.

    at home i have my old 9yo retired gaming desktop doing seedbox work and mostly just running BOINC to donate compute power to science... and also keep my feet warm lol

    yeah. that's it. i really don't do shit even though i totally could.

  • It's a work in progress, but https://wiki.gardiol.org (which is OFC self-hosted)

    Anyway, beefy HP laptop with 32gb ram and Xeon CPU to run all services. 3 RAID-1 (Linux sw raid) usb3 volumes to host all services and data.

    Two isp's: Vodafone FVA 5G (data capped) for general navigation and Fastweb FTTC (low speed but uncapped) for backup access and torrent/Usenet downloads.

    Gentoo Linux all the way and podman, but as much limited as possible: only immich (that's impossible to host on bare metal due to devs questionable choices).

    Services: WebDAV/webcal/etc wiki, more stuff, arrs, immich, podfetch, and a few more.

    All behind nginx reverse proxy.

    99% bare metal.

    Self developed simple dashboard

    External access via ssh tunnels to vps

    • That public wiki gives me the security heebie-jeebies. 🤭 Not saying it's not secure, just that I'd have constant doubts whether I've covered all the bases if I were doing it.

      • The service runs as an unpriviledged user, even if, at worst, an intruder would delete or replace the wiki itself. Even the php-fpm behind it runs as that unpriviledged user and is not shared with any other service.

        I doubt an attacker could do anything worse than DoS on the wiki itself.

      • Why?

    • Old Gaming Rig - Proxmox
      • Nextcloud, Immich, Grafana on VMs
    • Old HP ProDesk - FreeIPA
    • NAS - TrueNAS Scale
    • Couple Laptops - Docker Stuff
      • Wireguard, SearXNG, Nginx
    • Raspberry Pi 4 - Home Assistant
    • Rasberry Pi 3A+ - ntfy Docker
    • Very Old Dell - NTP Server
    • Qotom PC - OPNsense
    • Network Devices - OpenWRT
      • Zyxel Wireless APs (3)
      • Netgear R7000 (2)
      • Zyxel 24 and 8 port Switches
    • Gaming Rig - Windows 11 for now
      • Playnite, Sunshine, Jellyfin
    • Another HP ProDesk hopefully running an email server soon
    • UPS

    Edit: Formatting

    • Jesus, you can run more than one piece of software on each bit of hardware....

      Why spread out across 12-13 machines? Seems like a huge waste of power, and a whole bunch of extra to maintain.

      • You're probably right. I mean. I need most of the network devices, and I didn't list everything I am running on each, just big things. I do need to consolidate some if them though. Its been a trip and has made me a better IT though.

  • An old computer running on the top of a shelf that whenever I need to work with a display I have to bring it back down to the floor and borrow a VGA cable from another because the HDMI port is broken.

    Oh and it occasionally disconnects itself from the internet.

  • Main site:

    • 5950X on a GA-AB350-Gaming 3
    • 64GB
    • 1TB NVMe mirrored
    • 24TB RAIDz1, using external USB 3 disks
    • Ubuntu LTS
    • 700Mbps uplink
    • OpenWrt on Pi 4 router
    • Home Assistant Yellow

    Off site:

    • ThinkCentre 715q
    • 2400GE
    • 8GB
    • 256GB NVMe
    • 24TB RAIDz1, using external USB 3 disks
    • Ubuntu LTS
    • 30Mbps uplink
    • OpenWrt on Pi 4 router

    Syncthing replicates data between the two. ZFS auto snapshots prevent accidental or malicious data loss at each site. Various services are running on both machines. Plex, Wiki.js, OpenProject, etc. Most are run in docker, managed via systemd. The main machine is also used as a workstation as well as games. The storage arrays are ghetto special - USB 3 external disks, some WD Elements, some Seagate in enclosures. I even used to have a 1T, a 3T and a 4T disk in an LVM volume pretending to be an 8T disk in one of the ZFS pools. The next time I have to expand the storage I'll use second hand disks. The 5950X isn't boosting as high as it should be able to on a chipset with PB2, but I got all those cores on a B350 board. 😆 Config management is done with SaltStack.

  • Like a fucked up ACL trying to do a kind of least-priviledged filesystem knowing absolutely nothing.

    And 2 NUCs.

  • Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I've seen in this thread:

    Fewer Letters More Letters
    AP WiFi Access Point
    CGNAT Carrier-Grade NAT
    DNS Domain Name Service/System
    Git Popular version control system, primarily for code
    HA Home Assistant automation software
    ~ High Availability
    HTTP Hypertext Transfer Protocol, the Web
    HTTPS HTTP over SSL
    IP Internet Protocol
    LTS Long Term Support software version
    LVM (Linux) Logical Volume Manager for filesystem mapping
    LXC Linux Containers
    NAS Network-Attached Storage
    NAT Network Address Translation
    NUC Next Unit of Computing brand of Intel small computers
    NVMe Non-Volatile Memory Express interface for mass storage
    PCIe Peripheral Component Interconnect Express
    PSU Power Supply Unit
    PiHole Network-wide ad-blocker (DNS sinkhole)
    Plex Brand of media server package
    PoE Power over Ethernet
    RAID Redundant Array of Independent Disks for mass storage
    RPi Raspberry Pi brand of SBC
    SAN Storage Area Network
    SATA Serial AT Attachment interface for mass storage
    SBC Single-Board Computer
    SSD Solid State Drive mass storage
    SSH Secure Shell for remote terminal access
    SSL Secure Sockets Layer, for transparent encryption
    VPN Virtual Private Network
    ZFS Solaris/Linux filesystem focusing on data integrity
    Zigbee Wireless mesh network for low-power devices
    k8s Kubernetes container management package
    nginx Popular HTTP server

    30 acronyms in this thread; the most compressed thread commented on today has 6 acronyms.

    [Thread #525 for this sub, first seen 18th Feb 2024, 06:05] [FAQ] [Full list] [Contact] [Source code]

  • I'm running my email server on a POCO F1 ex-Android phone (running PostmarketOS now).

    I wish I could get NixOS running on it, then I'd move other things also there.

  • Self built Proxmox server (5600G/64gb ram/1x2tb nvme+4x4tb hdd) with 2 nics running litrally everything. List of services I run is long and Im too lazy to type them.

  • Power

    • 2x feeds into the rack (same circuit but we'll work on that)
    • Eaton 2000VA double conversion UPS on Feed A
    • APC 1500VA line interactive UPS on Feed B (bypassed, replacing it with another double conversion 2kVA eventually)

    Network

    • 2x Dell N2048P, stacked (potentially getting replaced with 2x stacked Cisco 9300)
    • FortiGate firewall
    • 1000/50 FTTP primary Internet link
    • 4G backup Internet link using a different Telco (the dream is to replace this with Starlink)

    Storage

    • Synology 4-bay NAS with 4x4TB in RAID-10 (for overflow storage from Virtual SAN cluster)
    • HP MSL2024 8GB Fiber Channel LTO5 Tape autoloader for off-site backup

    Compute

    • Dell R520 running VMware ESX for Production (2x Xeon E5-2450L, 80GB DDR3, 4x500GB SSD RAID-10 for Virtual SAN, 1x10TB SATA "scratch" disk, 2x10G fibre storage NICs, 2x1G copper NICs for VM traffic)
    • Dell R330 running VMware ESX for backups and DR (1x Xeon E3-1270v5, 32GB DDR4, 2x512GB SSD RAID-1, 2x4TB HDD RAID-1, 8G FC card for tape library)

    A second prod host will join the R520 soon to add some redundancy and mirror the Virtual SAN.

    All VMs are backed up and kept in an encrypted on-site data store for at least 4 weeks. They're duplicated to tape (encrypted) once a month and taken off site. Those are kept for 1 year minimum. Cloud backup storage will never replace tape in my setup.

    Services

    As far as "public facing" goes, the list is very short:

    Though I do run around 30-40 services all up on this setup (not including actual non-prod lab things that are on other servers or various SBCs around the place).

    If I had unlimited free electricity and no functioning ears I'd be using my Cisco UCS chassis and Nexus 5K switch/fabric extenders. But it just isn't meant to be (for now, haha).

    • Ryzen 2700X on a gigabyte B450i
    • Arc A380
    • 2 mirrored 4TB HDDs and 1 12 TB HDD, luks encrypted and on 2 zpools (I have an "unsafe" mount path for data on a single drive like media)
    • removable flash drive with boot partition and main SSD keyfile

    -Zwave dongle

    That's it.

    I can run everything I need to on it and my home internet is only 100/30 still because I don't live in a city, so 2.5gig networking isn't worth the cost. a380 does all of the hardware transcoding I need at a fairly low power. It isn't as good as just getting a newer NUC, but it was cheaper and a fun project.

    Also doing a full renovation, so KNX will be connected for home assistant to control my lights and things and my smart home stuff will probably balloon.

101 comments