My first non-internship IT role was as the sole actual IT person for a small community clinic. The layout was like this: the main building had a 10Mbps/5Mbps connection. The office building had a dedicated fiber run from it to the main clinic building. The small satellite clinic had a dedicated T1 connection to the main clinic.
There was one domain controller on the entire system. One. It was a pizza box system because VMware was new and expensive. (It was not really that expensive, but that’s what they kept telling me.) It was running on Windows Server 2003 R2 (2008 was a new thing at the time). This was right about the time Windows Server 2000 SP4 went EOL (end-of-life).
The issue? They had slow login times at the satellite clinic. Five people worked in that clinic, and every morning, at logon, it would take the users anywhere from fifteen to thirty minutes to successfully log on to their systems. We continually received help desk tickets on the issue. Every time I went to test with the user who submitted the ticket, the login time was long but not fifteen minutes — more like five.
Finally, I got fed up with it, and I put an old desktop computer in between the router and the switch at the remote clinic, running a free packet analyzer to help me troubleshoot. Surely there was something amiss here.
The next morning, I came in and checked the logs. Well, that’s weird. Why was SMB (Server Message Block protocol) pushing a ton of traffic when they log on? I checked the domain controller. Well, that’d do it: roaming profiles. Every morning, those users would log in at the same time and try to push MASSIVE amounts of user documents across that 1.5-Mbps T1. Every morning, those users would call the help desk and say, “It’s taking forever to log in.” And every morning, I would work with a user, and the login time would be far less, because the system wasn’t powered off, and therefore, the profile would stay cached.
I went to my boss, who was the Director of Finance.
Me: “Hey, [Boss], I figured out why they take forever to log in every morning.”
Boss: “Yeah? What’s that?”
Me: “They’re using roaming profiles.”
Boss: “What’s that?”
I sighed and proceeded to explain roaming profiles in as close to an orange crayon method as I could.
Boss: “Okay, so what’s the fix?”
Me: “Either we disable roaming profiles, or they need a local domain controller. We should have two anyway, just in case something goes awry with one or the other.”
Boss: “We don’t have money for that, and we can’t disable their profiles being backed up to the server. What else you got?”
Me: “A lot of unhappy users, that’s what we’ve got. I’ll explain what’s wrong to them, and then you can explain why we can’t fix it.”
Boss: “Can’t you just do it? You’re the IT guy.”
Me: “Sure, but I’m going to tell them who told me we couldn’t fix it.”
The next step was that I went to her boss, the clinic director. That conversation went as well as the previous one had. Same response: no money, and we can’t change settings.
Okay, back to the drawing board.
I went to our boneyard, a room in the basement of the office building where we stored old, washed-up PCs before they’d get recycled. I found an old PC with a halfway usable processor. It was an AMD Athlon XP 3200, with a Bioware motherboard with four memory slots. I managed to dig up four 2GB DDR DIMMs (ram). Yes, they were old then. They’re ancient now.
I dug around and found four 250GB 5200RPM 3.5″ hard drives. The motherboard had SATA on it and a built-in RAID controller (life saver). I set up the four drives in RAID 5. I continued digging, trying to find a Server 2003 license. I was unable to locate that, but I found a Server 2000 SP4. I said, “Screw it,” and installed that, promoted it to DC, replicated the remote users’ profiles to it, and changed their targets. I took the server to the remote site and installed it.
I got a call from that site the next day.
User: “Oh, wow! You fixed it! It took almost no time to log in today! Thank you so much!”
Me: “You’re welcome. Let us know if you have any more issues with it, okay?”
User: “Will do!”
I called my boss.
Me: “I fixed the satellite office.”
Boss: “How?”
Me: “Using old equipment that should’ve been recycled years ago. It’s a bandaid fix. We need to have a new server in the budget, period.”
Boss: “I’ll forward your request to [Big Boss].”
Budget time rolled around: no server. The justification? “It’s working now, so why do we need it?”
I left that place within a month after that.
It might still be running this way. I am not sure.