Phantom "?" slots showing in HLSW in TF2 server

[KGoBlin]

I've been having an issue with our TF2 server just recently. HLSW shows "?" players connected to the server (just as it shows when someone is connecting but hasn't fully connected to the server) but they never truly connect, nor do they go away after a map change. What's stranger is that the Steam server monitor shows the correct amount of players (all actual players minus the "?" slots). And what's stranger on top of that is that if the "?" slots reach the max player limit in the server, players can't join. They get the full server message. Even though there may only be 11 or 12 real players in there and Steam shows slots available. Anyone have any ideas?

Running:
MetaMod:Source v1.7.0
SourceMod v1.1.0

Plugins:
01 "Weapon Logging" (2.8) by TTS Oetzel & Goerz GmbH
02 "Fun Commands" (1.1.0) by AlliedModders LLC
03 "TF2: Killer's Info" (0.8.5) by Nut
04 "Basic Commands" (1.1.0) by AlliedModders LLC
05 "Basic Info Triggers" (1.1.0) by AlliedModders LLC
06 "Fun Votes" (1.1.0) by AlliedModders LLC
07 "Basic Comm Control" (1.1.0) by AlliedModders LLC
08 "Reserved Slots" (1.1.0) by AlliedModders LLC
09 "Client Preferences" (1.1.0) by AlliedModders LLC
10 "HLstatsX Plugin" (2.8) by TTS Oetzel & Goerz GmbH
11 "Admin Menu" (1.1.0) by AlliedModders LLC
12 "Anti-Flood" (1.1.0) by AlliedModders LLC
13 "SlapSlay Commands" (1.1.0) by AlliedModders LLC
14 "Observer Point" (1.0.100) by <eVa>Dog
15 "TeamSwitch" (1.3) by MistaGee
16 "Admin Help" (1.1.0) by AlliedModders LLC
17 "Basic Chat" (1.1.0) by AlliedModders LLC
18 "TF2 Fast Respawns" (1.0.5) by WoZeR
19 "Advertisements" (0.5.5) by Tsunami
20 "HLSW Nextmap & Timeleft" (1.0) by Tsunami
21 "Nextmap" (1.1.0) by AlliedModders LLC
22 "Basic Votes" (1.1.0) by AlliedModders LLC
23 "Basic Ban Commands" (1.1.0) by AlliedModders LLC
24 "SourceMod Radio" (1.0.0.12) by dubbeh
25 "Admin File Reader" (1.1.0) by AlliedModders LLC


Any help or suggestions would be greatly appreciated.