[FeuerSturm]

What's your server's Tickrate and FrameRate?

Usually SecretSpec only works correct if it's Tick100 and 1000fps
as I haven't found any other way to make that work on lower specs yet.

[f64]

Sadly, our servers are 66 tick. I suspected this might be messing with it but thanks for your help.

[f64]

You've probably tried this, but could it be possible to just block all the spectator information
sent to the client and not try to make it seem as though you're still on a team?

It also occurred to me while looking at all the panel info with the vgui_drawtree 1 command that it might be
possible to alter the alpha value of the Spectator text to zero, so that it is transparent, even though it's being sent.

[FeuerSturm]

Unfortunately this is not possible (as of now) and I already tried
a few different ways and nothing actually worked.