All this is indeed true but I have recently allowed Experience to be installed only because of the Shadowplay utility. It makes making videos very easy without drop in FPS. I have not set it to start in the background though, I start it only when I need to record video. If you don't make FS videos leave it out.
Does anyone know if Shadowplay works okay in 4K? I've been using Fraps and will record in 4K, but it's quite a load on my system.