bug#54237: Disabling `scroll-bar-mode' fails when setting `default-frame-alist'

[Tor Kringeland]

Running

  emacs -Q --daemon -l test.el

where the content of test.el is

  (scroll-bar-mode -1)
  (setq default-frame-alist '((cursor-color . "#007fff")))

fails to disable `scroll-bar-mode'.  When opening an Emacs client, I
have to toggle `scroll-bar-mode' two times to disable it.  The first
time it is "enabled" again (no visible change) and the second time it's
disabled.  The problem disappears if I remove the second line.

I'm using Emacs 29 built from master earlier today.