I found the setting that fixes this. It's counter-intuitive, but it works.
Under Settings, in the "Pen & Windows Ink" section, set the option "Ignore touch input when I'm using my pen" to ON.
Mine was off by default when I upgraded to the latest Windows. It seems like it should be off, but... whatever.