Unable to confirm installation on program from unknown source
Turns out this was caused by Twilight, which had an option that can fix the install issue.

With "Auto-pause in specified apps" ticket, and "APK Installer (button fix)", the problem goes away.