> This is true for C++23, but P2996R1 wants to allow exceptions during constant evaluation.

Thanks, I wasn't aware of this. I have updated my proposal (link is
still valid) with P2996 in mind.

In short, it should be feasible to implement constexpr
std::uncaught_exceptions regardless whether exceptions are actually
supported. It also makes sense to mark it constexpr either way.