-
Notifications
You must be signed in to change notification settings - Fork 388
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: use #guard_msgs in run tests #4175
Conversation
Thanks a lot! Once that is taken care of, I’d like to propose that a (And then we could actually remove special handling of |
Mathlib CI status (docs):
|
We're not quite there yet. There are many There are also many cases where a test either #prints a large statement, or looks a IR output, or long simp/defeq/etc trace output... So there is more thought and cleanup required before we can silence tests. I guess the intermediate solution is to split |
I'd the point of the check command is not it's output, you can make that explicit using |
I think you mean |
Some variant thereof, yes :-D |
Many of our tests in
tests/lean/run/
produce output from#eval
(or#check
) statements, that is then ignored.This PR tries to capture all the useful output using
#guard_msgs
. I've only done a cursory check that the output is still sane --- there is a chance that some "unchecked" tests have already accumulated regressions and this just cements them!In the other direction, I did identify two rotten tests:
setStructInstNotation.lean
, where a comment saysSet Nat
, but#check
actually prints?_
. Weird?CompilerProbe.lean
is generating empty output, apparently indicating that something is broken, but I don't know the signficance of this file.In any case, I'll ask about these elsewhere.
(This started by noticing that a recent
grind
test file had an untestedtrace_state
, and then got carried away.)