Leaklens

SWE-bench Verified: every task, with its verdict

Download CSV
TaskVerdictIssue title
pytest-dev__pytest-5262Tier A: the fix is stated in the issue_pytest.capture.EncodedFile mode should not include `b` (binary)
pytest-dev__pytest-5809Tier A: the fix is stated in the issueLexer "python3" in --pastebin feature causes HTTP errors
pytest-dev__pytest-6202Tier A: the fix is stated in the issue'.[' replaced with '[' in the headline shown of the test report
pytest-dev__pytest-7982Tier A: the fix is stated in the issueSymlinked directories not collected since pytest 6.1.0
pytest-dev__pytest-8399Tier A: the fix is stated in the issueStarting v6.2.0, unittest setUpClass fixtures are no longer "private"
pytest-dev__pytest-10051Tier B: the issue points to the file or function that was changedcaplog.get_records and caplog.clear conflict
pytest-dev__pytest-5631Tier B: the issue points to the file or function that was changedValueError when collecting tests that patch an array
pytest-dev__pytest-7205Tier B: the issue points to the file or function that was changedBytesWarning when using --setup-show with bytes parameter
pytest-dev__pytest-7324Tier B: the issue points to the file or function that was changedPytest crashes the interpreter on debug build for 3.8+
pytest-dev__pytest-7432Tier B: the issue points to the file or function that was changedskipping: --runxfail breaks pytest.mark.skip location reporting
pytest-dev__pytest-10081no quoted evidenceunittest.TestCase.tearDown executed for classes marked with `unittest.skip` when running --pdb
pytest-dev__pytest-10356disputedConsider MRO when obtaining marks for classes
pytest-dev__pytest-5787no quoted evidenceexception serialization should include chained exceptions
pytest-dev__pytest-5840disputed5.1.2 ImportError while loading conftest (windows import folder casing issues)
pytest-dev__pytest-6197no quoted evidenceRegression in 5.2.3: pytest tries to collect random __init__.py files
pytest-dev__pytest-7236disputedunittest.TestCase.tearDown executed on skipped tests when running --pdb
pytest-dev__pytest-7490disputedPytest 6: Dynamically adding xfail marker in test no longer ignores failure
pytest-dev__pytest-7521no quoted evidencepytest 6.0.0rc1: capfd.readouterr() converts \r to \n
pytest-dev__pytest-7571no quoted evidencecaplog fixture doesn't restore log level after test