TestSuiteBench eth-sri/tsb-mutants Updated 22 days ago • 3.16k eth-sri/tsb-reference_tests Updated 22 days ago • 833 eth-sri/tsb-reference_impl Updated 22 days ago • 1.32k
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 123 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 51 zai-org/humaneval-x Updated Oct 25, 2022 • 5.68k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 23 • 1
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 49 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 65
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 89 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 122 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 931 eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 91 • 2
TestSuiteBench eth-sri/tsb-mutants Updated 22 days ago • 3.16k eth-sri/tsb-reference_tests Updated 22 days ago • 833 eth-sri/tsb-reference_impl Updated 22 days ago • 1.32k
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 49 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 65
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 123 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 51 zai-org/humaneval-x Updated Oct 25, 2022 • 5.68k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 23 • 1
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 89 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 122 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 931 eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 91 • 2
