Towards Realistic Evaluation of Commit Message Generation by Matching Online and Offline Settings
Paper
•
2410.12046
•
Published
📊 Commit Message Generation Evaluation 🔍
All the resources for our "Towards Realistic Evaluation of Commit Message Generation by Matching Online and Offline Settings" study on CMG metrics!
-
Commit Message Editing Visualization
📈Note An app with visualizations and statistics for our commit message edits dataset and its synthetic extension. ❗Contains code for generating synthetic data, code for metrics selection, and code for plotting edit distance distributions. Check README for more details!
Commit Message Editing
✍Note An app for collecting commit message edits from human labelers.
JetBrains-Research/commit-msg-edits
Viewer • Updated • 116 • 273Note Our expert-labeled commit message edits dataset.
JetBrains-Research/synthetic-commit-msg-edits
Viewer • Updated • 18k • 76Note Synthetic extension of our commit message edits dataset.