mirror of
https://github.com/karma-riuk/crab-webapp.git
synced 2025-07-05 06:08:13 +02:00
921 B
921 B
User stories Batch 1
[ ] As a user I want to be able to download the dataset for EITHER comment generation OR code refinment
-
When asking for the dataset, there is a parameter to say whether you want to download the context or not (the state of the repo before the PR).
-
TODO: actually build the datasets
[ ] As a user I want to be able to submit my predictions for the given downloaded dataset
[ ] As a user I want to be able to see the performance of my predictions against the benchmark (comment generation: bleu score, code refinement: # tests passed)
Work flow
First I'll do a basic express server to serve the datasets. No login no frontend. I'll implement Batch 1 then move on to some other features (frontend, maybe auth).