Commit Graph

291 Commits

Author SHA1 Message Date
09df9a1ae8 removed already done TODO 2025-06-02 09:49:59 +02:00
5b8357567b removed code relatedness from manual selection
since now it's already done by pull_requests
2025-06-02 09:48:27 +02:00
b311c49f9a simplifying logging of common error we can't do
much about
2025-05-28 10:17:59 +02:00
77ed66ded8 added small logging statement 2025-05-28 10:17:48 +02:00
e097885e36 only writing the dataset to disk when there are new entries 2025-05-28 10:17:19 +02:00
0b182837c1 added new option for dataset 2025-05-27 10:50:10 +02:00
900003bac7 added a way to extract the information to then
generate paraphrases
2025-05-27 10:48:17 +02:00
63b69e40b8 tried to make requests cache better 2025-05-26 11:36:31 +02:00
a4ce620aa0 printing stacktrace when error is made 2025-05-26 11:36:04 +02:00
7e00656ab1 fixed condition 2025-05-26 11:35:54 +02:00
e619d2f339 added another point of failure 2025-05-21 10:59:07 +02:00
5734ca5c8d if we are multithreading, give some time between the requests 2025-05-21 09:40:30 +02:00
b598e97bc6 moved update of pbar 2025-05-21 09:33:44 +02:00
9ced42b6c4 removed unused variable 2025-05-21 09:33:31 +02:00
f1e8b896bb fixed slight bug 2025-05-21 09:18:51 +02:00
a8ccf081a2 formatted file 2025-05-21 09:18:33 +02:00
d48c5d04b8 removed stat that has become useless 2025-05-20 16:50:21 +02:00
33cea7bbb4 added cute little units for the progress bars 2025-05-20 16:50:04 +02:00
ea7b510926 added another way pr can be invalid, if they have
no lines for their comment (github api be wierd)
2025-05-20 16:44:02 +02:00
09ee7995ff made more general function to move logging to file 2025-05-20 16:40:26 +02:00
c577b3a6e5 saving all the results after any execption 2025-05-20 09:59:51 +02:00
e6c5c8df82 sorting the values descending, to have the top
most of the given column first
2025-05-20 09:59:09 +02:00
975b25f2f6 removed print statements 2025-05-20 09:58:55 +02:00
a3a89bb346 moved some logic around 2025-05-20 09:58:49 +02:00
b0443cc87f added exclusion list 2025-05-20 09:57:53 +02:00
04a37030f4 populating cache only if there is any cache 2025-05-20 09:57:29 +02:00
15ffe67b0e added fields to the metadata to make manual
filtering easier
2025-05-20 09:56:54 +02:00
3ffbb229b8 fixed typo 2025-05-20 09:50:00 +02:00
6e0aca2ad5 fixed typo 2025-05-20 09:48:31 +02:00
4d9c47f33a added all the progress bars for each worker 2025-05-17 10:45:57 +02:00
98db478b7b first draft of parallelization (NOT TESTED YET) 2025-05-17 09:42:02 +02:00
25072ac8b3 removed unused import 2025-05-17 09:37:33 +02:00
b90111c652 now i'm not crashing when no GITHUB_API_TOKEN is
given, rather just printing a warning
2025-05-17 09:37:31 +02:00
970ee1c363 added the possibility of sorting the incoming csv
by a certain column, now taking any csv instead of
the result of clone_repos.py
2025-05-17 09:32:40 +02:00
3ea3e980bd added metavar names for arguments 2025-05-17 09:16:52 +02:00
5cf5e5a8ee added enumchoiceaction for easier enum in argparse
handling
2025-05-16 19:41:15 +02:00
14e64984c5 instead of adding the cache as we go through the
repos, just add it before any processing, so we are sure to keep all the previously saved data
2025-05-16 19:39:59 +02:00
b84ea797ff moved enums to top of file 2025-05-16 19:11:26 +02:00
25161c4d46 refactored manual selection into smaller bits,
easier to consume
2025-05-16 09:58:14 +02:00
63c6785b4d when asking for entries that implement the
suggested change, we now only keep the ones that
are code related
2025-05-14 20:53:02 +02:00
c55d21d042 removed unused import 2025-05-14 20:52:52 +02:00
17823e39fe added placeholder for paraphrases 2025-05-14 20:52:37 +02:00
cabf8fd823 addedthe build of the reference map to the dataset 2025-05-14 20:52:17 +02:00
5328fe59e1 moved dependency to somewhere optional 2025-05-14 15:40:52 +02:00
5403ff5d4d added code to extract the expected output given a
dataset (to test the website)
2025-05-14 15:40:10 +02:00
acce738872 made the requests never expire 2025-05-14 09:39:55 +02:00
a13a29c6de removed buggy continue 2025-05-14 09:39:33 +02:00
726a0d92e1 using output (forgot to commit it before) 2025-05-14 09:36:52 +02:00
0b02518374 found out that some couldn't checkout due to
conflicts, but if you force it, it works
2025-05-14 09:36:12 +02:00
ccd962c205 now using the metadata to get archive name 2025-05-14 09:36:06 +02:00