285 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Karma Riuk	900003bac7	added a way to extract the information to then ... generate paraphrases	2025-05-27 10:48:17 +02:00
Karma Riuk	63b69e40b8	tried to make requests cache better	2025-05-26 11:36:31 +02:00
Karma Riuk	a4ce620aa0	printing stacktrace when error is made	2025-05-26 11:36:04 +02:00
Karma Riuk	7e00656ab1	fixed condition	2025-05-26 11:35:54 +02:00
Karma Riuk	e619d2f339	added another point of failure	2025-05-21 10:59:07 +02:00
Karma Riuk	5734ca5c8d	if we are multithreading, give some time between the requests	2025-05-21 09:40:30 +02:00
Karma Riuk	b598e97bc6	moved update of pbar	2025-05-21 09:33:44 +02:00
Karma Riuk	9ced42b6c4	removed unused variable	2025-05-21 09:33:31 +02:00
Karma Riuk	f1e8b896bb	fixed slight bug	2025-05-21 09:18:51 +02:00
Karma Riuk	a8ccf081a2	formatted file	2025-05-21 09:18:33 +02:00
Karma Riuk	d48c5d04b8	removed stat that has become useless	2025-05-20 16:50:21 +02:00
Karma Riuk	33cea7bbb4	added cute little units for the progress bars	2025-05-20 16:50:04 +02:00
Karma Riuk	ea7b510926	added another way pr can be invalid, if they have ... no lines for their comment (github api be wierd)	2025-05-20 16:44:02 +02:00
Karma Riuk	09ee7995ff	made more general function to move logging to file	2025-05-20 16:40:26 +02:00
Karma Riuk	c577b3a6e5	saving all the results after any execption	2025-05-20 09:59:51 +02:00
Karma Riuk	e6c5c8df82	sorting the values descending, to have the top ... most of the given column first	2025-05-20 09:59:09 +02:00
Karma Riuk	975b25f2f6	removed print statements	2025-05-20 09:58:55 +02:00
Karma Riuk	a3a89bb346	moved some logic around	2025-05-20 09:58:49 +02:00
Karma Riuk	b0443cc87f	added exclusion list	2025-05-20 09:57:53 +02:00
Karma Riuk	04a37030f4	populating cache only if there is any cache	2025-05-20 09:57:29 +02:00
Karma Riuk	15ffe67b0e	added fields to the metadata to make manual ... filtering easier	2025-05-20 09:56:54 +02:00
Karma Riuk	3ffbb229b8	fixed typo	2025-05-20 09:50:00 +02:00
Karma Riuk	6e0aca2ad5	fixed typo	2025-05-20 09:48:31 +02:00
Karma Riuk	4d9c47f33a	added all the progress bars for each worker	2025-05-17 10:45:57 +02:00
Karma Riuk	98db478b7b	first draft of parallelization (NOT TESTED YET)	2025-05-17 09:42:02 +02:00
Karma Riuk	25072ac8b3	removed unused import	2025-05-17 09:37:33 +02:00
Karma Riuk	b90111c652	now i'm not crashing when no GITHUB_API_TOKEN is ... given, rather just printing a warning	2025-05-17 09:37:31 +02:00
Karma Riuk	970ee1c363	added the possibility of sorting the incoming csv ... by a certain column, now taking any csv instead of the result of clone_repos.py	2025-05-17 09:32:40 +02:00
Karma Riuk	3ea3e980bd	added metavar names for arguments	2025-05-17 09:16:52 +02:00
Karma Riuk	5cf5e5a8ee	added enumchoiceaction for easier enum in argparse ... handling	2025-05-16 19:41:15 +02:00
Karma Riuk	14e64984c5	instead of adding the cache as we go through the ... repos, just add it before any processing, so we are sure to keep all the previously saved data	2025-05-16 19:39:59 +02:00
Karma Riuk	b84ea797ff	moved enums to top of file	2025-05-16 19:11:26 +02:00
Karma Riuk	25161c4d46	refactored manual selection into smaller bits, ... easier to consume	2025-05-16 09:58:14 +02:00
Karma Riuk	63c6785b4d	when asking for entries that implement the ... suggested change, we now only keep the ones that are code related	2025-05-14 20:53:02 +02:00
Karma Riuk	c55d21d042	removed unused import	2025-05-14 20:52:52 +02:00
Karma Riuk	17823e39fe	added placeholder for paraphrases	2025-05-14 20:52:37 +02:00
Karma Riuk	cabf8fd823	addedthe build of the reference map to the dataset	2025-05-14 20:52:17 +02:00
Karma Riuk	5328fe59e1	moved dependency to somewhere optional	2025-05-14 15:40:52 +02:00
Karma Riuk	5403ff5d4d	added code to extract the expected output given a ... dataset (to test the website)	2025-05-14 15:40:10 +02:00
Karma Riuk	acce738872	made the requests never expire	2025-05-14 09:39:55 +02:00
Karma Riuk	a13a29c6de	removed buggy continue	2025-05-14 09:39:33 +02:00
Karma Riuk	726a0d92e1	using output (forgot to commit it before)	2025-05-14 09:36:52 +02:00
Karma Riuk	0b02518374	found out that some couldn't checkout due to ... conflicts, but if you force it, it works	2025-05-14 09:36:12 +02:00
Karma Riuk	ccd962c205	now using the metadata to get archive name	2025-05-14 09:36:06 +02:00
Karma Riuk	1f91acf6c1	moved click to optional requirments	2025-05-14 09:19:08 +02:00
Karma Riuk	c731fd3393	commented out print	2025-05-14 09:18:36 +02:00
Karma Riuk	65806ccbe3	now the metadata knows it's archive name	2025-05-14 09:18:11 +02:00
Karma Riuk	ae516b6c34	removed good and put is_code_related in selection instead	2025-05-14 09:18:06 +02:00
Karma Riuk	ea3a2b72e5	added output to manual_selection in order not to ... overwrite every time	2025-05-14 09:16:31 +02:00
Karma Riuk	2f2cbae756	fixed typing of parameters for server version of ... python	2025-05-12 11:57:30 +02:00