Commit Graph

19 Commits

Author SHA1 Message Date
Wim Pomp
29203dd128 - redirect stdout and stderr in child processes to devnull instead of None
- add parfor.__version__
2024-07-22 17:32:17 +02:00
Wim Pomp
9ce96a7e61 - redirect stdout and stderr in child processes 2024-07-08 17:57:23 +02:00
Wim Pomp
b609df8b52 - bugfix: do not restart pool when n_processes = None 2024-05-28 16:35:14 +02:00
Wim Pomp
9783c1d1f2 - introduce n_processes to change the number of processes in the pool 2024-05-24 16:57:35 +02:00
Wim Pomp
ac4d599646 - minimum python: 3.10
- typing
- task_error bug fix
- remove some deprecated functions
2024-04-26 18:32:12 +02:00
Wim Pomp
42746d21eb - make ParPoolSingleton.close a class method. 2024-03-19 18:52:20 +01:00
Wim Pomp
6fefdb9be0 - bugfix for argument bar=False 2024-02-09 13:32:18 +01:00
Wim Pomp
bb3b87b913 - catch and ignore errors when emptying queue
- timeout on closing pool
- close manager on closing pool
2024-01-29 11:25:22 +01:00
Wim Pomp
0b0c7a798f - Shutdown workers after 10 minutes of inactivity. Restart pool when needed again. 2023-11-18 13:38:01 +01:00
Wim Pomp
ad8d9a4efb - Protect reference counter with a lock because changes to a multiprocessing manager dict are not atomic. 2023-11-08 12:50:30 +01:00
Wim Pomp
098d1810c3 - Bugfix 2023-11-07 16:51:02 +01:00
Wim Pomp
f22b682b2a - skip KeyboardInterrupts in workers
- silence some warnings
2023-11-07 15:04:54 +01:00
Wim Pomp
e936292905 - Implement reference counting to make sure the parent process does not trash the item before all children trashed it. 2023-10-27 17:48:52 +02:00
Wim Pomp
265470e0ac - Use a shared memory approach.
- Track unpickled objects by CouldNotBePickled class.
- Bump minimal python to 3.8.
2023-10-12 14:46:42 +02:00
Wim Pomp
0263b6a4c7 - Copy previous task to prevent unnecessary pickling. 2023-09-13 17:04:55 +02:00
Wim Pomp
f3302f6dba - Use a singleton pool to prevent lengthy restarts of the pool, this also means that arguments for pool size have gone.
- Removed qbar and TqdmMeter.
- Wrap chunked function for better error messages.
2023-09-08 17:19:35 +02:00
Wim Pomp
92f162b7d5 - Make processes non-daemonic
- Deprecate terminator argument
2023-08-16 16:46:50 +02:00
Wim Pomp
dfee4bc0ea - README update 2023-08-08 17:50:20 +02:00
Wim Pomp
0635c62d42 - bugfix: some iterables caused an error
- pytest tests
- deprecation warnings
- use poetry for installs
2023-08-08 15:05:31 +02:00