Deadlock Solution #19

mdavis-xyz · 2024-11-12T13:34:15Z

Partially solves #17

rewrite starmap scheduler to not give tasks to children until they've returned the previous result
add unit test for deadlock issues
rewrite map_async to return a single result, instead of list of results. (I should probably have done this in a different PR, but I'm being lazy because I don't have much time right now.)

mdavis-xyz added 4 commits November 12, 2024 13:09

add unit test for deadlock issue

ad54731

Update tests for map_async to match stdlib behavior

8a7460a

fix deadlock issue in map with scheduler

6cc9f4f

Rewrite map_async to return single result

b689407

mdavis-xyz marked this pull request as draft November 12, 2024 13:34

mdavis-xyz mentioned this pull request Nov 12, 2024

Pipe.send occasionally hangs when submitting a large job to child process #17

Open

mdavis-xyz added 7 commits November 12, 2024 15:03

add more accurate test for map_async total time

cabcc8b

add deadlock test to check map_async returns immediately

3ed1ea8

Batch tasks for async maps

df87f46

explain deadlock solution

4b91430

fix bug with class subclass syntax

39bf307

add python 3.13 to unit test CICD

4c3cad5

fix imports so unit tests work from root and library dir

1a3f429

mdavis-xyz force-pushed the deadlock_map_scheduler branch from d009511 to 1a3f429 Compare November 13, 2024 17:11

make test script compatible with python 3.8

6898877

mdavis-xyz marked this pull request as ready for review November 13, 2024 17:37

mdavis-xyz merged commit 5f5b4d9 into master Nov 13, 2024
7 checks passed

Provide feedback