-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add ML for synthesis prototype to repository #167
Commits on Jun 23, 2021
-
Configuration menu - View commit details
-
Copy full SHA for e47251c - Browse repository at this point
Copy the full SHA e47251cView commit details
Commits on Aug 4, 2021
-
Configuration menu - View commit details
-
Copy full SHA for a56fd16 - Browse repository at this point
Copy the full SHA a56fd16View commit details -
Configuration menu - View commit details
-
Copy full SHA for b377853 - Browse repository at this point
Copy the full SHA b377853View commit details -
Migrate to unix-like paths. Avoid manual nitta start and platform dep…
…s. Fix some warnings.
Configuration menu - View commit details
-
Copy full SHA for 63e245c - Browse repository at this point
Copy the full SHA 63e245cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8a5df52 - Browse repository at this point
Copy the full SHA 8a5df52View commit details
Commits on Aug 31, 2021
-
Add data crawling library and script
May be needed in the future for NITTA profiling purpose.
Configuration menu - View commit details
-
Copy full SHA for 823426f - Browse repository at this point
Copy the full SHA 823426fView commit details
Commits on Jul 1, 2022
-
Configuration menu - View commit details
-
Copy full SHA for ee87e0c - Browse repository at this point
Copy the full SHA ee87e0cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 27986cd - Browse repository at this point
Copy the full SHA 27986cdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9b36b7b - Browse repository at this point
Copy the full SHA 9b36b7bView commit details -
Revert adding unneeded explicit dependency
Regex-posix now have their own dependency for regex-posix-clib on Windows.
Configuration menu - View commit details
-
Copy full SHA for d1abe93 - Browse repository at this point
Copy the full SHA d1abe93View commit details
Commits on Jul 2, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 702383b - Browse repository at this point
Copy the full SHA 702383bView commit details
Commits on Aug 17, 2022
-
Configuration menu - View commit details
-
Copy full SHA for cdd98a0 - Browse repository at this point
Copy the full SHA cdd98a0View commit details
Commits on Aug 21, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 895f582 - Browse repository at this point
Copy the full SHA 895f582View commit details -
Configuration menu - View commit details
-
Copy full SHA for e26d1cc - Browse repository at this point
Copy the full SHA e26d1ccView commit details -
Configuration menu - View commit details
-
Copy full SHA for b2e5497 - Browse repository at this point
Copy the full SHA b2e5497View commit details
Commits on Feb 24, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2c72895 - Browse repository at this point
Copy the full SHA 2c72895View commit details -
Fix killing the parent process group instead of NITTA
Due to some platform-specific peculiarities (I guess) exiting run_nitta context manager is killing the whole process group including the parent process of the Python interpreter itself. Python tests were killing JetBrains IDE components in Docker development environment because of this 😅
Configuration menu - View commit details
-
Copy full SHA for bb16441 - Browse repository at this point
Copy the full SHA bb16441View commit details -
Configuration menu - View commit details
-
Copy full SHA for bffe337 - Browse repository at this point
Copy the full SHA bffe337View commit details -
Configuration menu - View commit details
-
Copy full SHA for e3a6c9c - Browse repository at this point
Copy the full SHA e3a6c9cView commit details
Commits on Mar 18, 2023
-
Merge branch 'master' into ml-for-synthesis-prototype
Updates haskell code to reformatted with recent fourmolu
Configuration menu - View commit details
-
Copy full SHA for ee14c3a - Browse repository at this point
Copy the full SHA ee14c3aView commit details
Commits on Mar 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7746f04 - Browse repository at this point
Copy the full SHA 7746f04View commit details
Commits on Mar 29, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 90405c8 - Browse repository at this point
Copy the full SHA 90405c8View commit details -
Configuration menu - View commit details
-
Copy full SHA for fe46ddf - Browse repository at this point
Copy the full SHA fe46ddfView commit details
Commits on Mar 30, 2023
-
Pass BackendCtx to handlers for ML backend server access
Failed to do so via StateT monad at the moment due to rising problems with type constraints ("could not deduce...") in Main.hs or when synthesis methods were used outside of NITTA REST API.
Configuration menu - View commit details
-
Copy full SHA for 286a011 - Browse repository at this point
Copy the full SHA 286a011View commit details
Commits on Mar 31, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 95cede8 - Browse repository at this point
Copy the full SHA 95cede8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7471461 - Browse repository at this point
Copy the full SHA 7471461View commit details -
Configuration menu - View commit details
-
Copy full SHA for 278e99d - Browse repository at this point
Copy the full SHA 278e99dView commit details
Commits on Apr 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 74b636a - Browse repository at this point
Copy the full SHA 74b636aView commit details
Commits on Apr 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f07e455 - Browse repository at this point
Copy the full SHA f07e455View commit details
Commits on Apr 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 58ecf53 - Browse repository at this point
Copy the full SHA 58ecf53View commit details -
Configuration menu - View commit details
-
Copy full SHA for 062c7d0 - Browse repository at this point
Copy the full SHA 062c7d0View commit details -
Configuration menu - View commit details
-
Copy full SHA for adbabb2 - Browse repository at this point
Copy the full SHA adbabb2View commit details
Commits on Apr 19, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a99a819 - Browse repository at this point
Copy the full SHA a99a819View commit details -
Configuration menu - View commit details
-
Copy full SHA for 16fdb84 - Browse repository at this point
Copy the full SHA 16fdb84View commit details
Commits on Apr 20, 2023
-
Fix problems and improve dx related to development docker image
- omitting uid/gid - ghcup - unminimizing + man - gpg passphrases - fix PATH and .bashrc issue - move aliases to .bash_aliases - fourmolu 0.10.1.0
Configuration menu - View commit details
-
Copy full SHA for 92f1f01 - Browse repository at this point
Copy the full SHA 92f1f01View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b4af30 - Browse repository at this point
Copy the full SHA 5b4af30View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5348ed - Browse repository at this point
Copy the full SHA e5348edView commit details -
Configuration menu - View commit details
-
Copy full SHA for e018cde - Browse repository at this point
Copy the full SHA e018cdeView commit details -
Configuration menu - View commit details
-
Copy full SHA for c70dbdb - Browse repository at this point
Copy the full SHA c70dbdbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1e760c4 - Browse repository at this point
Copy the full SHA 1e760c4View commit details
Commits on May 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c866cd2 - Browse repository at this point
Copy the full SHA c866cd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4106c86 - Browse repository at this point
Copy the full SHA 4106c86View commit details -
Configuration menu - View commit details
-
Copy full SHA for a9b097b - Browse repository at this point
Copy the full SHA a9b097bView commit details -
Configuration menu - View commit details
-
Copy full SHA for a7c3a33 - Browse repository at this point
Copy the full SHA a7c3a33View commit details -
Configuration menu - View commit details
-
Copy full SHA for 705e733 - Browse repository at this point
Copy the full SHA 705e733View commit details -
Get rid of dataclasses-json completely
Refactor everything to Pydantic for consistency
Configuration menu - View commit details
-
Copy full SHA for 818beab - Browse repository at this point
Copy the full SHA 818beabView commit details
Commits on May 6, 2023
-
Reformat & tidy up the Python codebase
- Python development was switched to VS Code since JetBrains Gateway is still too buggy and painful to use for remote development over SSH. - All Python code was reformatted with `black`. - All Python code was linted and made `mypy`-compatible. - All imports in Python code were regrouped and sorted with `isort`. - All unused imports were removed with `autoflake`. Besides: - Basics for tree sampling were implemented. Yes, this should've been a separate commit but things got messed up :c
Configuration menu - View commit details
-
Copy full SHA for 4093db9 - Browse repository at this point
Copy the full SHA 4093db9View commit details -
Fix early node children initialization (before async request)
It's important in async scenaries when multiple coroutines are working on the same node. One might incorrectly consider it already loaded.
Configuration menu - View commit details
-
Copy full SHA for 452f1e9 - Browse repository at this point
Copy the full SHA 452f1e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for aa8bd91 - Browse repository at this point
Copy the full SHA aa8bd91View commit details
Commits on May 7, 2023
-
Implement basic sampling results processing
- Label calculation - DataFrame assembly - Saving to csv
Configuration menu - View commit details
-
Copy full SHA for 58cf53a - Browse repository at this point
Copy the full SHA 58cf53aView commit details -
Implement label aggregation + fix running nitta + treecov
- Implemented label aggregation and sampling results deduplication - NITTA was failing to start sometimes due to port conflicts - fixed - Implemented sampling tree coverage estimation (phew...)
Configuration menu - View commit details
-
Copy full SHA for e859781 - Browse repository at this point
Copy the full SHA e859781View commit details -
Disable tree coverage estimation
Doesn't work for other examples and I've run out of time for that :(
Configuration menu - View commit details
-
Copy full SHA for 8f6b8c2 - Browse repository at this point
Copy the full SHA 8f6b8c2View commit details
Commits on May 8, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a557da3 - Browse repository at this point
Copy the full SHA a557da3View commit details
Commits on Jun 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2e52897 - Browse repository at this point
Copy the full SHA 2e52897View commit details -
Parametrize depth_base, implement aggressive drops
Aggressive drops jump straight to top-n node from the heap (instead of top-1) when synthesis is beating around the bush for too long. This was found to be helpful for huge synthesis cases.
Configuration menu - View commit details
-
Copy full SHA for 02eaf4d - Browse repository at this point
Copy the full SHA 02eaf4dView commit details
Commits on Jun 2, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ff74b2a - Browse repository at this point
Copy the full SHA ff74b2aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d732752 - Browse repository at this point
Copy the full SHA d732752View commit details -
Configuration menu - View commit details
-
Copy full SHA for 757fc89 - Browse repository at this point
Copy the full SHA 757fc89View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8ca4412 - Browse repository at this point
Copy the full SHA 8ca4412View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1a76c78 - Browse repository at this point
Copy the full SHA 1a76c78View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6cf9818 - Browse repository at this point
Copy the full SHA 6cf9818View commit details -
Configuration menu - View commit details
-
Copy full SHA for 818f2dd - Browse repository at this point
Copy the full SHA 818f2ddView commit details -
Configuration menu - View commit details
-
Copy full SHA for 902ce17 - Browse repository at this point
Copy the full SHA 902ce17View commit details
Commits on Jun 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f614804 - Browse repository at this point
Copy the full SHA f614804View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b8e9f2 - Browse repository at this point
Copy the full SHA 8b8e9f2View commit details -
Configuration menu - View commit details
-
Copy full SHA for eaf0d93 - Browse repository at this point
Copy the full SHA eaf0d93View commit details
Commits on Jun 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f910363 - Browse repository at this point
Copy the full SHA f910363View commit details -
Configuration menu - View commit details
-
Copy full SHA for b4ebea2 - Browse repository at this point
Copy the full SHA b4ebea2View commit details -
Merge pull request #254 from ryukzak/ml-for-synthesis-prototype-v2
ML for synthesis prototype v2 -> v1 branch
Configuration menu - View commit details
-
Copy full SHA for 01822e4 - Browse repository at this point
Copy the full SHA 01822e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for d89143f - Browse repository at this point
Copy the full SHA d89143fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 48c2a24 - Browse repository at this point
Copy the full SHA 48c2a24View commit details -
Configuration menu - View commit details
-
Copy full SHA for b3caac2 - Browse repository at this point
Copy the full SHA b3caac2View commit details
Commits on Jun 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ffa4493 - Browse repository at this point
Copy the full SHA ffa4493View commit details -
Configuration menu - View commit details
-
Copy full SHA for cecd005 - Browse repository at this point
Copy the full SHA cecd005View commit details
Commits on Jun 19, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8cca13d - Browse repository at this point
Copy the full SHA 8cca13dView commit details
Commits on Jun 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f0f561c - Browse repository at this point
Copy the full SHA f0f561cView commit details -
Fix the "random free port is already in use" problem with run_nitta
It was rare but sometimes it happened
Configuration menu - View commit details
-
Copy full SHA for d99953c - Browse repository at this point
Copy the full SHA d99953cView commit details
Commits on Jun 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a349a30 - Browse repository at this point
Copy the full SHA a349a30View commit details -
Fix NITTA startup in Python (NITTA-side port selection)
This is a fix for a "port is already in use" occasional problem with dynamic startup of NITTA API server in Python scripts. Before we've chosen a random port on Python side and passed it to NITTA via --port. Sometimes it was already occupied by another process. That caused random crashes. This could be fixed more easily by startup retries with port reselection if only we didn't need to support API server startup right after synthesis. Synthesis can take a long time, hence greater probability for chosen ports to become occupied and greater time cost of the retry. The only robust solution was to implement a NITTA-side free random port selection and its passing over to Python via inter-process communication. This commit implements it via Python-side NITTA stdout parsing as this is the simplest way to achieve the goal.
Configuration menu - View commit details
-
Copy full SHA for 4d9f8fb - Browse repository at this point
Copy the full SHA 4d9f8fbView commit details -
Update behavior of evalute Python script (API-based metrics)
The scripts now uses the updated behavior of NITTA itself (post-synthesis API server startup) and dynamic NITTA startup from Python (NITTA-side random port selection). Metrics gathering that was earlier implemented via NITTA stdout parsing is now fully `/treeInfo`-based.
Configuration menu - View commit details
-
Copy full SHA for 7da19ad - Browse repository at this point
Copy the full SHA 7da19adView commit details
Commits on Jun 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 56af030 - Browse repository at this point
Copy the full SHA 56af030View commit details
Commits on Jun 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9ceb85e - Browse repository at this point
Copy the full SHA 9ceb85eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6857280 - Browse repository at this point
Copy the full SHA 6857280View commit details
Commits on Jul 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c8b5cd7 - Browse repository at this point
Copy the full SHA c8b5cd7View commit details
Commits on Jul 17, 2023
-
Fix bugs in evaluation results aggregation
- sum/min/max/mean when len in (0, 1) - mistakenly taking columns only from results[0], although it can be a timeout (hence not a full dict).
Configuration menu - View commit details
-
Copy full SHA for 553da95 - Browse repository at this point
Copy the full SHA 553da95View commit details -
Fix synthesis success detection and logging
Successful leafs count wasn't checked, so non-timeout synthesis failure wasn't detected. NITTA API server was started anyway in those cases, so it was considered a success and led to stats evaluation errors and incorrect results.
Configuration menu - View commit details
-
Copy full SHA for 35bb5e0 - Browse repository at this point
Copy the full SHA 35bb5e0View commit details -
Increase default step limit for top-down synthesis so it's enough
Evaluation showed that "STEP LIMIT REACHED" was sometimes happening even before a 60 seconds synthesis timeout was reached.
Configuration menu - View commit details
-
Copy full SHA for ba83a70 - Browse repository at this point
Copy the full SHA ba83a70View commit details -
Configuration menu - View commit details
-
Copy full SHA for 041244e - Browse repository at this point
Copy the full SHA 041244eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f571e5 - Browse repository at this point
Copy the full SHA 1f571e5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1196def - Browse repository at this point
Copy the full SHA 1196defView commit details
Commits on Jul 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for d982a8d - Browse repository at this point
Copy the full SHA d982a8dView commit details
Commits on Jul 31, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 4de9180 - Browse repository at this point
Copy the full SHA 4de9180View commit details -
Remove current raw evaluation results from the repo
They were uploaded just to get a permalink and are not actually needed in the repo.
Configuration menu - View commit details
-
Copy full SHA for a8f9a00 - Browse repository at this point
Copy the full SHA a8f9a00View commit details
Commits on Aug 17, 2023
-
Remove old data crawling code, refactor the new one
This change replaces the old full-tree approach of gathering model training data with the recently developed tree sampling algorithm. The old code is deleted, all its usages are now working with the new method. This commit also includes lots of minor changes and refactorings of the related code. Small bugs and inconsistencies were fixed, some TODOs left. Object names, documentation and comments should also be clearer now.
Configuration menu - View commit details
-
Copy full SHA for 590f7c1 - Browse repository at this point
Copy the full SHA 590f7c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 48743e8 - Browse repository at this point
Copy the full SHA 48743e8View commit details -
Make NITTA stdout pipe reading not to stop on port
This is important so passthrough NITTA logger continues to operate and: 1) makes seeing NITTA logs easiser when debugging; 2) helps to avoid NITTA process locking since pipe's buffer is full.
Configuration menu - View commit details
-
Copy full SHA for e98ec55 - Browse repository at this point
Copy the full SHA e98ec55View commit details -
Configuration menu - View commit details
-
Copy full SHA for eb4ef43 - Browse repository at this point
Copy the full SHA eb4ef43View commit details
Commits on Aug 19, 2023
-
Revamp Python tooling, add Ruff and mypy, fix errors
- Reconfigured everything using basic version of pyproject.toml - Kept requirements.txt until poetry introduction - Found better VS code extensions, configured them (I should share this workspace config!) - Added type stubs for mypy's static type checking of some used libs - Fixed errors found by mypy (nothing useful so far...) - Fixed errors found by Ruff (cool!) - Fixed all formatting errors in the code with black Current suggested tooling: - VS code for editing and syntax highlighting - Microsoft's Pylance for an enchanced Python developer experience (syntax checking, autoimport, autocomplete, type inference, etc.) - black (formatting) - mypy (static type checking) - ruff (flake8-like style+idioms linting, imports optimizing/sorting) - Pytest for testing - Test Explorer UI VS code extension + Python adapter (tests summary) ^ replace with Pylance's?
Configuration menu - View commit details
-
Copy full SHA for 790725d - Browse repository at this point
Copy the full SHA 790725dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3bf8ac3 - Browse repository at this point
Copy the full SHA 3bf8ac3View commit details -
Refactor and fix crawling training data from many examples
Refactored and fixed 2 scripts here: - train_evaluate_in_ci - crawl_data_by_tree_sampling_many Logic of crawling from many examples was taken from the 2nd script, generalized and reused in the 1st. Relevant refactorings were made.
Configuration menu - View commit details
-
Copy full SHA for 23d7f65 - Browse repository at this point
Copy the full SHA 23d7f65View commit details -
Fix writing and reading input_columns from model's metadata
Now input columns are always stored in the model's metadata, respected by input data preprocessing logic and, thus, can be completely dynamic. Thanks to this, old models will still work even if NITTA will start to give more node parameters in the future.
Configuration menu - View commit details
-
Copy full SHA for 0e83ea2 - Browse repository at this point
Copy the full SHA 0e83ea2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4582ff5 - Browse repository at this point
Copy the full SHA 4582ff5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6ed4333 - Browse repository at this point
Copy the full SHA 6ed4333View commit details -
Configuration menu - View commit details
-
Copy full SHA for f304514 - Browse repository at this point
Copy the full SHA f304514View commit details -
Configuration menu - View commit details
-
Copy full SHA for ff1fa92 - Browse repository at this point
Copy the full SHA ff1fa92View commit details
Commits on Aug 20, 2023
-
Remove comment about broken cache for compute_node_label
Should we get rid of function calls caching in general? Is it useful anywhere at this point?
Configuration menu - View commit details
-
Copy full SHA for 7991145 - Browse repository at this point
Copy the full SHA 7991145View commit details -
Configuration menu - View commit details
-
Copy full SHA for ce9e23a - Browse repository at this point
Copy the full SHA ce9e23aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3244869 - Browse repository at this point
Copy the full SHA 3244869View commit details -
Configuration menu - View commit details
-
Copy full SHA for fcf6246 - Browse repository at this point
Copy the full SHA fcf6246View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6437c31 - Browse repository at this point
Copy the full SHA 6437c31View commit details -
Configuration menu - View commit details
-
Copy full SHA for a81d0b8 - Browse repository at this point
Copy the full SHA a81d0b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 534f6f9 - Browse repository at this point
Copy the full SHA 534f6f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 070b334 - Browse repository at this point
Copy the full SHA 070b334View commit details -
Configuration menu - View commit details
-
Copy full SHA for 107bc9b - Browse repository at this point
Copy the full SHA 107bc9bView commit details -
Bump scikit-learn to fix build errors on Python 3.11
Should upgrade all packages, perhaps, while we're at it...
Configuration menu - View commit details
-
Copy full SHA for f1cbea1 - Browse repository at this point
Copy the full SHA f1cbea1View commit details -
Use separate examples to validate a model instead of a random split
It'll lead to worse validation metrics for now, but it's an important future problem to be solved. It's unclear what prevents the model from generalizing better. Not enough node (input) parameters?
Configuration menu - View commit details
-
Copy full SHA for 2178f6c - Browse repository at this point
Copy the full SHA 2178f6cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3461159 - Browse repository at this point
Copy the full SHA 3461159View commit details -
Configuration menu - View commit details
-
Copy full SHA for 85dd429 - Browse repository at this point
Copy the full SHA 85dd429View commit details
Commits on Aug 21, 2023
-
Refactor model training and validation
+implement train/val columns mismatch automatic fixing
Configuration menu - View commit details
-
Copy full SHA for 99a626d - Browse repository at this point
Copy the full SHA 99a626dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7f2ab5e - Browse repository at this point
Copy the full SHA 7f2ab5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7fd47e3 - Browse repository at this point
Copy the full SHA 7fd47e3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4382b73 - Browse repository at this point
Copy the full SHA 4382b73View commit details -
Configuration menu - View commit details
-
Copy full SHA for e50bf74 - Browse repository at this point
Copy the full SHA e50bf74View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9242384 - Browse repository at this point
Copy the full SHA 9242384View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1251305 - Browse repository at this point
Copy the full SHA 1251305View commit details -
Configuration menu - View commit details
-
Copy full SHA for dbdba19 - Browse repository at this point
Copy the full SHA dbdba19View commit details
Commits on Aug 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 42a32d9 - Browse repository at this point
Copy the full SHA 42a32d9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8f87b64 - Browse repository at this point
Copy the full SHA 8f87b64View commit details -
Configuration menu - View commit details
-
Copy full SHA for f1a461a - Browse repository at this point
Copy the full SHA f1a461aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 123a692 - Browse repository at this point
Copy the full SHA 123a692View commit details -
Merge branch 'master' into ml-for-synthesis-prototype
Conflicts: - NITTA.Synthesis.Method (major, ctx argument addition basically) - NITTA.Synthesis.Types (minor, adding :: to changed defScore)
Configuration menu - View commit details
-
Copy full SHA for bf46ec2 - Browse repository at this point
Copy the full SHA bf46ec2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3becc1c - Browse repository at this point
Copy the full SHA 3becc1cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 95ca917 - Browse repository at this point
Copy the full SHA 95ca917View commit details -
Implement automatic column mapping based on dtype
This is done to get rid of hardcoded column names in preprocessing logic.
Configuration menu - View commit details
-
Copy full SHA for 4029ec1 - Browse repository at this point
Copy the full SHA 4029ec1View commit details -
Fix evaluation CLI was broken by postponed annotations eval
field.type now had string "int" instead of type int
Configuration menu - View commit details
-
Copy full SHA for e81cc15 - Browse repository at this point
Copy the full SHA e81cc15View commit details
Commits on Aug 23, 2023
-
Fix tree info fields, add error runs counter
/treeInfo fields were changed with the group bindings PR
Configuration menu - View commit details
-
Copy full SHA for d8c4819 - Browse repository at this point
Copy the full SHA d8c4819View commit details -
Configuration menu - View commit details
-
Copy full SHA for b689be2 - Browse repository at this point
Copy the full SHA b689be2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5927a08 - Browse repository at this point
Copy the full SHA 5927a08View commit details -
Fix bool preprocessing (preseve missing as 0)
This breaks backwards compatibility with previous models, but evaluation showed it improves ML-based synthesis performance significantly.
Configuration menu - View commit details
-
Copy full SHA for 293a7b9 - Browse repository at this point
Copy the full SHA 293a7b9View commit details -
Try to make baseline model less prone to overfitting
Training history showed that (proper) val metrics (evaluated on a different synthesis tree) behave better with this model version. A clear val_loss minimum is now seen (and I'm overtraining the model).
Configuration menu - View commit details
-
Copy full SHA for fbf96c5 - Browse repository at this point
Copy the full SHA fbf96c5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1a819b8 - Browse repository at this point
Copy the full SHA 1a819b8View commit details
Commits on Aug 24, 2023
-
Tweak default model hyperparams for better synthesis results
This is the result of a series of experiments conducted to improve ML synthesis performance measured by recently implemented "rating" of all-experiments synthesis evaluation results. Room for improvement was noticed thanks to the recent update to validation dataset selecting (now it consists of completely new synthesis trees not used for training). A close look at new training history charts showed signs of serious overfitting hurting *cross-tree* model generalization abilities. Training converged very fast for training loss/mae, but that made the new validation mae/loss only worse, so that's no good. Lowering the learning rate, adding L2 regularization and strong dropout to simulate model batching helped "slow down" training convergence a lot, allowing to observe the behaviour of the new val loss in a more detailed way. A clear minimum was spotted, overfitting confirmed, and the chosen training epoch count / steps per epoch / batch size were adjusted. The resulting model showed a synthesis evaluation rating of 76/100, which is much better than the previous model's (60/100). For reference, default score + SOTA synthesis method has a rating of 77/100, so that's a pretty strong result. The new hyperparameters produce models that conduct ML synthesis much better, so they should be chosen as the default.
Configuration menu - View commit details
-
Copy full SHA for e16377c - Browse repository at this point
Copy the full SHA e16377cView commit details
Commits on Aug 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ed56c91 - Browse repository at this point
Copy the full SHA ed56c91View commit details -
Configuration menu - View commit details
-
Copy full SHA for d219885 - Browse repository at this point
Copy the full SHA d219885View commit details -
Add a preconfigured vscode workspace
It's a multi-root workspace with: - "root" (haskell), "web" and "ml/synthesis" subfolders that help to deal with the project structure and configure tooling on a per-folder basis; - lists of recommended extensions, which were tested and preconfigured, and have the ultimate goal of providing a decent DX "out of the box"; - some shared launch configs used during ML synthesis development.
Configuration menu - View commit details
-
Copy full SHA for 0a1d4fd - Browse repository at this point
Copy the full SHA 0a1d4fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for ca07745 - Browse repository at this point
Copy the full SHA ca07745View commit details -
Fix unwanted logs weren't silenced during tests
Logger levels weren't initialized at import time, so recently introduced checks of them weren't working right. Using pytest hooks to defer them.
Configuration menu - View commit details
-
Copy full SHA for d8ea8c3 - Browse repository at this point
Copy the full SHA d8ea8c3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 906a3fe - Browse repository at this point
Copy the full SHA 906a3feView commit details -
Configuration menu - View commit details
-
Copy full SHA for fdfb994 - Browse repository at this point
Copy the full SHA fdfb994View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6deff5e - Browse repository at this point
Copy the full SHA 6deff5eView commit details
Commits on Aug 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 4bd5a17 - Browse repository at this point
Copy the full SHA 4bd5a17View commit details -
Configuration menu - View commit details
-
Copy full SHA for 74c4635 - Browse repository at this point
Copy the full SHA 74c4635View commit details -
Configuration menu - View commit details
-
Copy full SHA for 38e9426 - Browse repository at this point
Copy the full SHA 38e9426View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e9550e - Browse repository at this point
Copy the full SHA 4e9550eView commit details
Commits on Aug 29, 2023
-
Revamp dev docker container README
- update outdated info - clarify instructions, make them more detailed - make the readme easier to follow sequentially - describe more of possible problems with workarounds - fix typos, add some new ones to be found later :)
Configuration menu - View commit details
-
Copy full SHA for 6b841f9 - Browse repository at this point
Copy the full SHA 6b841f9View commit details -
Update and improve the dev container Dockerfile
- Update the Python tooling: - python installation is now managed by pyenv - dependencies are now managed by poetry - make pyenv, python, poetry, ruff, black, mypy and vulture available on PATH - Add markdownlint to the dev environment - Improve SSH security (forbid password auth by default) - Change SSH port to prevent conflicts and protect from bots if exposed - Remove tensorflow-gpu reinstall (obsolete for new versions) - Update the tensorflow version check to work with pyproject.toml - Extract stack/ghc/python versions and a resolver to more visible ARGs - Improve docker build layering to save some unnecessary rebuilds - Merge some of the fixes for aarch64, live tests pending - Fix some formatting and typos, clarify comments
Configuration menu - View commit details
-
Copy full SHA for 206c20e - Browse repository at this point
Copy the full SHA 206c20eView commit details -
Configuration menu - View commit details
-
Copy full SHA for c0f2215 - Browse repository at this point
Copy the full SHA c0f2215View commit details -
Disable mypy in all vscode subroots but ml/synthesis
So it doesn't produce meaningless errors
Configuration menu - View commit details
-
Copy full SHA for 12493a4 - Browse repository at this point
Copy the full SHA 12493a4View commit details -
Configuration menu - View commit details
-
Copy full SHA for a52fba6 - Browse repository at this point
Copy the full SHA a52fba6View commit details
Commits on Aug 31, 2023
-
Generalize siblings dict generation (breaking)
Breaking compatibility with old models to make alternative sibilings dict generation more self-adjustable to new decision tags.
Configuration menu - View commit details
-
Copy full SHA for ffa27ff - Browse repository at this point
Copy the full SHA ffa27ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0369b28 - Browse repository at this point
Copy the full SHA 0369b28View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2db4fa4 - Browse repository at this point
Copy the full SHA 2db4fa4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2af123a - Browse repository at this point
Copy the full SHA 2af123aView commit details -
Configuration menu - View commit details
-
Copy full SHA for cf28057 - Browse repository at this point
Copy the full SHA cf28057View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9cd3b22 - Browse repository at this point
Copy the full SHA 9cd3b22View commit details -
Make evaluation script write None for metrics if there's none
...instead of 0, which plays bad with time averaging and, to be frank, is quite unintuitive.
Configuration menu - View commit details
-
Copy full SHA for f997d96 - Browse repository at this point
Copy the full SHA f997d96View commit details -
Configuration menu - View commit details
-
Copy full SHA for e3a4868 - Browse repository at this point
Copy the full SHA e3a4868View commit details -
Add argument defaults and help descriptions
Defaults are added so configs can be kept shorter and more DRY. Also exposed config reading from JSON to reuse in CI script.
Configuration menu - View commit details
-
Copy full SHA for 19093a5 - Browse repository at this point
Copy the full SHA 19093a5View commit details -
Configuration menu - View commit details
-
Copy full SHA for ff53a3c - Browse repository at this point
Copy the full SHA ff53a3cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 102c3c0 - Browse repository at this point
Copy the full SHA 102c3c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 39d78d5 - Browse repository at this point
Copy the full SHA 39d78d5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c5729e - Browse repository at this point
Copy the full SHA 8c5729eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 49c405d - Browse repository at this point
Copy the full SHA 49c405dView commit details -
Configuration menu - View commit details
-
Copy full SHA for da02182 - Browse repository at this point
Copy the full SHA da02182View commit details -
Configuration menu - View commit details
-
Copy full SHA for cc4892f - Browse repository at this point
Copy the full SHA cc4892fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 949de64 - Browse repository at this point
Copy the full SHA 949de64View commit details -
Run "organize imports" for all tsx files so they're consistent
...with at least VS Code's default "organize import" action. Prettier doesn't enforce import order now (get a plugin?).
Configuration menu - View commit details
-
Copy full SHA for 99dea29 - Browse repository at this point
Copy the full SHA 99dea29View commit details
Commits on Sep 1, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 606d067 - Browse repository at this point
Copy the full SHA 606d067View commit details -
Configuration menu - View commit details
-
Copy full SHA for a96bc2e - Browse repository at this point
Copy the full SHA a96bc2eView commit details
Commits on Sep 11, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8f2d17b - Browse repository at this point
Copy the full SHA 8f2d17bView commit details
Commits on Sep 23, 2023
-
Merge pull request #257 from ryukzak/ml-for-synthesis-prototype-fix-b…
…uild Fix building errors.
Configuration menu - View commit details
-
Copy full SHA for bceb842 - Browse repository at this point
Copy the full SHA bceb842View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50ab618 - Browse repository at this point
Copy the full SHA 50ab618View commit details -
Adjust ci synthesis evaluation presets to speed it up
Do not evaluate known-to-be-poor configurations so the synthesis evaluation fits under GitHub Actions job runtime limit (6 hours).
Configuration menu - View commit details
-
Copy full SHA for e6d4dd6 - Browse repository at this point
Copy the full SHA e6d4dd6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 16c1a31 - Browse repository at this point
Copy the full SHA 16c1a31View commit details -
Configuration menu - View commit details
-
Copy full SHA for 258473a - Browse repository at this point
Copy the full SHA 258473aView commit details
Commits on Dec 28, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 513ecd0 - Browse repository at this point
Copy the full SHA 513ecd0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7fec9b2 - Browse repository at this point
Copy the full SHA 7fec9b2View commit details
Commits on Dec 29, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6117beb - Browse repository at this point
Copy the full SHA 6117bebView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3f66495 - Browse repository at this point
Copy the full SHA 3f66495View commit details -
Configuration menu - View commit details
-
Copy full SHA for 44f471f - Browse repository at this point
Copy the full SHA 44f471fView commit details
Commits on Dec 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 71a01cb - Browse repository at this point
Copy the full SHA 71a01cbView commit details -
Configuration menu - View commit details
-
Copy full SHA for de72eb9 - Browse repository at this point
Copy the full SHA de72eb9View commit details
Commits on Jan 5, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f0b91ab - Browse repository at this point
Copy the full SHA f0b91abView commit details -
Configuration menu - View commit details
-
Copy full SHA for fdd7ae6 - Browse repository at this point
Copy the full SHA fdd7ae6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 69aef37 - Browse repository at this point
Copy the full SHA 69aef37View commit details -
Configuration menu - View commit details
-
Copy full SHA for 174ad21 - Browse repository at this point
Copy the full SHA 174ad21View commit details
Commits on Jan 6, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0636193 - Browse repository at this point
Copy the full SHA 0636193View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3945599 - Browse repository at this point
Copy the full SHA 3945599View commit details -
Co-authored-by: Ilya Burakov <speedwatson@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for f85e126 - Browse repository at this point
Copy the full SHA f85e126View commit details -
Co-authored-by: Ilya Burakov <speedwatson@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 3601755 - Browse repository at this point
Copy the full SHA 3601755View commit details -
Update TENSORFLOW_VER in dev image
Co-authored-by: Ilya Burakov <speedwatson@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for aeb2c04 - Browse repository at this point
Copy the full SHA aeb2c04View commit details -
Update ml/synthesis/src/components/data_crawling/nitta/nitta_running.py
Co-authored-by: Ilya Burakov <speedwatson@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for f0941f3 - Browse repository at this point
Copy the full SHA f0941f3View commit details
Commits on Jan 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c2d1de1 - Browse repository at this point
Copy the full SHA c2d1de1View commit details -
Configuration menu - View commit details
-
Copy full SHA for f268fb1 - Browse repository at this point
Copy the full SHA f268fb1View commit details -
Configuration menu - View commit details
-
Copy full SHA for a93a304 - Browse repository at this point
Copy the full SHA a93a304View commit details -
Configuration menu - View commit details
-
Copy full SHA for 83c68ab - Browse repository at this point
Copy the full SHA 83c68abView commit details -
Configuration menu - View commit details
-
Copy full SHA for ecd35f9 - Browse repository at this point
Copy the full SHA ecd35f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2135a6 - Browse repository at this point
Copy the full SHA b2135a6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8e976f5 - Browse repository at this point
Copy the full SHA 8e976f5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d73b06 - Browse repository at this point
Copy the full SHA 6d73b06View commit details -
Merge pull request #261 from ryukzak/ml-for-synthesis-prototype-wip-t…
…f-fix Fix Tensorflow deps for Windows
Configuration menu - View commit details
-
Copy full SHA for 5cd88ac - Browse repository at this point
Copy the full SHA 5cd88acView commit details -
Fix Makefile: shell interaction for docker-build
Co-authored-by: Ilya Burakov <speedwatson@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 47c7497 - Browse repository at this point
Copy the full SHA 47c7497View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8a421b5 - Browse repository at this point
Copy the full SHA 8a421b5View commit details -
Configuration menu - View commit details
-
Copy full SHA for ffa9302 - Browse repository at this point
Copy the full SHA ffa9302View commit details
Commits on Jan 8, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 64edcc4 - Browse repository at this point
Copy the full SHA 64edcc4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8306454 - Browse repository at this point
Copy the full SHA 8306454View commit details -
Merge pull request #260 from ryukzak/ml-for-synthesis-prototype-wip
Ml for synthesis prototype - Refactoring
Configuration menu - View commit details
-
Copy full SHA for 5966a6b - Browse repository at this point
Copy the full SHA 5966a6bView commit details