Spring2024_Apache Kafka to create a data streaming platform #944
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* md file and read me * update * update * update * update * skeleton code * skeleton code * skeleton code * update * update * Delete README.md * Delete Buildmeister_process.md * Revert "Delete README.md" This reverts commit 0b155f6. * Revert "md file and read me" This reverts commit 39afc5d. * Revert "update" This reverts commit 559e4c8. * Update * update * update * update * update * update * misc_plot update * test_plot update * plt.figure * notebook update * update * update * update * linter * notebook update * Revert "notebook update" This reverts commit 2b99575. * note book update * linter * update * Delete docker-compose.yml delete unnecessary file * linter --------- Co-authored-by: DanilYachmenev <31514660+DanilYachmenev@users.noreply.github.com>
* commenting out line 48 if Telegram.md for input * Adding link reference in README and removing outdated line
* Rename gsheet names * Rename
* Checkpoint * some markups for `require_aws` * fix the np.float -> np.float64 issue here. * add more pytest markers "require_aws". * Add requires_ck_infra marker to those labelled with requires_aws * add requires_ck_infra to the timeout > 5s tests. Batch 1. * add more requires_aws + requires_ck_infra. * mark timeout tests > 5.0s as requires_ck_infra . Batch 1. * add more mark.requires_aws and mark.requires_ck_infra * mark requires_ck_infra for a RuntimeError [not time_out] * more requires_aws + requires_ck_infra * requires_ck_infra + requires_aws * requires_ck_infra (Runtime Error, gh auth failed eg) * Mark requires_ck_infra (Timeouts > 0.5s). All failures marked. * add the switch in lib_tasks_pytest.py; fix errors like two marks in one line. * mark out failure tests and fix inconsistency in expected outputs. * add mark; fix errors in fast tests. * simplify requires_ck_infra. cosmetics. --------- Co-authored-by: saggese <saggese@gmail.com>
* Checkpoint * Checkpoint * Update * remove TODOs * Add testing part * Update * Add docstrings * Update * Updated * Updated --use_sudo * Change to linux find * Remove fixed todo * Checkpoint --------- Co-authored-by: saggese <saggese@gmail.com> Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com>
* update * update * update * Update Codebase_clean_up_scripts.md * Update Codebase_clean_up_scripts.md * Update Codebase_clean_up_scripts.md * Update Codebase_clean_up_scripts.md --------- Co-authored-by: DanilYachmenev <31514660+DanilYachmenev@users.noreply.github.com>
* Gallery notebook test_rets_signal_analysis Added test to gallerynotebook * Update test_plots.py * Deprecate class approach SetupClass and teardown deprecate
* PB result to local * Update comments * code style * Delete sn_search5_profile_result.csv * Delete sn_search5_search_result.csv --------- Co-authored-by: GP Saggese <33238329+gpsaggese@users.noreply.github.com>
* merge master; add "check `gh auth status`" for run_fast_tests doc string. * use requires_ck_infra switch to find root of errors. * add command line switch run_only_ck_infra_tests; resolve conflict with skip_ck_infra_tests. * add command line switch require_ck for invoke. reduce code repetition. * implement ck infra related switch as bool; lint files.
* Checkpoint * Attempt to use mock in one fcn. * add mock tests to helpers/test/test_lib_tasks_pytest.py * remove temp tasks; factor helpers; skip problematic tests; lint --------- Co-authored-by: saggese <saggese@gmail.com>
* Cleaned up according to comments * removing white space
* Gallery notebook test_rets_signal_analysis Added test to gallerynotebook * Update test_plots.py * Deprecate class approach SetupClass and teardown deprecate * Expose config gallery notebook Simple config * Config from env Added additional option for config to be from env * Update config in test file * Fix incorrect return Accidentally returned a config instead of config_list while debugging and committed wrong thing. * fix * LINTER!!!! linted * Adding Debugging Notebooks LINTED! * Minor updates * Rename --------- Co-authored-by: dan <d.yachmenev@crypto-kaizen.com>
* Processed Glossary.md * Modified README.md to include Glossary.md * Second Glossary.md Modifications * Moved Glossary.md reference in README.md * Update Glossary.md 1. Put everything in a bullet list 2. No dots at the end of bullet points 3. Other small changes --------- Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com>
* Minor Clean-ups to /docs folder and to README * Resolved changes
* Create Google drive folder function. * Refine entire LinkedIn flow * Google API update
* Add files via upload * Add files via upload * Update Profiling.md * Update Profiling.md * Add files via upload * Update Profiling.md * Update Profiling.md * Update Profiling.md * Update Profiling.md * Update Profiling.md * Update README.md * update --------- Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com> Co-authored-by: samarth9008 <samarthpatel9008@gmail.com>
* smoke prototype * linter * update and linter * update * update * update * notebook * update
* test_model_plotter update * update * update * linter * update * linter * update * update * update * update * update * Delete linter_output.txt unnecessary * Delete linter_warnings.txt unnecessary * Delete docker-compose.yml unnecessary * Delete tmp.amp_normalize_import.txt unnecessary * update and linter * update * update notebook
* Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint * Checkpoint
* checkpoint * checkpoint * checkpoint
* Test get_range_filter * Changed the docString in test function * Fixed a few nicks --------- Co-authored-by: Dan <31514660+DanilYachmenev@users.noreply.github.com>
Co-authored-by: vlady <v.yakovenko@crypto-kaizen.com>
* Initial commit * checkpoint --------- Co-authored-by: Sonaal <sonaalkant95@gmail.com>
* md file * Update Hiring_process.md * Updated Hiring_process.md * file path change * relative path added
* checkpoint * checkpoint * checkpoint * checkpoint * checkpoint * checkpoint * checkpoint * checkpoint * checkpoint * checkpoint * checkpoint
* checkpoint * checkpoint * checkpoint * checkpoint
* checkpoint * checkpoint * checkpoint * checkpoint
* Unit_test_dassert_is_integer * update * update
* KaizenTask1077_Unit_test_dassert_timestamp_lt() * KaizenTask1077_Unit_test_dassert_timestamp_lt() * update * update * linter update * Update test_hdatetime.py --------- Co-authored-by: jayati1397 <patel.jayati@northeastern.edu> Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com>
* Unit test dassert_valid_remap * Linter changes reverted * Added new test cases * Fixed some nits --------- Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com>
* Unit test dassert_lt() * update * update * linter update * update --------- Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com>
* unti test for dassert_is_valid_timestamp * update * update * update * update * update * linter update * linter update * linter update * Update test_hdatetime.py * Update test_hdatetime.py --------- Co-authored-by: jayati1397 <patel.jayati@northeastern.edu> Co-authored-by: Samarth KaPatel <samarth.kapatel5@gmail.com>
* Update core * Update dev_scripts * Update sorrentum_sandbox
* Update * Update * Update
* Update * Update im_v2 * Fix broken test
* update * update
* update * update * update * update * adding files * update * update * update * update * update * update * update * update * update * update * update * update * update * update * update * update * update * Delete oms/broker/ccxt/test/outcomes/TestCcxtBroker_UsingFakeExchangeWithDynamicScheduler.test_submit_twap_orders_multiple_submission/output/actual_orders1.txt.tmp --------- Co-authored-by: jayati1397 <patel.jayati@northeastern.edu>
* Updated test_hpandas with unit testing code for dassert is days * Updated test_hpandas with unit testing code for dassert is days * Addressed review feedback and fixed code alignment issues * removed empty lines and added ended comments with full stops. * Comment reformating and resolving merge conflicts. * Restored requirements.txt to match the master branch * Restored the class Test_dassert_valid_remap. * Fixed requested minor nits in comments.
* Added test cases for apply_nan_mode. * Added test cases for apply_nan_mode and fixed the lints. * Defined correct type for var actual_info. * catching the error in test7. * Freeze outputs for the tests 8 and 10 and added comments. * Added comments. * Added required comments. Added check for the returned series in test8 and removed test9 and test10. * Added tests for invalid mode and when mode is strict without nans in the series. * Added check for the returned series while updating golden outcome for test8. * Removed test8 to resolve checks on GitHub. * Added test8 to resolve checks on GitHub. * outcome updated. * outcome updated. * Fixing the suggested nits. * Delete helpers/test/outcomes/Test_apply_nan_mode.test8/output/test.txt Removed helpers/test/outcomes/Test_apply_nan_mode.test8/output/test.txt * Updated all LOCs including comments to within 80 char per line.
* Add MkDocs related files/assets * Sync formatting changes from main repo * Add mkdocs config file
* Add CNAME file * Add init file * Add workflow dispatch to action
* Fix python version in serve MkDocs * Modify action file * Update pluin structure * Change plugin structure
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
SorrTask826_Apache_Kafka_to_create_a_data_streaming_platform