Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

99 implement deploy chunk upload fct #112

Merged
merged 47 commits into from
Sep 25, 2024

Conversation

thomas-senechal
Copy link
Member

No description provided.

@thomas-senechal thomas-senechal linked an issue Sep 14, 2024 that may be closed by this pull request
2 tasks
@thomas-senechal thomas-senechal force-pushed the 99-implement-deploy-chunk-upload-fct branch 3 times, most recently from 74bf010 to 3ce4da3 Compare September 20, 2024 08:50
thomas-senechal and others added 26 commits September 20, 2024 10:53
cli/tests/chunkPost.spec.ts Show resolved Hide resolved
cli/src/index.ts Show resolved Hide resolved
cli/src/tasks/prepareChunk.ts Show resolved Hide resolved
@thomas-senechal thomas-senechal force-pushed the 99-implement-deploy-chunk-upload-fct branch from 7708c2e to 5855a38 Compare September 24, 2024 13:01

getBatches(): UploadBatch[] {
return this.batches
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just for information, you could do that

  get batches(): UploadBatch[] {
    return this._batches;
  }

BigInt(ownerKey.length),
BigInt(provider.address.length)
)
const fileListCost = storageCostForEntry(1n, BigInt(U32.SIZE_BYTE))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just to keep in mind that we will need to update this when pr of sc will be merge

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator

@pivilartisant pivilartisant left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GG

@thomas-senechal thomas-senechal merged commit f783c79 into main Sep 25, 2024
11 checks passed
pivilartisant pushed a commit that referenced this pull request Sep 26, 2024
* Add chunk functions and tests for devideIntoChunks function

* Add jest

* Add storage cost variables

* Update massa-web3

* Fix entry cost in lib/utils/storage

* Add ChunkPost class and toChunkPosts function to convert list of chunk to list of ChunkPost

* Add batcher function to divide list of chunks into batches smaller than chunk size

* Replace deploy and edit commands with a single upload command, and add an empty delete command

* Add tests for ChunkPost and toChunkPosts functions

* Add built sc files in .gitignore

* Fix lint errors and error with subdirectories handling in prepareChunks

* Fix a bug with base path in prepareChunks and add await for speculative exec in uploadChunks

* Add ls command

* Update eslint to v9

* Fix missnamed option in delete command

* Add a function to calculate deployment cost

* Add a basic uploadManager

* Use listr2 to show upload progress

* Remove useless logger from tasks ctx

* Show batch and chunk information in prepareBatchesTask

* Fix typo in deploySC task prompt

* Add check for available funds before deploying the website

* Add yaml keystore handling

* Add functional test for CLI deployment with wallet handling

* Fix upload command in cli functional test CI

* Commented functional test cli for later

* Remove useless totalChunks from ChunkPost

* Fix lint errors

* Add wallet files to gitignore

* Fix build:sc script

* Fix getChunkKey

* Fix entry storage cost calculation

* Update CLI to match new SC

* Add getTotalChunkKey function

* Add getFileFromAddress function

* Remove unnecessary file listing from upload command

* Add showFileCommand to CLI

* Improve chunks and prestore handling

* Update runs-on value in tests.yml to use ubuntu-22.04 for test-server and functional-test-cli jobs

* Add sc build in cli functionnal test

* Add .gitkeep in cli/src/lib/website/sc

* Fix go cache path

* Update massa web3 to fix crypto lib

* Fix chunkPost tests

* Add missing doc in tasks/prepareChunk.ts

* Add test-cli workflow for CLI unit tests

* Use massa-web3 PublicApiUrl instead of raw url for buildnet url

---------

Co-authored-by: BenRey <br@massa.net>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement deploy & chunk upload fct
3 participants