[Intro] Add reproducibility section #82
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
No broken urls! 🎉 |
|
No spelling errors! 🎉 |
cansavvy
reviewed
Jul 12, 2023
|
|
||
| In order to maximize the reproducibility of your work, you should create good habits when working with any AI tool. This includes documenting your prompts and the intentions behind them, as well as saving the response threads generated by an AI chatbot. Some of the current chatbots already save your threads (particularly ChatGPT and Phind). At this time, Bard and the chatbots accessible via Poe do not save queries as individual threads but do keep a record of the questions and responses for some time. However, it is best practice to save them yourself as the saved chat threads can be reset. Saving them yourself also allows you to write notes about your intentions. | ||
|
|
||
| Keep in mind that the answers from the chatbots can change over time - don't expect them to always be the same! Phrasing a query slightly differently can result in a different answer, as can asking in a new session. You should expect to ask the AI tool the same question in multiple ways in order to be confident in the answer. |
There was a problem hiding this comment.
Question. Is there an equivalent of "setting the seed" with AI chatbots? For example, if I click "Regenerate response" in chatGPT I will never get the same results. So in many ways it is not reproducible. Is there a way to actually make it reproducible?
There was a problem hiding this comment.
good question! apparently @ehumph has heard there is a way but hasn't tried it yet so we will add it to another course
|
Re-rendered previews from the latest commit:
Updated at 2023-07-12 with changes from 346346b |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adding a section on reproducibility and best practices when using AI chatbots. Resolves #79