Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HiFi voice cloning docs #34

Closed
wants to merge 6 commits into from
Closed

HiFi voice cloning docs #34

wants to merge 6 commits into from

Conversation

boli-bohan
Copy link
Contributor

No description provided.

@boli-bohan boli-bohan changed the title HiFi voice cloning HiFi voice cloning docs Nov 4, 2024
Copy link

github-actions bot commented Nov 4, 2024

fern/assets/images/hifi-clone.png Outdated Show resolved Hide resolved
fern/build-with-sonic/capabilities/clone-voices.mdx Outdated Show resolved Hide resolved
boli-bohan and others added 2 commits November 4, 2024 21:12
Co-authored-by: Kabir Goel <kabirgoel.kg@gmail.com>
Copy link

github-actions bot commented Nov 5, 2024

Copy link

github-actions bot commented Nov 5, 2024

Copy link

github-actions bot commented Nov 5, 2024

Copy link

github-actions bot commented Nov 6, 2024

@bclyang
Copy link

bclyang commented Nov 6, 2024

My recommendation is to actually structure this as follows:

  • Instant cloning - there's two sections: High Stability and High Similarity
  • For High Stability - Results in a highly stable and clear voice, even if the input is noisy. Can use up to 30 seconds of audio. No transcripts required.
  • For High Similarity - Results in a voice that closely resembles the input in style, noise, and pacing. Can only use up to 10 seconds of audio, ideally just a single sentence. Transcripts optional - if possible to provide exactly correct transcripts, would be helpful. Artifacts in the audio (e.g. cutting off early, etc.) can result in artifacts in the resulting generation.

@boli-bohan boli-bohan closed this Nov 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants