Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add grouper and aggregator op for system_prompt #500

Merged
merged 90 commits into from
Dec 19, 2024
Merged

add grouper and aggregator op for system_prompt #500

merged 90 commits into from
Dec 19, 2024

Conversation

BeachWang
Copy link
Collaborator

No description provided.

drcege and others added 30 commits October 24, 2024 10:26
@drcege
add api call
63d430a
@drcege
add call_api ops
6720da4
@drcege
clean
8daa6e1
@drcege
minor update
ef11951
@drcege
more tests
5597d5c
@drcege
update tests
4b6e769
@drcege
Merge branch 'main' into dev/api_model
835be22
@drcege
update prompts
325a753
@drcege
fix unittest
4f04bdd
@drcege
update tests
0adbdcd
@drcege
add docs
0aa4069
@drcege
minor fix
f007532
@drcege
Merge branch 'main' into dev/api_model
9aa7390
@drcege
add API processor
ee4f461
@drcege
Merge branch 'main' into dev/api_model
9bbfe47
@drcege
refine API processor
b00b182
@drcege
refine
b718de7
@BeachWang
chunk and extract events
6d1d433
@drcege
fix bugs
4d1670f
@drcege
fix tests
9e11aa3
@BeachWang
extract attribute
cc40fc0
@BeachWang
Merge branch 'dev/api_model' of github.com:alibaba/data-juicer into d…
4c262ad 
…ev/llm_info_extract
@drcege
refine tests
347bc0f
@BeachWang
extract nickname
c9d5051
@BeachWang
Merge branch 'dev/api_model' of github.com:alibaba/data-juicer into d…
8a128ca 
…ev/llm_info_extract
@BeachWang
nickname test done
9262777
@BeachWang
merge main
58fc020
@BeachWang
lightRAG to OP
c7dc28e
@BeachWang
merge main
238869e
@BeachWang
doc done
0e51a43
@BeachWang BeachWang marked this pull request as ready for review December 5, 2024 12:24
@BeachWang BeachWang added the agent related to agent label Dec 9, 2024
@yxdyc yxdyc linked an issue Dec 19, 2024 that may be closed by this pull request
sharegpt format support #488
Closed
3 tasks
@yxdyc yxdyc removed a link to an issue Dec 19, 2024
sharegpt format support #488
Closed
3 tasks
yxdyc
yxdyc approved these changes Dec 19, 2024
View reviewed changes
Copy link
Collaborator

@yxdyc yxdyc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. In the future, we can extend the DEFAULT_SYSTEM/XXX_PROMPT to include both Chinese and English versions for broader accessibility and applicability.

data_juicer/utils/common_utils.py Show resolved Hide resolved
@yxdyc yxdyc added dj:op issues/PRs about some specific OPs dj:cookbook useful recipes and demos labels Dec 19, 2024
@BeachWang BeachWang merged commit b4811a0 into main Dec 19, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yxdyc yxdyc yxdyc approved these changes

@HYLcool HYLcool Awaiting requested review from HYLcool

@zhijianma zhijianma Awaiting requested review from zhijianma

@garyzhang99 garyzhang99 Awaiting requested review from garyzhang99

Assignees

@BeachWang BeachWang

Labels
agent related to agent dj:cookbook useful recipes and demos dj:op issues/PRs about some specific OPs
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@BeachWang @yxdyc @drcege