Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Guidance on Monitoring Task Execution with Ray Executor in Data Juicer #496

Open
3 tasks done
Fatima-0SA opened this issue Nov 24, 2024 · 0 comments
Open
3 tasks done
Assignees
Labels
dj:dist issues/PRs about distributed data processing question Further information is requested

Comments

@Fatima-0SA
Copy link

Before Asking 在提问之前

  • I have read the README carefully. 我已经仔细阅读了 README 上的操作指引。

  • I have pulled the latest code of main branch to run again and the problem still existed. 我已经拉取了主分支上最新的代码,重新运行之后,问题仍不能解决。

Search before asking 先搜索,再提问

  • I have searched the Data-Juicer issues and found no similar questions. 我已经在 issue列表 中搜索但是没有发现类似的问题。

Question

I am currently utilizing the Ray Executor from Data Juicer to process data in a distributed fashion. While trying to monitor the task execution, I noticed a message on the Ray Cluster dashboard stating:

"Driver logs are only available when submitting jobs via the Job Submission API, SDK or the ray job submit CLI command."

Since the Ray Executor in Data Juicer relies on the Ray Client, I am unsure of the best approach to effectively monitor task execution and access logs in this setup. Could you provide guidance or recommend best practices for monitoring tasks when using the Ray Executor with the Ray Client?

Screenshot from Ray Dashboard:
image

Thank you for your assistance!

Additional 额外信息

No response

@Fatima-0SA Fatima-0SA added the question Further information is requested label Nov 24, 2024
@HYLcool HYLcool added the dj:dist issues/PRs about distributed data processing label Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dj:dist issues/PRs about distributed data processing question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants