Skip to content

Comparison with torch.compile instead of Eager #15

Comparison with torch.compile instead of Eager

Comparison with torch.compile instead of Eager #15

Triggered via issue March 21, 2024 16:11
Status Success
Total duration 27s
Artifacts

auto-cc.yml

on: issues
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 1 warning
auto-cc
Not Found { name: 'HttpError', id: '8378207327', status: 404, response: { url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/1464', status: 404, headers: { 'access-control-allow-origin': '*', 'access-control-expose-headers': 'ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset', connection: 'close', 'content-encoding': 'gzip', 'content-security-policy': "default-src 'none'", 'content-type': 'application/json; charset=utf-8', date: 'Thu, 21 Mar 2024 16:12:03 GMT', 'referrer-policy': 'origin-when-cross-origin, strict-origin-when-cross-origin', server: 'GitHub.com', 'strict-transport-security': 'max-age=31536000; includeSubdomains; preload', 'transfer-encoding': 'chunked', vary: 'Accept-Encoding, Accept, X-Requested-With', 'x-accepted-github-permissions': 'issues=read', 'x-content-type-options': 'nosniff', 'x-frame-options': 'deny', 'x-github-api-version-selected': '2022-11-28', 'x-github-media-type': 'github.v3; format=json', 'x-github-request-id': '04A2:3AC7:5E96:6037:65FC5C53', 'x-ratelimit-limit': '15000', 'x-ratelimit-remaining': '14988', 'x-ratelimit-reset': '1711038895', 'x-ratelimit-resource': 'core', 'x-ratelimit-used': '12', 'x-xss-protection': '0' }, data: { message: 'Not Found', documentation_url: 'https://docs.github.com/rest/issues/issues#get-an-issue' } }, request: { method: 'GET', url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/1464', headers: { accept: 'application/vnd.github.v3+json', 'user-agent': 'probot/12.2.5 octokit-core.js/3.6.0 Node.js/16.20.2 (linux; x64)', authorization: 'token [REDACTED]' }, request: {} }, event: { id: '8378207327', name: 'issues', payload: { action: 'labeled', issue: { active_lock_reason: null, assignee: null, assignees: [], author_association: 'NONE', body: '## 📚 Documentation\r\n' + '\r\n' + 'Hey! I saw your tool and plots with "acceleration", but you compare to un-optimised eager torch, which is obviously slower. Could you provide a graph with comparison against basic native pytorch loop, where you `torch.compile` the model? It would be useful for people who already have some optimisations in their pipelines, but would like to try yours framework instead\r\n' + '\r\n' + 'Thanks', closed_at: null, comments: 0, comments_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/comments', created_at: '2024-03-21T16:11:40Z', events_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/events', html_url: 'https://github.com/Lightning-AI/lightning-thunder/issues/33', id: 2200599952, labels: [ { color: '0075ca', default: true, description: 'Improvements or additions to documentation', id: 6707871893, name: 'documentation', node_id: 'LA_kwDOLiCyD88AAAABj9IAlQ', url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/labels/documentation' } ], labels_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/labels{/name}', locked: false, milestone: null, node_id: 'I_kwDOLiCyD86DKn2Q', number: 33, performed_via_github_app: null, reactions: { '+1': 0, '-1': 0, confused: 0, eyes: 0, heart: 0, hooray: 0, laugh: 0, rocket: 0, total_count: 0, url: 'https://api.github.com/repos/Lightning-AI/li
auto-cc
HttpError: Not Found at /home/runner/work/_actions/Lightning-AI/probot/v5/node_modules/@octokit/core/node_modules/@octokit/request/dist-node/index.js:86:21 at processTicksAndRejections (node:internal/process/task_queues:96:5) at async Job.doExecute (/home/runner/work/_actions/Lightning-AI/probot/v5/node_modules/bottleneck/light.js:405:18) { name: 'AggregateError', event: { id: '8378207327', name: 'issues', payload: { action: 'labeled', issue: { active_lock_reason: null, assignee: null, assignees: [], author_association: 'NONE', body: '## 📚 Documentation\r\n' + '\r\n' + 'Hey! I saw your tool and plots with "acceleration", but you compare to un-optimised eager torch, which is obviously slower. Could you provide a graph with comparison against basic native pytorch loop, where you `torch.compile` the model? It would be useful for people who already have some optimisations in their pipelines, but would like to try yours framework instead\r\n' + '\r\n' + 'Thanks', closed_at: null, comments: 0, comments_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/comments', created_at: '2024-03-21T16:11:40Z', events_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/events', html_url: 'https://github.com/Lightning-AI/lightning-thunder/issues/33', id: 2200599952, labels: [ { color: '0075ca', default: true, description: 'Improvements or additions to documentation', id: 6707871893, name: 'documentation', node_id: 'LA_kwDOLiCyD88AAAABj9IAlQ', url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/labels/documentation' } ], labels_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/labels{/name}', locked: false, milestone: null, node_id: 'I_kwDOLiCyD86DKn2Q', number: 33, performed_via_github_app: null, reactions: { '+1': 0, '-1': 0, confused: 0, eyes: 0, heart: 0, hooray: 0, laugh: 0, rocket: 0, total_count: 0, url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/reactions' }, repository_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder', state: 'open', state_reason: null, timeline_url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33/timeline', title: 'Comparison with `torch.compile` instead of Eager', updated_at: '2024-03-21T16:11:40Z', url: 'https://api.github.com/repos/Lightning-AI/lightning-thunder/issues/33', user: { avatar_url: 'https://avatars.githubusercontent.com/u/14337581?v=4', events_url: 'https://api.github.com/users/bonlime/events{/privacy}', followers_url: 'https://api.github.com/users/bonlime/followers', following_url: 'https://api.github.com/users/bonlime/following{/other_user}', gists_url: 'https://api.github.com/users/bonlime/gists{/gist_id}', gravatar_id: '', html_url: 'https://github.com/bonlime', id: 14337581, login: 'bonlime', node_id: 'MDQ6VXNlcjE0MzM3NTgx', organizations_url: 'https://api.github.com/users/bonlime/orgs', received_events_url: 'https://api.github.com/users/bonlime/received_events', repos_url: 'https://api.github.com/users/bonlime/repos', site_admin: false, starred_url: 'https://api.github.com/users/bonlime/starred{/owner}{/repo}', subscriptions_url: 'https://api.github.com/users/bonlime/subscriptions', type: 'User', url: 'https://api.github.com/users/bonlime' } }, label: { color: '0075ca', default: true, descripti
auto-cc
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Lightning-AI/probot@v5. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.