Skip to content

Add (or update) robots.txt and ai.txt to block AI crawlers #8631

Add (or update) robots.txt and ai.txt to block AI crawlers

Add (or update) robots.txt and ai.txt to block AI crawlers #8631

Triggered via pull request April 9, 2024 04:00
Status Success
Total duration 14m 36s
Artifacts 9

ci_cd.yml

on: pull_request
Get changes
13s
Get changes
Get image tag
0s
Get image tag
Validate CODEOWNERS
15s
Validate CODEOWNERS
Determine images to build and publish
12s
Determine images to build and publish
Add stack label
5s
Add stack label
Matrix: Run Playwright tests
Matrix: Run Nuxt checks
Matrix: Run checks for packages/*
Build full-stack docs
3m 39s
Build full-stack docs
Check Nuxt build
2m 18s
Check Nuxt build
Matrix: Build Docker images
Post Playwright test debugging instructions
9s
Post Playwright test debugging instructions
Matrix: Run Playwright tests
Matrix: Run Nuxt checks
Matrix: Run checks for packages/*
Run tests for the catalog
0s
Run tests for the catalog
Run tests for ingestion-server
0s
Run tests for ingestion-server
Run tests for the API
6m 16s
Run tests for the API
Matrix: Run Django checks
Run catalog checks
0s
Run catalog checks
Matrix: Publish Docker images
Emit full-stack docs
1m 46s
Emit full-stack docs
Matrix: Run Django checks
Deploy staging API
0s
Deploy staging API
Deploy staging frontend
0s
Deploy staging frontend
Send Slack report
0s
Send Slack report
Fit to window
Zoom out
Zoom in

Annotations

1 warning
Emit full-stack docs
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: peaceiris/actions-gh-pages@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Artifacts

Produced during runtime
Name Size
api Expired
140 MB
api_logs Expired
86.2 KB
api_nginx Expired
18 MB
documentation Expired
29.2 MB
frontend Expired
129 MB
frontend_nginx Expired
17.1 MB
ingestion_server Expired
110 MB
openapi.json Expired
18.1 KB
upstream_db Expired
307 MB