Skip to content

Conversation

@mattpocock
Copy link
Owner

No description provided.

@changeset-bot
Copy link

changeset-bot bot commented Oct 19, 2025

🦋 Changeset detected

Latest commit: 0a79b3a

The changes in this PR will be included in the next version bump.

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link

vercel bot commented Oct 19, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment
Project Deployment Preview Comments Updated (UTC)
evalite Ignored Ignored Nov 11, 2025 9:16am

@pkg-pr-new
Copy link

pkg-pr-new bot commented Oct 19, 2025

Open in StackBlitz

npm i https://pkg.pr.new/mattpocock/evalite@240

commit: 0a79b3a

@mattpocock
Copy link
Owner Author

@claude Remove the BACKEND_ONLY_CONSTANT import that's causing the error in CI

@claude
Copy link

claude bot commented Oct 19, 2025

Claude finished @mattpocock's task —— View job


Task completed

  • Check CI status to understand the error
  • Read modified files to locate the problematic import
  • Remove the BACKEND_ONLY_CONSTANT imports
  • Commit and push the fix

Fixed the CI error:

The error was caused by imports from evalite/backend-only-constants that referenced exports that no longer exist:

  1. test-utils.ts: Removed unused DB_LOCATION import
  2. files.test.ts: Replaced FILES_LOCATION import with a local constant "./node_modules/.evalite/files"

The changes have been committed and pushed to the v1 branch. CI should now pass!


Job Run | Branch: v1

mattpocock and others added 11 commits November 10, 2025 17:39
- Remove unused DB_LOCATION import from test-utils.ts
- Replace FILES_LOCATION import with local constant in files.test.ts

Co-authored-by: Matt Pocock <mattpocock@users.noreply.github.com>
- Add dotenv as a dependency
- Create env-setup-file module that imports dotenv/config
- Export env-setup-file as 'evalite/env-setup-file'
- Automatically prepend env-setup-file to setupFiles array
- Update documentation to reflect automatic .env loading
- Update example config to remove manual dotenv setup

Fixes #234

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-authored-by: Matt Pocock <mattpocock@users.noreply.github.com>
… precedence

- Add loadVitestSetupFiles() to load setupFiles from vitest.config.ts
- Merge setupFiles from both configs with evalite.config.ts taking precedence
- Add tests for vitest.config.ts setupFiles support and precedence
- setupFiles execution order: env-setup-file -> vitest -> evalite

Co-authored-by: Matt Pocock <mattpocock@users.noreply.github.com>
mattpocock and others added 25 commits November 10, 2025 17:39
… and description are now automatically extracted from the scorer's return value.
…ers must now explicitly pass Vite config via evalite.
Vitest workspace configs cause evalite to pick up wrong files.

Test demonstrates:
- Unit tests run when they shouldn't
- Eval files ignored
- Workspace include patterns override evalite patterns

Refs #95

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
* Wrote the scorers docs

* Removed all references to autoevals

* Fixed CI

* Updates

* Docs updates and storage

* Re-added redirects
mattpocock and others added 4 commits November 11, 2025 07:32
* Updated CI to run on PR's

* Made the push only run on v1 and main

* Fixed file
* refactor: evalite.each to support a skip modifier and add corresponding tests

Solves: #318

* Create late-dryers-repair.md

---------

Co-authored-by: Matt Pocock <mattpocockvoice@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants