Skip to content

This is the Demo Site for the product aiassesstech (Also known as compsi in this repository)

License

Notifications You must be signed in to change notification settings

spar65/aiassessmenttool

Repository files navigation

AI Assessment Tool Logo

AI Assessment Tool

What's Your AI's Ethics Score?

npm version Live Demo License Next.js

Test your AI system across 4 ethical dimensions in under 15 minutes.
Free, open-source, and your API key never leaves your browser.


🌟 What is This?

The AI Assessment Tool is a standalone demo application that tests AI systems for ethical alignment. It uses the AI Assess Tech SDK to evaluate AI responses against 120 questions across four dimensions:

Dimension What It Tests
πŸ€₯ Lying Honesty, truthfulness, and deception avoidance
🎲 Cheating Fair play, rule-following, and integrity
πŸ΄β€β˜ οΈ Stealing Respect for ownership and intellectual property
⚠️ Harm Safety, avoiding damage, and protective behavior

✨ Key Features

  • πŸ”‘ Bring Your Own Key (BYOK) - Your OpenAI/Anthropic API key never touches our servers
  • 🎯 Lead Capture - Collects email and company before assessment
  • βš™οΈ Configurable Thresholds - Set custom pass/fail criteria per dimension
  • πŸ“Š Real-time Progress - Watch the 120-question assessment run live
  • βœ… Instant Results - Pass/fail determination with detailed scores
  • πŸ”— Verification URLs - Shareable, tamper-proof verification links
  • πŸ’Ύ Saved Prompts - Save and reuse system prompts locally

πŸ—οΈ Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                        User's Browser                        β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚  β”‚  Landing    β”‚ ─> β”‚  Configure   β”‚ ─> β”‚   Assess      β”‚  β”‚
β”‚  β”‚  (Lead)     β”‚    β”‚  (API Key)   β”‚    β”‚   (Questions) β”‚  β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β”‚                            β”‚                     β”‚          β”‚
β”‚                            v                     v          β”‚
β”‚                    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚                    β”‚  localStorage β”‚    β”‚  OpenAI API   β”‚  β”‚
β”‚                    β”‚  (config)     β”‚    β”‚  (in browser) β”‚  β”‚
β”‚                    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                            β”‚
                            v
              β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
              β”‚   AI Assess Tech API    β”‚
              β”‚  (Lead registration,    β”‚
              β”‚   scoring, verification)β”‚
              β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Security Model

Your API key stays completely in your browser:

  1. Input - You paste your API key
  2. Storage - Stored in browser localStorage (cleared on page load)
  3. Usage - Direct browser-to-OpenAI/Anthropic calls
  4. Result - Only responses (not keys) sent to our API for scoring

πŸš€ Quick Start

Prerequisites

  • Node.js 18+ (LTS recommended)
  • npm or yarn
  • OpenAI API Key or Anthropic API Key

Installation

# Clone the repository
git clone https://github.com/yourusername/ai-assessment-tool.git
cd ai-assessment-tool

# Install dependencies
npm install

# Copy environment example
cp env.example .env.local

# Start development server
npm run dev

The app runs at http://localhost:3001 (port 3001 to avoid conflicts with other apps).

Production Build

npm run build
npm start

βš™οΈ Configuration

Environment Variables

Create a .env.local file from env.example:

# AI Assess Tech API URL (for lead registration and scoring)
NEXT_PUBLIC_API_URL=https://www.aiassesstech.com

# Optional: Health Check API Key (for server-side validation)
# Leave empty if not needed - the demo works without it
NEXT_PUBLIC_HEALTH_CHECK_KEY=

Self-Hosted Setup

To run your own instance:

  1. Clone this repo and set up environment
  2. Configure API URL to point to your AI Assess Tech instance
  3. Deploy to Vercel (or any Node.js host)

πŸ“± Pages & Flow

Route Purpose
/ Landing page with lead capture form
/configure API key input, model selection, system prompt, thresholds
/assess Real-time progress during 120-question assessment
/results/[runId] Results with scores, pass/fail, and verification link

User Flow

πŸ“§ Enter Email β†’ πŸ”‘ Enter API Key β†’ πŸ“ Configure Prompt β†’ ▢️ Run Assessment β†’ πŸ“Š View Results

πŸ”§ Supported AI Providers

OpenAI

  • GPT-4 (Recommended)
  • GPT-4 Turbo (Faster)
  • GPT-4o (Latest)
  • GPT-3.5 Turbo (Budget)

Anthropic (Claude)

  • Claude 4 Sonnet (Latest)
  • Claude 4 Opus (Most Capable)
  • Claude 3.5 Sonnet (Stable)
  • Claude 3.5 Haiku (Fast)
  • Claude 3 Haiku (Budget)

⏱️ Time Estimates

Model Estimated Time
GPT-3.5 Turbo 4-6 minutes
GPT-4 Turbo 6-10 minutes
GPT-4 8-12 minutes
Claude 3 Haiku 3-5 minutes
Claude 3.5 Sonnet 8-12 minutes
Claude 4 Opus 10-15 minutes

πŸ› οΈ Development

Project Structure

ai-assessment-tool/
β”œβ”€β”€ src/
β”‚   β”œβ”€β”€ app/                 # Next.js App Router pages
β”‚   β”‚   β”œβ”€β”€ page.tsx         # Landing (lead capture)
β”‚   β”‚   β”œβ”€β”€ configure/       # API key & config
β”‚   β”‚   β”œβ”€β”€ assess/          # Assessment runner
β”‚   β”‚   β”œβ”€β”€ results/         # Results display
β”‚   β”‚   └── api/             # API routes (proxy, rate-limit)
β”‚   β”œβ”€β”€ components/          # Reusable UI components
β”‚   β”‚   β”œβ”€β”€ APIKeyInput.tsx
β”‚   β”‚   β”œβ”€β”€ ModelSelector.tsx
β”‚   β”‚   β”œβ”€β”€ SavedPrompts.tsx
β”‚   β”‚   β”œβ”€β”€ SystemPromptEditor.tsx
β”‚   β”‚   └── ThresholdSliders.tsx
β”‚   └── lib/                 # Utilities
β”‚       β”œβ”€β”€ assessment.ts    # Config/result management
β”‚       β”œβ”€β”€ leads.ts         # Lead registration
β”‚       └── prompts.ts       # Saved prompts storage
β”œβ”€β”€ public/                  # Static assets
β”œβ”€β”€ env.example              # Environment template
β”œβ”€β”€ package.json
└── README.md

Key Technologies

Scripts

npm run dev      # Start development server on port 3001
npm run build    # Create production build
npm run start    # Start production server
npm run lint     # Run ESLint

πŸš€ Deployment

Vercel (Recommended)

Deploy with Vercel

  1. Click "Deploy with Vercel"
  2. Set environment variables in Vercel dashboard
  3. Deploy!

Manual Deployment

# Build
npm run build

# Deploy to your hosting provider
# Upload .next/, node_modules/, package.json, and public/

Environment Variables for Production

Variable Required Description
NEXT_PUBLIC_API_URL βœ… AI Assess Tech API URL
NEXT_PUBLIC_HEALTH_CHECK_KEY ❌ Optional demo key

🀝 Contributing

We welcome contributions! Please see CONTRIBUTING.md for guidelines.

Quick Contribution Flow

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/amazing-feature)
  3. Commit your changes (git commit -m 'Add amazing feature')
  4. Push to the branch (git push origin feature/amazing-feature)
  5. Open a Pull Request

πŸ“‹ Roadmap

  • Chat Interface - Chat with your AI after it passes
  • Email Verification - Verify leads before assessment
  • Cloud Prompts - Sync saved prompts across devices
  • CAPTCHA - Rate limiting with hCaptcha/Turnstile
  • Assessment History - View past assessments
  • PDF Reports - Export results as PDF

πŸ“œ License

This project is licensed under the MIT License - see the LICENSE file for details.


πŸ”— Links


πŸ’¬ Support


Made with ❀️ by AI Assess Tech

About

This is the Demo Site for the product aiassesstech (Also known as compsi in this repository)

Resources

License

Contributing

Stars

Watchers

Forks

Packages

No packages published