Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add caikit tutorial for text classification #58

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

manisnesan
Copy link
Owner

@manisnesan manisnesan commented Oct 12, 2023

This nb is based on the resources found in this comment

#57 (comment)

Start the inference server. This serves the gRPC server running at port 8085 and http server running at 8080

$ python start_runtime.py

Start the client the sends text inputs to gRPC and http (Note: I am facing issue with http not responding with predictions). I tried cloning the caikit repository and tried to run the example directly and http is responding withe predictions correctly. So the issue is something to do with the way that I am trying to reproduce the example.

✗ python client.py 
Text:  I am not feeling well today
Response from gRPC:  classes {
  class_name: "NEGATIVE"
  conf: 0.99970537424087524
}

Text:  Today is a nice sunny day
Response from gRPC:  classes {
  class_name: "POSITIVE"
  conf: 0.999869704246521
}


Text: I am not feeling well today
RESPONSE from HTTP: {
    "detail": "Not Found"
}

Text: Today is a nice sunny day
RESPONSE from HTTP: {
    "detail": "Not Found"
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant