PDF Summarization with ChatGPT-3.5! This repository contains a Python script that uses the power of ChatGPT, a large language model trained by OpenAI, to summarize PDF documents into key points.
Open API key has restriction on number of token generated per prompt which ranges from 2048 tokens to 4096 tokens per prompt.
This means that the length of the prompt text string must not exceed the specified token limit, including any additional parameters or options that are included in the API request.
Our script can summarize text well over the lenght of 4096 tokens by dividing text into sizeable amount of chunks and summarizing the chunks.
But this comes at the cost of time take to summarize.
To summarize a 45 page pdf containg over 88,000 words it take around 562 second which is 9 min 36 sec.
