-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #9 from cheronodaisy/dev
Compare RAGAs metrics
- Loading branch information
Showing
7 changed files
with
319 additions
and
39 deletions.
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
,0 | ||
faithfulness,0.8 | ||
answer_relevancy,0.7303519445666862 | ||
context_precision,0.7778333333140975 | ||
context_recall,0.95 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
,0 | ||
faithfulness,0.7333333333333333 | ||
answer_relevancy,0.7359878053275298 | ||
context_precision,0.8733333333151666 | ||
context_recall,1.0 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,38 @@ | ||
,question,answer,contexts,ground_truth,context_precision,context_recall,faithfulness,answer_relevancy | ||
0,What should be included in the invoice?,"The invoice should include the following items: | ||
|
||
1. The Contract Number | ||
2. Contractor’s name and address | ||
3. A description of the Services performed | ||
4. The dates such Services were performed | ||
5. A pricing calculation based on the payment terms | ||
6. Properly reimbursable expenses (if any) incurred along with receipts for such expenses for all individual expenses exceeding $25 USD | ||
7. Such other information as Mercy Corps may reasonably request.","['Invoicing and Payment.' | ||
'have no obligation to pay any portion of invoices received more than 60 days after the end date of the Contract. Each invoice will include (i)\xa0the Contract Number; (ii)\xa0Contractor’s name and address; (iii)\xa0a description of the Services performed, (iv)\xa0the dates such Services were performed, (v)\xa0a pricing calculation based on the payment terms, (vi)\xa0properly reimbursable expenses (if any) incurred along with receipts for such expenses (if applicable) for all individual expenses exceeding $25' | ||
'for all individual expenses exceeding $25 USD, and (vii) such other information as Mercy Corps may reasonably request. Invoices will only be deemed received on the date they are delivered to the Authorized Representative pursuant to the Payment Terms (see Schedule I). If Mercy Corps determines that Services that are the subject of an invoice have not been performed in accordance with the Statement of Services, Mercy Corps may dispute the invoice by sending Contractor notice of such dispute' | ||
'Terms, and the time required of Contractor to complete the Services.' | ||
'Liability/Indemnity\nUnder no circumstances nor for any reason whatsoever will the European Union be held liable for damages as a result of the work pursuant to this Contract. \nRight of Access/ Audit\nThe Vendor will be responsible for holding all invoices, receipts and financial and accounting documents relating to this Contract for at least seven years following final payment made under this Contract.' | ||
'Except as otherwise provided in the Statement of Services, Mercy Corps will pay each invoice (or adjusted invoice if the subject of dispute) in accordance with the Payment Terms within 30 days after the later of (i)\xa0receipt of the invoice or (ii)\xa0resolution of the items set forth in the notice of disputed charges.\nMercy Corps may off-set any amount it owes Contractor against any amount Contractor owes Mercy Corps.\nTaxes, Duties and Expenses.']","Each invoice will include (i) the Contract Number; (ii) Contractor’s name and address; (iii) a description of the Services performed, (iv) the dates such Services were performed, (v) a pricing calculation based on the payment terms, (vi) properly reimbursable expenses (if any) incurred along with receipts for such expenses (if applicable) for all individual expenses exceeding $25 USD, and (vii) such other information as Mercy Corps may reasonably request.",0.9999999999833333,1.0,1.0,0.9815858311463699 | ||
1,What happens if a contractor breaches the contract?,"If a contractor breaches the contract, Mercy Corps may terminate the contract immediately upon written notice. Mercy Corps may withhold any amounts owed to the contractor until the breach is remedied. Additionally, if the termination is due to the contractor's breach, Mercy Corps will not be obligated to pay the contractor for any partially completed work.","['Terms, and the time required of Contractor to complete the Services.' | ||
'Contractor possesses all governmental and other certifications and licenses necessary to perform the Services. Performance by Contractor of its obligations under this Contract will not infringe on any patent, copyright, trademark, trade secret or other proprietary right of any third party.\nContractor will comply with all applicable law, regulations and rules in the performance of its obligations under this Contract.' | ||
'by Mercy Corps immediately upon written notice if Mercy Corps using its sole discretion determines that Contractor has or will breach any of its warranties, covenants or representations in this Contract, in which case Mercy Corps may withhold any and all amounts owed to Contractor until such breach is remedied.' | ||
'Contractor has not engaged in, and will not engage in, any of the following conduct: (A) trafficking in persons (as defined in the Protocol to Prevent, Suppress, and Punish Trafficking in Persons, especially Women and Children, supplementing the UN Convention against Transnational Organized Crime); (B) procuring a commercial sex act; or (C) using forced labor.' | ||
'Definitions:' 'Invoicing and Payment.' 'Anti-terrorism' | ||
'of business on the next business day for the recipient).' | ||
'and also may require the Contractor to refund a portion or all of any amounts paid to the Contractor under this contract.' | ||
'In the event of termination due to Contractor’s breach of this Contract or by Contractor for Contractor’s convenience, Mercy Corps will not be obligated to pay Contractor for any partially completed work. In the event termination is due to Mercy Corps’ breach of this Contract, by Mercy Corps for Mercy Corps’ convenience, due to force majeure event, or due to loss of funding, Mercy Corps will be obligated to pay Contractor for its reasonable, pro-rated costs of work completed and expenses']","In the event of termination due to Contractor’s breach of this Contract or by Contractor for Contractor’s convenience, Mercy Corps will not be obligated to pay Contractor for any partially completed work. ",0.344444444432963,1.0,1.0,0.8543245266783456 | ||
2,What is the deadline for submitting the invoicing schedule?,I don't know.,"['Invoicing and Payment.' | ||
'Contractor will submit invoices to Mercy Corps in accordance with the invoicing schedule and invoicing delivery terms set forth in the Statement of Services (Schedule I). Final invoices must be submitted within 60 days of the end date of the Contract. Contractor recognizes that in many cases Mercy Corps’ donor will not reimburse Mercy Corps for invoices submitted beyond 60 days after the termination of a contract and therefore Mercy Corps will have no obligation to pay any portion of invoices' | ||
'have no obligation to pay any portion of invoices received more than 60 days after the end date of the Contract. Each invoice will include (i)\xa0the Contract Number; (ii)\xa0Contractor’s name and address; (iii)\xa0a description of the Services performed, (iv)\xa0the dates such Services were performed, (v)\xa0a pricing calculation based on the payment terms, (vi)\xa0properly reimbursable expenses (if any) incurred along with receipts for such expenses (if applicable) for all individual expenses exceeding $25' | ||
'for all individual expenses exceeding $25 USD, and (vii) such other information as Mercy Corps may reasonably request. Invoices will only be deemed received on the date they are delivered to the Authorized Representative pursuant to the Payment Terms (see Schedule I). If Mercy Corps determines that Services that are the subject of an invoice have not been performed in accordance with the Statement of Services, Mercy Corps may dispute the invoice by sending Contractor notice of such dispute']",Final invoices must be submitted within 60 days of the end date of the Contract. Contractor recognizes that in many cases Mercy Corps’ donor will not reimburse Mercy Corps for invoices submitted beyond 60 days after the termination of a contract and therefore Mercy Corps will have no obligation to pay any portion of invoices received more than 60 days after the end date of the Contract.,0.999999999975,1.0,0.0,0.0 | ||
3,When will Mercy Corps submit payment?,Mercy Corps will pay each invoice (or adjusted invoice if the subject of dispute) within 30 days after the later of (i) receipt of the invoice or (ii) resolution of the items set forth in the notice of disputed charges.,"['Contractor will submit invoices to Mercy Corps in accordance with the invoicing schedule and invoicing delivery terms set forth in the Statement of Services (Schedule I). Final invoices must be submitted within 60 days of the end date of the Contract. Contractor recognizes that in many cases Mercy Corps’ donor will not reimburse Mercy Corps for invoices submitted beyond 60 days after the termination of a contract and therefore Mercy Corps will have no obligation to pay any portion of invoices' | ||
'Except as otherwise provided in the Statement of Services, Mercy Corps will pay each invoice (or adjusted invoice if the subject of dispute) in accordance with the Payment Terms within 30 days after the later of (i)\xa0receipt of the invoice or (ii)\xa0resolution of the items set forth in the notice of disputed charges.\nMercy Corps may off-set any amount it owes Contractor against any amount Contractor owes Mercy Corps.\nTaxes, Duties and Expenses.' | ||
'Delivery of Services. \nContractor will perform the Services, and Mercy Corps will pay for the Services, in accordance with the terms and conditions and within the Performance Period set forth in this Contract and the Statement of Services.' | ||
'for all individual expenses exceeding $25 USD, and (vii) such other information as Mercy Corps may reasonably request. Invoices will only be deemed received on the date they are delivered to the Authorized Representative pursuant to the Payment Terms (see Schedule I). If Mercy Corps determines that Services that are the subject of an invoice have not been performed in accordance with the Statement of Services, Mercy Corps may dispute the invoice by sending Contractor notice of such dispute' | ||
'by Mercy Corps immediately upon written notice if Mercy Corps using its sole discretion determines that Contractor has or will breach any of its warranties, covenants or representations in this Contract, in which case Mercy Corps may withhold any and all amounts owed to Contractor until such breach is remedied.']","Except as otherwise provided in the Statement of Services, Mercy Corps will pay each invoice (or adjusted invoice if the subject of dispute) in accordance with the Payment Terms within 30 days after the later of (i) receipt of the invoice or (ii) resolution of the items set forth in the notice of disputed charges.",0.99999999998,1.0,1.0,0.9458873108716661 | ||
4,Who is responsible for paying taxes in the agreement?,"The Contractor is responsible for all expenses incurred in performing under the Contract, including all taxes, duties, and other governmental charges. However, if the law requires Mercy Corps to withhold taxes from payments to the Contractor, Mercy Corps may withhold those taxes and pay them to the appropriate taxing authority.","['Except as otherwise provided in the Statement of Services, Contractor is responsible for all expenses incurred by it in performing under this Contract and all taxes, duties and other governmental charges with respect to the provision of Services. If the law requires Mercy Corps to withhold taxes from payments to Contractor, Mercy Corps may withhold those taxes and pay them to the appropriate taxing authority. Mercy Corps will deliver to Contractor an official notice for such taxes. Mercy' | ||
'Invoicing and Payment.' | ||
'paid (at each of their own cost, unless otherwise agreed).' | ||
'Liability/Indemnity\nUnder no circumstances nor for any reason whatsoever will the European Union be held liable for damages as a result of the work pursuant to this Contract. \nRight of Access/ Audit\nThe Vendor will be responsible for holding all invoices, receipts and financial and accounting documents relating to this Contract for at least seven years following final payment made under this Contract.' | ||
'The Vendor will seek to ensure that none of the funds or assets provided under this Agreement are made available or used to provide support to individuals, groups or entities associated with terrorism.' | ||
'Except as otherwise provided in the Statement of Services, Mercy Corps will pay each invoice (or adjusted invoice if the subject of dispute) in accordance with the Payment Terms within 30 days after the later of (i)\xa0receipt of the invoice or (ii)\xa0resolution of the items set forth in the notice of disputed charges.\nMercy Corps may off-set any amount it owes Contractor against any amount Contractor owes Mercy Corps.\nTaxes, Duties and Expenses.']","Except as otherwise provided in the Statement of Services, Contractor is responsible for all expenses incurred by it in performing under this Contract and all taxes, duties and other governmental charges with respect to the provision of Services. If the law requires Mercy Corps to withhold taxes from payments to Contractor, Mercy Corps may withhold those taxes and pay them to the appropriate taxing authority. Mercy Corps will deliver to Contractor an official notice for such taxes. Mercy Corps will use reasonable efforts to minimize any taxes withheld to the extent allowed by law.",0.9666666666473333,0.75,1.0,0.8967428990913818 |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters