Error in spending utxos with reference script

[larestrepo]

Describe the bug
Spending utxos with reference script fails with following error after trying to submit the transaction:

Failed to submit transaction. Error code: 400. Error message: {"contents":{"contents":{"contents":{"era":"ShelleyBasedEraConway","error":["ConwayUtxowFailure (UtxoFailure (FeeTooSmallUTxO (Mismatch {mismatchSupplied = Coin 175181, mismatchExpected = Coin 1432410})))"],"kind":"ShelleyTxValidationError"},"tag":"TxValidationErrorInCardanoMode"},"tag":"TxCmdTxSubmitValidationError"},"tag":"TxSubmitFail"}

To Reproduce
Spend a utxo containing a reference script such as:

{
    'input': {
      'index': 0,
      'transaction_id': TransactionId(hex='7b2e253ec4c788....'),
    },
    'output': {
      'address': addr_...,
      'amount': {'coin': 51401060, 'multi_asset': {}},
      'datum': None,
      'datum_hash': None,
      'post_alonzo': False,
      'script': b'Y-\xc1\x01\x00\x003#########################################################################################""#####################################################################################################################7J\x90\x00\x1b\xb1I\x8c\x8c\x8c\x8c\x8c\xcc\xcc\xcc\xcc\xcc\xcc\xcc\xcc\xcd@\x14\x02\x00T\x02\x80$\x03@0\x04\x81X\x06\x00<\x03\x80\x18\x02\xc0\x1c\x06\x84\x01\x04\x00\xc4\x00\x84\x00A\xdc\x1d\xc1\xdc\x1d\xc4\x88\x88\x88\x88\x88\x88\x88\x88\x88\x8c\x8c\x8c\x8c\x8c\x94\xcc\xd5\xcd\x19\x18q\x00\x88\x00\x99\x18Y\x00\x88\x00\xa8\x03\x89\x91\x91\x91\x91\x91\x91\x91\x92\x99\x9a\xb9\xa3#\x0e\xa0\x11\x00...

Expected behavior
Transaction is submit without errors.

Environment and software version (please complete the following information):

• PyCardano V 0.15.0

Additional context
I managed to submit the transaction by artificially adding some additional lovelace amount to the fee_buffer field...

[cffls]

It seems like a bug in fee estimation. If possible, could you please provide the state of txbuilder, which should be printed when the transaction failed, or a sample code of how the transaction was constructed would be also very helpful.

[larestrepo]

The code is something like this in order to simply spend the utxo with the reference script:

for utxo in context.utxos(ref_address):
    if utxo.output.script == PlutusV2Script(cbor2.loads(bytes.fromhex(script)):
        reference_utxo = utxo
        break

builder = TransactionBuilder(context)

builder.add_input(reference_utxo)

signed_tx = builder.build_and_sign([signing_key], change_address(ref_address))

context.submit_tx(signed_tx)

It builds the transaction but it fails during submission with the error I posted previously.

Failed to submit transaction. Error code: 400. Error message: {"contents":{"contents":{"contents":{"era":"ShelleyBasedEraConway","error":["ConwayUtxowFailure (UtxoFailure (FeeTooSmallUTxO (Mismatch {mismatchSupplied = Coin 175181, mismatchExpected = Coin 1432410})))"],"kind":"ShelleyTxValidationError"},"tag":"TxValidationErrorInCardanoMode"},"tag":"TxCmdTxSubmitValidationError"},"tag":"TxSubmitFail"}

When I add this (builder.fee_buffer = 1_000_000) before the build, the trasnsaction works fine.

[cffls]

Thanks for the context. You might need to use add_script_input instead of add_input:

builder.add_script_input(reference_utxo)

[larestrepo]

It is not working either. This is the utxo:

{
    'input': {
      'index': 0,
      'transaction_id': TransactionId(hex='04e18ab41cfa3d3fc83fe08da9ca2d97b5f2506a3124ea11005ba61d4fd37c60'),
    },
    'output': {
      'address': addr_test1vpfmwqj445kx44wn4z5sx7t35ex4h2jjfu0gsc3e3cjg3rge8k6xu,
      'amount': {'coin': 14438500, 'multi_asset': {}},
      'datum': None,
      'datum_hash': None,
      'post_alonzo': False,
      'script': b'Y\x0cA\x01\x00\x003###############################################""22222222222222222222222222222222222222222222222222222222222222222223t\xa9\x00\x01\xbb\x14\x98\xc8\xc8\xc8\xcc\xcc\xcc\xcc\xcc\xcc\xd4\x01\x00\x14\x01\x800\x02\x80$\x02\x00\xcc\x04\xc0\x1c\x05D\x00\xc4\x00\x84\x00A\x14\x11A\x14H\x88\x88\x88\x88\x88\x88\xc8\xc8\xc8\xc8\xc8\xc8\xc8\xc8\xc8\xc8\xc9L\xcd\\\xd1\x91\x84@\x08\x80\t\x91\x83X\x80\n\x80h\xa9\x99\xab\x9a20\x88\x01\x10\x012235\x01P\x11\x10\x02\x10\x01P\x0fP\x0c\x1535sFF\x11\x00"\x00&`\xecd`\xec \x02\xa0\x04\x90\x02\t\x91\x91\x91\x92\x99\x9a\xb9\xa3#\x08\xc0\x11\x00\x130z2230lP\x08\x10\x02\x10\x01H\x00\x14\x00\xd2\x00!S3W4da\x18\x02 \x02f\x0fFFFf\r\x8a\x01\x02\x00B\x00)\x00\x02\x80\n@\x04&f`\n\x08\xa0\x06\x07`\x02&Lf\xaeq$\x01\x1eMust mint exactly 1 user token\x00I\x84\xc9\x8c\xd5\xce$\x81"Must mint exactly 1 protocol token\x00I\x84\x00L\x8c\x8c\xcc\xcc\xcc\xd4\x05\x00\xa4\n\x00X\t\x80\x9c\x04\xc4\x00\x84\x00T\x06\x14\x04\x04\x00L\x8c\x8c\xcc\xcc\xcc\xd4\x04\x80\x9c\t\x80P\t\x00\x94\x04D\x00\x84\x00T\x05\xd4\x03\x84\xc9\x8c\xd5\xce$\x81\x1aMust mint exactly 2 tokens\x00I\x84\xc9\x8c\xd5\xce$\x81\x11UTxO not consumed\x00I\x84\xc9L\xcd\\\xd1\x91\x84H\x08\x80\t\x91\x84\x10\x08\x80\n\x80p\xa9\x99\xab\x9a20\x89\x01\x10\x013\x07s#\x07q\x00\x15\x004\x80\x10L\x8c\x8c\xcc\xc0\x04\x00L\x18\x94\x02A\x10\x0e\x88\x88\x94\xcc\xd5\\\xf8\x01\x89\x99\x80(\x01\x00\x10\x00\x89\x91\x91\x92\x99\x9a\xb9\xa3#\t\x10\x11\x00\x130\x7fP\x01H\x00\x04\xcc\xcc\x01\xc0\x1c\xd5\xd1\x000\x01\x80\x08\x991\x9a\xb9\xc4\x91*Cannot send tokens to outputs when burning\x00I\x84\x00L\x8d@d@\x04\xcc\x1b\xcc\x8c\x8c\xcc\x1c\x0c\x1a\x94\x00\xc4\x00\x84\x00L\xd5\xd0\x19\xbb\x03u)\x11\x007P\x90\x00\x1b\xb2I\x94\x03\xc5&\x13WB\x00dDf\x00\x80\x04\x00"d\xc6j\xe7\x12A1Must burn exactly 2 tokens (protocol + user pair)\x00I\x85L\xcd\\\xd1\x91\x84H\x08\x80\nP\x130\x01\x04 8\x13&3W8\x92\x01\x15Invalid redeemer type\x00I\x88\x8c\xcc\xc0\x0c\x00\x81\x00\x00@\xd4\x88\x89&\x10\x012230fP\x03\x10\x02\x10\x013W@f\xec\r\xd4\xa4A\x007P\x90\x00\x1b\xb2I\x94\x01D\x00L\x16\x14\x00D\x00L\x19T\x01D\x00L\x18\x94\x00D\x00L\x8c\xcd@(\x07\x00\x14@\x05@\x04A\xa4A\xa4H\x88\x88\x88\x8c\x8c\x8c\x8c\x8c\x8c\x8c\x8c\x8c\x94\xcc\xd5\xcd\x19\x18?\x08\x00\x99\x83i\x91\x83\xd8\x80\n\x80\x12@\x80&FFFf\xa0  \x06 \x04 \x02\xa0\x08\x90 $\x00\x02`\x02)1(\x01\x08\x00\x99\x19\x19\xa8\x08\x08\x01\x08\x00\xa8\x01(\x03\x88\x00\x99\x1a\x80P\x80\n\x80\x08\x80\t\x91\x91\x9a\x80`\x80\x10\x80\n\x80\x11\x82\xd1\x82\xda\x80 \x80\t\x91\x91\x9a\x80H\x80\x10\x80\nE\x000QP\x02\x12"222230\x01\x00\x13\x05E\x0004"%35W>\x00Bf\x00\x80\x02\x00"dd\xa6f\xaeh\xc8\xc1\xdc@\x04\xcc\x19\xcc\x16\xd4\x00\x94\x02E(\x89\x80\x08\xa4\xc4f`\n\x00\xa6\xae\x88\x01\x00\x08M]\x08\x01\x11%\x01\x00\x13\x055\x00!"##%35sFF\x0e\x02\x00&F\nb\x00*\x00"\xa0\x02&L\x93\x08\x00\x98%\xa8\x00\x88\x00\xa4A\x05USER_\x00\x10\x01H\x81\x04REF_\x00\x127&\xa0\x02$Dfn1@\r@\t@\x04H\x8c\xdcZ\x80\x12\x80\x08\x91\x19\xb8\xa5\x00%\x00\x11\x06Q\x00\x12230Y\x00\x17\x00\x90\x00(\x00\x89\x93\x19\xab\x9cI\x01\x10NameError: ~bool\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: z\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: y\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: y\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: y\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: x\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: x\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: x\x00I\x84\xc9\x8c\xd5\xce$\x81\x0cNameError: x\x00I\x84\xc9\x8c\xd5\xce$\x81\x14NameError: validator\x00I\x84\xc9\x8c\xd5\xce$\x81\x1aNameError: user_token_name\x00I\x84\xc9\x8c\xd5\xce$\x81\x1cNameError: unique_token_name\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: tx_info\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: tx_info\x00I\x84\xc9\x8c\xd5\xce$\x81\x17NameError: token_amount\x00I\x84\xc9\x8c\xd5\xce$\x81\x0eNameError: sum\x00I\x84\xc9\x8c\xd5\xce$\x81\x1cNameError: slice_byte_string\x00I\x84\xc9\x8c\xd5\xce$\x81\x13NameError: sha3_256\x00I\x84\xc9\x8c\xd5\xce$\x81\x13NameError: redeemer\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: purpose\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: purpose\x00I\x84\xc9\x8c\xd5\xce$\x81\x1eNameError: protocol_token_name\x00I\x84\xc9\x8c\xd5\xce$\x81\x11NameError: prefix\x00I\x84\xc9\x8c\xd5\xce$\x81\x18NameError: own_policy_id\x00I\x84\xc9\x8c\xd5\xce$\x81\x11NameError: output\x00I\x84\xc9\x8c\xd5\xce$\x81\x15NameError: our_minted\x00I\x84\xc9\x8c\xd5\xce$\x81\x0fNameError: oref\x00I\x84\xc9\x8c\xd5\xce$\x81\x0fNameError: oref\x00I\x84\xc9\x8c\xd5\xce$\x81\x0fNameError: oref\x00I\x84\xc9\x8c\xd5\xce$\x81\x15NameError: mint_value\x00I\x84\xc9\x8c\xd5\xce$\x81\x0eNameError: len\x00I\x84\xc9\x8c\xd5\xce$\x81\x15NameError: isinstance\x00I\x84\xc9\x8c\xd5\xce$\x81\x15NameError: input_utxo\x00I\x84\xc9\x8c\xd5\xce$\x81\x16NameError: index_bytes\x00I\x84\xc9\x8c\xd5\xce$\x81\x13NameError: has_utxo\x00I\x84\xc9\x8c\xd5\xce$\x81\x1eNameError: get_minting_purpose\x00I\x84\xc9\x8c\xd5\xce$\x81\x15NameError: full_token\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: context\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: context\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: context\x00I\x84\xc9\x8c\xd5\xce$\x81\x1bNameError: cons_byte_string\x00I\x84\xc9\x8c\xd5\xce$\x81\x18NameError: combined_hash\x00I\x84\xc9\x8c\xd5\xce$\x81\x18NameError: combined_data\x00I\x84\xc9\x8c\xd5\xce$\x81\x1dNameError: append_byte_string\x00I\x84\xc9\x8c\xd5\xce$\x81\x1aNameError: PREFIX_USER_NFT\x00I\x84\xc9\x8c\xd5\xce$\x81\x1fNameError: PREFIX_REFERENCE_NFT\x00I\x84\xc9\x8c\xd5\xce$\x81\x12NameError: Minting\x00I\x84\xc9\x8c\xd5\xce$\x81\x0fNameError: Mint\x00I\x84\xc9\x8c\xd5\xce$\x81\x0fNameError: Burn\x00I\x80\x04\x8d\xd5\x98\x01\x98\x16\x00\x08\x01\x91\x80!\xab\xa2\x00\x10\x0c#3\x01\xd3u\x86\x01\xa6\x05\x00\x02@\x02&\xecRb0\x0c5t@\x02\x01`\x16\x01`\x16\x01`\x16FFn\x1c\xc0D\x00R\x00\x05\x00\x10\x0f\x00\xf27V` `:\x00$`\x1ej\xe8\x80\x04\x8d\xd6\x98\x07\x18\r\x80\t\x18\x06\x98\r\x00\t\x11\x1b\xad25W<f` \x00\x84f\xeb\xc0\x08\xd5\\\xe8\x00\x89\x9b\xb0\x00\x13u\n\x00F\xeaT\x00\x88\x88\xddY\x91\xaa\xb9\xe33\x00\xf0\x04#7^\x00F\xaa\xe7@\x04L\xdd\x80\x00\x9b\xa6P\x027R\xa0\x04Df`\x1a\x00Dn\xb4\xd5\\\xf0\x00\x8a^\xb0\x08\xcc\xc0,\xdda\x80\xb9\x80\xb0\x00\x90\x00\x89\xbb\x14\x98\x8c\x8c\xcc\x03\x00\x04\x88\xcd\xc0\x00\x12@\x04\x90\x00(\x00\x80X\x07\x00q\x18\x08\x00\t\x1b\xae0\x110\x10\x00\x120\x100\x0f\x00\x120\x0f5t@\x02DFd`&D\xa6f\xaa\xe7\xc0\x04T\x01\x05L\xcd\\\xd1\x80\x19\xab\xa1\x00\x115t \x02&`\x04\x00F\xae\x88\x00@\x08\x00\xc8\x88\xcc\x8c\x04\x88\x94\xcc\xd5\\\xf8\x00\x8a\x80 \x99\xab\xa00\x035t \x02f\x00@\x04j\xe8\x80\x04\x00\x80\x0c\x88\x8c\xcc\x8c\x04H\x89L\xcdU\xcf\x80\x10\x80\x08\x99\x98\x01\x80\x19\xab\xa2\x00#0\x04\x00\x13WB\x00@\x04\x00`\x02FIE@\x05\xc3\x91\x9b\xa5H\x00\x8d\xd8\xa4\xc4f\xe9R\x00\x03v)1\x19\x1b\x8d\x00\x15\x00\x12#7\x10\x00 \x04\xeb\xc8\xc8\x00T\x00H\xd5\\\xe9\xba\xa0\x01#Us\xc6\xea\x80\x04\x8d]\x08\x00\x91\x9b\xa5H\x00\x0c\xd5\xd0\x1b\xa9P\x017b\x93\x11\x91\x80\x08\x00\x80\na+\xd8y\x9f\xd8y\x9fX \xbe\x08p\x0c\x9al78D\xb8\xc2\x1ea\xa3\xb6\x93\xb4V5\x10\xd9a\xf3\xe8\xc7L\x0e\x15L\xd9B\x85\xff\x00\xff\x00\x01',
    },
}

The add_script_input is looking for a script type address but this is an usual address that stores the script. This section of the code is failing:

        if not utxo.output.address.address_type.name.startswith("SCRIPT"):
            raise InvalidArgumentException(
                f"Expect the output address of utxo to be script type, "
                f"but got {utxo.output.address.address_type} instead."
            )

Because the address type name is 'KEY_NONE'

[cffls]

Got it. Thanks for the clarification. I will try to replicate this in a testnet and find the root cause of this issue.

[cffls]

Verified the fix in integration test: https://github.com/Python-Cardano/pycardano/blob/main/integration-test/test/test_plutus.py#L363-L365