[Question]: error RESOURCE_EXHAUSTED when trying to upload badge arcade file

[FrancyAngy]

Checked Existing

• I have checked the repository for duplicate issues.

What would you like to know?

Hi, I'm trying to self host the badge arcade, and I've arrived to the step of uploading the badge arcade BOSS files to the server, but I keep running into the RESOURCE_EXHAUSTED error, specifically ClientError: /boss.BOSS/UploadFile RESOURCE_EXHAUSTED: Received message larger than max (26528196 vs 4194304).
I tried both uploading manually and through seeding, but I keep hitting this error. My seeding tasksheet is:
1.J6la9Kj8iqTvAPOq.data.tasksheet.xml:
<?xml version="1.0" encoding="UTF-8"?> <TaskSheet> <TitleId>0004000000153600</TitleId> <TaskId>data</TaskId> <ServiceStatus>open</ServiceStatus> <Files> <File> <Filename>data_v131.dat</Filename> <DataId>901</DataId> <Type>AppData</Type> <Url>http://npdl.cdn.pretendo.cc/p01/nsa/J6la9Kj8iqTvAPOq/data/data_v131.dat</Url> <Size>26528138</Size> <Notify> <New>app</New> <LED>false</LED> </Notify> </File> <File> <Filename>allbadge_v131.dat</Filename> <DataId>902</DataId> <Type>AppData</Type> <Url>http://npdl.cdn.pretendo.cc/p01/nsa/J6la9Kj8iqTvAPOq/data/allbadge_v131.dat?tm=2</Url> <Size>44167555</Size> <Notify> <New>app</New> <LED>false</LED> </Notify> </File> </Files> </TaskSheet>
and the files are unencrypted since the boss CLI doesn't decrypt 3DS files. Is there a flag I need to tweak to either increase the max file size or remove it altogether? I'm running a custom version of pretendo-docker if that changes anything. I edited the setup script to pull the latest version of BOSS in addition to adding other custom servers.

[DaniElectra]

3DS support on BOSS is currently not present yet (see #41 ). That said, you bring up a good question about the payload limits.

@jonbarrow The default limit for gRPC messages is on 4 MB, but the Badge Arcade BOSS data (at least those made by Nintendo) can take 25MB+. Is this something we want to update?

[jonbarrow]

The default limit for gRPC messages is on 4 MB

I genuinely had no idea this was a thing, I'll look into it

[jonbarrow]

@DaniElectra The sizes can now be changed

[FrancyAngy]

I forgot to post this earlier, but I patched the boss repo with the PR in order to add the 3DS support and increased the grpc message sent and received max sizes, but now the grpc server errors with:
ClientError: /boss.v2.BossService/UploadFileCTR INVALID_ARGUMENT: ABORTED: Expected closing tag 'hr' (opened in line 5, col 1) instead of closing tag 'body'.:6:1 Deserialization error: to see the raw response, inspect the hidden field {error}.$response on this object. at wrapClientError (/home/node/app/node_modules/nice-grpc/src/client/wrapClientError.ts:7:12) at Object.callback (/home/node/app/node_modules/nice-grpc/src/client/createUnaryMethod.ts:63:35) at Object.onReceiveStatus (/home/node/app/node_modules/@grpc/grpc-js/src/client.ts:360:26) at Object.onReceiveStatus (/home/node/app/node_modules/@grpc/grpc-js/src/client-interceptors.ts:458:34) at Object.onReceiveStatus (/home/node/app/node_modules/@grpc/grpc-js/src/client-interceptors.ts:419:48) at <anonymous> (/home/node/app/node_modules/@grpc/grpc-js/src/resolving-call.ts:163:24) at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { path: '/boss.v2.BossService/UploadFileCTR', code: 3, details: "ABORTED: Expected closing tag 'hr' (opened in line 5, col 1) instead of closing tag 'body'.:6:1\n" + ' Deserialization error: to see the raw response, inspect the hidden field {error}.$response on this object.' }
I also encountered this error while seeding with the files provided in this repo, just with the standard UploadFile. This error also appears in the logs of the actual server, not just in the boss cli. Uploading other files works fine since I tried uploading swapdoodle's dstsetting file and it was uploaded without any errors

[jonbarrow]

Are you able to interact with the gRPC service at all. Like listing tasks or BOSS applications

That's not an error our server generates, and it looks to me like you're trying to use the gRPC client to connect to a non-gRPC service since it's trying to handle html

[FrancyAngy]

yes, I can, and as I said I can even upload other files, such as the dstsetting for swapdoodle. During the mentioned seeding only certain files, only the ones from the woodBGM task, gave me that error. The error also appears in the logs of the server, so I'm pretty sure that I'm connected to it. I think that the BOSS program could be sending html to the server in some situations, though I feel like that would have been caught by some bug testing

[jonbarrow]

I missed that

That said, you said you patched things and are running a custom version of pretendo-docker. That's not something we officially support, can you just clone the branch and run the server stand-alone? I want to rule out pretendo-docker being the issue

[FrancyAngy]

Right now I can't but when I can I will post an update. I don't think that's the issue since the boss repo is basically stock except for the pr patch but it doesn't hurt to try

[jonbarrow]

pretendo-docker does things like run its own nginx server and such if I remember correctly. Which could be causing issues if it's not setup for gRPC correctly or whatever. Like I said, it's not a project we officially support and so I'm trying to eliminate anything not directly related to our code that could be causing issues

[FrancyAngy]

Ok, but I'm using sh inside the built boss docket container to use the boss command, I'm not using nginx to interact with the grpc api, I'm using the internal port inside the container. I will still try building and testing this exact thing outside docker in an "officially" supported environment, but, as I said, I think that the results will be the same

[jonbarrow]

And that's fine you can think that, I'm not even doubting you, I'm just asking you to run the server in a context we officially support so we can verify that it's an upstream issue. Please just run the server normally when you're able to. This did not need to be such a back and forth.