Web page to search for Granblue Fantasy assets.
Click Here to access it.
There are two pages:
- The Asset Lookup, to search assets, consisting of one HTML, one javascript and one css files.
- The Spark Maker, for users to keep track of their "spark", which has its own HTML, javascript and css files too, on top of reusing the Asset Lookup javascript and css files.
Note
These pages are static and are currently hosted on Github Pages, but it can technically be hosted anywhere.
Two of the JSON files in the json folder are the core of the system:
- changelog.json is the first file loaded upon opening the page. It contains the timestamp of the last update and a list of recently updated elements.
- data.json is loaded next and contains the data used to catalog all the assets, and more.
Others JSON files are used for debug or update purpose:
- job_data_export.json is used to quickly link some MC jobs to their weapon animations using the built-in CLI.
- manual_lookup.json is used to fill lookup entries without wiki data.
- manual_fate.json is used to associate fate episode entries with other elements.
More JSON files not specified here might appear in this folder, for development or testing purpose.
This script is in charge of updating the JSON files.
Caution
Using it can be time and bandwidth consuming.
- Python 3.13.
- Run
pip install -r requirements.txtin a command prompt. - See requirements.txt for a list of third-party modules.
GBFAL Updater v3.4
usage: updater.py [-h] [-r] [-u UPDATE [UPDATE ...]] [-j [FULL]]
[-sc [SCENE ...]] [-sd [SOUND ...]] [-ev [EVENT ...]] [-ne]
[-st [LIMIT]] [-ft [FATES]] [-pt] [-ij] [-ej] [-lk] [-fj]
[-it] [-et] [-mt] [-au [ADDUNCAP ...]] [-nc] [-nr] [-dg]
Asset Updater v3.4 for GBFAL https://mizagbf.github.io/GBFAL/
options:
-h, --help show this help message and exit
primary:
main commands to update the data.
-r, --run search for new content.
-u, --update UPDATE [UPDATE ...]
update given elements.
-j, --job [FULL] detailed job search. Add something to trigger a full search.
secondary:
commands to update some specific data.
-sc, --scene [SCENE ...]
update scene content. Add optional strings to match.
-sd, --sound [SOUND ...]
update sound content. Add optional strings to match.
-ev, --event [EVENT ...]
update event content. Add optional event IDs to update specific events.
-ne, --newevent check new event content.
-st, --story [LIMIT] update story content. Add an optional chapter to stop at.
-ft, --fate [FATES] update fate content. Add an optional fate ID to update or a range (START-END) or 'last' to update the latest.
-pt, --partner update all parner content. Time consuming.
-mn, --missingnpc search for missing NPCs. Time consuming.
maintenance:
commands to update some specific data.
-ij, --importjob import data from job_data_export.json.
-ej, --exportjob export data to job_data_export.json.
-lk, --lookup import and update manual_lookup.json and fetch the wiki to update the lookup table.
-fj, --fatejson import and manual_fate.json.
-it, --importthumb import data from manual_event_thumbnail.json.
-et, --exportthumb export data to manual_event_thumbnail.json.
-mt, --maintenance basic tasks to keep the data up-to-date.
-js, --json import all manual JSON files.
settings:
commands to update some specific data.
-au, --adduncap [ADDUNCAP ...]
add elements to be updated during the next run.
-nc, --nochange disable update of the New category of changelog.json.
-nr, --noresume disable the use of the resume file.
-if, --ignorefilecount
ignore known file count when updating elements.
-da, --gbfdaio PATH import index.json from GBFDAIO.
-dg, --debug enable the debug infos in the progress string.
Tip
For an "every day" use case, you'll only need to:
Use -r after game updates.
Use -u for element uncaps or if an older NPC got new arts, with their IDs.
Use -j, -ej and -ij when new MC classes or skins are released, to find and set their datas and export then import json/job_data_export.json.
Use -lk to update the string lookup and import json/manual_lookup.json.
Use -fj to force import of json/manual_fate.json.
Use -it to force import of json/manual_event_thumbnail.json.
Use -mt to force an update of some element (this is usually automatically used by -r).
You can pause updater.py with a simple CTRL+C. It opens a CLI letting you save, exit or resume with text commands.
When you interrupt some tasks (like the ones invoked by -sc and -sd), the updater creates a resume file (a JSON file without the extension) in the same folder.
If you restart the same action at a later time, that file will be loaded and content already processed will be skipped.
The Updater uses wrappers around Asyncio Tasks to execute code.
Tasks/Functions calls can be queued into the Task Manager. There are 5 queues available, the first one having the highest priority.
The Task Manager itself won't run more than 90 Tasks concurrently (The number itself can be changed in the code). In the same way, the Updater is limited to 80 concurrent requests.
When a Task or the Updater judges more Task are needed, they will be queued too. That's why the number of Tasks will likely grow when executing the Updater.
It's designed to limit the memory usage while keeping the Updater always busy, to not have idle/dead times.
- Use one of the
serverscripts to start a Python HTTP server and test the project locally, in your web browser. - Or, on other OS, just run
python-m http.serverin a terminal, in the project folder. - GBFAP is the sister project, dealing with character animations. It reuses some Javascript, HTML, CSS and Python code.
- For developers, I documented some things in this file.