Database migration tool, deduplication of sets data, customizable checkboxes #44

gregoo · 2025-01-20T17:50:18+01:00

gregoo commented

2025-01-20 17:50:18 +01:00

~~DO NOT MERGE~~: It's just to show you an example of how this could be done.

A first working version of checking the database user version and applying patches incrementally
Some stuff around the configuration variables reworked for clarity and to avoid potentially missing with Flask

~~**DO NOT MERGE**~~: It's just to show you an example of how this could be done. - A first working version of checking the database user version and applying patches incrementally - Some stuff around the configuration variables reworked for clarity and to avoid potentially missing with Flask

gregoo added 4 commits 2025-01-20 17:50:18 +01:00

Don't store complex objects in Flash config that could mask existing config items, rather store the values and handle the actual list of conf differently e232e2ab7f

Clean unused not_from_env property. Every config has an environment variable to configure it a857a43288

Change the way the database counters are displayed to easiliy accomodate for more tables c6e5a6a2d9

Incremental forward upgrades of the database 5e99371b39

gregoo added 27 commits 2025-01-24 10:37:45 +01:00

Quote SQL identifiers as best practice and to avoid any problem in the future ebe0585a40

Remove unused count_none query 1b823b158b

Create the app outside of the global context of app.py to avoid any interference a6ab53efa7

Use constats for SQL g. variables to avoid any typo 14bc9cef26

Fix wrong set_version extraction 132892ab0b

Cosmetics 86fea8cd7d

Remove debug prints 2908e80293

Fix indent a3e50e9b3c

Rework upgrade needed and check upgrade too far as an error for the database b475bfe8d4

Inject the database version when downloading it 0e977fd01d

Fix functions definition with stricter positional or keyword restrictions c977217f48

Add missing whislist database counter in the admin 71af15b16d

Make sure number and version are integer in instruction number detection a84493908a

More function definition fixes 3223dd0edc

Make the admin database counters failsafe 5ea9240f34

Take a more generic approach at counting all the tables in the database file e2bcd61ace

Split the uncomfortably big admin view into smaller admin views 798226932f

Fix BrickRecordFields failing on KeyError instead of AttributeError when used with hasattr() b73bd6e99d

Allow BrickRecord insert to force not being defered, as well as overriding its query a01d38ee7a

Move then select-then-ingest logic into BrickRecord and allow context to be passed to select() 4e1bf08139

SQLite debug messages 9029f6d423

More cleanup of unquoted or misquoted SQL identifiers da2746d2a0

Ignore static "minifigures" folder from compose.yaml 4052ac00ad

Allow exception_handler to pass kwargs to the wrapped function 57d9f167a5

Separate bricktracker sets from rebrickable sets (dedup), introduce custom checkboxes d063062780

Unquoted SQL identifiers c075b525a8

Remove unused SQL initialize function eaa14d2341

gregoo added 18 commits 2025-01-24 16:00:34 +01:00

Merge branch 'upstream' 42e42b9a1b

Remove <br> from blockquotes to accomodate Gitea markdown processing 913ceb339e

Add an organized documentation page d919f7b972

Complete the list of libs used as well as credit for the logo designer 89fe0646a0

Remove duplicated info from common errors, doc fixes 8c279655ea

Escape angled brackets outside of code blocks ca741a25a3

Cleanup any outside BK_ variables for the test-server.sh to avoid looking for bugs that do not exist... 41ee6df887

Documentation about database upgrade 9ec8077be1

Remove debug print from BrickSQLMigration 6c342ec3f3

Fix RebrickableSet not using url in database for sets d22ca2c7cb

Use table.rebrickable rather than badge.rebrickable in the wishes table to be more consistent with the other tables c518c405c2

Fix border around checkboxes depending if there are any displayed or not 1685867494

Reword unsetting external variables to avoid confusion on what it does 466e2e39d9

Set checkboxes documentation 30ea2ae567

Add a custom search function to the tables capable of excluding some pills 623b205733

Simplify the way javascript is loaded (we don't have that many scripts running) and use data attribute to instantiate grid and tables 982a1fa8db

Add a changelog 3d878ea7c5

Bump version to 1.1.0 5ebdf89c85

gregoo added 1 commit 2025-01-24 16:05:59 +01:00

Rename the bricktracker doc to overview 2d3e8cdd8b

gregoo changed title from ~~WIP: Initial work on a database migration tool for incremental upgrades of the schema and data~~ to Initial work on a database migration tool for incremental upgrades of the schema and data

2025-01-24 16:06:41 +01:00

gregoo changed title from ~~Initial work on a database migration tool for incremental upgrades of the schema and data~~ to Database migration tool, deduplication of sets data, customizable checkboxes

2025-01-24 16:07:18 +01:00

gregoo commented

2025-01-24 16:08:25 +01:00

@FrederikBaerentsen this could be 1.1.0 unless you want to have your download tool included with it.
I'm currently looking at it.

@FrederikBaerentsen this could be `1.1.0` unless you want to have your download tool included with it. I'm currently looking at it.

FrederikBaerentsen commented

2025-01-24 16:31:14 +01:00

I'm thinking this would be good for a 1.1.0 and then instructions download could be 1.2.0, as I would like to improve it a bit.

Then we also don't get a monster release with too many changes 😄

This is still labeled DO NOT MERGE. Is it ready or?

Flow would be like last time:

Merge
Test locally
Write release post
Push new docker image

I'm thinking this would be good for a 1.1.0 and then instructions download could be 1.2.0, as I would like to improve it a bit. Then we also don't get a monster release with too many changes 😄 This is still labeled `DO NOT MERGE`. Is it ready or? Flow would be like last time: - Merge - Test locally - Write release post - Push new docker image

👍 1

gregoo commented

2025-01-24 17:50:22 +01:00

I just realized that it is missing upgrading the version in the compose files and a tag, silly me!

gregoo added 1 commit 2025-01-24 17:57:16 +01:00

Update docker image version 8b1df86f33

gregoo commented

2025-01-24 17:59:09 +01:00

I don't have anything else to add to this merge request 😂