Add plugin support

[b-rowan]

This adds plugin support for goosebit, allowing extending templates, static files, routing, config data hooks, and update hooks. This is everything we need for our internal plugins, and have been using a form of this for well over a month now with no issues. This is a slightly cleaner implementation of our system that uses a PluginSchema class to define what should be included in the main app.

Closes #15

[easybe]

Great to see that you were able to come up with a solution for this problem.

Would it be possible to whip up a very simple example plugin which we ideally could include in the demo setup? Or, at least some documentation on how to use this. It would make it a lot easier for me to review.

[b-rowan]

Sure, can do. Main thing I wanted here was confirmation of the concept, if the concept seems sound then I will work on the stuff that makes it easier for other people to use.

[b-rowan]

@easybe Added an example plugin under goosebit/example_plugin, if you follow the instructions in the readme for it you should be able to get it up and running. The main important parts of this PR are all under goosebit itself, but taking a look through the example plugin should help clarify how to use it.

[easybe]

Sorry for taking so long.

Seems like a good approach to me.

[b-rowan]

@jkuri I can't figure out what is wrong with these tests... Getting the following error locally -

 goosebit  Built
 swupdate  Built
 Network s3_goosebit_network  Creating
 Network s3_goosebit_network  Error
failed to create network s3_goosebit_network: Error response from daemon: invalid pool request: Pool overlaps with other one on this address space

[easybe]

@jkuri I can't figure out what is wrong with these tests... Getting the following error locally -

 goosebit  Built
 swupdate  Built
 Network s3_goosebit_network  Creating
 Network s3_goosebit_network  Error
failed to create network s3_goosebit_network: Error response from daemon: invalid pool request: Pool overlaps with other one on this address space

I was wondering why you are using static IP addresses. Why not just use Compose's default network and use host names for addressing? I.e.:

endpoint_url: http://minio:9000

instead of:

goosebit/e2e/s3/goosebit.yaml

Line 77 in a17e9e9

endpoint_url: http://172.20.5.100:9000 # example for self-hosted min.io

[jkuri]

@jkuri I can't figure out what is wrong with these tests... Getting the following error locally -

 goosebit  Built
 swupdate  Built
 Network s3_goosebit_network  Creating
 Network s3_goosebit_network  Error
failed to create network s3_goosebit_network: Error response from daemon: invalid pool request: Pool overlaps with other one on this address space

Maybe you didn't wait for them to complete or cancelling them with ctrl+c then forgot to docker compose -f /path/to/docker-compose.yml down.

[jkuri]

@jkuri I can't figure out what is wrong with these tests... Getting the following error locally -

 goosebit  Built
 swupdate  Built
 Network s3_goosebit_network  Creating
 Network s3_goosebit_network  Error
failed to create network s3_goosebit_network: Error response from daemon: invalid pool request: Pool overlaps with other one on this address space

I was wondering why you are using static IP addresses. Why not just use Compose's default network and use host names for addressing? I.e.:

endpoint_url: http://minio:9000

instead of:

goosebit/e2e/s3/goosebit.yaml

Line 77 in a17e9e9

endpoint_url: http://172.20.5.100:9000 # example for self-hosted min.io

I can update to dynamic ips configuration and use host addresses if you prefer.

[b-rowan]

I can update to dynamic ips configuration and use host addresses if you prefer.

I'm testing this locally right now. Getting a different error, but there's a good chance I have no idea what I'm doing.

[b-rowan]

goosebit stucks after running migrations and not bootstraping up, that's why container is unhealthy and e2e tests are not starting.

Any guesses how to fix this? I will push updates to this branch with the rebase so you ca take a better look.

[github-actions]

filepath	function	error	SUBTOTAL
e2e/external_auth/tests/test_e2e_external_auth.py	test_e2e_external_auth_smoke_and_health	1	1
e2e/external_auth/tests/test_e2e_external_auth.py	test_e2e_device_registration_with_external_auth	1	1
e2e/s3/tests/test_e2e_s3.py	test_e2e_smoke_setup_login_and_basic_routes	1	1
e2e/s3/tests/test_e2e_s3.py	test_e2e_artifact_upload_and_minio_presence	1	1
e2e/s3/tests/test_e2e_s3.py	test_e2e_device_update_rollout_to_version	1	1
TOTAL		5	58

[jkuri]

goosebit stucks after running migrations and not bootstraping up, that's why container is unhealthy and e2e tests are not starting.

Any guesses how to fix this? I will push updates to this branch with the rebase so you ca take a better look.

I'll find an issue and let you know.

[jkuri]

@b-rowan it should be fixed now, I needed to upgrade aerich more info tortoise/aerich#63 (comment)