-
Notifications
You must be signed in to change notification settings - Fork 5
Merge dstack-cloud build system + upgrade to Yocto 6.0 wrynose (kernel 6.18) #64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
131 commits
Select commit
Hold shift + click to select a range
00e00ff
Update .gitignore
kvinwang 84a43aa
Update yocto to whinlatter
kvinwang c7e3d52
Adding minimal stdio.h stub to satisfy libgcc-initial configure
kvinwang 400b67c
systemd handle volatile deps
kvinwang 2e56958
Volatile /etc/
kvinwang dd579e0
Rust 1.92.0
kvinwang ce97ff8
Suppress the warn Text file busy in build.sh
kvinwang d583c53
Remove CF_ZONE_ID
kvinwang afe5786
Rename DStack to dstack
kvinwang 3c0e2a0
More stable network in bb build
kvinwang 8fd64a5
Use custom kernel 6.17
kvinwang dd731b0
Make GCP image
kvinwang 624131a
Add tpm-tools and lib
kvinwang f1ce527
Update dstack
kvinwang 0aa78d4
Update zfs to 2.4.0
kvinwang 92e7e54
v0.6.0
kvinwang 2193b47
ssh: Disable password auth
kvinwang 88ebc91
Update meta-confidential-compute
kvinwang 29f2555
Use patched meta-rust-bin
kvinwang 9b5f221
Update meta-virtualization
kvinwang 78d1eb4
fixup zfs
kvinwang ed99054
Fix QA errors in meta-virtualization
kvinwang 5a5e27e
Update nvidia receipes
kvinwang c1355e4
Update dstack/
kvinwang 8fc9ddb
fixup zfs
kvinwang daed2d7
fixup meta-nvidia
kvinwang bbc89cc
Update dstack/
kvinwang 169cf02
Adapt docker 29
kvinwang 81da840
Remove mod-tdx-guest
kvinwang a9295ba
Update dstack/
kvinwang a4fbb92
Output gcp.tar.gz inside the image dir
kvinwang c22dfd4
Add cli dstack-cloud
kvinwang 9163e80
Sync dstack/
kvinwang 373ba08
Update dstack
kvinwang 44a4444
Update url of dstack submodule
kvinwang ea76d25
Fix reproducibility issues
kvinwang 268ce48
Update dstack
kvinwang d06a4d6
dstack-cloud: Add fw command group
kvinwang 3dea1d5
dstack-cloud: Disable .env when kms is off
kvinwang 8aa5409
dstack-cloud: Auto upload data-disk image
kvinwang 5858bc0
Update dstack submodule url
kvinwang 14b119f
Update dstack
kvinwang 8980c09
Update submodules
kvinwang 4da51e9
Update LICENSE
kvinwang 4f72c0c
Update submodule URL
kvinwang d90c9fa
Update URL in README.md
kvinwang 9a88cf4
Update dstack/
kvinwang 78082be
Fix random fakeroot bb build error
kvinwang 04288d0
bb: Rename image from dstack to dstack-cloud
kvinwang 7cc276f
bb: Refactor image recipes to use multiconfig
kvinwang 37531fe
bb: Move build config from bb-build to meta-dstack/conf
kvinwang 6a0ae2a
Rename dist image prefix from dstack to dstack-cloud
kvinwang 04100cd
mkimage: Fix UKI auth_hash not being written to output
kvinwang 0ff95e2
Update LICENSE
kvinwang 8e59b37
Fix uki filename in bb files
kvinwang 1ee6539
Update dstack/ submodule
kvinwang 2be0714
mkimage: Split output into bare-metal and UKI tarballs
kvinwang cd84be8
Fix filenames in dstack-cloud.py
kvinwang 0a002d4
Fix url in repro-build.sh
kvinwang 82555d3
mkimage: Fix authenticode_hash.py path resolution
kvinwang b964368
dstack-guest: Restore do_unpack nostamp flag
kvinwang c65b000
mkimage: Use stat -L to follow symlinks when getting rootfs size
kvinwang 4775271
Remove tpm2 from DISTRO_FEATURES
kvinwang f1e2879
Remove unused systemd components completely
kvinwang d82f4d0
dstack-cloud: Remove init command and improve UX
kvinwang 5652ee2
Update dstack/ submodule
kvinwang 4f1d55a
Suppress meta-tpm warning
kvinwang f899c7e
Always calculate auth hash
kvinwang 0b8d9c3
Update dstack/ submodule
kvinwang 6afa83d
Update meta-virtualization
kvinwang 65d6ffd
Fix env issue in dstack-cloud
kvinwang b49e84b
Update dstack/ submodule
kvinwang c92e0a8
Upgrade kernel to 6.18.7
kvinwang d748963
Merge pull request #1 from Phala-Network/upgrade-kernel-6.18.7
kvinwang 7cf15f5
Update dstack/ submodule
kvinwang f9db23a
feat: Enable systemd socket proxy for dstack backward compatibility
kvinwang 7d30c7b
Add ephemeral-docker.sh
kvinwang 83f8d58
fix(dstack-cloud): fix env encryption format for CVM decryption
kvinwang 6da8d86
feat: built-in systemd socket activation for dstack-guest-agent
kvinwang cb2c347
Move docker daemon config from package to image level
kvinwang 557ff81
Merge pull request #2 from Phala-Network/fix-nvidia-docker-config
kvinwang 0db86d1
Update dstack/ submodule
kvinwang b12b5c6
feat(guest): install conntrack sysctl config into CVM
kvinwang 5d6a81f
feat(guest): add sysbox container runtime v0.6.7
kvinwang 963789b
fix(sysbox): adapt services for dm-verity read-only rootfs
kvinwang 78d8314
docs(sysbox): add comments explaining sysctl values
kvinwang 69bb46e
refactor: move sysbox bind-mount from service into dstack-prepare
kvinwang ea244e2
refactor: move sysbox bind-mount from service into dstack-prepare
kvinwang 1e20cc0
refactor: move sysbox bind-mount from service into dstack-prepare
kvinwang 3aba6f8
Update dstack/ submodule
kvinwang b93d08d
Merge pull request #3 from Phala-Network/feat/sysbox-runtime
kvinwang 08c1a62
feat(dstack-cloud): support absolute URL in pull command
kvinwang 350002d
fix(gcp): preserve firewall reachability after instance recreation
kvinwang 230c113
Update dstack/ submodule
kvinwang 3865b26
fix: remove env_file from app.json in non-KMS mode
kvinwang 962d729
chore: sync dstack submodule (rename network test -> custom)
kvinwang ec80adb
fix: handle missing instance gracefully in stop/start commands
kvinwang eb5b4e5
fix: distinguish "not found" from other gcloud errors
kvinwang ca1e9ab
Merge pull request #4 from Phala-Network/fix/stop-start-instance-not-…
kvinwang aa614d4
kernel: enable CONFIG_OVERLAY_FS_METACOPY for sysbox chown fallback
kvinwang 0ddc6bd
dstack-sysbox: disable ovfs on idmapped mounts
kvinwang 544e5b6
Merge pull request #6 from Phala-Network/enable-overlay-metacopy
kvinwang baf5631
libnvidia-container: fix TLS verification for build-time downloads
kvinwang 98f4f9e
Merge pull request #7 from Phala-Network/fix/libnvidia-curl-tls
kvinwang 50172d8
Add xt_comment, nf_tables and other iptables kernel modules for k3s s…
kvinwang d6478e3
add gcp service account and scope config
jerryrhyu 4905ccc
Merge pull request #10 from jerryrhyu/gcp-sa-config
kvinwang 2d56823
fix: add nftables kernel modules to 6.18 defconfig
kvinwang 4e47e23
Merge pull request #9 from Phala-Network/add-k3s-kernel-modules
kvinwang 4201d20
chore: update dstack submodule to latest master
kvinwang f1a35b7
kernel: enable CONFIG_CRYPTO_ECDSA for H100 confidential compute
kvinwang 110991a
Merge pull request #14 from Phala-Network/kvin/fix-h100-cc-crypto-ecdsa
kvinwang bab2c0e
dstack-cloud: add gcp_config.provisioning_model for SPOT instances
kvinwang 5a1bfea
Merge pull request #15 from Phala-Network/kvin/dstack-cloud-spot-prov…
kvinwang 275ea21
bump dstack submodule to b051018a
kvinwang 74a86df
Merge pull request #16 from Phala-Network/kvin/bump-dstack-submodule
kvinwang 7477e4a
bump DISTRO_VERSION to 0.6.1
kvinwang 7deca28
build: merge dstack-cloud build system; switch to Yocto split layout …
kvinwang aeb3e0a
kernel: switch from linux-custom to official linux-yocto 6.18
kvinwang 4d4a0d3
build: fix flavor dist names (dstack* not dstack-cloud*) and UKI pyth…
kvinwang 4925deb
build: wrynose migration fixes — parse clean (28395 targets, 0 errors)
kvinwang ba6c005
distro: set INIT_MANAGER=systemd (wrynose udev fix)
kvinwang dd12be4
dstack-ovmf: drop S = ${WORKDIR}/git (wrynose sets S for git fetches)
kvinwang d8da197
dstack-ovmf: add Upstream-Status to local patches (wrynose fatal QA)
kvinwang 19114d9
dstack-ovmf: build on wrynose (edk2-stable202511 + NASM 3.0 fix)
kvinwang 42f8b3f
meta-virtualization: bump to runc patch-fuzz fix
kvinwang 3ac32c5
kernel: build CRYPTO_SHA256 in (dm-verity rootfs hash in initramfs)
kvinwang d403f7d
dstack-ovmf: keep edk2-stable202502 (dstack-mr compat) + build on wry…
kvinwang 8f6b753
review: build-system fixes from PR review
kvinwang fed4cc1
Potential fix for pull request finding
kvinwang 9de071b
mkimage: dedupe sgdisk check from autofix; clearer message
kvinwang File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -3,3 +3,5 @@ | |
| *.qcow2 | ||
| __pycache__/ | ||
| /.target | ||
| /.vscode | ||
| /.claude | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,21 +1,94 @@ | ||
| MIT License | ||
|
|
||
| Copyright (c) 2024 Phala Network | ||
|
|
||
| Permission is hereby granted, free of charge, to any person obtaining a copy | ||
| of this software and associated documentation files (the "Software"), to deal | ||
| in the Software without restriction, including without limitation the rights | ||
| to use, copy, modify, merge, publish, distribute, sublicense, and/or sell | ||
| copies of the Software, and to permit persons to whom the Software is | ||
| furnished to do so, subject to the following conditions: | ||
|
|
||
| The above copyright notice and this permission notice shall be included in all | ||
| copies or substantial portions of the Software. | ||
|
|
||
| THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR | ||
| IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, | ||
| FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE | ||
| AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER | ||
| LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, | ||
| OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE | ||
| SOFTWARE. | ||
| Business Source License 1.1 | ||
|
|
||
| Parameters | ||
|
|
||
| Licensor: Hashforest Technology LLC | ||
|
|
||
| Licensed Work: dstack-cloud | ||
| The Licensed Work is (c) Hashforest Technology LLC | ||
|
|
||
| Additional Use Grant: Notwithstanding the foregoing, the Licensor grants | ||
| to certain commercial partners a license to use the | ||
| Licensed Work for production and commercial purposes | ||
| pursuant to separate agreements. | ||
|
|
||
| Change Date: Two years from the date a MINOR version (SemVer) is | ||
| published. | ||
|
|
||
| Change License: GNU Affero General Public License Version 3 (AGPL-3.0) | ||
|
|
||
| Notice | ||
|
|
||
| License text copyright (c) 2023 MariaDB plc, All Rights Reserved. | ||
| “Business Source License” is a trademark of MariaDB plc. | ||
|
|
||
| ----------------------------------------------------------------------------- | ||
|
|
||
| Business Source License 1.1 | ||
|
|
||
| Terms | ||
|
|
||
| The Licensor hereby grants you the right to copy, modify, create derivative | ||
| works, redistribute, and make non-production use of the Licensed Work. The | ||
| Licensor may make an Additional Use Grant, above, permitting limited | ||
| production use. | ||
|
|
||
| Effective on the Change Date, or the fourth anniversary of the first publicly | ||
| available distribution of a specific version of the Licensed Work under this | ||
| License, whichever comes first, the Licensor hereby grants you rights under | ||
| the terms of the Change License, and the rights granted in the paragraph | ||
| above terminate. | ||
|
|
||
| If your use of the Licensed Work does not comply with the requirements | ||
| currently in effect as described in this License, you must purchase a | ||
| commercial license from the Licensor, its affiliated entities, or authorized | ||
| resellers, or you must refrain from using the Licensed Work. | ||
|
|
||
| All copies of the original and modified Licensed Work, and derivative works | ||
| of the Licensed Work, are subject to this License. This License applies | ||
| separately for each version of the Licensed Work and the Change Date may vary | ||
| for each version of the Licensed Work released by Licensor. | ||
|
|
||
| You must conspicuously display this License on each original or modified copy | ||
| of the Licensed Work. If you receive the Licensed Work in original or | ||
| modified form from a third party, the terms and conditions set forth in this | ||
| License apply to your use of that work. | ||
|
|
||
| Any use of the Licensed Work in violation of this License will automatically | ||
| terminate your rights under this License for the current and all other | ||
| versions of the Licensed Work. | ||
|
|
||
| This License does not grant you any right in any trademark or logo of | ||
| Licensor or its affiliates (provided that you may use a trademark or logo of | ||
| Licensor as expressly required by this License). | ||
|
|
||
| TO THE EXTENT PERMITTED BY APPLICABLE LAW, THE LICENSED WORK IS PROVIDED ON | ||
| AN “AS IS” BASIS. LICENSOR HEREBY DISCLAIMS ALL WARRANTIES AND CONDITIONS, | ||
| EXPRESS OR IMPLIED, INCLUDING (WITHOUT LIMITATION) WARRANTIES OF | ||
| MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, NON-INFRINGEMENT, AND | ||
| TITLE. | ||
|
|
||
| MariaDB hereby grants you permission to use this License’s text to license | ||
| your works, and to refer to it using the trademark “Business Source License”, | ||
| as long as you comply with the Covenants of Licensor below. | ||
|
|
||
| Covenants of Licensor | ||
|
|
||
| In consideration of the right to use this License’s text and the “Business | ||
| Source License” name and trademark, Licensor covenants to MariaDB, and to all | ||
| other recipients of the licensed work to be provided by Licensor: | ||
|
|
||
| 1. To specify as the Change License the GPL Version 2.0 or any later version, | ||
| or a license that is compatible with GPL Version 2.0 or a later version, | ||
| where “compatible” means that software provided under the Change License can | ||
| be included in a program with software provided under GPL Version 2.0 or a | ||
| later version. Licensor may specify additional Change Licenses without | ||
| limitation. | ||
|
|
||
| 2. To either: (a) specify an additional grant of rights to use that does not | ||
| impose any additional restriction on the right granted in this License, as | ||
| the Additional Use Grant; or (b) insert the text “None”. | ||
|
|
||
| 3. To specify a Change Date. | ||
|
|
||
| 4. Not to modify this License in any other way. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Submodule bitbake
added at
220217
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Submodule meta-confidential-compute
updated
6 files
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| # Development flavor configuration | ||
| DSTACK_FLAVOR = "dev" | ||
| DSTACK_NVIDIA = "0" | ||
| DSTACK_DEV = "1" | ||
|
|
||
| # Use separate TMPDIR to avoid conflicts between multiconfigs | ||
| TMPDIR = "${TOPDIR}/tmp-mc-dev" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| # NVIDIA development flavor configuration | ||
| DSTACK_FLAVOR = "nvidia-dev" | ||
| DSTACK_NVIDIA = "1" | ||
| DSTACK_DEV = "1" | ||
|
|
||
| # Use separate TMPDIR to avoid conflicts between multiconfigs | ||
| TMPDIR = "${TOPDIR}/tmp-mc-nvidia-dev" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| # NVIDIA production flavor configuration | ||
| DSTACK_FLAVOR = "nvidia" | ||
| DSTACK_NVIDIA = "1" | ||
| DSTACK_DEV = "0" | ||
|
|
||
| # Use separate TMPDIR to avoid conflicts between multiconfigs | ||
| TMPDIR = "${TOPDIR}/tmp-mc-nvidia" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| # Production flavor configuration | ||
| DSTACK_FLAVOR = "prod" | ||
| DSTACK_NVIDIA = "0" | ||
| DSTACK_DEV = "0" | ||
|
|
||
| # Use separate TMPDIR to avoid conflicts between multiconfigs | ||
| TMPDIR = "${TOPDIR}/tmp-mc-prod" |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.