How to build sdk from source for new architecture #4501
Replies: 9 comments 24 replies
-
|
If you want to build in source-only mode, please use the For cross-compilation, I generally use the following additional arguments to Edit: And use https://github.com/dotnet/dotnet/ for building |
Beta Was this translation helpful? Give feedback.
-
|
For clarity what repo are you building from? |
Beta Was this translation helpful? Give feedback.
-
|
Have you run If you don't want to download an SDK or packages, you can pass |
Beta Was this translation helpful? Give feedback.
-
|
@ellahathaway Yes, I was trying to use and after some small fixes in
I noticed that |
Beta Was this translation helpful? Give feedback.
-
|
Do you know if ILCompiler is implemented for riscv64? If it is, then the runtime build system should be taught to build it by default (that may or may not involve Subsets.props). Otherwise we should teach sdk repo to stop requiring it for riscv64. I think the error message is saying that the package can't be found locally. In |
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
|
Possibly here: https://github.com/dotnet/sdk/blob/5d2b7f6b3438cb5c42d7b4cdfaccd5fd5603cd7b/src/Installer/redist-installer/redist-installer.csproj#L12 |
Beta Was this translation helpful? Give feedback.
-
|
Hey, edit: tried with some extra parameters, like |
Beta Was this translation helpful? Give feedback.
-
|
Poking around some scripts I use, setting |
Beta Was this translation helpful? Give feedback.
-
|
Nope, looks like VMR build is still doing runtime for linux... |
Beta Was this translation helpful? Give feedback.
-
|
Slightly off-topic, can you help me set up a debian:sid (or any other) container that supports cross-compilation from x86_64/amd64 to riscv64? The obvious thing (at least to me) doesn't work: ROM debian:unstable
ARG TARGET_DEBIAN_ARCH
ARG TARGET_GNU_ARCH
ENV TARGET_DEBIAN_ARCH=${TARGET_DEBIAN_ARCH:-riscv64}
ENV TARGET_GNU_ARCH=${TARGET_GNU_ARCH:-riscv64}
ENV DEBIAN_FRONTEND=noninteractive
RUN apt-get update && \
apt-get install -y \
clang-16 \
cmake \
curl \
g++ \
gcc \
git \
libexpat1-dev \
libgmp-dev \
libncurses5-dev \
libpython3-dev \
libssl-dev \
locales \
make \
nodejs \
python3 \
sudo \
texinfo \
wget
RUN dpkg --add-architecture "$TARGET_DEBIAN_ARCH" && \
apt-get update && \
apt-get install --no-install-recommends --yes \
binutils-multiarch \
crossbuild-essential-"$TARGET_DEBIAN_ARCH" |
Beta Was this translation helpful? Give feedback.
-
|
I also have |
Beta Was this translation helpful? Give feedback.
-
|
In my case, I can't even install |
Beta Was this translation helpful? Give feedback.
-
|
@omajid At Samsung, we use Ubuntu for cross-compilation. I know it's not Debian, but configuration should be similar. MS imageAs for the official MS image, you can find it here: Custom oneAs for custom, we use a Dockerfile based on ubuntu:noble Dockerfile for RISC-V cross compilationFROM ubuntu:noble
RUN apt update; apt -y install apt-utils
RUN DEBIAN_FRONTEND=noninteractive apt -y install tzdata
RUN DEBIAN_FRONTEND=noninteractive apt -y install ca-certificates wget curl sudo
RUN wget -qO- https://apt.llvm.org/llvm-snapshot.gpg.key | tee /etc/apt/trusted.gpg.d/apt.llvm.org.asc
RUN echo "deb http://apt.llvm.org/noble/ llvm-toolchain-noble-18 main" >> "/etc/apt/sources.list"
RUN echo "deb-src http://apt.llvm.org/noble/ llvm-toolchain-noble-18 main" >> "/etc/apt/sources.list"
RUN DEBIAN_FRONTEND=noninteractive apt-get update
RUN DEBIAN_FRONTEND=noninteractive apt-get -y install \
clang-18 \
llvm-18 \
lldb-18 \
lld-18
RUN DEBIAN_FRONTEND=noninteractive apt -y install \
gcc\
g++ \
git \
libxml2-utils \
rpm2cpio \
cpio \
gcc-arm-linux-gnueabi \
g++-arm-linux-gnueabi \
gcc-arm-linux-gnueabihf \
g++-arm-linux-gnueabihf \
gcc-aarch64-linux-gnu \
g++-aarch64-linux-gnu \
gcc-riscv64-linux-gnu \
g++-riscv64-linux-gnu \
vim \
cmake \
liblttng-ust-dev \
locales \
libicu-dev \
zlib1g \
zlib1g-dev \
libkrb5-dev \
libssl-dev \
qemu-user-static \
debootstrap \
gdb-multiarch \
inetutils-ping \
strace
RUN locale-gen en_US.UTF-8
RUN update-alternatives --install /usr/bin/clang clang /usr/bin/clang-18 10
RUN update-alternatives --install /usr/bin/lldb lldb /usr/bin/lldb-18 10
RUN update-alternatives --install /usr/bin/lld lld /usr/bin/lld-18 10
RUN DEBIAN_FRONTEND=noninteractive apt -y install time
RUN tee /etc/sudoers.d/dotnet-cli <<-_EOF_
Cmnd_Alias DOTNET_ALIAS = /runtime/artifacts/bin/testhost/net9.0-linux-Checked-riscv64/dotnet, \
/runtime/artifacts/bin/testhost/net9.0-linux-Release-riscv64/dotnet, \
/runtime/artifacts/bin/testhost/net9.0-linux-Debug-riscv64/dotnet
Defaults!DOTNET_ALIAS env_keep += "QEMU_LD_PREFIX", \
env_keep += "qemu_ld_prefix", \
env_keep += "ROOTFS_DIR", \
env_keep += "rootfs_dir", \
env_keep += "DOTNET_EnableWriteXorExecute"
_EOF_
ENV TMPDIR=/tmp
VOLUME [ "/runtime" ]
WORKDIR /runtime# build docker image
docker build . -t riscv-net
# start docker
docker run -ti \
-v /home/"$USER"/runtime:/runtime \
--cap-add SYS_PTRACE \
--name riscross \
--privileged \
--sysctl net.ipv6.conf.all.disable_ipv6=0 \
--sysctl net.ipv6.conf.default.disable_ipv6=0 \
--hostname $(hostname) \
riscv-net bash
build crossrootfs# inside docker:
export ARCH=riscv64
export ROOTFS_DIR="/crossrootfs/$ARCH"
export QEMU_LD_PREFIX="$ROOTFS_DIR/"
mkdir -p $ROOTFS_DIR
# build crossrootfs
/runtime/eng/common/cross/build-rootfs.sh $ARCH noble
# enable qemu in kerner - probably require reboot of container
/usr/sbin/update-binfmts --enable qemu-$ARCH
# patch needed for some runtime tests:
cp -r $QEMU_LD_PREFIX/lib/riscv64-linux-gnu /lib
ln -s /lib/riscv64-linux-gnu/ld-linux-riscv64-lp64d.so.1 /lib/ld-linux-riscv64-lp64d.so.1
ln -s /tmp $QEMU_LD_PREFIX/tmp
ln -s /proc $QEMU_LD_PREFIX/proc |
Beta Was this translation helpful? Give feedback.
-
|
And yes, I recommend using the newer |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for the pointers! |
Beta Was this translation helpful? Give feedback.
-
|
I build I don't know what to do with it? I can turn off |
Beta Was this translation helpful? Give feedback.
-
|
This seems very similar to dotnet/sdk#40843 (comment). Essentially, runtime built a version of crossgen with a different package name than aspnetcore expects. This might be a question for someone on the aspnetcore or runtime team. |
Beta Was this translation helpful? Give feedback.
-
|
@jkoritzinsky / @agocke / @MichalStrehovsky for the crossgen2 question |
Beta Was this translation helpful? Give feedback.
-
|
Strangely enough, when I try crossbuilding for |
Beta Was this translation helpful? Give feedback.
-
|
After digging a bit, |
Beta Was this translation helpful? Give feedback.
-
|
In the meantime, I would like to ask about one bug that has accompanied me during my and I wasn't able to find the reason behind it. Could anyone explain me this? Thx :D |
Beta Was this translation helpful? Give feedback.
-
|
"application host" is what .NET calls the platform-architecture-specific executable that's used to start .NET applications. It sounds like something is trying to publish an application for |
Beta Was this translation helpful? Give feedback.
-
|
Hi. passing edit: change in |
Beta Was this translation helpful? Give feedback.
-
|
Hi, how to build .net core 8 sdk in source-only mode? |
Beta Was this translation helpful? Give feedback.
-
|
The |
Beta Was this translation helpful? Give feedback.
-
|
After setting up the right cross-compilation environment, I was able to apply this patch: --- a/src/aspnetcore/src/Framework/App.Runtime/src/Microsoft.AspNetCore.App.Runtime.csproj
+++ b/src/aspnetcore/src/Framework/App.Runtime/src/Microsoft.AspNetCore.App.Runtime.csproj
@@ -42,7 +42,7 @@
<AllowedOutputExtensionsInSymbolsPackageBuildOutputFolder>$(AllowedOutputExtensionsInSymbolsPackageBuildOutputFolder);.r2rmap</AllowedOutputExtensionsInSymbolsPackageBuildOutputFolder>
<!-- Optimize the framework using the crossgen2 tool. Crossgen2 is not currently supported on s390x or ppc64le or armv6 or loongarch64. -->
- <CrossgenOutput Condition=" '$(TargetArchitecture)' == 's390x' OR '$(TargetArchitecture)' == 'armv6' OR '$(TargetArchitecture)' == 'ppc64le' OR '$(TargetArchitecture)' == 'loongarch64' ">false</CrossgenOutput>
+ <CrossgenOutput Condition=" '$(TargetArchitecture)' == 's390x' OR '$(TargetArchitecture)' == 'armv6' OR '$(TargetArchitecture)' == 'ppc64le' OR '$(TargetArchitecture)' == 'loongarch64' OR '$(TargetArchitecture)' == 'riscv64' ">false</CrossgenOutput>
<!-- VMR doesn't produce valid crossgen for the host/build machine https://github.com/dotnet/source-build/issues/3793 -->
<CrossgenOutput Condition=" '$(DotNetBuild)' == 'true' AND '$(Crossbuild)' == 'true' ">false</CrossgenOutput>
<CrossgenOutput Condition=" '$(CrossgenOutput)' == '' AND '$(Configuration)' != 'Debug' ">true</CrossgenOutput>
--- a/src/sdk/src/Installer/redist-installer/redist-installer.csproj
+++ b/src/sdk/src/Installer/redist-installer/redist-installer.csproj
@@ -9,7 +9,7 @@
<ResolveAssemblyWarnOrErrorOnTargetArchitectureMismatch>none</ResolveAssemblyWarnOrErrorOnTargetArchitectureMismatch>
<BundleRuntimePacks Condition="'$(BundleRuntimePacks)' == '' and '$(DotNetBuildSourceOnly)' == 'true'">true</BundleRuntimePacks>
<!-- DotNetBuildOrchestrator is (currently) needed in order to obtain NuGet packages from the runtime build. -->
- <BundleNativeAotCompiler Condition="'$(BundleNativeAotCompiler)' == '' and '$(DotNetBuildSourceOnly)' == 'true' and '$(SourceBuildUseMonoRuntime)' != 'true' and '$(DotNetBuildOrchestrator)' == 'true'">true</BundleNativeAotCompiler>
+ <BundleNativeAotCompiler Condition="'$(BundleNativeAotCompiler)' == '' and '$(DotNetBuildSourceOnly)' == 'true' and '$(SourceBuildUseMonoRuntime)' != 'true' and '$(DotNetBuildOrchestrator)' == 'true' and '$(Architecture)' != 'riscv64'">true</BundleNativeAotCompiler>
</PropertyGroup>
<ItemGroup>And then build it using the following commands: |
Beta Was this translation helpful? Give feedback.
-
I would like to ask for any hint how to build SDK for a new architecture (
riscv). I was tryingBut building failed with error:
I was trying to build dotnet/sdk
Beta Was this translation helpful? Give feedback.
All reactions