mirror of
https://github.com/microsoft/vcpkg.git
synced 2025-01-14 15:07:58 +08:00
671db8ae9d
* Update vcpkg-tool to 2022-03-24 * Hook up https://github.com/microsoft/vcpkg-tool/pull/345 * Hook up https://github.com/microsoft/vcpkg-tool/pull/442 * Update vcpkg-tool to 2022-03-25 * Analysis of failures. * [Most recent nightly build failed](https://dev.azure.com/vcpkg/public/_build/results?buildId=69427) * [Validation of this tool update failed](https://dev.azure.com/vcpkg/public/_build/results?buildId=69417) ## Common to both: PASSING, REMOVE FROM FAIL LIST: chartdir:x64-windows (.\scripts\ci.baseline.txt) PASSING, REMOVE FROM FAIL LIST: chartdir:x64-windows-static-md (.\scripts\ci.baseline.txt) PASSING, REMOVE FROM FAIL LIST: chartdir:x86-windows (.\scripts\ci.baseline.txt) Probably fixed by https://github.com/microsoft/vcpkg/pull/23701 PASSING, REMOVE FROM FAIL LIST: gmp:x64-uwp (.\scripts\ci.baseline.txt) PASSING, REMOVE FROM FAIL LIST: gmp:x64-windows-static-md (.\scripts\ci.baseline.txt) Probably fixed by https://github.com/microsoft/vcpkg/pull/23466 ? REGRESSION: colmap:x64-windows-static-md failed with BUILD_FAILED. If expected, add colmap:x64-windows-static-md=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. I don't know exactly what changed. I observe that * this thing depends on a *lot* of stuff * on March 14 we didn't even attempt to build this * the x64-windows ones are already in the baseline so I skipped it. REGRESSION: qtdeclarative:x64-windows. If expected, add qtdeclarative:x64-windows=fail to .\scripts\ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\1\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: qtdeclarative:x64-windows failed with BUILD_FAILED. If expected, add qtdeclarative:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. This is a reporting change: The new world order also includes host build failures which is why it's duplicated. See also https://github.com/microsoft/vcpkg/issues/23714 See also https://github.com/microsoft/vcpkg/issues/23490 I'm nervous about baslining this because it seems most of the qt world is built on top of this port I filed https://github.com/microsoft/vcpkg/issues/23824 about this and @Neumann-A indicated this should be fixed by https://github.com/microsoft/vcpkg/pull/23755 REGRESSION: nettle:x64-uwp. If expected, add nettle:x64-uwp=fail to .\scripts\ci.baseline.txt. REGRESSION: nettle:x64-windows-static-md. If expected, add nettle:x64-windows-static-md=fail to .\scripts\ci.baseline.txt. REGRESSION: nettle:x64-uwp failed with BUILD_FAILED. If expected, add nettle:x64-uwp=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. REGRESSION: nettle:x64-windows-static-md failed with POST_BUILD_CHECKS_FAILED. If expected, add nettle:x64-windows-static-md=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. Didn't analyze, probably fixed by https://github.com/microsoft/vcpkg/pull/23519 ? REGRESSION: libgpg-error:x64-uwp. If expected, add libgpg-error:x64-uwp=fail to .\scripts\ci.baseline.txt. REGRESSION: libgpg-error:x64-uwp failed with BUILD_FAILED. If expected, add libgpg-error:x64-uwp=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. This was broken by VS2022 update: ``` C:\Program Files\Microsoft Visual Studio\2022\Enterprise\MSBuild\Microsoft\VisualStudio\v17.0\AppxPackage\Microsoft.AppXPackage.Targets(892,25): error MSB4086: A numeric comparison was attempted on "$(TargetPlatformMinVersion)" that evaluates to "" instead of a number, in condition "'$(TargetPlatformMinVersion)' >= '10.0.17200.0'". [C:\Dev\vcpkg\buildtrees\libgpg-error\x64-uwp-rel\error-1.42-2324ddbc71.clean\SMP\libgpg-error_winrt.vcxproj] ``` REGRESSION: libmikmod:x64-osx. If expected, add libmikmod:x64-osx=fail to .\scripts\ci.baseline.txt. REGRESSION: libmikmod:x64-osx failed with BUILD_FAILED. If expected, add libmikmod:x64-osx=fail to /Users/vagrant/Data/work/2/s/scripts/azure-pipelines/../ci.baseline.txt. Broken between [2022-03-16](https://dev.azure.com/vcpkg/public/_build/results?buildId=68947) and [2022-03-18](https://dev.azure.com/vcpkg/public/_build/results?buildId=69051). Unfortunately I don't see obvious reasons why. Nothing else depends on this and nobody has noticed in 2 weeks, so I'm baslining it for now. (Will investigate shortly...) ## Only broken in tool update: REGRESSION: mesa:x64-windows failed with BUILD_FAILED. If expected, add mesa:x64-windows=fail to C:\a\2\s\scripts\azure-pipelines/../ci.baseline.txt. ``` -- Downloading https://gitlab.freedesktop.org/mesa/mesa/-/archive/mesa-21.2.5/mesa-mesa-21.2.5.tar.gz -> mesa-mesa-mesa-21.2.5-1.tar.gz... -- Extracting source /Users/vagrant/Data/downloads/mesa-mesa-mesa-21.2.5-1.tar.gz -- Applying patch swravx512-post-static-link.patch -- Applying patch swr-msvc-2.patch -- Applying patch swr-llvm13.patch -- Applying patch radv-msvc-llvm13-2.patch -- Applying patch d3d10sw.patch -- Using source at /Users/vagrant/Data/buildtrees/mesa/src/esa-21.2.5-2df234d2b1.clean Traceback (most recent call last): File "<string>", line 1, in <module> ModuleNotFoundError: No module named 'mako' CMake Error at ports/mesa/portfile.cmake:85 (message): Python package 'mako' needs to be installed for port 'mesa'. Complete list of required python packages: setuptools;mako Call Stack (most recent call first): ports/mesa/portfile.cmake:91 (vcpkg_get_python_package) scripts/ports.cmake:145 (include) ``` Looks like this is being tracked by https://github.com/microsoft/vcpkg/pull/23089 ; perhaps that we don't have as aggressive a recycling strategy for macos boxes as we do for the others has let different machines give different results? ## Only broken without tool update: REGRESSION: chromium-base:x64-osx. If expected, add chromium-base:x64-osx=fail to .\scripts\ci.baseline.txt. This one has been constantly flaky; I baselined it. REGRESSION: libxml2:x64-osx. If expected, add libxml2:x64-osx=fail to .\scripts\ci.baseline.txt. This port uses vcpkg_from_git and the upstream server was down during the build. * Restore chartdir to the baseline, I thought https://github.com/microsoft/vcpkg/pull/23732 had been merged.
266 lines
9.2 KiB
Bash
266 lines
9.2 KiB
Bash
#!/bin/sh
|
|
|
|
# Find .vcpkg-root.
|
|
vcpkgRootDir=$(X= cd -- "$(dirname -- "$0")" && pwd -P)
|
|
while [ "$vcpkgRootDir" != "/" ] && ! [ -e "$vcpkgRootDir/.vcpkg-root" ]; do
|
|
vcpkgRootDir="$(dirname "$vcpkgRootDir")"
|
|
done
|
|
|
|
# Parse arguments.
|
|
vcpkgDisableMetrics="OFF"
|
|
vcpkgUseSystem=false
|
|
vcpkgUseMuslC="OFF"
|
|
for var in "$@"
|
|
do
|
|
if [ "$var" = "-disableMetrics" -o "$var" = "--disableMetrics" ]; then
|
|
vcpkgDisableMetrics="ON"
|
|
elif [ "$var" = "-useSystemBinaries" -o "$var" = "--useSystemBinaries" ]; then
|
|
echo "Warning: -useSystemBinaries no longer has any effect; ignored. Note that the VCPKG_USE_SYSTEM_BINARIES environment variable behavior is not changed."
|
|
elif [ "$var" = "-allowAppleClang" -o "$var" = "--allowAppleClang" ]; then
|
|
echo "Warning: -allowAppleClang no longer has any effect; ignored."
|
|
elif [ "$var" = "-buildTests" ]; then
|
|
echo "Warning: -buildTests no longer has any effect; ignored."
|
|
elif [ "$var" = "-musl" ]; then
|
|
vcpkgUseMuslC="ON"
|
|
elif [ "$var" = "-help" -o "$var" = "--help" ]; then
|
|
echo "Usage: ./bootstrap-vcpkg.sh [options]"
|
|
echo
|
|
echo "Options:"
|
|
echo " -help Display usage help"
|
|
echo " -disableMetrics Mark this vcpkg root to disable metrics."
|
|
echo " -musl Use the musl binary rather than the glibc binary on Linux."
|
|
exit 1
|
|
else
|
|
echo "Unknown argument $var. Use '-help' for help."
|
|
exit 1
|
|
fi
|
|
done
|
|
|
|
# Enable using this entry point on windows from git bash by redirecting to the .bat file.
|
|
unixName=$(uname -s | sed 's/MINGW.*_NT.*/MINGW_NT/')
|
|
if [ "$unixName" = "MINGW_NT" ]; then
|
|
if [ "$vcpkgDisableMetrics" = "ON" ]; then
|
|
args="-disableMetrics"
|
|
else
|
|
args=""
|
|
fi
|
|
|
|
vcpkgRootDir=$(cygpath -aw "$vcpkgRootDir")
|
|
cmd "/C $vcpkgRootDir\\bootstrap-vcpkg.bat $args" || exit 1
|
|
exit 0
|
|
fi
|
|
|
|
# Determine the downloads directory.
|
|
if [ -z ${VCPKG_DOWNLOADS+x} ]; then
|
|
downloadsDir="$vcpkgRootDir/downloads"
|
|
else
|
|
downloadsDir="$VCPKG_DOWNLOADS"
|
|
if [ ! -d "$VCPKG_DOWNLOADS" ]; then
|
|
echo "VCPKG_DOWNLOADS was set to '$VCPKG_DOWNLOADS', but that was not a directory."
|
|
exit 1
|
|
fi
|
|
|
|
fi
|
|
|
|
# Check for minimal prerequisites.
|
|
vcpkgCheckRepoTool()
|
|
{
|
|
__tool=$1
|
|
if ! command -v "$__tool" >/dev/null 2>&1 ; then
|
|
echo "Could not find $__tool. Please install it (and other dependencies) with:"
|
|
echo "On Debian and Ubuntu derivatives:"
|
|
echo " sudo apt-get install curl zip unzip tar"
|
|
echo "On recent Red Hat and Fedora derivatives:"
|
|
echo " sudo dnf install curl zip unzip tar"
|
|
echo "On older Red Hat and Fedora derivatives:"
|
|
echo " sudo yum install curl zip unzip tar"
|
|
echo "On SUSE Linux and derivatives:"
|
|
echo " sudo zypper install curl zip unzip tar"
|
|
echo "On Arch Linux and derivatives:"
|
|
echo " sudo pacman -S curl zip unzip tar cmake ninja"
|
|
echo "On Alpine:"
|
|
echo " apk add build-base cmake ninja zip unzip curl git"
|
|
echo " (and export VCPKG_FORCE_SYSTEM_BINARIES=1)"
|
|
exit 1
|
|
fi
|
|
}
|
|
|
|
vcpkgCheckRepoTool curl
|
|
vcpkgCheckRepoTool zip
|
|
vcpkgCheckRepoTool unzip
|
|
vcpkgCheckRepoTool tar
|
|
|
|
UNAME="$(uname)"
|
|
ARCH="$(uname -m)"
|
|
|
|
if [ -e /etc/alpine-release ]; then
|
|
vcpkgUseSystem="ON"
|
|
vcpkgUseMuslC="ON"
|
|
fi
|
|
|
|
if [ "$UNAME" = "OpenBSD" ]; then
|
|
vcpkgUseSystem="ON"
|
|
|
|
if [ -z "$CXX" ]; then
|
|
CXX=/usr/bin/clang++
|
|
fi
|
|
if [ -z "$CC" ]; then
|
|
CC=/usr/bin/clang
|
|
fi
|
|
fi
|
|
|
|
if [ "$vcpkgUseSystem" = "ON" ]; then
|
|
vcpkgCheckRepoTool cmake
|
|
vcpkgCheckRepoTool ninja
|
|
vcpkgCheckRepoTool git
|
|
vcpkgCheckRepoTool gcc
|
|
fi
|
|
|
|
# Determine what we are going to do to bootstrap:
|
|
# MacOS -> Download vcpkg-macos
|
|
# Linux
|
|
# useMuslC -> download vcpkg-muslc
|
|
# amd64 -> download vcpkg-glibc
|
|
# Otherwise
|
|
# Download and build from source
|
|
|
|
# Choose the vcpkg binary to download
|
|
vcpkgDownloadTool="ON"
|
|
vcpkgToolReleaseTag="2022-03-25"
|
|
if [ "$UNAME" = "Darwin" ]; then
|
|
echo "Downloading vcpkg-macos..."
|
|
vcpkgToolReleaseSha="a48a35949362182a792124a6088a2ac24e1992e4ef2604ae369d44b2b7745a422dd78f74cba5807f52312674ea7bcd11d79435faffb8391b3703bc43c0d95605"
|
|
vcpkgToolName="vcpkg-macos"
|
|
elif [ "$vcpkgUseMuslC" = "ON" ]; then
|
|
echo "Downloading vcpkg-muslc..."
|
|
vcpkgToolReleaseSha="d0995018de0b20188291aeabafff5296ab33ef334b67c7512f3cd511dfc1740af62d8ad863e48df5731a6d44e2fbdfe060410494449d61743bd767e87fe68b20"
|
|
vcpkgToolName="vcpkg-muslc"
|
|
elif [ "$ARCH" = "x86_64" ]; then
|
|
echo "Downloading vcpkg-glibc..."
|
|
vcpkgToolReleaseSha="c66e74d4469849c063e9e165b034a529e61e8245fd608a9bfb6c5e25a5a530951ea6995f5b1ee20aac1632f094f49ba3067516506dd2a81122a686ff5826efd9"
|
|
vcpkgToolName="vcpkg-glibc"
|
|
else
|
|
echo "Unable to determine a binary release of vcpkg; attempting to build from source."
|
|
vcpkgDownloadTool="OFF"
|
|
vcpkgToolReleaseSha="15188f9c7370b308d54df3a47bba56d7cbcf437252c3c4545b8aaa7e459e06c47cbdf3d3a8d98bd1ef0d39ccbf2e70b4c0a6d99ce0a58db866b95606d46f92d6"
|
|
fi
|
|
|
|
# Do the download or build.
|
|
vcpkgCheckEqualFileHash()
|
|
{
|
|
url=$1; filePath=$2; expectedHash=$3
|
|
|
|
if command -v "sha512sum" >/dev/null 2>&1 ; then
|
|
actualHash=$(sha512sum "$filePath")
|
|
else
|
|
# sha512sum is not available by default on osx
|
|
# shasum is not available by default on Fedora
|
|
actualHash=$(shasum -a 512 "$filePath")
|
|
fi
|
|
|
|
actualHash="${actualHash%% *}" # shasum returns [hash filename], so get the first word
|
|
|
|
if ! [ "$expectedHash" = "$actualHash" ]; then
|
|
echo ""
|
|
echo "File does not have expected hash:"
|
|
echo " url: [ $url ]"
|
|
echo " File path: [ $downloadPath ]"
|
|
echo " Expected hash: [ $sha512 ]"
|
|
echo " Actual hash: [ $actualHash ]"
|
|
exit 1
|
|
fi
|
|
}
|
|
|
|
vcpkgDownloadFile()
|
|
{
|
|
url=$1; downloadPath=$2 sha512=$3
|
|
rm -rf "$downloadPath.part"
|
|
curl -L $url --tlsv1.2 --create-dirs --retry 3 --output "$downloadPath.part" --silent --show-error --fail || exit 1
|
|
|
|
vcpkgCheckEqualFileHash $url "$downloadPath.part" $sha512
|
|
chmod +x "$downloadPath.part"
|
|
mv "$downloadPath.part" "$downloadPath"
|
|
}
|
|
|
|
vcpkgExtractTar()
|
|
{
|
|
archive=$1; toPath=$2
|
|
rm -rf "$toPath" "$toPath.partial"
|
|
mkdir -p "$toPath.partial"
|
|
$(cd "$toPath.partial" && tar xzf "$archive")
|
|
mv "$toPath.partial" "$toPath"
|
|
}
|
|
|
|
if [ "$vcpkgDownloadTool" = "ON" ]; then
|
|
vcpkgDownloadFile "https://github.com/microsoft/vcpkg-tool/releases/download/$vcpkgToolReleaseTag/$vcpkgToolName" "$vcpkgRootDir/vcpkg" $vcpkgToolReleaseSha
|
|
else
|
|
if [ "x$CXX" = "x" ]; then
|
|
if which g++-11 >/dev/null 2>&1; then
|
|
CXX=g++-11
|
|
elif which g++-10 >/dev/null 2>&1; then
|
|
CXX=g++-10
|
|
elif which g++-9 >/dev/null 2>&1; then
|
|
CXX=g++-9
|
|
elif which g++-8 >/dev/null 2>&1; then
|
|
CXX=g++-8
|
|
elif which g++-7 >/dev/null 2>&1; then
|
|
CXX=g++-7
|
|
elif which g++-6 >/dev/null 2>&1; then
|
|
CXX=g++-6
|
|
elif which g++ >/dev/null 2>&1; then
|
|
CXX=g++
|
|
fi
|
|
# If we can't find g++, allow CMake to do the look-up
|
|
fi
|
|
|
|
vcpkgToolReleaseTarball="$vcpkgToolReleaseTag.tar.gz"
|
|
vcpkgToolUrl="https://github.com/microsoft/vcpkg-tool/archive/$vcpkgToolReleaseTarball"
|
|
baseBuildDir="$vcpkgRootDir/buildtrees/_vcpkg"
|
|
buildDir="$baseBuildDir/build"
|
|
tarballPath="$downloadsDir/$vcpkgToolReleaseTarball"
|
|
srcBaseDir="$baseBuildDir/src"
|
|
srcDir="$srcBaseDir/vcpkg-tool-$vcpkgToolReleaseTag"
|
|
|
|
if [ -e "$tarballPath" ]; then
|
|
vcpkgCheckEqualFileHash "$vcpkgToolUrl" "$tarballPath" "$vcpkgToolReleaseSha"
|
|
else
|
|
echo "Downloading vcpkg tool sources"
|
|
vcpkgDownloadFile "$vcpkgToolUrl" "$tarballPath" "$vcpkgToolReleaseSha"
|
|
fi
|
|
|
|
echo "Building vcpkg-tool..."
|
|
rm -rf "$baseBuildDir"
|
|
mkdir -p "$buildDir"
|
|
vcpkgExtractTar "$tarballPath" "$srcBaseDir"
|
|
cmakeConfigOptions="-DCMAKE_BUILD_TYPE=Release -G 'Ninja' -DVCPKG_DEVELOPMENT_WARNINGS=OFF"
|
|
|
|
if [ "${VCPKG_MAX_CONCURRENCY}" != "" ] ; then
|
|
cmakeConfigOptions=" $cmakeConfigOptions '-DCMAKE_JOB_POOL_COMPILE:STRING=compile' '-DCMAKE_JOB_POOL_LINK:STRING=link' '-DCMAKE_JOB_POOLS:STRING=compile=$VCPKG_MAX_CONCURRENCY;link=$VCPKG_MAX_CONCURRENCY' "
|
|
fi
|
|
|
|
(cd "$buildDir" && CXX="$CXX" eval cmake "$srcDir" $cmakeConfigOptions) || exit 1
|
|
(cd "$buildDir" && cmake --build .) || exit 1
|
|
|
|
rm -rf "$vcpkgRootDir/vcpkg"
|
|
cp "$buildDir/vcpkg" "$vcpkgRootDir/"
|
|
fi
|
|
|
|
# Apply the disable-metrics marker file.
|
|
if [ "$vcpkgDisableMetrics" = "ON" ]; then
|
|
touch "$vcpkgRootDir/vcpkg.disable-metrics"
|
|
elif ! [ -f "$vcpkgRootDir/vcpkg.disable-metrics" ]; then
|
|
# Note that we intentionally leave any existing vcpkg.disable-metrics; once a user has
|
|
# opted out they should stay opted out.
|
|
cat <<EOF
|
|
Telemetry
|
|
---------
|
|
vcpkg collects usage data in order to help us improve your experience.
|
|
The data collected by Microsoft is anonymous.
|
|
You can opt-out of telemetry by re-running the bootstrap-vcpkg script with -disableMetrics,
|
|
passing --disable-metrics to vcpkg on the command line,
|
|
or by setting the VCPKG_DISABLE_METRICS environment variable.
|
|
|
|
Read more about vcpkg telemetry at docs/about/privacy.md
|
|
EOF
|
|
fi
|